2020-11-16 02:21:23,288 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/08H8C4ACY3G5 | | | /functest-opnfv-functest-benchmarking-hunter- | | | rally_jobs-run-553 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 08H8C4ACY3G5 | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/08H8C4ACY3G5 | | | /functest-opnfv-functest-benchmarking-hunter- | | | rally_jobs-run-553 | | NODE_NAME | lf-virtual6 | +-------------------------+----------------------------------------------------------+ 2020-11-16 02:21:23,319 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-11-16 02:21:28,416 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-11-16 02:21:39,355 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-11-16 02:21:46,838 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | c3506bb7-ca42-4381-beab-b4eaaf2be583 | 2020-11-16T02:21:46.617031 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: c3506bb7-ca42-4381-beab-b4eaaf2be583 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-11-16 02:21:50,981 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-11-16 02:21:52,816 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-11-16 02:45:14,105 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 84d4a05a-8e83-42ba-944d-c166ba6adde3 2020-11-16 02:45:15,682 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 84d4a05a-8e83-42ba-944d-c166ba6adde3 -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.495 | 1.312 | 3.925 | 4.319 | 5.034 | 2.017 | 100.0% | 100 | | neutron.list_networks | 0.156 | 0.572 | 2.72 | 2.907 | 4.753 | 0.988 | 100.0% | 100 | | total | 0.736 | 3.366 | 4.491 | 4.786 | 5.744 | 3.005 | 100.0% | 100 | | -> duration | 0.736 | 3.366 | 4.491 | 4.786 | 5.744 | 3.005 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.227746 Full duration: 41.148348 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.394 | 0.826 | 1.475 | 1.684 | 3.331 | 0.995 | 100.0% | 40 | | neutron.update_network | 0.401 | 0.816 | 2.319 | 2.801 | 3.193 | 1.143 | 100.0% | 40 | | total | 0.8 | 1.649 | 3.805 | 4.139 | 4.444 | 2.138 | 100.0% | 40 | | -> duration | 0.8 | 1.649 | 3.805 | 4.139 | 4.444 | 2.138 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.745225 Full duration: 21.547468 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.388 | 0.933 | 1.564 | 1.628 | 1.678 | 0.942 | 100.0% | 40 | | neutron.delete_network | 0.718 | 1.6 | 3.766 | 4.233 | 4.461 | 2.202 | 100.0% | 40 | | total | 1.25 | 2.925 | 4.692 | 5.57 | 5.693 | 3.145 | 100.0% | 40 | | -> duration | 1.25 | 2.925 | 4.692 | 5.57 | 5.693 | 3.145 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.805004 Full duration: 14.171864 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.461 | 1.042 | 2.952 | 3.148 | 3.821 | 1.239 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.86 | 3.324 | 7.111 | 7.955 | 8.292 | 4.122 | 100.0% | 40 | | neutron.list_subnets | 0.098 | 0.206 | 0.372 | 0.422 | 0.461 | 0.236 | 100.0% | 40 | | total | 2.645 | 5.375 | 8.719 | 8.942 | 9.545 | 5.597 | 100.0% | 40 | | -> duration | 2.645 | 5.375 | 8.719 | 8.942 | 9.545 | 5.597 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.189061 Full duration: 42.678737 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.329 | 0.703 | 2.881 | 3.48 | 3.762 | 1.044 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.677 | 4.632 | 7.596 | 8.47 | 12.255 | 4.616 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.954 | 2.244 | 5.072 | 5.629 | 8.048 | 2.794 | 100.0% | 100 | | total | 3.13 | 7.688 | 13.568 | 13.89 | 17.933 | 8.454 | 100.0% | 100 | | -> duration | 3.13 | 7.688 | 13.568 | 13.89 | 17.933 | 8.454 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.661005 Full duration: 104.556726 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.322 | 0.978 | 3.412 | 3.697 | 3.886 | 1.366 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.852 | 3.738 | 7.325 | 9.188 | 9.421 | 4.43 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.989 | 4.842 | 6.036 | 6.789 | 9.946 | 4.035 | 100.0% | 40 | | total | 3.42 | 9.249 | 14.587 | 16.538 | 16.601 | 9.845 | 100.0% | 40 | | -> duration | 3.42 | 9.249 | 14.587 | 16.538 | 16.601 | 9.845 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.815898 Full duration: 43.030696 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.322 | 0.86 | 1.433 | 1.975 | 2.666 | 0.946 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.712 | 6.121 | 9.252 | 11.313 | 11.581 | 5.737 | 100.0% | 40 | | neutron.create_router (x2) | 0.269 | 0.691 | 1.518 | 2.96 | 3.744 | 0.935 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.47 | 15.002 | 21.773 | 26.336 | 26.782 | 15.168 | 100.0% | 40 | | neutron.list_routers | 0.141 | 0.303 | 0.514 | 0.542 | 0.675 | 0.339 | 100.0% | 40 | | total | 9.924 | 23.848 | 31.884 | 40.86 | 41.065 | 23.126 | 100.0% | 40 | | -> duration | 9.924 | 23.848 | 31.884 | 40.86 | 41.065 | 23.126 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 54.625767 Full duration: 126.096333 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.444 | 1.038 | 2.014 | 2.806 | 3.29 | 1.084 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.638 | 5.835 | 8.796 | 8.857 | 8.96 | 5.473 | 100.0% | 40 | | neutron.create_router (x2) | 0.249 | 0.613 | 0.892 | 0.908 | 2.966 | 0.676 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.445 | 12.359 | 18.741 | 18.85 | 19.203 | 12.526 | 100.0% | 40 | | neutron.update_router (x2) | 1.175 | 3.417 | 5.539 | 5.844 | 6.431 | 3.465 | 100.0% | 40 | | total | 11.043 | 23.327 | 32.966 | 35.467 | 35.667 | 23.224 | 100.0% | 40 | | -> duration | 11.043 | 23.327 | 32.966 | 35.467 | 35.667 | 23.224 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.858333 Full duration: 140.202613 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.373 | 1.196 | 1.729 | 1.919 | 3.109 | 1.153 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.674 | 5.62 | 7.455 | 7.725 | 11.671 | 5.177 | 100.0% | 40 | | neutron.create_router (x2) | 0.231 | 0.522 | 0.965 | 1.106 | 3.628 | 0.689 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.396 | 11.113 | 18.966 | 19.461 | 19.79 | 12.039 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.074 | 11.838 | 16.701 | 17.226 | 18.38 | 10.743 | 100.0% | 40 | | neutron.delete_router (x2) | 0.779 | 1.618 | 4.349 | 4.573 | 4.692 | 2.289 | 100.0% | 40 | | total | 16.34 | 32.311 | 47.739 | 48.261 | 48.36 | 32.091 | 100.0% | 40 | | -> duration | 16.34 | 32.311 | 47.739 | 48.261 | 48.36 | 32.091 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.749045 Full duration: 117.563733 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.439 | 0.695 | 1.474 | 2.326 | 3.177 | 0.959 | 100.0% | 8 | | neutron.create_port (x50) | 44.843 | 53.131 | 99.333 | 100.537 | 101.74 | 63.153 | 100.0% | 8 | | neutron.list_ports | 0.348 | 0.652 | 0.856 | 0.891 | 0.927 | 0.638 | 100.0% | 8 | | total | 46.263 | 55.583 | 100.819 | 101.921 | 103.023 | 64.754 | 100.0% | 8 | | -> duration | 46.263 | 55.583 | 100.819 | 101.921 | 103.023 | 64.754 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 149.499821 Full duration: 226.364462 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.378 | 0.876 | 1.381 | 2.992 | 3.433 | 1.04 | 100.0% | 40 | | neutron.create_port (x5) | 4.061 | 7.193 | 13.83 | 17.472 | 17.595 | 8.79 | 100.0% | 40 | | neutron.update_port (x5) | 2.197 | 5.464 | 9.473 | 9.873 | 13.279 | 5.956 | 100.0% | 40 | | total | 7.117 | 14.243 | 24.9 | 27.887 | 28.448 | 15.813 | 100.0% | 40 | | -> duration | 7.117 | 14.243 | 24.9 | 27.887 | 28.448 | 15.813 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.944289 Full duration: 80.199432 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.414 | 0.83 | 3.102 | 3.172 | 3.801 | 1.242 | 100.0% | 40 | | neutron.create_port (x5) | 3.905 | 9.216 | 22.811 | 24.697 | 25.168 | 10.225 | 100.0% | 40 | | neutron.delete_port (x5) | 2.54 | 7.198 | 13.739 | 14.153 | 15.972 | 7.394 | 100.0% | 40 | | total | 7.634 | 17.623 | 40.241 | 40.375 | 40.435 | 18.88 | 100.0% | 40 | | -> duration | 7.634 | 17.623 | 40.241 | 40.375 | 40.435 | 18.88 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.221682 Full duration: 58.736669 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.211 | 0.423 | 0.616 | 0.783 | 3.436 | 0.558 | 100.0% | 40 | | total | 0.301 | 0.631 | 0.857 | 1.097 | 3.604 | 0.749 | 100.0% | 40 | | -> duration | 0.301 | 0.631 | 0.857 | 1.097 | 3.604 | 0.749 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.800503 Full duration: 29.862589 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 84d4a05a-8e83-42ba-944d-c166ba6adde3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.783 | 0.871 | 1.102 | 1.136 | 1.17 | 0.924 | 100.0% | 4 | | neutron.create_port (x126) | 127.062 | 174.643 | 222.412 | 222.469 | 222.525 | 174.718 | 100.0% | 4 | | neutron.create_trunk | 12.7 | 17.213 | 21.843 | 21.914 | 21.985 | 17.278 | 100.0% | 4 | | neutron.update_port | 1.295 | 1.924 | 2.307 | 2.342 | 2.378 | 1.88 | 100.0% | 4 | | neutron.list_trunks | 0.055 | 0.115 | 0.239 | 0.26 | 0.282 | 0.142 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.061 | 0.097 | 0.115 | 0.116 | 0.117 | 0.093 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.224 | 0.782 | 2.504 | 2.825 | 3.145 | 1.233 | 100.0% | 4 | | total | 142.201 | 195.911 | 250.269 | 250.674 | 251.079 | 196.276 | 100.0% | 4 | | -> duration | 142.201 | 195.911 | 250.269 | 250.674 | 251.079 | 196.276 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 251.087531 Full duration: 328.504447 HINTS: * To plot HTML graphics with this data, run: rally task report 84d4a05a-8e83-42ba-944d-c166ba6adde3 --out output.html * To generate a JUnit report, run: rally task export 84d4a05a-8e83-42ba-944d-c166ba6adde3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 84d4a05a-8e83-42ba-944d-c166ba6adde3 --json --out output.json 2020-11-16 02:45:20,382 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 84d4a05a-8e83-42ba-944d-c166ba6adde3 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-11-16 02:45:20,626 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-11-16 02:45:20,628 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:22:54 | 612 | 100.00% | | | | | | | TOTAL: | 00:22:54 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-11-16 02:45:20,628 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2020-11-16 02:45:25,281 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-11-16 02:45:29,253 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-11-16 02:45:29,254 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 24:00 | PASS | +--------------------+------------------+------------------+----------------+