2021-01-28 16:53:49,306 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-----------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0DPQB1CNUH2W | | | /functest-pi-ollivier-functest-benchmarking-cntt- | | | arm64-hunter-rally_jobs_cntt-run-20 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 0DPQB1CNUH2W | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0DPQB1CNUH2W | | | /functest-pi-ollivier-functest-benchmarking-cntt- | | | arm64-hunter-rally_jobs_cntt-run-20 | | NODE_NAME | lf-virtual6 | +-------------------------+-----------------------------------------------------------+ 2021-01-28 16:53:49,507 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2021-01-28 16:53:55,311 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2021-01-28 16:54:05,511 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-01-28 16:54:39,600 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 2afa1fce-a68b-4fd9-a9db-9a6115699f4a | 2021-01-28T16:54:39.012117 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 2afa1fce-a68b-4fd9-a9db-9a6115699f4a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-01-28 16:54:59,586 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-01-28 16:55:08,812 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-01-28 17:20:19,654 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: f4f46c67-dd9c-4055-a875-d35e71458380 2021-01-28 17:20:28,207 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f4f46c67-dd9c-4055-a875-d35e71458380 -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.892 | 2.057 | 3.889 | 4.208 | 5.323 | 2.313 | 100.0% | 100 | | neutron.list_networks | 0.22 | 0.934 | 2.143 | 2.258 | 2.799 | 1.099 | 100.0% | 100 | | total | 1.35 | 3.377 | 5.126 | 5.348 | 5.951 | 3.414 | 100.0% | 100 | | -> duration | 1.35 | 3.377 | 5.126 | 5.348 | 5.951 | 3.414 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.573999 Full duration: 50.141982 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.651 | 1.424 | 2.499 | 2.639 | 2.724 | 1.59 | 100.0% | 40 | | neutron.update_network | 0.369 | 0.869 | 1.732 | 1.776 | 1.946 | 1.036 | 100.0% | 40 | | total | 1.02 | 2.626 | 3.513 | 3.608 | 3.982 | 2.627 | 100.0% | 40 | | -> duration | 1.02 | 2.626 | 3.513 | 3.608 | 3.982 | 2.627 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.392843 Full duration: 26.526149 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.581 | 1.351 | 2.444 | 2.892 | 2.951 | 1.52 | 100.0% | 40 | | neutron.delete_network | 0.692 | 1.676 | 2.731 | 2.799 | 3.497 | 1.72 | 100.0% | 40 | | total | 1.857 | 3.059 | 5.214 | 5.492 | 5.745 | 3.24 | 100.0% | 40 | | -> duration | 1.857 | 3.059 | 5.214 | 5.492 | 5.745 | 3.24 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.857014 Full duration: 18.681078 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.51 | 1.283 | 2.0 | 2.302 | 2.541 | 1.346 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.194 | 4.075 | 6.004 | 7.789 | 8.244 | 4.544 | 100.0% | 40 | | neutron.list_subnets | 0.143 | 0.342 | 0.65 | 1.112 | 1.515 | 0.444 | 100.0% | 40 | | total | 3.375 | 6.531 | 7.781 | 9.975 | 10.541 | 6.335 | 100.0% | 40 | | -> duration | 3.375 | 6.531 | 7.781 | 9.975 | 10.541 | 6.335 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.267427 Full duration: 52.824728 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.369 | 1.113 | 1.876 | 2.21 | 2.44 | 1.191 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.672 | 3.528 | 5.725 | 6.341 | 7.784 | 3.753 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.958 | 2.374 | 3.322 | 3.961 | 5.395 | 2.323 | 100.0% | 100 | | total | 3.95 | 6.805 | 10.386 | 10.698 | 13.382 | 7.267 | 100.0% | 100 | | -> duration | 3.95 | 6.805 | 10.386 | 10.698 | 13.382 | 7.267 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.822762 Full duration: 114.4624 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.435 | 0.99 | 1.616 | 1.939 | 2.05 | 1.088 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.547 | 4.06 | 6.337 | 10.546 | 10.804 | 4.692 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.242 | 2.814 | 4.115 | 4.365 | 6.631 | 2.965 | 100.0% | 40 | | total | 5.265 | 8.36 | 11.502 | 15.708 | 16.033 | 8.921 | 100.0% | 40 | | -> duration | 5.265 | 8.36 | 11.502 | 15.708 | 16.033 | 8.921 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.55952 Full duration: 42.856062 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.349 | 1.221 | 1.777 | 2.494 | 3.081 | 1.172 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.642 | 3.966 | 6.923 | 7.206 | 8.186 | 4.197 | 100.0% | 40 | | neutron.create_router (x2) | 0.177 | 0.439 | 1.641 | 1.962 | 2.097 | 0.672 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.482 | 11.017 | 18.016 | 22.922 | 24.038 | 11.956 | 100.0% | 40 | | neutron.list_routers | 0.188 | 0.441 | 1.141 | 1.457 | 1.534 | 0.621 | 100.0% | 40 | | total | 9.774 | 16.979 | 25.862 | 35.057 | 35.409 | 18.62 | 100.0% | 40 | | -> duration | 9.774 | 16.979 | 25.862 | 35.057 | 35.409 | 18.62 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.937236 Full duration: 129.751079 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.513 | 1.112 | 1.635 | 1.908 | 2.017 | 1.13 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.843 | 4.766 | 6.55 | 7.061 | 7.726 | 4.731 | 100.0% | 40 | | neutron.create_router (x2) | 0.23 | 0.44 | 1.435 | 1.602 | 2.233 | 0.636 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.12 | 11.443 | 19.265 | 23.061 | 23.458 | 13.825 | 100.0% | 40 | | neutron.update_router (x2) | 1.279 | 3.924 | 5.928 | 6.907 | 6.98 | 4.127 | 100.0% | 40 | | total | 11.612 | 21.079 | 32.5 | 39.987 | 40.315 | 24.451 | 100.0% | 40 | | -> duration | 11.612 | 21.079 | 32.5 | 39.987 | 40.315 | 24.451 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.926982 Full duration: 147.396083 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.364 | 1.258 | 2.181 | 2.495 | 3.527 | 1.294 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.584 | 3.54 | 6.354 | 7.64 | 7.8 | 3.922 | 100.0% | 40 | | neutron.create_router (x2) | 0.18 | 0.355 | 0.919 | 1.441 | 2.989 | 0.539 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.79 | 10.648 | 17.743 | 22.145 | 23.354 | 10.679 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.752 | 9.581 | 15.73 | 19.724 | 21.312 | 9.711 | 100.0% | 40 | | neutron.delete_router (x2) | 0.803 | 2.277 | 3.805 | 4.416 | 4.692 | 2.199 | 100.0% | 40 | | total | 15.474 | 28.18 | 45.14 | 57.124 | 57.67 | 28.345 | 100.0% | 40 | | -> duration | 15.474 | 28.18 | 45.14 | 57.124 | 57.67 | 28.345 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.575216 Full duration: 114.973983 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.494 | 0.961 | 1.816 | 1.82 | 1.825 | 1.06 | 100.0% | 8 | | neutron.create_port (x50) | 46.701 | 56.032 | 83.628 | 83.722 | 83.817 | 60.264 | 100.0% | 8 | | neutron.list_ports | 0.534 | 0.977 | 1.396 | 1.681 | 1.966 | 1.004 | 100.0% | 8 | | total | 48.008 | 57.746 | 86.507 | 86.667 | 86.828 | 62.363 | 100.0% | 8 | | -> duration | 48.008 | 57.746 | 86.507 | 86.667 | 86.828 | 62.363 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 147.892023 Full duration: 225.063843 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.487 | 1.69 | 6.459 | 6.689 | 7.348 | 2.753 | 100.0% | 40 | | neutron.create_port (x5) | 4.43 | 9.639 | 17.995 | 22.442 | 25.789 | 10.551 | 100.0% | 40 | | neutron.update_port (x5) | 2.307 | 4.457 | 12.488 | 13.051 | 15.046 | 6.344 | 100.0% | 40 | | total | 8.448 | 15.94 | 31.912 | 37.59 | 37.943 | 19.837 | 100.0% | 40 | | -> duration | 8.448 | 15.94 | 31.912 | 37.59 | 37.943 | 19.837 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.284819 Full duration: 100.929602 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.438 | 1.058 | 1.683 | 2.068 | 2.283 | 1.13 | 100.0% | 40 | | neutron.create_port (x5) | 4.286 | 7.243 | 12.108 | 12.195 | 12.826 | 7.94 | 100.0% | 40 | | neutron.delete_port (x5) | 2.752 | 5.667 | 8.683 | 8.922 | 9.788 | 5.952 | 100.0% | 40 | | total | 8.373 | 15.4 | 21.35 | 22.024 | 24.042 | 15.212 | 100.0% | 40 | | -> duration | 8.373 | 15.4 | 21.35 | 22.024 | 24.042 | 15.212 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.357801 Full duration: 59.285906 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.232 | 0.536 | 0.697 | 0.726 | 0.848 | 0.53 | 100.0% | 40 | | total | 0.736 | 1.185 | 1.568 | 1.589 | 2.104 | 1.178 | 100.0% | 40 | | -> duration | 0.736 | 1.185 | 1.568 | 1.589 | 2.104 | 1.178 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.38155 Full duration: 52.65782 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4f46c67-dd9c-4055-a875-d35e71458380 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.858 | 1.32 | 1.761 | 1.772 | 1.782 | 1.32 | 100.0% | 4 | | neutron.create_port (x126) | 112.865 | 164.525 | 190.692 | 190.716 | 190.74 | 158.164 | 100.0% | 4 | | neutron.create_trunk | 11.106 | 14.979 | 16.726 | 16.764 | 16.801 | 14.466 | 100.0% | 4 | | neutron.update_port | 1.352 | 2.398 | 2.535 | 2.558 | 2.581 | 2.183 | 100.0% | 4 | | neutron.list_trunks | 0.093 | 0.144 | 0.237 | 0.25 | 0.263 | 0.161 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.089 | 0.109 | 0.142 | 0.146 | 0.151 | 0.115 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.552 | 1.354 | 1.802 | 1.835 | 1.868 | 1.282 | 100.0% | 4 | | total | 127.521 | 184.789 | 213.68 | 213.724 | 213.769 | 177.717 | 100.0% | 4 | | -> duration | 127.521 | 184.789 | 213.68 | 213.724 | 213.769 | 177.717 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 213.851492 Full duration: 308.537058 HINTS: * To plot HTML graphics with this data, run: rally task report f4f46c67-dd9c-4055-a875-d35e71458380 --out output.html * To generate a JUnit report, run: rally task export f4f46c67-dd9c-4055-a875-d35e71458380 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f4f46c67-dd9c-4055-a875-d35e71458380 --json --out output.json 2021-01-28 17:20:51,889 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f4f46c67-dd9c-4055-a875-d35e71458380 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2021-01-28 17:20:52,940 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-01-28 17:20:52,947 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:24:04 | 612 | 100.00% | | | | | | | TOTAL: | 00:24:04 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-01-28 17:20:52,948 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2021-01-28 17:21:18,097 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2021-01-28 17:21:39,069 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2021-01-28 17:21:39,072 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 27:43 | PASS | +-------------------------+------------------+------------------+----------------+