2021-06-08 11:29:51,212 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0RSAQBWDPB5X | | NODE_NAME | lf-pod4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0RSAQBWDPB5X/fun | | | ctest-pi-ollivier-functest-benchmarking-cntt- | | | jerma-rally_jobs_cntt-run-15 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0RSAQBWDPB5X/f | | | unctest-pi-ollivier-functest-benchmarking-cntt- | | | jerma-rally_jobs_cntt-run-15 | +-------------------------+------------------------------------------------------------+ 2021-06-08 11:29:51,229 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2021-06-08 11:29:53,671 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2021-06-08 11:29:59,491 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-06-08 11:30:06,515 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | b88f7765-d907-4605-9b84-936b4f15643a | 2021-06-08T11:30:06.234588 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: b88f7765-d907-4605-9b84-936b4f15643a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-06-08 11:30:10,371 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-06-08 11:30:12,290 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-06-08 11:51:29,058 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 2021-06-08 11:51:30,540 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.356 | 1.437 | 8.452 | 17.761 | 30.835 | 3.737 | 100.0% | 100 | | neutron.list_networks | 0.154 | 0.348 | 0.52 | 1.09 | 1.455 | 0.392 | 100.0% | 100 | | total | 0.589 | 1.903 | 8.844 | 18.196 | 31.253 | 4.129 | 100.0% | 100 | | -> duration | 0.589 | 1.903 | 8.844 | 18.196 | 31.253 | 4.129 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.253221 Full duration: 47.065783 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.325 | 1.757 | 7.821 | 8.22 | 9.905 | 3.026 | 100.0% | 40 | | neutron.update_network | 0.207 | 0.275 | 0.486 | 1.143 | 1.269 | 0.369 | 100.0% | 40 | | total | 0.609 | 2.12 | 8.368 | 8.492 | 10.112 | 3.395 | 100.0% | 40 | | -> duration | 0.609 | 2.12 | 8.368 | 8.492 | 10.112 | 3.395 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.918607 Full duration: 21.272799 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.372 | 2.277 | 8.342 | 10.827 | 12.498 | 3.533 | 100.0% | 40 | | neutron.delete_network | 0.26 | 0.37 | 0.663 | 1.248 | 1.613 | 0.47 | 100.0% | 40 | | total | 0.788 | 2.86 | 8.833 | 11.09 | 12.767 | 4.003 | 100.0% | 40 | | -> duration | 0.788 | 2.86 | 8.833 | 11.09 | 12.767 | 4.003 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.143805 Full duration: 20.431075 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.424 | 2.948 | 13.979 | 17.09 | 23.504 | 4.899 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.189 | 2.683 | 6.589 | 6.793 | 7.65 | 3.267 | 100.0% | 40 | | neutron.list_subnets | 0.091 | 0.228 | 0.428 | 1.157 | 1.303 | 0.315 | 100.0% | 40 | | total | 2.525 | 6.064 | 16.924 | 23.261 | 25.082 | 8.482 | 100.0% | 40 | | -> duration | 2.525 | 6.064 | 16.924 | 23.261 | 25.082 | 8.482 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.576866 Full duration: 61.240155 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.338 | 1.719 | 6.708 | 8.802 | 20.716 | 2.756 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.091 | 4.205 | 6.78 | 7.459 | 10.637 | 4.256 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.476 | 1.794 | 3.04 | 3.284 | 4.156 | 1.856 | 100.0% | 100 | | total | 3.074 | 7.854 | 12.951 | 16.03 | 27.456 | 8.867 | 100.0% | 100 | | -> duration | 3.074 | 7.854 | 12.951 | 16.03 | 27.456 | 8.867 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.104327 Full duration: 112.497231 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.346 | 2.049 | 7.106 | 15.641 | 26.229 | 3.987 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.337 | 3.029 | 6.449 | 7.921 | 8.413 | 3.539 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.786 | 2.469 | 8.283 | 9.516 | 10.872 | 3.454 | 100.0% | 40 | | total | 2.605 | 8.633 | 19.62 | 22.613 | 30.611 | 11.033 | 100.0% | 40 | | -> duration | 2.605 | 8.633 | 19.62 | 22.613 | 30.611 | 11.033 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.712239 Full duration: 44.187761 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.363 | 2.179 | 8.689 | 11.02 | 20.772 | 3.832 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.362 | 4.734 | 8.93 | 10.241 | 10.981 | 5.253 | 100.0% | 40 | | neutron.create_router (x2) | 0.232 | 0.881 | 1.982 | 2.38 | 3.185 | 1.081 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.599 | 13.861 | 30.566 | 32.154 | 34.602 | 16.48 | 100.0% | 40 | | neutron.list_routers | 0.178 | 0.507 | 1.542 | 1.818 | 2.729 | 0.655 | 100.0% | 40 | | total | 13.121 | 22.41 | 50.832 | 51.989 | 52.527 | 27.302 | 100.0% | 40 | | -> duration | 13.121 | 22.41 | 50.832 | 51.989 | 52.527 | 27.302 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.6765 Full duration: 149.306702 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.353 | 2.104 | 7.87 | 9.068 | 11.286 | 3.166 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.246 | 4.348 | 8.646 | 12.482 | 12.903 | 4.93 | 100.0% | 40 | | neutron.create_router (x2) | 0.163 | 0.795 | 2.522 | 2.746 | 3.277 | 1.168 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.765 | 13.034 | 27.889 | 28.285 | 30.498 | 15.265 | 100.0% | 40 | | neutron.update_router (x2) | 1.222 | 3.608 | 12.978 | 13.21 | 15.097 | 5.79 | 100.0% | 40 | | total | 9.872 | 24.935 | 55.706 | 56.367 | 58.349 | 30.319 | 100.0% | 40 | | -> duration | 9.872 | 24.935 | 55.706 | 56.367 | 58.349 | 30.319 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.957317 Full duration: 162.469696 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.437 | 2.07 | 6.439 | 8.524 | 12.275 | 2.906 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.213 | 4.669 | 7.856 | 8.479 | 11.062 | 4.35 | 100.0% | 40 | | neutron.create_router (x2) | 0.179 | 0.979 | 2.105 | 2.269 | 2.648 | 1.065 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.96 | 15.584 | 21.89 | 22.344 | 24.168 | 15.603 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.721 | 14.458 | 20.824 | 21.957 | 24.116 | 14.359 | 100.0% | 40 | | neutron.delete_router (x2) | 0.97 | 3.002 | 4.741 | 4.932 | 5.649 | 3.079 | 100.0% | 40 | | total | 12.494 | 42.191 | 54.606 | 59.713 | 64.793 | 41.362 | 100.0% | 40 | | -> duration | 12.494 | 42.191 | 54.606 | 59.713 | 64.793 | 41.362 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 108.471941 Full duration: 146.184682 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.372 | 1.454 | 1.899 | 2.121 | 2.344 | 1.32 | 100.0% | 8 | | neutron.create_port (x50) | 25.247 | 28.183 | 45.591 | 46.183 | 46.774 | 31.819 | 100.0% | 8 | | neutron.list_ports | 0.607 | 1.17 | 2.042 | 2.097 | 2.152 | 1.263 | 100.0% | 8 | | total | 27.774 | 30.019 | 49.115 | 49.611 | 50.106 | 34.413 | 100.0% | 8 | | -> duration | 27.774 | 30.019 | 49.115 | 49.611 | 50.106 | 34.413 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.963203 Full duration: 138.408573 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.539 | 1.79 | 7.876 | 10.114 | 15.341 | 3.186 | 100.0% | 40 | | neutron.create_port (x5) | 3.231 | 7.532 | 10.571 | 11.199 | 11.817 | 7.632 | 100.0% | 40 | | neutron.update_port (x5) | 2.94 | 5.437 | 7.699 | 7.879 | 9.452 | 5.58 | 100.0% | 40 | | total | 7.859 | 16.086 | 21.927 | 23.689 | 28.136 | 16.467 | 100.0% | 40 | | -> duration | 7.859 | 16.086 | 21.927 | 23.689 | 28.136 | 16.467 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.872492 Full duration: 76.956096 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.419 | 1.785 | 7.637 | 10.396 | 24.089 | 3.466 | 100.0% | 40 | | neutron.create_port (x5) | 2.823 | 6.642 | 10.849 | 12.343 | 13.657 | 7.142 | 100.0% | 40 | | neutron.delete_port (x5) | 2.051 | 5.872 | 8.774 | 9.978 | 10.263 | 5.952 | 100.0% | 40 | | total | 5.905 | 16.032 | 24.764 | 27.602 | 32.007 | 16.613 | 100.0% | 40 | | -> duration | 5.905 | 16.032 | 24.764 | 27.602 | 32.007 | 16.613 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.611778 Full duration: 51.668264 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.227 | 0.348 | 0.467 | 1.123 | 1.342 | 0.419 | 100.0% | 40 | | total | 0.402 | 0.531 | 0.692 | 1.239 | 1.564 | 0.608 | 100.0% | 40 | | -> duration | 0.402 | 0.531 | 0.692 | 1.239 | 1.564 | 0.608 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.606623 Full duration: 24.779418 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.512 | 1.184 | 1.604 | 1.685 | 1.767 | 1.162 | 100.0% | 4 | | neutron.create_port (x126) | 62.771 | 86.245 | 108.645 | 108.664 | 108.683 | 85.986 | 100.0% | 4 | | neutron.create_trunk | 9.293 | 11.417 | 12.855 | 12.903 | 12.951 | 11.27 | 100.0% | 4 | | neutron.update_port | 0.995 | 1.612 | 2.277 | 2.291 | 2.305 | 1.631 | 100.0% | 4 | | neutron.list_trunks | 0.045 | 0.058 | 0.072 | 0.074 | 0.075 | 0.059 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.049 | 0.053 | 0.095 | 0.104 | 0.113 | 0.067 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.078 | 0.089 | 0.199 | 0.222 | 0.245 | 0.125 | 100.0% | 4 | | total | 75.332 | 100.479 | 124.892 | 124.914 | 124.936 | 100.306 | 100.0% | 4 | | -> duration | 75.332 | 100.479 | 124.892 | 124.914 | 124.936 | 100.306 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 124.94686 Full duration: 195.625769 HINTS: * To plot HTML graphics with this data, run: rally task report 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 --out output.html * To generate a JUnit report, run: rally task export 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 --json --out output.json 2021-06-08 11:51:34,028 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6cd3c494-6ac1-4c6a-a365-7f1edc6d3572 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2021-06-08 11:51:34,173 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-06-08 11:51:34,175 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:20:52 | 612 | 100.00% | | | | | | | TOTAL: | 00:20:52 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-06-08 11:51:34,175 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2021-06-08 11:51:37,788 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2021-06-08 11:51:41,155 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2021-06-08 11:51:41,156 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 21:47 | PASS | +-------------------------+------------------+------------------+----------------+