2020-11-16 04:18:29,641 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/08H8C4ACY3G5 | | | /functest-opnfv-functest-benchmarking-cntt-hunter- | | | rally_jobs_cntt-run-131 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 08H8C4ACY3G5 | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/08H8C4ACY3G5 | | | /functest-opnfv-functest-benchmarking-cntt-hunter- | | | rally_jobs_cntt-run-131 | | NODE_NAME | lf-virtual6 | +-------------------------+------------------------------------------------------------+ 2020-11-16 04:18:29,673 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-11-16 04:18:32,908 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2020-11-16 04:18:42,143 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-11-16 04:18:48,836 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | e4ed68c1-cd1f-4c23-a9ec-2c84cf4793bf | 2020-11-16T04:18:48.637233 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: e4ed68c1-cd1f-4c23-a9ec-2c84cf4793bf ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-11-16 04:18:52,532 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-11-16 04:18:55,032 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-11-16 04:41:08,425 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 2020-11-16 04:41:10,294 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.39 | 0.917 | 3.348 | 3.484 | 6.437 | 1.423 | 100.0% | 100 | | neutron.list_networks | 0.18 | 0.567 | 3.016 | 3.104 | 5.049 | 1.159 | 100.0% | 100 | | total | 0.655 | 1.945 | 4.293 | 4.742 | 6.861 | 2.582 | 100.0% | 100 | | -> duration | 0.655 | 1.945 | 4.293 | 4.742 | 6.861 | 2.582 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.498511 Full duration: 38.398344 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.372 | 0.857 | 3.342 | 3.456 | 3.829 | 1.263 | 100.0% | 40 | | neutron.update_network | 0.429 | 1.004 | 3.13 | 3.16 | 3.776 | 1.466 | 100.0% | 40 | | total | 0.984 | 2.184 | 5.062 | 5.187 | 5.266 | 2.729 | 100.0% | 40 | | -> duration | 0.984 | 2.184 | 5.062 | 5.187 | 5.266 | 2.729 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.512043 Full duration: 22.224119 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.449 | 0.928 | 3.879 | 4.011 | 5.124 | 1.401 | 100.0% | 40 | | neutron.delete_network | 0.595 | 1.445 | 3.897 | 5.169 | 5.527 | 2.066 | 100.0% | 40 | | total | 1.22 | 2.44 | 6.627 | 6.898 | 7.072 | 3.467 | 100.0% | 40 | | -> duration | 1.22 | 2.44 | 6.627 | 6.898 | 7.072 | 3.467 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.650705 Full duration: 16.942963 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.436 | 0.822 | 1.63 | 3.612 | 3.686 | 1.106 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.946 | 4.505 | 7.183 | 8.849 | 9.058 | 4.538 | 100.0% | 40 | | neutron.list_subnets | 0.094 | 0.232 | 0.543 | 0.689 | 2.508 | 0.341 | 100.0% | 40 | | total | 2.589 | 5.356 | 9.174 | 11.042 | 11.236 | 5.986 | 100.0% | 40 | | -> duration | 2.589 | 5.356 | 9.174 | 11.042 | 11.236 | 5.986 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.325914 Full duration: 46.386125 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.311 | 0.61 | 1.77 | 3.938 | 4.572 | 0.993 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.572 | 3.219 | 8.854 | 9.124 | 10.601 | 4.354 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.957 | 2.074 | 6.309 | 6.883 | 8.959 | 3.104 | 100.0% | 100 | | total | 2.969 | 7.023 | 16.045 | 17.139 | 21.558 | 8.451 | 100.0% | 100 | | -> duration | 2.969 | 7.023 | 16.045 | 17.139 | 21.558 | 8.451 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.98376 Full duration: 105.17945 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.427 | 0.843 | 1.034 | 1.14 | 3.095 | 0.847 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.93 | 5.187 | 6.676 | 7.619 | 7.727 | 4.75 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.119 | 1.971 | 3.928 | 6.239 | 11.741 | 2.713 | 100.0% | 40 | | total | 3.914 | 8.095 | 11.851 | 14.251 | 15.108 | 8.34 | 100.0% | 40 | | -> duration | 3.914 | 8.095 | 11.851 | 14.251 | 15.108 | 8.34 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.667096 Full duration: 40.495577 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.343 | 0.878 | 1.362 | 1.46 | 1.74 | 0.852 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.537 | 4.539 | 7.893 | 8.729 | 9.076 | 4.886 | 100.0% | 40 | | neutron.create_router (x2) | 0.251 | 0.525 | 1.089 | 1.26 | 3.061 | 0.716 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.159 | 11.146 | 19.709 | 25.205 | 25.722 | 12.974 | 100.0% | 40 | | neutron.list_routers | 0.166 | 0.336 | 2.552 | 2.683 | 2.789 | 0.643 | 100.0% | 40 | | total | 10.224 | 19.136 | 30.058 | 37.185 | 37.343 | 20.072 | 100.0% | 40 | | -> duration | 10.224 | 19.136 | 30.058 | 37.185 | 37.343 | 20.072 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.976998 Full duration: 127.64289 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.388 | 0.921 | 1.231 | 1.524 | 3.003 | 0.95 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.751 | 4.623 | 7.013 | 7.245 | 8.076 | 4.547 | 100.0% | 40 | | neutron.create_router (x2) | 0.274 | 0.465 | 0.819 | 0.992 | 1.353 | 0.562 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.577 | 12.181 | 17.383 | 19.145 | 19.7 | 12.259 | 100.0% | 40 | | neutron.update_router (x2) | 1.326 | 3.823 | 7.039 | 7.927 | 9.487 | 3.998 | 100.0% | 40 | | total | 11.937 | 21.833 | 32.811 | 33.921 | 35.302 | 22.316 | 100.0% | 40 | | -> duration | 11.937 | 21.833 | 32.811 | 33.921 | 35.302 | 22.316 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 52.330133 Full duration: 129.623971 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.382 | 0.892 | 1.224 | 1.331 | 2.08 | 0.885 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.681 | 3.879 | 7.717 | 12.217 | 12.432 | 4.752 | 100.0% | 40 | | neutron.create_router (x2) | 0.238 | 0.627 | 1.362 | 3.177 | 3.578 | 0.833 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.981 | 13.774 | 28.592 | 29.476 | 31.657 | 15.136 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.209 | 13.302 | 21.11 | 22.624 | 23.225 | 12.127 | 100.0% | 40 | | neutron.delete_router (x2) | 0.838 | 3.155 | 4.547 | 5.006 | 8.248 | 2.949 | 100.0% | 40 | | total | 17.082 | 34.089 | 61.771 | 68.609 | 68.767 | 36.683 | 100.0% | 40 | | -> duration | 17.082 | 34.089 | 61.771 | 68.609 | 68.767 | 36.683 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 114.955102 Full duration: 157.210655 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.447 | 0.742 | 0.856 | 0.879 | 0.902 | 0.69 | 100.0% | 8 | | neutron.create_port (x50) | 47.211 | 52.447 | 60.892 | 63.446 | 66.0 | 53.697 | 100.0% | 8 | | neutron.list_ports | 0.439 | 0.9 | 1.574 | 2.146 | 2.717 | 1.078 | 100.0% | 8 | | total | 48.637 | 53.978 | 62.591 | 65.092 | 67.593 | 55.469 | 100.0% | 8 | | -> duration | 48.637 | 53.978 | 62.591 | 65.092 | 67.593 | 55.469 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 116.257094 Full duration: 175.82391 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.365 | 0.912 | 3.656 | 4.116 | 5.325 | 1.349 | 100.0% | 40 | | neutron.create_port (x5) | 4.666 | 10.614 | 25.853 | 28.972 | 35.617 | 13.595 | 100.0% | 40 | | neutron.update_port (x5) | 2.618 | 5.313 | 13.038 | 15.937 | 18.304 | 6.615 | 100.0% | 40 | | total | 8.62 | 17.121 | 45.504 | 46.215 | 46.554 | 21.579 | 100.0% | 40 | | -> duration | 8.62 | 17.121 | 45.504 | 46.215 | 46.554 | 21.579 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.967016 Full duration: 96.909582 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.387 | 3.255 | 4.161 | 4.242 | 4.275 | 2.414 | 100.0% | 40 | | neutron.create_port (x5) | 3.93 | 8.222 | 14.964 | 15.854 | 18.706 | 9.043 | 100.0% | 40 | | neutron.delete_port (x5) | 2.679 | 6.62 | 9.56 | 12.646 | 12.939 | 6.537 | 100.0% | 40 | | total | 7.764 | 16.485 | 28.091 | 28.659 | 29.08 | 18.009 | 100.0% | 40 | | -> duration | 7.764 | 16.485 | 28.091 | 28.659 | 29.08 | 18.009 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.87587 Full duration: 61.204683 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.212 | 0.389 | 0.516 | 0.535 | 0.853 | 0.388 | 100.0% | 40 | | total | 0.344 | 0.579 | 0.727 | 0.842 | 0.926 | 0.565 | 100.0% | 40 | | -> duration | 0.344 | 0.579 | 0.727 | 0.842 | 0.926 | 0.565 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.761797 Full duration: 25.24702 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.7 | 0.807 | 0.883 | 0.892 | 0.901 | 0.804 | 100.0% | 4 | | neutron.create_port (x126) | 126.0 | 140.328 | 159.434 | 162.226 | 165.018 | 142.918 | 100.0% | 4 | | neutron.create_trunk | 11.788 | 12.772 | 13.798 | 13.885 | 13.971 | 12.826 | 100.0% | 4 | | neutron.update_port | 1.258 | 1.394 | 3.224 | 3.594 | 3.963 | 2.002 | 100.0% | 4 | | neutron.list_trunks | 0.048 | 0.068 | 0.083 | 0.085 | 0.086 | 0.068 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.051 | 0.063 | 0.09 | 0.093 | 0.097 | 0.069 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.332 | 0.464 | 0.601 | 0.613 | 0.625 | 0.471 | 100.0% | 4 | | total | 142.669 | 157.199 | 175.328 | 177.461 | 179.594 | 159.165 | 100.0% | 4 | | -> duration | 142.669 | 157.199 | 175.328 | 177.461 | 179.594 | 159.165 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 179.594457 Full duration: 256.396203 HINTS: * To plot HTML graphics with this data, run: rally task report 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 --out output.html * To generate a JUnit report, run: rally task export 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 --json --out output.json 2020-11-16 04:41:14,823 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7b6f5238-15e0-4adc-83bb-e9d42ded02a1 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-11-16 04:41:15,054 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-11-16 04:41:15,056 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:21:39 | 612 | 100.00% | | | | | | | TOTAL: | 00:21:39 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-11-16 04:41:15,056 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-11-16 04:41:19,558 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-11-16 04:41:22,720 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-11-16 04:41:22,720 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 22:49 | PASS | +-------------------------+------------------+------------------+----------------+