2020-12-09 15:31:53,085 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0MFB3UXXHQ3X | | NODE_NAME | lf-pod4-3 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0MFB3UXXHQ3X/fun | | | ctest-opnfv-functest-benchmarking-cntt-kali- | | | rally_jobs_cntt-run-116 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0MFB3UXXHQ3X/f | | | unctest-opnfv-functest-benchmarking-cntt-kali- | | | rally_jobs_cntt-run-116 | +-------------------------+------------------------------------------------------------+ 2020-12-09 15:31:53,107 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-12-09 15:31:55,632 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2020-12-09 15:32:02,752 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-09 15:32:10,149 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 58ea19f9-b443-4e0e-a9ba-65d130c83cb1 | 2020-12-09T15:32:09.882998 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 58ea19f9-b443-4e0e-a9ba-65d130c83cb1 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-09 15:32:14,413 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | accelerator | Available | | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-09 15:32:16,349 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-09 15:57:29,843 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: a25df0d7-1660-4b97-a1e4-b2e70ece30f2 2020-12-09 15:57:31,536 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a25df0d7-1660-4b97-a1e4-b2e70ece30f2 -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.325 | 1.593 | 8.264 | 14.866 | 28.197 | 3.648 | 100.0% | 100 | | neutron.list_networks | 0.151 | 0.353 | 0.788 | 1.062 | 1.204 | 0.413 | 100.0% | 100 | | total | 0.604 | 1.988 | 8.602 | 15.891 | 28.601 | 4.061 | 100.0% | 100 | | -> duration | 0.604 | 1.988 | 8.602 | 15.891 | 28.601 | 4.061 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.76629 Full duration: 54.380238 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.347 | 1.715 | 8.503 | 12.041 | 12.66 | 3.638 | 100.0% | 40 | | neutron.update_network | 0.415 | 0.579 | 1.433 | 1.626 | 1.682 | 0.788 | 100.0% | 40 | | total | 0.87 | 2.925 | 9.609 | 12.503 | 13.722 | 4.426 | 100.0% | 40 | | -> duration | 0.87 | 2.925 | 9.609 | 12.503 | 13.722 | 4.426 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.034904 Full duration: 27.679781 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.326 | 2.344 | 7.92 | 13.096 | 17.796 | 3.345 | 100.0% | 40 | | neutron.delete_network | 0.587 | 1.116 | 2.347 | 2.701 | 2.911 | 1.336 | 100.0% | 40 | | total | 1.201 | 3.818 | 8.917 | 13.804 | 18.485 | 4.681 | 100.0% | 40 | | -> duration | 1.201 | 3.818 | 8.917 | 13.804 | 18.485 | 4.681 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.521783 Full duration: 24.122517 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.296 | 2.397 | 13.436 | 17.978 | 27.651 | 4.657 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.437 | 4.054 | 11.0 | 12.886 | 13.498 | 4.644 | 100.0% | 40 | | neutron.list_subnets | 0.108 | 0.261 | 0.509 | 0.678 | 1.264 | 0.308 | 100.0% | 40 | | total | 1.987 | 6.144 | 20.135 | 21.212 | 30.412 | 9.609 | 100.0% | 40 | | -> duration | 1.987 | 6.144 | 20.135 | 21.212 | 30.412 | 9.609 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.777598 Full duration: 61.861255 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.314 | 1.478 | 5.277 | 6.86 | 40.467 | 2.903 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.347 | 4.48 | 8.043 | 9.657 | 11.869 | 5.109 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.88 | 2.77 | 4.259 | 4.921 | 6.927 | 2.815 | 100.0% | 100 | | total | 2.769 | 9.319 | 17.672 | 18.783 | 52.733 | 10.828 | 100.0% | 100 | | -> duration | 2.769 | 9.319 | 17.672 | 18.783 | 52.733 | 10.828 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 60.035807 Full duration: 121.043724 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.412 | 2.282 | 6.157 | 7.618 | 16.935 | 3.098 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.4 | 4.871 | 7.077 | 7.456 | 10.888 | 4.848 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.071 | 3.783 | 7.473 | 7.62 | 8.661 | 4.352 | 100.0% | 40 | | total | 3.336 | 12.046 | 19.575 | 21.794 | 25.374 | 12.371 | 100.0% | 40 | | -> duration | 3.336 | 12.046 | 19.575 | 21.794 | 25.374 | 12.371 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.646893 Full duration: 43.705316 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.334 | 1.825 | 8.153 | 9.024 | 11.111 | 3.086 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.446 | 4.741 | 8.453 | 8.756 | 9.757 | 5.007 | 100.0% | 40 | | neutron.create_router (x2) | 0.177 | 0.847 | 1.704 | 1.905 | 2.26 | 0.99 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.588 | 15.887 | 21.437 | 21.979 | 22.326 | 15.386 | 100.0% | 40 | | neutron.list_routers | 0.156 | 0.491 | 1.371 | 1.446 | 1.699 | 0.619 | 100.0% | 40 | | total | 8.276 | 25.887 | 35.996 | 37.311 | 38.143 | 25.087 | 100.0% | 40 | | -> duration | 8.276 | 25.887 | 35.996 | 37.311 | 38.143 | 25.087 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.034057 Full duration: 149.020884 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.373 | 1.473 | 6.213 | 7.181 | 10.466 | 2.44 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.518 | 4.236 | 10.059 | 11.394 | 15.507 | 5.749 | 100.0% | 40 | | neutron.create_router (x2) | 0.184 | 0.647 | 2.317 | 2.89 | 3.226 | 1.076 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.783 | 12.407 | 33.645 | 35.159 | 39.698 | 16.587 | 100.0% | 40 | | neutron.update_router (x2) | 1.275 | 4.152 | 12.748 | 15.342 | 15.796 | 5.464 | 100.0% | 40 | | total | 12.673 | 25.804 | 63.339 | 64.99 | 68.468 | 31.315 | 100.0% | 40 | | -> duration | 12.673 | 25.804 | 63.339 | 64.99 | 68.468 | 31.315 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.644597 Full duration: 158.240694 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.367 | 2.088 | 5.323 | 6.055 | 10.855 | 2.752 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.598 | 5.092 | 8.761 | 9.594 | 11.844 | 5.411 | 100.0% | 40 | | neutron.create_router (x2) | 0.209 | 1.107 | 2.319 | 2.735 | 2.989 | 1.17 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.402 | 14.861 | 24.204 | 24.925 | 25.449 | 16.081 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 5.475 | 13.129 | 24.166 | 25.855 | 27.729 | 15.512 | 100.0% | 40 | | neutron.delete_router (x2) | 0.789 | 2.496 | 4.314 | 4.912 | 4.979 | 2.66 | 100.0% | 40 | | total | 17.448 | 38.704 | 65.679 | 67.142 | 73.124 | 43.586 | 100.0% | 40 | | -> duration | 17.448 | 38.704 | 65.679 | 67.142 | 73.124 | 43.586 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 128.221724 Full duration: 160.352294 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.349 | 1.142 | 3.472 | 4.008 | 4.544 | 1.685 | 100.0% | 8 | | neutron.create_port (x50) | 32.845 | 33.892 | 75.417 | 75.84 | 76.263 | 44.219 | 100.0% | 8 | | neutron.list_ports | 0.525 | 1.274 | 1.867 | 2.099 | 2.331 | 1.27 | 100.0% | 8 | | total | 34.896 | 36.011 | 80.886 | 81.435 | 81.983 | 47.183 | 100.0% | 8 | | -> duration | 34.896 | 36.011 | 80.886 | 81.435 | 81.983 | 47.183 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 107.897786 Full duration: 168.843414 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.45 | 2.102 | 6.664 | 10.485 | 14.258 | 3.099 | 100.0% | 40 | | neutron.create_port (x5) | 3.545 | 9.757 | 12.376 | 14.476 | 14.901 | 9.759 | 100.0% | 40 | | neutron.update_port (x5) | 3.471 | 7.289 | 10.18 | 10.551 | 11.28 | 7.296 | 100.0% | 40 | | total | 8.951 | 18.809 | 30.712 | 32.668 | 34.716 | 20.219 | 100.0% | 40 | | -> duration | 8.951 | 18.809 | 30.712 | 32.668 | 34.716 | 20.219 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.837191 Full duration: 88.209281 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.354 | 1.352 | 6.211 | 8.976 | 11.356 | 2.699 | 100.0% | 40 | | neutron.create_port (x5) | 2.905 | 7.971 | 16.587 | 17.385 | 19.972 | 9.624 | 100.0% | 40 | | neutron.delete_port (x5) | 2.209 | 6.26 | 12.381 | 12.729 | 15.163 | 7.332 | 100.0% | 40 | | total | 6.501 | 16.537 | 34.594 | 36.258 | 40.207 | 19.715 | 100.0% | 40 | | -> duration | 6.501 | 16.537 | 34.594 | 36.258 | 40.207 | 19.715 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.997752 Full duration: 60.574816 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.243 | 0.353 | 0.462 | 0.479 | 0.512 | 0.357 | 100.0% | 40 | | total | 0.34 | 0.503 | 0.74 | 0.765 | 0.767 | 0.532 | 100.0% | 40 | | -> duration | 0.34 | 0.503 | 0.74 | 0.765 | 0.767 | 0.532 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.748292 Full duration: 21.997178 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a25df0d7-1660-4b97-a1e4-b2e70ece30f2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.824 | 1.691 | 2.238 | 2.295 | 2.353 | 1.64 | 100.0% | 4 | | neutron.create_port (x126) | 82.789 | 230.172 | 230.81 | 230.928 | 231.045 | 193.545 | 100.0% | 4 | | neutron.create_trunk | 9.819 | 27.6 | 27.92 | 27.949 | 27.979 | 23.25 | 100.0% | 4 | | neutron.update_port | 1.237 | 3.675 | 4.432 | 4.461 | 4.49 | 3.269 | 100.0% | 4 | | neutron.list_trunks | 0.052 | 0.117 | 0.154 | 0.156 | 0.159 | 0.111 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.057 | 0.074 | 0.176 | 0.195 | 0.214 | 0.105 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.905 | 1.046 | 1.518 | 1.613 | 1.708 | 1.176 | 100.0% | 4 | | total | 95.689 | 265.309 | 266.076 | 266.089 | 266.101 | 223.102 | 100.0% | 4 | | -> duration | 95.689 | 265.309 | 266.076 | 266.089 | 266.101 | 223.102 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 266.121067 Full duration: 347.936935 HINTS: * To plot HTML graphics with this data, run: rally task report a25df0d7-1660-4b97-a1e4-b2e70ece30f2 --out output.html * To generate a JUnit report, run: rally task export a25df0d7-1660-4b97-a1e4-b2e70ece30f2 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report a25df0d7-1660-4b97-a1e4-b2e70ece30f2 --json --out output.json 2020-12-09 15:57:35,584 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a25df0d7-1660-4b97-a1e4-b2e70ece30f2 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-12-09 15:57:35,724 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-09 15:57:35,726 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:24:47 | 612 | 100.00% | | | | | | | TOTAL: | 00:24:47 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-09 15:57:35,726 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-12-09 15:57:39,321 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-12-09 15:57:43,030 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-12-09 15:57:43,030 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 25:47 | PASS | +-------------------------+------------------+------------------+----------------+