2021-05-26 23:12:07,884 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | XSMEF3GOU7ET | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/XSMEF3GOU7ET/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-218 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/XSMEF3GOU7ET/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-218 | +-------------------------+------------------------------------------------------------+ 2021-05-26 23:12:07,904 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-05-26 23:12:13,119 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-05-26 23:12:18,105 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-05-26 23:12:24,482 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 7dc565fa-b027-4560-a2d1-785086b39370 | 2021-05-26T23:12:24.190294 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 7dc565fa-b027-4560-a2d1-785086b39370 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-05-26 23:12:29,395 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-05-26 23:12:33,528 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-26 23:12:33,688 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-05-26 23:15:40,674 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 220c5d4b-056d-4a4f-ab3b-5961566d3429 2021-05-26 23:15:41,910 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 220c5d4b-056d-4a4f-ab3b-5961566d3429 -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.864 | 1.141 | 1.511 | 1.755 | 2.0 | 1.236 | 100.0% | 10 | | total | 0.864 | 1.141 | 1.511 | 1.755 | 2.0 | 1.236 | 100.0% | 10 | | -> duration | 0.864 | 1.141 | 1.511 | 1.755 | 2.0 | 1.236 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.532687 Full duration: 31.136732 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.143 | 0.229 | 0.46 | 0.744 | 1.029 | 0.319 | 100.0% | 10 | | total | 0.569 | 0.989 | 1.34 | 1.581 | 1.822 | 1.035 | 100.0% | 10 | | -> duration | 0.569 | 0.989 | 1.34 | 1.581 | 1.822 | 1.035 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.895709 Full duration: 32.776474 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.193 | 0.299 | 0.505 | 0.527 | 0.549 | 0.331 | 100.0% | 10 | | total | 0.688 | 1.086 | 1.209 | 1.252 | 1.295 | 1.029 | 100.0% | 10 | | -> duration | 0.688 | 1.086 | 1.209 | 1.252 | 1.295 | 1.029 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.170569 Full duration: 33.118915 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.152 | 0.192 | 0.525 | 0.566 | 0.608 | 0.311 | 100.0% | 10 | | total | 0.613 | 1.037 | 1.161 | 1.36 | 1.56 | 0.973 | 100.0% | 10 | | -> duration | 0.613 | 1.037 | 1.161 | 1.36 | 1.56 | 0.973 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.728382 Full duration: 33.093501 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 8.54455 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 220c5d4b-056d-4a4f-ab3b-5961566d3429 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.151 | 0.226 | 0.365 | 0.374 | 0.382 | 0.247 | 100.0% | 10 | | total | 0.608 | 1.013 | 1.118 | 1.217 | 1.315 | 0.928 | 100.0% | 10 | | -> duration | 0.608 | 1.013 | 1.118 | 1.217 | 1.315 | 0.928 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.592451 Full duration: 25.116327 HINTS: * To plot HTML graphics with this data, run: rally task report 220c5d4b-056d-4a4f-ab3b-5961566d3429 --out output.html * To generate a JUnit report, run: rally task export 220c5d4b-056d-4a4f-ab3b-5961566d3429 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 220c5d4b-056d-4a4f-ab3b-5961566d3429 --json --out output.json At least one workload did not pass SLA criteria. 2021-05-26 23:15:44,922 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 220c5d4b-056d-4a4f-ab3b-5961566d3429 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-05-26 23:15:44,930 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" Failed. 2021-05-26 23:15:44,961 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-26 23:15:45,142 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-05-26 23:27:16,173 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa 2021-05-26 23:27:17,420 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa -------------------------------------------------------------------------------- Task dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.025 | 6.641 | 9.388 | 10.054 | 10.721 | 7.027 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.103 | 0.12 | 0.122 | 0.124 | 0.106 | 100.0% | 10 | | -> glance_v2.upload_data | 2.411 | 3.686 | 6.462 | 6.974 | 7.486 | 4.128 | 100.0% | 10 | | glance_v2.delete_image | 2.461 | 3.151 | 7.181 | 8.866 | 10.551 | 4.612 | 100.0% | 10 | | total | 8.192 | 9.74 | 15.754 | 15.876 | 15.998 | 11.639 | 100.0% | 10 | | -> duration | 8.192 | 9.74 | 15.754 | 15.876 | 15.998 | 11.639 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.242603 Full duration: 69.892628 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.038 | 6.1 | 11.194 | 11.242 | 11.291 | 7.607 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.087 | 0.102 | 0.117 | 0.119 | 0.12 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 2.451 | 2.925 | 4.979 | 5.899 | 6.819 | 3.724 | 100.0% | 10 | | glance_v2.list_images | 0.055 | 0.062 | 0.068 | 0.07 | 0.073 | 0.062 | 100.0% | 10 | | total | 5.106 | 6.156 | 11.256 | 11.303 | 11.35 | 7.67 | 100.0% | 10 | | -> duration | 5.106 | 6.156 | 11.256 | 11.303 | 11.35 | 7.67 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.770454 Full duration: 57.924506 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.143 | 0.164 | 0.291 | 0.361 | 0.432 | 0.212 | 100.0% | 10 | | total | 0.143 | 0.164 | 0.291 | 0.361 | 0.432 | 0.212 | 100.0% | 10 | | -> duration | 0.143 | 0.164 | 0.291 | 0.361 | 0.432 | 0.212 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.487489 Full duration: 32.189482 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.34 | 7.024 | 12.454 | 13.349 | 14.244 | 8.338 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.096 | 0.101 | 0.113 | 0.113 | 0.113 | 0.103 | 100.0% | 10 | | -> glance_v2.upload_data | 2.705 | 4.098 | 7.61 | 8.741 | 9.872 | 4.956 | 100.0% | 10 | | nova.boot_servers | 72.338 | 117.913 | 154.399 | 160.592 | 166.785 | 117.54 | 60.0% | 10 | | total | 86.582 | 128.501 | 160.28 | 167.183 | 174.086 | 125.879 | 60.0% | 10 | | -> duration | 85.582 | 127.501 | 159.28 | 166.183 | 173.086 | 124.879 | 60.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 60.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 341.303393 Full duration: 504.343747 HINTS: * To plot HTML graphics with this data, run: rally task report dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa --out output.html * To generate a JUnit report, run: rally task export dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa --type junit --to output.xml * To get raw JSON output of task results, run: rally task report dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa --json --out output.json At least one workload did not pass SLA criteria. 2021-05-26 23:27:20,424 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid dfb73ad9-52ec-4d9e-80c1-2e65a0e849aa --out /home/opnfv/functest/results/rally_full/glance.json 2021-05-26 23:27:20,519 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-05-26 23:27:20,561 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-26 23:27:20,968 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-05-27 00:20:59,124 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc 2021-05-27 00:21:00,534 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "size": 1, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 40.086 | 72.966 | 97.085 | 99.699 | 102.312 | 73.395 | 100.0% | 10 | | cinder_v3.create_volume | 4.347 | 16.093 | 24.663 | 25.486 | 26.308 | 16.187 | 100.0% | 10 | | nova.attach_volume | 6.472 | 17.015 | 29.22 | 30.162 | 31.104 | 18.221 | 100.0% | 10 | | nova.detach_volume | 3.97 | 5.792 | 14.637 | 14.653 | 14.67 | 7.504 | 100.0% | 10 | | cinder_v3.delete_volume | 3.028 | 8.318 | 14.639 | 17.999 | 21.358 | 9.19 | 100.0% | 10 | | nova.delete_server | 12.82 | 23.543 | 33.056 | 35.356 | 37.656 | 23.506 | 100.0% | 10 | | total | 74.613 | 151.345 | 186.147 | 189.169 | 192.19 | 148.004 | 100.0% | 10 | | -> duration | 73.613 | 150.345 | 185.147 | 188.169 | 191.19 | 147.004 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 403.523925 Full duration: 447.627034 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.946 | 6.619 | 7.743 | 7.905 | 8.067 | 6.36 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.036 | 0.041 | 0.044 | 0.046 | 0.047 | 0.041 | 100.0% | 10 | | total | 3.99 | 6.658 | 7.789 | 7.948 | 8.106 | 6.401 | 100.0% | 10 | | -> duration | 3.99 | 6.658 | 7.789 | 7.948 | 8.106 | 6.401 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.167086 Full duration: 97.628181 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 19.103 | 20.616 | 27.564 | 27.573 | 27.582 | 22.467 | 100.0% | 10 | | cinder_v3.list_volumes | 0.074 | 0.091 | 0.264 | 0.35 | 0.436 | 0.143 | 100.0% | 10 | | total | 19.52 | 20.698 | 27.687 | 27.701 | 27.715 | 22.61 | 100.0% | 10 | | -> duration | 19.52 | 20.698 | 27.687 | 27.701 | 27.715 | 22.61 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 66.271093 Full duration: 127.861675 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.874 | 9.478 | 12.9 | 12.971 | 13.042 | 9.396 | 100.0% | 10 | | cinder_v3.list_volumes | 0.066 | 0.074 | 0.093 | 0.096 | 0.098 | 0.077 | 100.0% | 10 | | total | 4.94 | 9.562 | 12.972 | 13.043 | 13.114 | 9.473 | 100.0% | 10 | | -> duration | 4.94 | 9.562 | 12.972 | 13.043 | 13.114 | 9.473 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.985095 Full duration: 71.521617 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.818 | 7.984 | 10.477 | 10.909 | 11.34 | 8.152 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 30.425 | 57.077 | 63.079 | 63.285 | 63.491 | 53.37 | 100.0% | 10 | | cinder_v3.delete_volume | 2.363 | 4.01 | 5.887 | 6.291 | 6.695 | 4.122 | 100.0% | 10 | | glance_v2.delete_image | 4.712 | 7.641 | 9.162 | 9.383 | 9.604 | 7.165 | 100.0% | 10 | | total | 44.059 | 78.364 | 83.764 | 85.816 | 87.867 | 72.81 | 100.0% | 10 | | -> duration | 44.059 | 78.364 | 83.764 | 85.816 | 87.867 | 72.81 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 204.813166 Full duration: 241.211632 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 38.168 | 48.076 | 52.362 | 52.887 | 53.412 | 46.836 | 100.0% | 10 | | cinder_v3.create_volume | 2.92 | 14.671 | 22.973 | 24.087 | 25.201 | 14.917 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.45 | 7.403 | 13.819 | 14.469 | 15.119 | 8.532 | 100.0% | 10 | | nova.attach_volume | 11.338 | 21.843 | 28.91 | 31.57 | 34.23 | 20.424 | 100.0% | 10 | | nova.detach_volume | 4.562 | 6.799 | 9.335 | 9.811 | 10.287 | 6.948 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.648 | 4.489 | 7.751 | 7.925 | 8.1 | 5.061 | 100.0% | 10 | | cinder_v3.delete_volume | 2.4 | 5.687 | 9.077 | 9.182 | 9.286 | 6.026 | 100.0% | 10 | | nova.delete_server | 11.743 | 17.648 | 21.912 | 22.983 | 24.054 | 17.546 | 100.0% | 10 | | total | 89.861 | 129.862 | 141.659 | 149.346 | 157.033 | 126.291 | 100.0% | 10 | | -> duration | 88.861 | 128.862 | 140.659 | 148.346 | 156.033 | 125.291 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 350.706348 Full duration: 399.313889 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.121 | 17.619 | 22.625 | 23.323 | 24.02 | 18.256 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.605 | 10.143 | 17.934 | 18.365 | 18.796 | 11.742 | 100.0% | 10 | | nova.boot_server | 27.45 | 57.452 | 64.927 | 65.409 | 65.891 | 52.084 | 100.0% | 10 | | nova.attach_volume | 8.431 | 24.726 | 28.606 | 29.174 | 29.742 | 22.027 | 100.0% | 10 | | nova.detach_volume | 4.404 | 6.842 | 12.545 | 14.197 | 15.849 | 8.014 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.859 | 5.907 | 15.614 | 18.137 | 20.661 | 7.819 | 100.0% | 10 | | cinder_v3.delete_volume | 2.604 | 10.881 | 15.303 | 19.922 | 24.541 | 10.27 | 100.0% | 10 | | nova.delete_server | 5.694 | 30.42 | 36.276 | 37.983 | 39.689 | 27.743 | 100.0% | 10 | | total | 88.64 | 163.449 | 194.387 | 197.797 | 201.207 | 157.955 | 100.0% | 10 | | -> duration | 87.64 | 162.449 | 193.387 | 196.797 | 200.207 | 156.955 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 435.580684 Full duration: 476.552499 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.809 | 7.148 | 14.796 | 15.23 | 15.664 | 8.663 | 100.0% | 10 | | total | 4.809 | 7.148 | 14.796 | 15.23 | 15.664 | 8.663 | 100.0% | 10 | | -> duration | 4.809 | 7.148 | 14.796 | 15.23 | 15.664 | 8.663 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.862674 Full duration: 95.524464 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.426 | 3.789 | 4.379 | 4.437 | 4.494 | 3.897 | 100.0% | 10 | | total | 3.426 | 3.789 | 4.379 | 4.437 | 4.494 | 3.897 | 100.0% | 10 | | -> duration | 3.426 | 3.789 | 4.379 | 4.437 | 4.494 | 3.897 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.28874 Full duration: 65.413051 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.629 | 0.79 | 1.088 | 1.356 | 1.623 | 0.894 | 100.0% | 10 | | total | 0.629 | 0.79 | 1.088 | 1.356 | 1.624 | 0.894 | 100.0% | 10 | | -> duration | 0.629 | 0.79 | 1.088 | 1.356 | 1.624 | 0.894 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.716091 Full duration: 152.487543 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.569 | 7.773 | 9.027 | 9.306 | 9.586 | 7.635 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.443 | 3.93 | 5.134 | 5.448 | 5.761 | 3.888 | 100.0% | 10 | | total | 9.518 | 11.703 | 13.73 | 13.772 | 13.813 | 11.523 | 100.0% | 10 | | -> duration | 9.518 | 11.703 | 13.73 | 13.772 | 13.813 | 11.523 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.691711 Full duration: 96.741125 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.626 | 9.691 | 13.944 | 14.514 | 15.084 | 9.686 | 100.0% | 10 | | cinder_v3.delete_volume | 5.289 | 6.142 | 12.249 | 12.397 | 12.544 | 7.369 | 100.0% | 10 | | total | 10.833 | 15.741 | 22.833 | 22.878 | 22.924 | 17.055 | 100.0% | 10 | | -> duration | 10.833 | 15.741 | 22.833 | 22.878 | 22.924 | 17.055 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.123435 Full duration: 78.422687 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.738 | 23.673 | 27.06 | 27.333 | 27.606 | 23.27 | 100.0% | 10 | | cinder_v3.delete_volume | 2.686 | 3.277 | 11.391 | 12.041 | 12.691 | 5.63 | 100.0% | 10 | | total | 20.726 | 29.988 | 34.613 | 35.474 | 36.336 | 28.901 | 100.0% | 10 | | -> duration | 20.726 | 29.988 | 34.613 | 35.474 | 36.336 | 28.901 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 85.057413 Full duration: 120.39311 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.644 | 9.518 | 12.021 | 12.107 | 12.194 | 9.789 | 100.0% | 10 | | cinder_v3.delete_volume | 3.41 | 9.165 | 10.397 | 11.202 | 12.007 | 8.203 | 100.0% | 10 | | total | 12.991 | 18.16 | 21.263 | 21.34 | 21.417 | 17.993 | 100.0% | 10 | | -> duration | 12.991 | 18.16 | 21.263 | 21.34 | 21.417 | 17.993 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.478551 Full duration: 91.742527 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.204 | 11.861 | 14.329 | 17.634 | 20.939 | 11.432 | 100.0% | 10 | | cinder_v3.extend_volume | 3.231 | 5.45 | 14.485 | 15.263 | 16.041 | 7.482 | 100.0% | 10 | | cinder_v3.delete_volume | 2.322 | 6.066 | 7.485 | 7.738 | 7.991 | 5.589 | 100.0% | 10 | | total | 18.785 | 22.607 | 31.343 | 31.536 | 31.729 | 24.503 | 100.0% | 10 | | -> duration | 18.785 | 22.607 | 31.343 | 31.536 | 31.729 | 24.503 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 70.845499 Full duration: 111.704024 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.345 | 11.889 | 15.034 | 15.314 | 15.594 | 11.77 | 100.0% | 10 | | cinder_v3.delete_volume | 2.527 | 8.584 | 10.156 | 10.222 | 10.288 | 7.813 | 100.0% | 10 | | total | 13.999 | 18.724 | 24.94 | 25.1 | 25.259 | 19.583 | 100.0% | 10 | | -> duration | 13.999 | 18.724 | 24.94 | 25.1 | 25.259 | 19.583 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.187518 Full duration: 132.846635 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.943 | 1.285 | 1.543 | 1.756 | 1.97 | 1.287 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.034 | 0.039 | 0.041 | 0.043 | 0.035 | 100.0% | 10 | | total | 0.974 | 1.32 | 1.582 | 1.798 | 2.013 | 1.322 | 100.0% | 10 | | -> duration | 0.974 | 1.32 | 1.582 | 1.798 | 2.013 | 1.322 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.604083 Full duration: 38.829839 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.854 | 1.669 | 3.476 | 3.506 | 3.535 | 2.093 | 100.0% | 10 | | cinder_v3.list_qos | 0.035 | 0.041 | 0.046 | 0.055 | 0.064 | 0.043 | 100.0% | 10 | | total | 0.889 | 1.721 | 3.519 | 3.549 | 3.579 | 2.136 | 100.0% | 10 | | -> duration | 0.889 | 1.721 | 3.519 | 3.549 | 3.579 | 2.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.810287 Full duration: 39.838839 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.39 | 1.719 | 2.152 | 2.259 | 2.366 | 1.718 | 100.0% | 10 | | cinder_v3.set_qos | 0.357 | 1.177 | 1.729 | 1.755 | 1.781 | 1.203 | 100.0% | 10 | | total | 2.486 | 2.872 | 3.468 | 3.514 | 3.561 | 2.922 | 100.0% | 10 | | -> duration | 2.486 | 2.872 | 3.468 | 3.514 | 3.561 | 2.922 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.984196 Full duration: 54.233808 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.718 | 1.247 | 1.461 | 1.597 | 1.733 | 1.195 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.028 | 0.037 | 0.042 | 0.049 | 0.055 | 0.038 | 100.0% | 10 | | total | 0.755 | 1.28 | 1.499 | 1.636 | 1.774 | 1.234 | 100.0% | 10 | | -> duration | 0.755 | 1.28 | 1.499 | 1.636 | 1.774 | 1.234 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.153583 Full duration: 36.668646 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.001 | 1.883 | 2.402 | 2.415 | 2.428 | 1.851 | 100.0% | 10 | | cinder_v3.list_types | 0.033 | 0.044 | 0.052 | 0.059 | 0.066 | 0.045 | 100.0% | 10 | | total | 1.04 | 1.932 | 2.452 | 2.461 | 2.471 | 1.896 | 100.0% | 10 | | -> duration | 1.04 | 1.932 | 2.452 | 2.461 | 2.471 | 1.896 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.400939 Full duration: 33.946117 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 1.134 | 1.53 | 2.829 | 2.952 | 3.075 | 1.832 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.233 | 0.701 | 1.857 | 2.182 | 2.507 | 1.057 | 100.0% | 10 | | total | 1.802 | 2.563 | 4.252 | 4.339 | 4.426 | 2.889 | 100.0% | 10 | | -> duration | 1.802 | 2.563 | 4.252 | 4.339 | 4.426 | 2.889 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.536841 Full duration: 48.104221 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.851 | 1.676 | 2.506 | 2.71 | 2.914 | 1.652 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.653 | 0.773 | 1.192 | 1.47 | 1.748 | 0.904 | 100.0% | 10 | | total | 1.506 | 2.502 | 3.308 | 3.985 | 4.662 | 2.556 | 100.0% | 10 | | -> duration | 1.506 | 2.502 | 3.308 | 3.985 | 4.662 | 2.556 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.869006 Full duration: 43.239459 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.736 | 1.118 | 1.253 | 1.27 | 1.286 | 1.092 | 100.0% | 10 | | cinder_v2.add_type_access | 0.183 | 0.518 | 0.701 | 0.719 | 0.737 | 0.506 | 100.0% | 10 | | cinder_v2.list_type_access | 0.033 | 0.046 | 0.243 | 0.243 | 0.244 | 0.102 | 100.0% | 10 | | total | 1.512 | 1.651 | 1.93 | 1.937 | 1.944 | 1.701 | 100.0% | 10 | | -> duration | 1.512 | 1.651 | 1.93 | 1.937 | 1.944 | 1.701 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.066427 Full duration: 53.30959 HINTS: * To plot HTML graphics with this data, run: rally task report d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc --out output.html * To generate a JUnit report, run: rally task export d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc --json --out output.json 2021-05-27 00:21:03,693 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d838ddd7-99c6-4ab9-8b6d-19eee04fc7fc --out /home/opnfv/functest/results/rally_full/cinder.json 2021-05-27 00:21:03,727 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-05-27 00:21:03,759 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 00:21:04,300 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-05-27 01:16:53,607 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 610e1dae-0dff-4f0e-9106-d4cb81d50cbf 2021-05-27 01:16:54,867 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 610e1dae-0dff-4f0e-9106-d4cb81d50cbf -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.667 | 12.427 | 17.949 | 18.038 | 18.126 | 13.173 | 100.0% | 10 | | heat.list_stacks | 0.054 | 0.067 | 0.073 | 0.073 | 0.073 | 0.066 | 100.0% | 10 | | total | 7.724 | 12.485 | 18.017 | 18.108 | 18.199 | 13.238 | 100.0% | 10 | | -> duration | 5.724 | 10.485 | 16.017 | 16.108 | 16.199 | 11.238 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.786697 Full duration: 110.883198 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 27.891 | 55.476 | 66.161 | 68.175 | 70.189 | 48.815 | 100.0% | 10 | | heat.update_stack | 12.063 | 38.308 | 43.57 | 43.68 | 43.79 | 33.992 | 100.0% | 10 | | heat.delete_stack | 23.167 | 39.977 | 46.92 | 47.228 | 47.537 | 38.545 | 100.0% | 10 | | total | 87.39 | 123.414 | 146.012 | 146.807 | 147.602 | 121.352 | 100.0% | 10 | | -> duration | 83.39 | 119.414 | 142.012 | 142.807 | 143.602 | 117.352 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 333.50338 Full duration: 383.459873 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 31.206 | 41.683 | 57.33 | 57.376 | 57.422 | 43.838 | 100.0% | 10 | | heat.update_stack | 9.922 | 17.623 | 25.313 | 29.772 | 34.231 | 19.864 | 100.0% | 10 | | heat.delete_stack | 10.003 | 24.756 | 39.68 | 39.9 | 40.119 | 25.624 | 100.0% | 10 | | total | 61.278 | 95.096 | 98.895 | 101.004 | 103.114 | 89.326 | 100.0% | 10 | | -> duration | 57.278 | 91.096 | 94.895 | 97.004 | 99.114 | 85.326 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 249.51569 Full duration: 295.82641 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 51.126 | 60.528 | 69.445 | 70.007 | 70.568 | 60.358 | 100.0% | 10 | | heat.update_stack | 17.761 | 57.223 | 65.993 | 68.35 | 70.706 | 52.591 | 100.0% | 10 | | heat.delete_stack | 29.362 | 51.639 | 54.812 | 55.697 | 56.583 | 48.442 | 100.0% | 10 | | total | 108.503 | 171.472 | 179.933 | 181.209 | 182.485 | 161.391 | 100.0% | 10 | | -> duration | 104.503 | 167.472 | 175.933 | 177.209 | 178.485 | 157.391 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 453.514627 Full duration: 508.743983 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 38.537 | 52.295 | 66.628 | 67.827 | 69.025 | 54.322 | 100.0% | 10 | | heat.update_stack | 22.777 | 41.468 | 50.321 | 51.322 | 52.323 | 40.316 | 100.0% | 10 | | heat.delete_stack | 17.87 | 41.368 | 53.446 | 54.02 | 54.593 | 39.515 | 100.0% | 10 | | total | 89.142 | 142.405 | 159.028 | 159.96 | 160.892 | 134.153 | 100.0% | 10 | | -> duration | 85.142 | 138.405 | 155.028 | 155.96 | 156.892 | 130.153 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 371.420832 Full duration: 428.822367 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 60.66 | 65.945 | 72.485 | 72.75 | 73.016 | 66.456 | 100.0% | 10 | | heat.update_stack | 21.782 | 58.144 | 65.547 | 66.758 | 67.969 | 53.174 | 100.0% | 10 | | heat.delete_stack | 19.68 | 51.135 | 67.827 | 68.686 | 69.546 | 50.157 | 100.0% | 10 | | total | 105.575 | 180.705 | 200.138 | 201.287 | 202.436 | 169.787 | 100.0% | 10 | | -> duration | 101.575 | 176.705 | 196.138 | 197.287 | 198.436 | 165.787 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 465.130577 Full duration: 509.55248 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.447 | 55.229 | 63.879 | 65.735 | 67.592 | 53.367 | 100.0% | 10 | | heat.update_stack | 29.919 | 42.469 | 50.254 | 51.405 | 52.556 | 42.443 | 100.0% | 10 | | heat.delete_stack | 11.47 | 24.892 | 34.912 | 35.926 | 36.94 | 25.133 | 100.0% | 10 | | total | 72.288 | 123.062 | 143.22 | 145.803 | 148.386 | 120.943 | 100.0% | 10 | | -> duration | 68.288 | 119.062 | 139.22 | 141.803 | 144.386 | 116.943 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 333.94024 Full duration: 390.0047 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 32.84 | 48.348 | 52.048 | 52.307 | 52.565 | 46.853 | 100.0% | 10 | | heat.check_stack | 3.826 | 10.861 | 14.352 | 14.473 | 14.595 | 10.309 | 100.0% | 10 | | heat.delete_stack | 8.815 | 25.201 | 30.423 | 30.446 | 30.469 | 23.894 | 100.0% | 10 | | total | 50.81 | 88.37 | 91.934 | 91.94 | 91.946 | 81.056 | 100.0% | 10 | | -> duration | 48.81 | 86.37 | 89.934 | 89.94 | 89.946 | 79.056 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 225.596 Full duration: 269.78256 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.831 | 35.373 | 40.563 | 41.123 | 41.683 | 36.301 | 100.0% | 10 | | heat.suspend_stack | 7.564 | 24.521 | 26.861 | 27.117 | 27.374 | 21.748 | 100.0% | 10 | | heat.resume_stack | 5.131 | 19.222 | 20.616 | 20.777 | 20.939 | 16.475 | 100.0% | 10 | | heat.delete_stack | 12.607 | 21.656 | 29.215 | 30.559 | 31.903 | 22.422 | 100.0% | 10 | | total | 56.924 | 101.757 | 115.534 | 117.269 | 119.004 | 96.946 | 100.0% | 10 | | -> duration | 54.924 | 99.757 | 113.534 | 115.269 | 117.004 | 94.946 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 267.980901 Full duration: 320.192311 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 610e1dae-0dff-4f0e-9106-d4cb81d50cbf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.724 | 0.903 | 1.589 | 1.612 | 1.636 | 1.1 | 100.0% | 10 | | total | 0.724 | 0.903 | 1.589 | 1.612 | 1.636 | 1.1 | 100.0% | 10 | | -> duration | 0.724 | 0.903 | 1.589 | 1.612 | 1.636 | 1.1 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.296688 Full duration: 55.593313 HINTS: * To plot HTML graphics with this data, run: rally task report 610e1dae-0dff-4f0e-9106-d4cb81d50cbf --out output.html * To generate a JUnit report, run: rally task export 610e1dae-0dff-4f0e-9106-d4cb81d50cbf --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 610e1dae-0dff-4f0e-9106-d4cb81d50cbf --json --out output.json 2021-05-27 01:16:57,863 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 610e1dae-0dff-4f0e-9106-d4cb81d50cbf --out /home/opnfv/functest/results/rally_full/heat.json 2021-05-27 01:16:57,879 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-05-27 01:16:57,908 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 01:16:58,672 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-05-27 01:29:08,921 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: a76826c8-1e50-4f19-adbe-be39aeb0d9a4 2021-05-27 01:29:10,235 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a76826c8-1e50-4f19-adbe-be39aeb0d9a4 -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.269 | 0.667 | 0.988 | 1.113 | 1.238 | 0.639 | 100.0% | 10 | | keystone_v3.add_role | 0.134 | 0.448 | 0.739 | 0.741 | 0.743 | 0.461 | 100.0% | 10 | | keystone_v3.revoke_role | 0.184 | 0.432 | 0.753 | 0.888 | 1.023 | 0.473 | 100.0% | 10 | | total | 0.894 | 1.363 | 2.302 | 2.502 | 2.702 | 1.573 | 100.0% | 10 | | -> duration | 0.894 | 1.363 | 2.302 | 2.502 | 2.702 | 1.573 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.158295 Full duration: 50.331478 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.114 | 0.665 | 1.1 | 1.231 | 1.361 | 0.675 | 100.0% | 10 | | keystone_v3.add_role | 0.079 | 0.364 | 0.533 | 0.576 | 0.619 | 0.338 | 100.0% | 10 | | keystone_v3.list_roles | 0.11 | 0.129 | 0.421 | 0.477 | 0.532 | 0.201 | 100.0% | 10 | | total | 0.315 | 1.156 | 1.613 | 1.809 | 2.006 | 1.213 | 100.0% | 10 | | -> duration | 0.315 | 1.156 | 1.613 | 1.809 | 2.006 | 1.213 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.278677 Full duration: 58.900609 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.556 | 1.01 | 1.326 | 1.417 | 1.507 | 1.035 | 100.0% | 10 | | keystone_v3.list_projects | 0.109 | 0.125 | 0.132 | 0.137 | 0.142 | 0.123 | 100.0% | 10 | | total | 0.685 | 1.132 | 1.458 | 1.554 | 1.649 | 1.158 | 100.0% | 10 | | -> duration | 0.685 | 1.132 | 1.458 | 1.554 | 1.649 | 1.158 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.279062 Full duration: 52.016085 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.163 | 1.326 | 1.775 | 2.006 | 2.238 | 1.223 | 100.0% | 10 | | keystone_v3.delete_role | 0.193 | 0.711 | 1.032 | 1.14 | 1.247 | 0.665 | 100.0% | 10 | | total | 0.395 | 2.019 | 2.75 | 2.832 | 2.913 | 1.888 | 100.0% | 10 | | -> duration | 0.395 | 2.019 | 2.75 | 2.832 | 2.913 | 1.888 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.678935 Full duration: 43.142345 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.44 | 1.664 | 2.659 | 2.67 | 2.681 | 1.627 | 100.0% | 10 | | keystone_v3.delete_service | 0.123 | 1.137 | 1.778 | 1.826 | 1.873 | 1.044 | 100.0% | 10 | | total | 0.634 | 2.722 | 4.147 | 4.298 | 4.448 | 2.671 | 100.0% | 10 | | -> duration | 0.634 | 2.722 | 4.147 | 4.298 | 4.448 | 2.671 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.12857 Full duration: 47.950189 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.375 | 0.663 | 0.962 | 0.963 | 0.964 | 0.689 | 100.0% | 10 | | keystone_v3.create_user | 0.993 | 1.474 | 2.266 | 2.33 | 2.394 | 1.521 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.042 | 0.053 | 0.144 | 0.18 | 0.215 | 0.076 | 100.0% | 10 | | -> keystone_v3.add_role | 0.24 | 0.487 | 1.281 | 1.454 | 1.627 | 0.689 | 100.0% | 10 | | keystone_v3.create_role | 0.079 | 0.332 | 1.571 | 1.572 | 1.574 | 0.607 | 100.0% | 10 | | keystone_v3.get_project | 0.032 | 0.044 | 0.131 | 0.179 | 0.228 | 0.073 | 100.0% | 10 | | keystone_v3.get_user | 0.032 | 0.037 | 0.042 | 0.043 | 0.043 | 0.037 | 100.0% | 10 | | keystone_v3.get_role | 0.029 | 0.039 | 0.218 | 0.485 | 0.751 | 0.129 | 100.0% | 10 | | keystone_v3.list_services | 0.039 | 0.064 | 0.333 | 0.463 | 0.593 | 0.151 | 100.0% | 10 | | keystone_v3.get_services | 0.033 | 0.06 | 0.339 | 0.345 | 0.351 | 0.136 | 100.0% | 10 | | total | 2.679 | 3.49 | 4.156 | 4.334 | 4.512 | 3.475 | 100.0% | 10 | | -> duration | 2.679 | 3.49 | 4.156 | 4.334 | 4.512 | 3.475 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.182299 Full duration: 81.036866 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.639 | 2.31 | 3.468 | 4.154 | 4.84 | 2.332 | 100.0% | 10 | | keystone_v3.update_project | 0.194 | 0.886 | 1.697 | 1.751 | 1.806 | 0.946 | 100.0% | 10 | | keystone_v3.delete_project | 0.519 | 0.955 | 1.556 | 1.795 | 2.034 | 1.086 | 100.0% | 10 | | total | 2.358 | 4.194 | 6.008 | 6.109 | 6.209 | 4.365 | 100.0% | 10 | | -> duration | 2.358 | 4.194 | 6.008 | 6.109 | 6.209 | 4.365 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.894059 Full duration: 49.424315 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.251 | 1.072 | 1.629 | 1.739 | 1.848 | 1.065 | 100.0% | 10 | | total | 0.507 | 1.157 | 1.899 | 1.916 | 1.933 | 1.21 | 100.0% | 10 | | -> duration | 0.507 | 1.157 | 1.899 | 1.916 | 1.933 | 1.21 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.764936 Full duration: 39.233302 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.434 | 0.974 | 1.525 | 2.46 | 3.394 | 1.159 | 100.0% | 10 | | total | 0.434 | 0.974 | 1.525 | 2.46 | 3.394 | 1.159 | 100.0% | 10 | | -> duration | 0.434 | 0.974 | 1.525 | 2.46 | 3.394 | 1.159 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.694414 Full duration: 37.563409 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.237 | 0.473 | 0.926 | 1.051 | 1.176 | 0.562 | 100.0% | 10 | | keystone_v3.list_users | 0.058 | 0.074 | 0.166 | 0.215 | 0.264 | 0.102 | 100.0% | 10 | | total | 0.378 | 0.799 | 1.252 | 1.29 | 1.328 | 0.829 | 100.0% | 10 | | -> duration | 0.378 | 0.799 | 1.252 | 1.29 | 1.328 | 0.829 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.251132 Full duration: 31.666821 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a76826c8-1e50-4f19-adbe-be39aeb0d9a4 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.234 | 0.831 | 2.731 | 2.747 | 2.763 | 1.336 | 100.0% | 10 | | keystone_v3.create_users | 14.337 | 21.499 | 28.073 | 28.156 | 28.238 | 22.273 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 14.337 | 21.499 | 28.073 | 28.155 | 28.238 | 22.272 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.522 | 1.327 | 2.148 | 2.153 | 2.157 | 1.292 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 5.229 | 8.592 | 11.243 | 12.398 | 13.552 | 8.904 | 100.0% | 10 | | total | 15.481 | 24.489 | 29.599 | 29.657 | 29.716 | 24.563 | 100.0% | 10 | | -> duration | 15.481 | 24.489 | 29.599 | 29.657 | 29.716 | 24.563 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.689716 Full duration: 202.483865 HINTS: * To plot HTML graphics with this data, run: rally task report a76826c8-1e50-4f19-adbe-be39aeb0d9a4 --out output.html * To generate a JUnit report, run: rally task export a76826c8-1e50-4f19-adbe-be39aeb0d9a4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a76826c8-1e50-4f19-adbe-be39aeb0d9a4 --json --out output.json 2021-05-27 01:29:13,412 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a76826c8-1e50-4f19-adbe-be39aeb0d9a4 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-05-27 01:29:13,434 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-05-27 01:29:13,472 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 01:29:13,932 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-05-27 01:52:58,484 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 62839534-1052-4d89-94c3-cce63daaa4d3 2021-05-27 01:52:59,785 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 62839534-1052-4d89-94c3-cce63daaa4d3 -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.624 | 4.393 | 4.852 | 4.867 | 4.882 | 4.175 | 100.0% | 10 | | neutron.update_network | 1.068 | 1.349 | 1.733 | 1.841 | 1.949 | 1.427 | 100.0% | 10 | | total | 4.258 | 5.782 | 6.09 | 6.175 | 6.259 | 5.602 | 100.0% | 10 | | -> duration | 4.258 | 5.782 | 6.09 | 6.175 | 6.259 | 5.602 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.399019 Full duration: 75.880801 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.537 | 5.016 | 11.649 | 12.098 | 12.548 | 6.228 | 100.0% | 10 | | neutron.update_port | 1.183 | 2.098 | 8.797 | 9.186 | 9.575 | 3.369 | 100.0% | 10 | | total | 5.57 | 7.907 | 14.437 | 14.575 | 14.712 | 9.597 | 100.0% | 10 | | -> duration | 5.57 | 7.907 | 14.437 | 14.575 | 14.712 | 9.597 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.768723 Full duration: 106.551712 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.236 | 3.677 | 9.847 | 9.866 | 9.884 | 5.583 | 100.0% | 10 | | neutron.create_subnet | 2.189 | 4.109 | 5.161 | 5.198 | 5.235 | 4.056 | 100.0% | 10 | | neutron.update_subnet | 0.994 | 1.486 | 2.275 | 2.37 | 2.466 | 1.561 | 100.0% | 10 | | total | 6.05 | 9.484 | 15.804 | 15.971 | 16.137 | 11.201 | 100.0% | 10 | | -> duration | 6.05 | 9.484 | 15.804 | 15.971 | 16.137 | 11.201 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.925031 Full duration: 99.261761 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.739 | 4.86 | 7.758 | 7.765 | 7.772 | 5.387 | 100.0% | 10 | | neutron.delete_network | 1.249 | 2.171 | 3.742 | 4.497 | 5.253 | 2.52 | 100.0% | 10 | | total | 4.082 | 7.713 | 11.252 | 11.266 | 11.279 | 7.907 | 100.0% | 10 | | -> duration | 4.082 | 7.713 | 11.252 | 11.266 | 11.279 | 7.907 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.422623 Full duration: 76.035059 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.803 | 6.743 | 9.769 | 11.761 | 13.754 | 7.144 | 100.0% | 10 | | neutron.delete_port | 1.349 | 2.742 | 4.569 | 4.621 | 4.673 | 2.929 | 100.0% | 10 | | total | 6.008 | 9.855 | 12.84 | 14.654 | 16.468 | 10.073 | 100.0% | 10 | | -> duration | 6.008 | 9.855 | 12.84 | 14.654 | 16.468 | 10.073 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.806518 Full duration: 128.04088 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.236 | 6.061 | 7.89 | 9.226 | 10.563 | 6.017 | 100.0% | 10 | | neutron.create_subnet | 2.271 | 4.951 | 6.363 | 6.467 | 6.57 | 4.696 | 100.0% | 10 | | neutron.delete_subnet | 1.533 | 2.301 | 3.214 | 3.259 | 3.304 | 2.326 | 100.0% | 10 | | total | 7.304 | 13.639 | 17.274 | 17.889 | 18.504 | 13.039 | 100.0% | 10 | | -> duration | 7.304 | 13.639 | 17.274 | 17.889 | 18.504 | 13.039 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.54252 Full duration: 95.875082 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.632 | 2.886 | 3.972 | 3.979 | 3.986 | 2.862 | 100.0% | 10 | | neutron.list_networks | 0.164 | 0.192 | 0.949 | 0.95 | 0.951 | 0.357 | 100.0% | 10 | | total | 1.843 | 3.165 | 4.247 | 4.548 | 4.849 | 3.219 | 100.0% | 10 | | -> duration | 1.843 | 3.165 | 4.247 | 4.548 | 4.849 | 3.219 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.059065 Full duration: 60.482305 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.805 | 4.837 | 5.929 | 5.935 | 5.941 | 4.546 | 100.0% | 10 | | neutron.list_ports | 0.107 | 0.358 | 1.957 | 2.704 | 3.452 | 0.776 | 100.0% | 10 | | total | 3.133 | 5.525 | 6.843 | 7.21 | 7.576 | 5.322 | 100.0% | 10 | | -> duration | 3.133 | 5.525 | 6.843 | 7.21 | 7.576 | 5.322 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.765903 Full duration: 98.671062 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.593 | 5.67 | 7.985 | 8.503 | 9.02 | 5.879 | 100.0% | 10 | | neutron.create_subnet | 2.345 | 4.29 | 7.088 | 7.381 | 7.674 | 4.992 | 100.0% | 10 | | neutron.list_subnets | 0.074 | 0.094 | 1.309 | 1.337 | 1.364 | 0.34 | 100.0% | 10 | | total | 7.943 | 11.454 | 13.742 | 13.911 | 14.081 | 11.211 | 100.0% | 10 | | -> duration | 7.943 | 11.454 | 13.742 | 13.911 | 14.081 | 11.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.319399 Full duration: 82.73862 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.247 | 3.962 | 5.015 | 5.258 | 5.501 | 4.036 | 100.0% | 10 | | neutron.delete_security_group | 0.413 | 1.065 | 2.058 | 2.123 | 2.187 | 1.164 | 100.0% | 10 | | total | 2.66 | 5.246 | 6.599 | 7.144 | 7.688 | 5.2 | 100.0% | 10 | | -> duration | 2.66 | 5.246 | 6.599 | 7.144 | 7.688 | 5.2 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.777616 Full duration: 63.07286 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.074 | 5.027 | 6.158 | 6.446 | 6.734 | 4.716 | 100.0% | 10 | | neutron.create_security_group_rule | 1.107 | 2.459 | 3.582 | 3.971 | 4.361 | 2.573 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.196 | 0.409 | 1.412 | 1.669 | 1.925 | 0.63 | 100.0% | 10 | | neutron.delete_security_group | 0.219 | 0.566 | 0.713 | 0.752 | 0.791 | 0.513 | 100.0% | 10 | | total | 4.081 | 8.063 | 11.164 | 11.166 | 11.167 | 8.432 | 100.0% | 10 | | -> duration | 4.081 | 8.063 | 11.164 | 11.166 | 11.167 | 8.432 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.240561 Full duration: 77.665351 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.681 | 5.608 | 12.445 | 13.87 | 15.295 | 7.129 | 100.0% | 10 | | neutron.create_security_group_rule | 1.126 | 4.816 | 8.269 | 11.233 | 14.197 | 5.6 | 100.0% | 10 | | neutron.list_security_group_rules | 0.077 | 0.494 | 2.284 | 2.294 | 2.304 | 0.986 | 100.0% | 10 | | total | 6.366 | 11.842 | 21.866 | 23.339 | 24.811 | 13.715 | 100.0% | 10 | | -> duration | 6.366 | 11.842 | 21.866 | 23.339 | 24.811 | 13.715 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.656237 Full duration: 115.27878 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.397 | 4.158 | 5.646 | 5.739 | 5.832 | 4.048 | 100.0% | 10 | | neutron.show_security_group | 0.06 | 0.083 | 0.109 | 0.13 | 0.151 | 0.09 | 100.0% | 10 | | total | 1.481 | 4.25 | 5.717 | 5.827 | 5.937 | 4.138 | 100.0% | 10 | | -> duration | 1.481 | 4.25 | 5.717 | 5.827 | 5.937 | 4.138 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.342446 Full duration: 85.357341 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 38.966817 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 62839534-1052-4d89-94c3-cce63daaa4d3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 8.202 | 16.558 | 18.511 | 18.622 | 18.733 | 14.897 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.311 | 0.731 | 2.134 | 3.153 | 4.172 | 1.159 | 100.0% | 10 | | total | 8.96 | 17.471 | 19.542 | 19.736 | 19.929 | 16.056 | 100.0% | 10 | | -> duration | 8.96 | 17.471 | 19.542 | 19.736 | 19.929 | 16.056 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.50591 Full duration: 176.808964 HINTS: * To plot HTML graphics with this data, run: rally task report 62839534-1052-4d89-94c3-cce63daaa4d3 --out output.html * To generate a JUnit report, run: rally task export 62839534-1052-4d89-94c3-cce63daaa4d3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 62839534-1052-4d89-94c3-cce63daaa4d3 --json --out output.json At least one workload did not pass SLA criteria. 2021-05-27 01:53:02,985 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 62839534-1052-4d89-94c3-cce63daaa4d3 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-05-27 01:53:03,007 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-05-27 01:53:03,047 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 01:53:03,521 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-05-27 03:10:42,719 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 7ab6de79-c085-4c03-9083-2e951bc53ecd 2021-05-27 03:10:44,041 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7ab6de79-c085-4c03-9083-2e951bc53ecd -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.591 | 2.917 | 3.641 | 4.355 | 5.069 | 2.901 | 100.0% | 10 | | nova.delete_keypair | 1.801 | 2.179 | 3.166 | 3.673 | 4.18 | 2.397 | 100.0% | 10 | | total | 3.812 | 4.909 | 7.277 | 7.7 | 8.123 | 5.298 | 100.0% | 10 | | -> duration | 3.812 | 4.909 | 7.277 | 7.7 | 8.123 | 5.298 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.300083 Full duration: 73.586312 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 2.528 | 5.891 | 6.426 | 6.512 | 6.597 | 5.293 | 100.0% | 10 | | nova.list_keypairs | 0.034 | 0.042 | 0.05 | 0.055 | 0.06 | 0.043 | 100.0% | 10 | | total | 2.568 | 5.941 | 6.473 | 6.553 | 6.633 | 5.336 | 100.0% | 10 | | -> duration | 2.568 | 5.941 | 6.473 | 6.553 | 6.633 | 5.336 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.651554 Full duration: 70.960307 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 60.912 | 95.157 | 109.367 | 119.032 | 128.698 | 93.106 | 100.0% | 10 | | nova.reboot_server | 19.091 | 38.372 | 57.057 | 57.284 | 57.51 | 38.239 | 100.0% | 10 | | nova.soft_reboot_server | 15.468 | 142.858 | 153.039 | 157.662 | 162.284 | 98.048 | 100.0% | 10 | | nova.stop_and_start_server | 18.482 | 29.302 | 51.253 | 64.289 | 77.324 | 35.636 | 100.0% | 10 | | -> nova.stop_server | 9.495 | 14.711 | 27.479 | 47.589 | 67.7 | 20.294 | 100.0% | 10 | | -> nova.start_server | 8.987 | 11.1 | 24.851 | 25.817 | 26.782 | 15.343 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 18.575 | 28.698 | 83.254 | 87.987 | 92.72 | 43.289 | 100.0% | 10 | | -> nova.rescue_server | 10.28 | 15.968 | 71.32 | 72.679 | 74.037 | 31.364 | 100.0% | 10 | | -> nova.unrescue_server | 5.591 | 10.599 | 18.141 | 18.412 | 18.683 | 11.925 | 100.0% | 10 | | nova.delete_server | 13.743 | 20.199 | 36.922 | 37.063 | 37.204 | 23.867 | 100.0% | 10 | | total | 170.312 | 363.372 | 470.922 | 471.162 | 471.403 | 332.247 | 100.0% | 10 | | -> duration | 161.312 | 354.372 | 461.922 | 462.162 | 462.403 | 323.247 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 853.105871 Full duration: 931.756945 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 51.913 | 62.148 | 76.911 | 79.689 | 82.468 | 64.727 | 100.0% | 10 | | nova.delete_server | 14.202 | 29.376 | 36.371 | 36.498 | 36.624 | 28.186 | 100.0% | 10 | | total | 74.925 | 95.949 | 107.697 | 108.884 | 110.071 | 92.913 | 100.0% | 10 | | -> duration | 73.925 | 94.949 | 106.697 | 107.884 | 109.071 | 91.913 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 262.612004 Full duration: 329.195524 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 47.53 | 70.365 | 86.977 | 89.028 | 91.078 | 69.455 | 100.0% | 10 | | nova.list_servers | 0.386 | 0.408 | 0.488 | 0.605 | 0.722 | 0.443 | 100.0% | 10 | | total | 47.929 | 70.784 | 87.407 | 89.604 | 91.8 | 69.898 | 100.0% | 10 | | -> duration | 46.929 | 69.784 | 86.407 | 88.604 | 90.8 | 68.898 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 194.064728 Full duration: 352.592777 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "from_image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "to_image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 47.302 | 87.993 | 108.887 | 111.068 | 113.248 | 84.731 | 100.0% | 10 | | nova.rebuild_server | 16.339 | 30.742 | 36.347 | 37.302 | 38.257 | 28.545 | 100.0% | 10 | | nova.delete_server | 13.816 | 21.497 | 30.169 | 33.596 | 37.023 | 22.215 | 100.0% | 10 | | total | 93.512 | 141.52 | 155.7 | 158.643 | 161.587 | 135.491 | 100.0% | 10 | | -> duration | 91.512 | 139.52 | 153.7 | 156.643 | 159.587 | 133.491 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 381.230905 Full duration: 475.474997 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 135.486 | 174.838 | 194.811 | 197.674 | 200.537 | 172.389 | 100.0% | 10 | | nova.snapshot_server | 33.377 | 45.259 | 54.235 | 55.873 | 57.512 | 45.686 | 100.0% | 10 | | -> glance_v2.get_image | 0.07 | 0.099 | 0.125 | 0.149 | 0.173 | 0.102 | 100.0% | 10 | | -> glance.wait_for_image | 28.659 | 34.779 | 43.074 | 43.138 | 43.201 | 36.065 | 100.0% | 10 | | --> glance_v2.get_image (x18) | 0.732 | 0.738 | 0.743 | 0.744 | 0.744 | 0.738 | 100.0% | 2 | | --> glance_v2.get_image (x17) | 0.706 | 0.729 | 0.823 | 0.835 | 0.847 | 0.761 | 100.0% | 3 | | --> glance_v2.get_image (x20) | 0.825 | 0.843 | 0.857 | 0.859 | 0.86 | 0.843 | 100.0% | 2 | | --> glance_v2.get_image (x22) | 1.01 | 1.083 | 1.142 | 1.149 | 1.156 | 1.083 | 100.0% | 2 | | --> glance_v2.get_image (x15) | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 100.0% | 1 | | nova.delete_server (x2) | 36.652 | 64.975 | 76.658 | 79.306 | 81.953 | 62.593 | 100.0% | 10 | | nova.delete_image | 5.052 | 11.321 | 16.188 | 19.634 | 23.081 | 11.684 | 100.0% | 10 | | -> glance_v2.delete_image | 5.004 | 11.275 | 16.046 | 19.411 | 22.777 | 11.604 | 100.0% | 10 | | -> glance.wait_for_delete | 0.037 | 0.045 | 0.141 | 0.221 | 0.302 | 0.078 | 100.0% | 10 | | --> glance_v2.get_image | 0.037 | 0.045 | 0.141 | 0.221 | 0.302 | 0.078 | 0.0% | 10 | | total | 210.705 | 305.0 | 322.442 | 331.023 | 339.604 | 292.351 | 100.0% | 10 | | -> duration | 208.705 | 303.0 | 320.442 | 329.023 | 337.604 | 290.351 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 821.068444 Full duration: 882.1403 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "volume_size": 1, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 33.329 | 47.641 | 70.799 | 73.393 | 75.986 | 52.823 | 100.0% | 10 | | nova.boot_server | 44.245 | 126.633 | 147.3 | 151.886 | 156.472 | 112.749 | 100.0% | 10 | | total | 103.683 | 173.987 | 193.954 | 199.207 | 204.461 | 165.573 | 100.0% | 10 | | -> duration | 102.683 | 172.987 | 192.954 | 198.207 | 203.461 | 164.573 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 464.920675 Full duration: 685.702737 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 51.008 | 90.129 | 120.907 | 124.975 | 129.042 | 92.257 | 100.0% | 10 | | total | 51.008 | 90.129 | 120.907 | 124.975 | 129.042 | 92.257 | 100.0% | 10 | | -> duration | 50.008 | 89.129 | 119.907 | 123.975 | 128.042 | 91.257 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 251.865211 Full duration: 413.76515 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 45.43395 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "image": { "name": "rally_full-img_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "to_flavor": { "name": "rally_full-flavor_alt_c4986cab-c229-47d8-93bb-87467b6e2f9f" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "49529cc5-8ace-4c99-af85-6c6474aff820" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7ab6de79-c085-4c03-9083-2e951bc53ecd has 5 error(s) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-d0056d6b-49fc-496f-8b0b-f70c0cb2d11f) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-d0056d6b-49fc-496f-8b0b-f70c0cb2d11f) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-db3d3f08-db12-4d73-9f58-2cb6508c133c) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-db3d3f08-db12-4d73-9f58-2cb6508c133c) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-94aa8749-fb82-46a6-b439-17c6647172d2) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-94aa8749-fb82-46a6-b439-17c6647172d2) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-c5269a19-f06a-4c22-98c3-51833891acd9) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-c5269a19-f06a-4c22-98c3-51833891acd9) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-f98a8597-fc1b-4fe5-a36b-bd2b6964531d) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-f98a8597-fc1b-4fe5-a36b-bd2b6964531d) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 64.583 | 102.904 | 120.235 | 123.031 | 125.826 | 100.702 | 100.0% | 5 | | nova.resize | 15.081 | 39.127 | 43.358 | 43.594 | 43.831 | 35.837 | 0.0% | 5 | | total | 79.664 | 145.553 | 162.184 | 165.921 | 169.657 | 136.54 | 0.0% | 5 | | -> duration | 78.664 | 144.553 | 161.184 | 164.921 | 168.657 | 135.54 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 215.542617 Full duration: 324.630101 HINTS: * To plot HTML graphics with this data, run: rally task report 7ab6de79-c085-4c03-9083-2e951bc53ecd --out output.html * To generate a JUnit report, run: rally task export 7ab6de79-c085-4c03-9083-2e951bc53ecd --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7ab6de79-c085-4c03-9083-2e951bc53ecd --json --out output.json At least one workload did not pass SLA criteria. 2021-05-27 03:10:47,109 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7ab6de79-c085-4c03-9083-2e951bc53ecd --out /home/opnfv/functest/results/rally_full/nova.json 2021-05-27 03:10:47,132 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-05-27 03:10:47,160 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 03:10:47,611 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-05-27 03:14:14,820 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 2021-05-27 03:14:16,059 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 -------------------------------------------------------------------------------- Task 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.035 | 3.719 | 4.822 | 4.972 | 5.123 | 3.41 | 100.0% | 10 | | quotas.delete_quotas | 0.036 | 0.906 | 1.777 | 2.096 | 2.415 | 0.957 | 100.0% | 10 | | total | 1.223 | 4.66 | 5.384 | 5.701 | 6.018 | 4.366 | 100.0% | 10 | | -> duration | 1.223 | 4.66 | 5.384 | 5.701 | 6.018 | 4.366 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.317282 Full duration: 62.07934 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.217 | 2.415 | 3.715 | 3.794 | 3.873 | 2.602 | 100.0% | 10 | | total | 1.217 | 2.415 | 3.715 | 3.794 | 3.873 | 2.602 | 100.0% | 10 | | -> duration | 1.217 | 2.415 | 3.715 | 3.794 | 3.873 | 2.602 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.209384 Full duration: 52.013079 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 11.584 | 12.473 | 17.364 | 17.393 | 17.423 | 13.71 | 100.0% | 10 | | total | 11.584 | 12.474 | 17.364 | 17.394 | 17.423 | 13.71 | 100.0% | 10 | | -> duration | 11.584 | 12.474 | 17.364 | 17.394 | 17.423 | 13.71 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.202092 Full duration: 73.856076 HINTS: * To plot HTML graphics with this data, run: rally task report 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 --out output.html * To generate a JUnit report, run: rally task export 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 --json --out output.json 2021-05-27 03:14:19,030 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7fc3c537-5d5e-4d88-9bb4-8da03c108cc2 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-05-27 03:14:19,036 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-05-27 03:14:19,069 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-27 03:14:19,244 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-05-27 03:25:04,482 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 9ac1389f-31c1-44e2-8f2a-8f5ca404098d 2021-05-27 03:25:05,702 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 9ac1389f-31c1-44e2-8f2a-8f5ca404098d -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.908 | 1.071 | 1.321 | 1.602 | 1.883 | 1.162 | 100.0% | 10 | | swift.upload_object (x2) | 1.002 | 1.114 | 1.167 | 1.167 | 1.168 | 1.101 | 100.0% | 10 | | swift.list_objects | 0.982 | 1.041 | 1.068 | 1.068 | 1.068 | 1.036 | 100.0% | 10 | | total | 2.896 | 3.277 | 3.455 | 3.773 | 4.091 | 3.3 | 100.0% | 10 | | -> duration | 2.896 | 3.277 | 3.455 | 3.773 | 4.091 | 3.3 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.049953 Full duration: 137.07396 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.38 | 1.431 | 1.639 | 1.655 | 1.671 | 1.476 | 100.0% | 10 | | swift.list_objects | 0.966 | 1.007 | 1.047 | 1.049 | 1.05 | 1.009 | 100.0% | 10 | | total | 2.364 | 2.436 | 2.637 | 2.678 | 2.719 | 2.485 | 100.0% | 10 | | -> duration | 2.364 | 2.436 | 2.637 | 2.678 | 2.719 | 2.485 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.910077 Full duration: 89.450336 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.977 | 1.101 | 1.241 | 1.242 | 1.243 | 1.117 | 100.0% | 10 | | swift.upload_object (x5) | 2.517 | 2.705 | 2.747 | 2.765 | 2.784 | 2.686 | 100.0% | 10 | | swift.download_object (x5) | 2.411 | 2.472 | 2.563 | 2.582 | 2.6 | 2.49 | 100.0% | 10 | | total | 6.081 | 6.316 | 6.464 | 6.496 | 6.527 | 6.295 | 100.0% | 10 | | -> duration | 6.081 | 6.316 | 6.464 | 6.496 | 6.527 | 6.295 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.012074 Full duration: 151.444654 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.943 | 1.081 | 1.202 | 1.204 | 1.206 | 1.09 | 100.0% | 10 | | swift.upload_object (x5) | 2.467 | 2.551 | 2.636 | 2.685 | 2.734 | 2.572 | 100.0% | 10 | | swift.delete_object (x5) | 2.207 | 2.461 | 2.525 | 2.57 | 2.615 | 2.419 | 100.0% | 10 | | swift.delete_container | 0.49 | 0.54 | 0.594 | 0.609 | 0.624 | 0.55 | 100.0% | 10 | | total | 6.385 | 6.651 | 6.769 | 6.781 | 6.793 | 6.633 | 100.0% | 10 | | -> duration | 6.385 | 6.651 | 6.769 | 6.781 | 6.793 | 6.633 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 66.382757 Full duration: 126.685761 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9ac1389f-31c1-44e2-8f2a-8f5ca404098d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.341 | 1.499 | 1.535 | 1.587 | 1.638 | 1.49 | 100.0% | 10 | | swift.list_objects | 0.926 | 1.038 | 1.049 | 1.06 | 1.071 | 1.023 | 100.0% | 10 | | swift.download_object (x5) | 2.491 | 2.57 | 2.607 | 2.623 | 2.639 | 2.567 | 100.0% | 10 | | total | 4.943 | 5.13 | 5.164 | 5.165 | 5.167 | 5.08 | 100.0% | 10 | | -> duration | 4.943 | 5.13 | 5.164 | 5.165 | 5.167 | 5.08 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.858068 Full duration: 113.450408 HINTS: * To plot HTML graphics with this data, run: rally task report 9ac1389f-31c1-44e2-8f2a-8f5ca404098d --out output.html * To generate a JUnit report, run: rally task export 9ac1389f-31c1-44e2-8f2a-8f5ca404098d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 9ac1389f-31c1-44e2-8f2a-8f5ca404098d --json --out output.json 2021-05-27 03:25:08,778 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 9ac1389f-31c1-44e2-8f2a-8f5ca404098d --out /home/opnfv/functest/results/rally_full/swift.json 2021-05-27 03:25:08,792 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-05-27 03:25:08,796 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:43 | 50 | 100.00% | | glance | 00:11:04 | 40 | 90.00% | | cinder | 00:52:35 | 240 | 100.00% | | heat | 00:54:32 | 100 | 100.00% | | keystone | 00:11:33 | 110 | 100.00% | | neutron | 00:23:00 | 140 | 100.00% | | nova | 01:16:25 | 95 | 94.74% | | quotas | 00:03:07 | 30 | 100.00% | | swift | 00:10:18 | 50 | 100.00% | | | | | | | TOTAL: | 04:05:21 | 855 | 98.95% | +----------------+------------+----------------+-----------+ 2021-05-27 03:25:08,796 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.95% in 5/9 modules 2021-05-27 03:25:12,611 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-05-27 03:25:16,075 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-05-27 03:25:16,076 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 253:02 | FAIL | +--------------------+------------------+------------------+----------------+