2021-03-20 15:30:45,884 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | 1NB8LDRXOM6L | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/1NB8LDRXOM6L/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-204 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/1NB8LDRXOM6L/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-204 | +-------------------------+------------------------------------------------------------+ 2021-03-20 15:30:45,903 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-03-20 15:30:49,142 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-03-20 15:30:55,534 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-03-20 15:31:02,180 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | fe09d173-38d1-4e9d-bc77-a100c15e05ef | 2021-03-20T15:31:01.919577 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: fe09d173-38d1-4e9d-bc77-a100c15e05ef ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-03-20 15:31:07,041 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-03-20 15:31:08,589 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 15:31:09,016 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-03-20 15:34:04,241 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: c44cc843-17d6-47b2-9dc1-b58913898c6b 2021-03-20 15:34:05,504 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c44cc843-17d6-47b2-9dc1-b58913898c6b -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.871 | 1.284 | 1.904 | 1.924 | 1.945 | 1.369 | 100.0% | 10 | | total | 0.871 | 1.284 | 1.904 | 1.924 | 1.945 | 1.369 | 100.0% | 10 | | -> duration | 0.871 | 1.284 | 1.904 | 1.924 | 1.945 | 1.369 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.084147 Full duration: 24.87104 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.15 | 0.174 | 0.356 | 0.37 | 0.384 | 0.225 | 100.0% | 10 | | total | 0.638 | 1.046 | 1.231 | 1.297 | 1.364 | 1.011 | 100.0% | 10 | | -> duration | 0.638 | 1.046 | 1.231 | 1.297 | 1.364 | 1.011 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.93458 Full duration: 27.681512 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.22 | 0.312 | 0.764 | 0.78 | 0.796 | 0.393 | 100.0% | 10 | | total | 0.669 | 1.121 | 2.284 | 2.354 | 2.423 | 1.292 | 100.0% | 10 | | -> duration | 0.669 | 1.121 | 2.284 | 2.354 | 2.423 | 1.292 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.495872 Full duration: 32.400816 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.162 | 0.3 | 0.515 | 0.519 | 0.524 | 0.326 | 100.0% | 10 | | total | 0.613 | 1.023 | 1.115 | 1.142 | 1.168 | 0.944 | 100.0% | 10 | | -> duration | 0.613 | 1.023 | 1.115 | 1.142 | 1.168 | 0.944 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.778199 Full duration: 23.529289 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.369 | 0.606 | 1.089 | 1.227 | 1.365 | 0.707 | 100.0% | 10 | | total | 0.807 | 1.205 | 1.787 | 1.797 | 1.806 | 1.261 | 100.0% | 10 | | -> duration | 0.807 | 1.205 | 1.787 | 1.797 | 1.806 | 1.261 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.460075 Full duration: 21.305055 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c44cc843-17d6-47b2-9dc1-b58913898c6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.16 | 0.224 | 0.424 | 0.44 | 0.456 | 0.274 | 100.0% | 10 | | total | 0.6 | 0.9 | 1.175 | 1.175 | 1.175 | 0.912 | 100.0% | 10 | | -> duration | 0.6 | 0.9 | 1.175 | 1.175 | 1.175 | 0.912 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.567507 Full duration: 24.882079 HINTS: * To plot HTML graphics with this data, run: rally task report c44cc843-17d6-47b2-9dc1-b58913898c6b --out output.html * To generate a JUnit report, run: rally task export c44cc843-17d6-47b2-9dc1-b58913898c6b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c44cc843-17d6-47b2-9dc1-b58913898c6b --json --out output.json 2021-03-20 15:34:08,488 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c44cc843-17d6-47b2-9dc1-b58913898c6b --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-03-20 15:34:08,497 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-03-20 15:34:08,528 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 15:34:08,704 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-03-20 15:40:46,080 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: a3b3441a-2c02-4d7e-8dc5-341817aef7a6 2021-03-20 15:40:47,312 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a3b3441a-2c02-4d7e-8dc5-341817aef7a6 -------------------------------------------------------------------------------- Task a3b3441a-2c02-4d7e-8dc5-341817aef7a6: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3b3441a-2c02-4d7e-8dc5-341817aef7a6 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.934 | 5.667 | 6.51 | 6.512 | 6.513 | 5.737 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.099 | 0.13 | 0.151 | 0.172 | 0.194 | 0.131 | 100.0% | 10 | | -> glance_v2.upload_data | 2.447 | 2.964 | 3.685 | 3.723 | 3.762 | 3.065 | 100.0% | 10 | | glance_v2.delete_image | 1.65 | 2.263 | 2.664 | 2.741 | 2.819 | 2.222 | 100.0% | 10 | | total | 6.891 | 7.951 | 8.885 | 9.108 | 9.33 | 7.958 | 100.0% | 10 | | -> duration | 6.891 | 7.951 | 8.885 | 9.108 | 9.33 | 7.958 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.74384 Full duration: 53.276668 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3b3441a-2c02-4d7e-8dc5-341817aef7a6 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.617 | 7.936 | 10.045 | 10.586 | 11.128 | 8.259 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.091 | 0.103 | 0.111 | 0.111 | 0.111 | 0.103 | 100.0% | 10 | | -> glance_v2.upload_data | 2.603 | 3.827 | 4.916 | 5.066 | 5.215 | 3.831 | 100.0% | 10 | | glance_v2.list_images | 0.054 | 0.058 | 0.113 | 0.117 | 0.12 | 0.072 | 100.0% | 10 | | total | 6.671 | 7.997 | 10.105 | 10.661 | 11.217 | 8.332 | 100.0% | 10 | | -> duration | 6.671 | 7.997 | 10.105 | 10.661 | 11.217 | 8.332 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.738907 Full duration: 60.723451 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3b3441a-2c02-4d7e-8dc5-341817aef7a6 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.154 | 0.167 | 0.409 | 0.464 | 0.519 | 0.232 | 100.0% | 10 | | total | 0.154 | 0.167 | 0.409 | 0.464 | 0.519 | 0.233 | 100.0% | 10 | | -> duration | 0.154 | 0.167 | 0.409 | 0.464 | 0.519 | 0.233 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.754695 Full duration: 25.306712 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3b3441a-2c02-4d7e-8dc5-341817aef7a6 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.357 | 6.431 | 9.027 | 10.306 | 11.585 | 7.09 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.098 | 0.106 | 0.114 | 0.117 | 0.119 | 0.106 | 100.0% | 9 | | -> glance_v2.upload_data | 2.351 | 3.667 | 5.38 | 6.799 | 8.218 | 4.016 | 100.0% | 9 | | nova.boot_servers | 11.254 | 61.733 | 67.854 | 69.99 | 72.126 | 51.593 | 55.6% | 9 | | total | 19.642 | 68.507 | 74.621 | 76.589 | 78.557 | 58.683 | 55.6% | 9 | | -> duration | 18.642 | 67.507 | 73.621 | 75.589 | 77.557 | 57.683 | 55.6% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 55.6% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 154.667183 Full duration: 230.107508 HINTS: * To plot HTML graphics with this data, run: rally task report a3b3441a-2c02-4d7e-8dc5-341817aef7a6 --out output.html * To generate a JUnit report, run: rally task export a3b3441a-2c02-4d7e-8dc5-341817aef7a6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a3b3441a-2c02-4d7e-8dc5-341817aef7a6 --json --out output.json At least one workload did not pass SLA criteria. 2021-03-20 15:40:50,236 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a3b3441a-2c02-4d7e-8dc5-341817aef7a6 --out /home/opnfv/functest/results/rally_full/glance.json 2021-03-20 15:40:50,248 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-03-20 15:40:50,292 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 15:40:50,773 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-03-20 16:19:34,375 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 601b9929-a4ff-4441-b456-f3f0e8c58eb7 2021-03-20 16:19:35,696 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 601b9929-a4ff-4441-b456-f3f0e8c58eb7 -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "size": 1, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 16.444 | 35.865 | 45.558 | 45.624 | 45.69 | 34.942 | 100.0% | 10 | | cinder_v3.create_volume | 5.08 | 6.358 | 9.479 | 10.5 | 11.522 | 6.988 | 100.0% | 10 | | nova.attach_volume | 8.032 | 11.755 | 17.207 | 19.474 | 21.741 | 12.427 | 100.0% | 10 | | nova.detach_volume | 3.754 | 4.514 | 4.797 | 5.31 | 5.823 | 4.516 | 100.0% | 10 | | cinder_v3.delete_volume | 2.455 | 2.961 | 4.694 | 4.744 | 4.795 | 3.414 | 100.0% | 10 | | nova.delete_server | 5.692 | 8.55 | 10.977 | 12.065 | 13.153 | 8.377 | 100.0% | 10 | | total | 52.078 | 72.607 | 77.544 | 83.527 | 89.51 | 70.665 | 100.0% | 10 | | -> duration | 51.078 | 71.607 | 76.544 | 82.527 | 88.51 | 69.665 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 203.658156 Full duration: 243.33931 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.61 | 4.873 | 7.194 | 7.414 | 7.635 | 5.205 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.036 | 0.041 | 0.044 | 0.046 | 0.048 | 0.041 | 100.0% | 10 | | total | 3.653 | 4.918 | 7.235 | 7.457 | 7.678 | 5.246 | 100.0% | 10 | | -> duration | 3.653 | 4.918 | 7.235 | 7.457 | 7.678 | 5.246 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.818495 Full duration: 75.174422 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 13.148 | 16.391 | 17.255 | 17.256 | 17.257 | 15.89 | 100.0% | 10 | | cinder_v3.list_volumes | 0.067 | 0.074 | 0.113 | 0.143 | 0.174 | 0.089 | 100.0% | 10 | | total | 13.226 | 16.48 | 17.323 | 17.327 | 17.332 | 15.979 | 100.0% | 10 | | -> duration | 13.226 | 16.48 | 17.323 | 17.327 | 17.332 | 15.979 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.328204 Full duration: 89.303387 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.033 | 5.689 | 7.286 | 7.319 | 7.352 | 5.723 | 100.0% | 10 | | cinder_v3.list_volumes | 0.067 | 0.072 | 0.087 | 0.092 | 0.098 | 0.075 | 100.0% | 10 | | total | 4.101 | 5.761 | 7.364 | 7.392 | 7.419 | 5.799 | 100.0% | 10 | | -> duration | 4.101 | 5.761 | 7.364 | 7.392 | 7.419 | 5.799 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.656539 Full duration: 53.706017 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.991 | 5.623 | 7.939 | 8.015 | 8.09 | 5.543 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 36.198 | 60.747 | 64.05 | 64.186 | 64.322 | 56.44 | 100.0% | 10 | | cinder_v3.delete_volume | 2.283 | 2.772 | 5.862 | 6.702 | 7.543 | 3.522 | 100.0% | 10 | | glance_v2.delete_image | 5.42 | 6.256 | 10.345 | 10.846 | 11.346 | 7.451 | 100.0% | 10 | | total | 48.454 | 78.939 | 81.257 | 81.297 | 81.337 | 72.956 | 100.0% | 10 | | -> duration | 48.454 | 78.939 | 81.257 | 81.297 | 81.337 | 72.956 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 206.968831 Full duration: 238.14278 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 29.145 | 37.514 | 41.298 | 42.779 | 44.259 | 36.902 | 100.0% | 10 | | cinder_v3.create_volume | 3.845 | 7.376 | 12.934 | 13.237 | 13.539 | 7.662 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.005 | 6.435 | 10.185 | 10.334 | 10.482 | 7.067 | 100.0% | 10 | | nova.attach_volume | 5.89 | 12.768 | 18.983 | 19.211 | 19.439 | 13.139 | 100.0% | 10 | | nova.detach_volume | 3.842 | 4.887 | 7.727 | 8.007 | 8.288 | 5.468 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.238 | 4.406 | 7.622 | 8.119 | 8.615 | 5.066 | 100.0% | 10 | | cinder_v3.delete_volume | 2.573 | 5.558 | 8.821 | 9.781 | 10.741 | 5.96 | 100.0% | 10 | | nova.delete_server | 8.154 | 13.574 | 19.254 | 21.149 | 23.044 | 14.159 | 100.0% | 10 | | total | 74.876 | 95.701 | 110.294 | 110.625 | 110.956 | 95.424 | 100.0% | 10 | | -> duration | 73.876 | 94.701 | 109.294 | 109.625 | 109.956 | 94.424 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 278.617408 Full duration: 319.992026 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.621 | 9.749 | 14.885 | 15.355 | 15.825 | 10.368 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.496 | 5.186 | 7.824 | 8.053 | 8.281 | 5.204 | 100.0% | 10 | | nova.boot_server | 21.27 | 35.815 | 62.873 | 62.969 | 63.064 | 43.005 | 100.0% | 10 | | nova.attach_volume | 5.91 | 11.872 | 18.004 | 21.62 | 25.235 | 12.501 | 100.0% | 10 | | nova.detach_volume | 3.795 | 4.61 | 5.663 | 6.038 | 6.413 | 4.761 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.329 | 4.566 | 5.173 | 5.357 | 5.541 | 4.404 | 100.0% | 10 | | cinder_v3.delete_volume | 2.659 | 4.633 | 6.214 | 6.591 | 6.969 | 4.686 | 100.0% | 10 | | nova.delete_server | 6.024 | 12.472 | 16.084 | 16.694 | 17.303 | 12.521 | 100.0% | 10 | | total | 59.482 | 86.361 | 130.757 | 130.787 | 130.818 | 97.451 | 100.0% | 10 | | -> duration | 58.482 | 85.361 | 129.757 | 129.787 | 129.818 | 96.451 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 272.367291 Full duration: 315.451544 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.754 | 8.0 | 15.295 | 16.933 | 18.571 | 9.714 | 100.0% | 10 | | total | 3.754 | 8.0 | 15.295 | 16.933 | 18.571 | 9.715 | 100.0% | 10 | | -> duration | 3.754 | 8.0 | 15.295 | 16.933 | 18.571 | 9.715 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.440198 Full duration: 79.827998 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.12 | 7.064 | 8.834 | 9.252 | 9.669 | 7.347 | 100.0% | 10 | | total | 6.121 | 7.064 | 8.834 | 9.252 | 9.669 | 7.348 | 100.0% | 10 | | -> duration | 6.121 | 7.064 | 8.834 | 9.252 | 9.669 | 7.348 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.115588 Full duration: 66.65792 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.631 | 0.738 | 1.83 | 1.835 | 1.841 | 0.984 | 100.0% | 10 | | total | 0.631 | 0.738 | 1.83 | 1.836 | 1.841 | 0.984 | 100.0% | 10 | | -> duration | 0.631 | 0.738 | 1.83 | 1.836 | 1.841 | 0.984 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.686783 Full duration: 82.657157 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.896 | 5.485 | 7.16 | 7.334 | 7.508 | 5.651 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.213 | 2.578 | 5.034 | 5.228 | 5.421 | 3.283 | 100.0% | 10 | | total | 6.322 | 8.92 | 11.085 | 11.379 | 11.674 | 8.934 | 100.0% | 10 | | -> duration | 6.322 | 8.92 | 11.085 | 11.379 | 11.674 | 8.934 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.675669 Full duration: 74.561006 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.349 | 5.426 | 6.919 | 7.244 | 7.568 | 5.392 | 100.0% | 10 | | cinder_v3.delete_volume | 2.538 | 3.347 | 4.725 | 5.316 | 5.907 | 3.541 | 100.0% | 10 | | total | 5.897 | 9.463 | 10.374 | 10.471 | 10.568 | 8.933 | 100.0% | 10 | | -> duration | 5.897 | 9.463 | 10.374 | 10.471 | 10.568 | 8.933 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.70615 Full duration: 56.818763 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.64 | 17.737 | 20.033 | 20.232 | 20.432 | 17.847 | 100.0% | 10 | | cinder_v3.delete_volume | 2.963 | 3.688 | 5.063 | 5.402 | 5.742 | 3.843 | 100.0% | 10 | | total | 18.603 | 21.551 | 23.2 | 24.31 | 25.419 | 21.691 | 100.0% | 10 | | -> duration | 18.603 | 21.551 | 23.2 | 24.31 | 25.419 | 21.691 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 62.986736 Full duration: 93.144786 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.751 | 7.051 | 9.957 | 10.441 | 10.924 | 6.906 | 100.0% | 10 | | cinder_v3.delete_volume | 2.28 | 2.943 | 5.297 | 5.951 | 6.604 | 3.621 | 100.0% | 10 | | total | 7.154 | 10.701 | 13.024 | 13.114 | 13.204 | 10.527 | 100.0% | 10 | | -> duration | 7.154 | 10.701 | 13.024 | 13.114 | 13.204 | 10.527 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.322713 Full duration: 58.627342 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.081 | 4.458 | 5.92 | 7.249 | 8.578 | 4.953 | 100.0% | 10 | | cinder_v3.extend_volume | 3.25 | 5.401 | 8.976 | 9.348 | 9.72 | 5.772 | 100.0% | 10 | | cinder_v3.delete_volume | 2.78 | 4.333 | 5.477 | 5.672 | 5.866 | 4.323 | 100.0% | 10 | | total | 10.88 | 15.136 | 17.848 | 18.106 | 18.364 | 15.048 | 100.0% | 10 | | -> duration | 10.88 | 15.136 | 17.848 | 18.106 | 18.364 | 15.048 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.827304 Full duration: 77.546525 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.557 | 6.453 | 8.707 | 9.078 | 9.449 | 6.624 | 100.0% | 10 | | cinder_v3.delete_volume | 2.612 | 6.504 | 7.433 | 7.53 | 7.627 | 5.842 | 100.0% | 10 | | total | 8.731 | 12.915 | 14.804 | 15.208 | 15.611 | 12.466 | 100.0% | 10 | | -> duration | 8.731 | 12.915 | 14.804 | 15.208 | 15.611 | 12.466 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.36048 Full duration: 88.345948 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.642 | 1.566 | 1.86 | 1.889 | 1.917 | 1.395 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.036 | 0.045 | 0.049 | 0.052 | 0.038 | 100.0% | 10 | | total | 0.674 | 1.607 | 1.9 | 1.935 | 1.969 | 1.433 | 100.0% | 10 | | -> duration | 0.674 | 1.607 | 1.9 | 1.935 | 1.969 | 1.433 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.669002 Full duration: 28.019961 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.734 | 0.931 | 1.257 | 1.545 | 1.832 | 1.019 | 100.0% | 10 | | cinder_v3.list_qos | 0.035 | 0.041 | 0.056 | 0.058 | 0.06 | 0.043 | 100.0% | 10 | | total | 0.791 | 0.973 | 1.297 | 1.587 | 1.877 | 1.063 | 100.0% | 10 | | -> duration | 0.791 | 0.973 | 1.297 | 1.587 | 1.877 | 1.063 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.975672 Full duration: 30.746498 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.548 | 0.949 | 1.492 | 1.639 | 1.785 | 1.062 | 100.0% | 10 | | cinder_v3.set_qos | 0.155 | 0.258 | 0.457 | 0.477 | 0.497 | 0.308 | 100.0% | 10 | | total | 0.703 | 1.229 | 1.944 | 2.086 | 2.228 | 1.371 | 100.0% | 10 | | -> duration | 0.703 | 1.229 | 1.944 | 2.086 | 2.228 | 1.371 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.677917 Full duration: 33.445039 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.72 | 0.966 | 1.169 | 1.256 | 1.344 | 0.991 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.029 | 0.033 | 0.038 | 0.039 | 0.04 | 0.033 | 100.0% | 10 | | total | 0.754 | 1.0 | 1.207 | 1.295 | 1.384 | 1.024 | 100.0% | 10 | | -> duration | 0.754 | 1.0 | 1.207 | 1.295 | 1.384 | 1.024 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.11036 Full duration: 30.966484 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.957 | 1.281 | 1.906 | 1.917 | 1.929 | 1.415 | 100.0% | 10 | | cinder_v3.list_types | 0.035 | 0.041 | 0.047 | 0.047 | 0.048 | 0.042 | 100.0% | 10 | | total | 0.999 | 1.322 | 1.954 | 1.965 | 1.975 | 1.457 | 100.0% | 10 | | -> duration | 0.999 | 1.322 | 1.954 | 1.965 | 1.975 | 1.457 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.421449 Full duration: 32.096577 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.616 | 1.487 | 2.457 | 2.469 | 2.48 | 1.523 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.206 | 0.501 | 0.916 | 0.918 | 0.92 | 0.588 | 100.0% | 10 | | total | 0.822 | 2.145 | 2.874 | 2.909 | 2.943 | 2.111 | 100.0% | 10 | | -> duration | 0.822 | 2.145 | 2.874 | 2.909 | 2.943 | 2.111 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.750648 Full duration: 31.958973 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.651 | 0.936 | 1.52 | 1.592 | 1.665 | 1.059 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.082 | 0.194 | 0.751 | 0.775 | 0.799 | 0.362 | 100.0% | 10 | | total | 0.745 | 1.251 | 2.271 | 2.367 | 2.464 | 1.422 | 100.0% | 10 | | -> duration | 0.745 | 1.251 | 2.271 | 2.367 | 2.464 | 1.422 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.79196 Full duration: 29.935091 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 601b9929-a4ff-4441-b456-f3f0e8c58eb7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.648 | 0.886 | 1.109 | 1.187 | 1.264 | 0.889 | 100.0% | 10 | | cinder_v2.add_type_access | 0.07 | 0.248 | 0.424 | 0.464 | 0.503 | 0.268 | 100.0% | 10 | | cinder_v2.list_type_access | 0.035 | 0.041 | 0.051 | 0.056 | 0.061 | 0.043 | 100.0% | 10 | | total | 0.928 | 1.169 | 1.423 | 1.462 | 1.501 | 1.2 | 100.0% | 10 | | -> duration | 0.928 | 1.169 | 1.423 | 1.462 | 1.501 | 1.2 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.401294 Full duration: 27.634134 HINTS: * To plot HTML graphics with this data, run: rally task report 601b9929-a4ff-4441-b456-f3f0e8c58eb7 --out output.html * To generate a JUnit report, run: rally task export 601b9929-a4ff-4441-b456-f3f0e8c58eb7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 601b9929-a4ff-4441-b456-f3f0e8c58eb7 --json --out output.json 2021-03-20 16:19:38,832 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 601b9929-a4ff-4441-b456-f3f0e8c58eb7 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-03-20 16:19:38,892 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-03-20 16:19:38,922 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 16:19:39,261 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-03-20 16:53:49,881 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 2021-03-20 16:53:51,089 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.817 | 8.257 | 9.292 | 9.856 | 10.419 | 8.205 | 100.0% | 10 | | heat.list_stacks | 0.054 | 0.073 | 0.078 | 0.079 | 0.08 | 0.069 | 100.0% | 10 | | total | 5.894 | 8.314 | 9.353 | 9.924 | 10.495 | 8.275 | 100.0% | 10 | | -> duration | 3.894 | 6.314 | 7.353 | 7.924 | 8.495 | 6.275 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.767353 Full duration: 79.351134 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.979 | 30.657 | 41.195 | 42.128 | 43.062 | 32.438 | 100.0% | 10 | | heat.update_stack | 17.316 | 30.893 | 33.849 | 34.303 | 34.757 | 27.944 | 100.0% | 10 | | heat.delete_stack | 14.067 | 20.956 | 25.279 | 25.488 | 25.697 | 21.114 | 100.0% | 10 | | total | 62.39 | 81.37 | 91.385 | 94.53 | 97.675 | 81.495 | 100.0% | 10 | | -> duration | 58.39 | 77.37 | 87.385 | 90.53 | 93.675 | 77.495 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 228.320106 Full duration: 274.240865 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.255 | 25.803 | 26.454 | 26.552 | 26.65 | 23.913 | 100.0% | 10 | | heat.update_stack | 5.278 | 14.275 | 19.107 | 19.172 | 19.238 | 13.146 | 100.0% | 10 | | heat.delete_stack | 4.134 | 14.166 | 15.156 | 15.567 | 15.978 | 12.438 | 100.0% | 10 | | total | 35.246 | 50.501 | 59.069 | 59.184 | 59.3 | 49.497 | 100.0% | 10 | | -> duration | 31.246 | 46.501 | 55.069 | 55.184 | 55.3 | 45.497 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 134.48498 Full duration: 178.42432 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.219 | 31.45 | 46.89 | 47.106 | 47.322 | 34.865 | 100.0% | 10 | | heat.update_stack | 13.027 | 30.867 | 42.085 | 42.296 | 42.506 | 30.93 | 100.0% | 10 | | heat.delete_stack | 11.309 | 29.283 | 32.902 | 33.919 | 34.935 | 26.196 | 100.0% | 10 | | total | 49.555 | 100.245 | 108.807 | 109.065 | 109.323 | 91.992 | 100.0% | 10 | | -> duration | 45.555 | 96.245 | 104.807 | 105.065 | 105.323 | 87.992 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 250.061001 Full duration: 290.375888 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.396 | 30.027 | 37.775 | 38.153 | 38.531 | 31.451 | 100.0% | 10 | | heat.update_stack | 10.847 | 26.999 | 29.705 | 31.375 | 33.045 | 24.471 | 100.0% | 10 | | heat.delete_stack | 10.649 | 26.283 | 28.345 | 28.369 | 28.394 | 23.048 | 100.0% | 10 | | total | 47.825 | 83.837 | 92.955 | 95.115 | 97.274 | 78.97 | 100.0% | 10 | | -> duration | 43.825 | 79.837 | 88.955 | 91.115 | 93.274 | 74.97 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 216.704509 Full duration: 258.381926 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 28.579 | 33.689 | 43.157 | 43.377 | 43.598 | 35.756 | 100.0% | 10 | | heat.update_stack | 17.111 | 24.215 | 31.787 | 32.036 | 32.285 | 25.268 | 100.0% | 10 | | heat.delete_stack | 5.922 | 19.97 | 21.856 | 23.124 | 24.391 | 18.206 | 100.0% | 10 | | total | 56.097 | 83.274 | 89.032 | 89.036 | 89.04 | 79.231 | 100.0% | 10 | | -> duration | 52.097 | 79.274 | 85.032 | 85.036 | 85.04 | 75.231 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 222.268941 Full duration: 261.821554 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 21.657 | 28.315 | 34.939 | 36.321 | 37.702 | 27.626 | 100.0% | 10 | | heat.update_stack | 9.372 | 24.26 | 37.934 | 40.19 | 42.446 | 26.163 | 100.0% | 10 | | heat.delete_stack | 9.297 | 15.123 | 21.104 | 21.134 | 21.164 | 15.863 | 100.0% | 10 | | total | 48.511 | 61.438 | 89.409 | 92.065 | 94.72 | 69.653 | 100.0% | 10 | | -> duration | 44.511 | 57.438 | 85.409 | 88.065 | 90.72 | 65.653 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 192.449457 Full duration: 238.215955 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 19.61 | 27.765 | 29.675 | 29.892 | 30.109 | 26.313 | 100.0% | 10 | | heat.check_stack | 2.606 | 8.933 | 9.522 | 9.998 | 10.474 | 8.043 | 100.0% | 10 | | heat.delete_stack | 6.244 | 12.054 | 14.18 | 14.3 | 14.419 | 11.314 | 100.0% | 10 | | total | 29.493 | 48.872 | 52.407 | 52.671 | 52.936 | 45.67 | 100.0% | 10 | | -> duration | 27.493 | 46.872 | 50.407 | 50.671 | 50.936 | 43.67 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 125.036613 Full duration: 164.25146 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 11.009 | 23.913 | 29.56 | 29.67 | 29.78 | 23.027 | 100.0% | 10 | | heat.suspend_stack | 4.022 | 8.849 | 13.036 | 13.393 | 13.75 | 9.571 | 100.0% | 10 | | heat.resume_stack | 4.256 | 9.219 | 12.047 | 12.209 | 12.371 | 8.965 | 100.0% | 10 | | heat.delete_stack | 4.933 | 15.883 | 16.827 | 16.851 | 16.876 | 13.708 | 100.0% | 10 | | total | 43.137 | 57.193 | 63.005 | 65.007 | 67.01 | 55.272 | 100.0% | 10 | | -> duration | 41.137 | 55.193 | 61.005 | 63.007 | 65.01 | 53.272 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 153.641557 Full duration: 194.478891 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.53 | 0.767 | 1.278 | 1.289 | 1.299 | 0.816 | 100.0% | 10 | | total | 0.53 | 0.767 | 1.278 | 1.289 | 1.299 | 0.816 | 100.0% | 10 | | -> duration | 0.53 | 0.767 | 1.278 | 1.289 | 1.299 | 0.816 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.346909 Full duration: 39.139936 HINTS: * To plot HTML graphics with this data, run: rally task report 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 --out output.html * To generate a JUnit report, run: rally task export 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 --json --out output.json 2021-03-20 16:53:54,168 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4ce2eb87-bb70-4a7f-8643-c4b5a30c42e1 --out /home/opnfv/functest/results/rally_full/heat.json 2021-03-20 16:53:54,186 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-03-20 16:53:54,215 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 16:53:54,646 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-03-20 17:02:39,479 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 5d452945-fdcd-4027-a407-b174827cb154 2021-03-20 17:02:40,818 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5d452945-fdcd-4027-a407-b174827cb154 -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.193 | 0.596 | 2.28 | 2.407 | 2.534 | 0.97 | 100.0% | 10 | | keystone_v3.add_role | 0.076 | 0.707 | 1.773 | 1.932 | 2.091 | 0.911 | 100.0% | 10 | | keystone_v3.revoke_role | 0.27 | 0.449 | 0.821 | 0.858 | 0.895 | 0.527 | 100.0% | 10 | | total | 0.931 | 1.847 | 4.37 | 4.375 | 4.381 | 2.407 | 100.0% | 10 | | -> duration | 0.931 | 1.847 | 4.37 | 4.375 | 4.381 | 2.407 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.967496 Full duration: 47.876229 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.11 | 0.247 | 0.489 | 0.525 | 0.561 | 0.277 | 100.0% | 10 | | keystone_v3.add_role | 0.072 | 0.228 | 0.35 | 0.373 | 0.397 | 0.222 | 100.0% | 10 | | keystone_v3.list_roles | 0.107 | 0.126 | 0.343 | 0.376 | 0.408 | 0.182 | 100.0% | 10 | | total | 0.325 | 0.73 | 0.963 | 0.968 | 0.974 | 0.681 | 100.0% | 10 | | -> duration | 0.325 | 0.73 | 0.963 | 0.968 | 0.974 | 0.681 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.801686 Full duration: 36.435458 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.227 | 0.448 | 0.714 | 0.798 | 0.881 | 0.478 | 100.0% | 10 | | keystone_v3.list_projects | 0.112 | 0.135 | 0.219 | 0.268 | 0.318 | 0.161 | 100.0% | 10 | | total | 0.371 | 0.604 | 0.848 | 0.968 | 1.089 | 0.64 | 100.0% | 10 | | -> duration | 0.371 | 0.604 | 0.848 | 0.968 | 1.089 | 0.64 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.246989 Full duration: 38.164885 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.268 | 0.433 | 0.562 | 0.621 | 0.68 | 0.444 | 100.0% | 10 | | keystone_v3.delete_role | 0.11 | 0.299 | 0.649 | 0.804 | 0.96 | 0.389 | 100.0% | 10 | | total | 0.571 | 0.782 | 1.132 | 1.18 | 1.228 | 0.832 | 100.0% | 10 | | -> duration | 0.571 | 0.782 | 1.132 | 1.18 | 1.228 | 0.832 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.637465 Full duration: 34.635347 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.116 | 0.378 | 0.594 | 0.61 | 0.626 | 0.394 | 100.0% | 10 | | keystone_v3.delete_service | 0.125 | 0.295 | 0.382 | 0.453 | 0.524 | 0.298 | 100.0% | 10 | | total | 0.394 | 0.678 | 0.85 | 0.982 | 1.114 | 0.692 | 100.0% | 10 | | -> duration | 0.394 | 0.678 | 0.85 | 0.982 | 1.114 | 0.692 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.980657 Full duration: 32.662931 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.413 | 0.59 | 1.039 | 1.137 | 1.236 | 0.673 | 100.0% | 10 | | keystone_v3.create_user | 0.68 | 1.207 | 1.863 | 1.994 | 2.124 | 1.309 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.051 | 0.055 | 0.103 | 0.113 | 0.123 | 0.066 | 100.0% | 10 | | -> keystone_v3.add_role | 0.149 | 0.391 | 0.596 | 0.693 | 0.791 | 0.389 | 100.0% | 10 | | keystone_v3.create_role | 0.082 | 0.201 | 0.351 | 0.355 | 0.36 | 0.206 | 100.0% | 10 | | keystone_v3.get_project | 0.038 | 0.051 | 0.142 | 0.237 | 0.332 | 0.091 | 100.0% | 10 | | keystone_v3.get_user | 0.037 | 0.043 | 0.06 | 0.114 | 0.169 | 0.054 | 100.0% | 10 | | keystone_v3.get_role | 0.029 | 0.039 | 0.583 | 0.718 | 0.854 | 0.171 | 100.0% | 10 | | keystone_v3.list_services | 0.04 | 0.053 | 0.336 | 0.486 | 0.636 | 0.134 | 100.0% | 10 | | keystone_v3.get_services | 0.034 | 0.038 | 0.515 | 0.522 | 0.53 | 0.188 | 100.0% | 10 | | total | 1.769 | 2.844 | 3.831 | 4.037 | 4.244 | 2.943 | 100.0% | 10 | | -> duration | 1.769 | 2.844 | 3.831 | 4.037 | 4.244 | 2.943 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.334611 Full duration: 58.797536 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.468 | 0.851 | 1.988 | 2.004 | 2.021 | 1.059 | 100.0% | 10 | | keystone_v3.update_project | 0.209 | 0.594 | 0.756 | 1.03 | 1.304 | 0.601 | 100.0% | 10 | | keystone_v3.delete_project | 0.371 | 0.661 | 1.725 | 1.863 | 2.0 | 0.941 | 100.0% | 10 | | total | 1.717 | 2.596 | 3.077 | 3.184 | 3.29 | 2.602 | 100.0% | 10 | | -> duration | 1.717 | 2.596 | 3.077 | 3.184 | 3.29 | 2.602 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.959067 Full duration: 41.152042 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.245 | 1.221 | 1.86 | 2.116 | 2.373 | 1.073 | 100.0% | 10 | | total | 0.336 | 1.327 | 2.388 | 2.415 | 2.442 | 1.306 | 100.0% | 10 | | -> duration | 0.336 | 1.327 | 2.388 | 2.415 | 2.442 | 1.306 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.92853 Full duration: 29.806545 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.328 | 0.624 | 0.969 | 1.08 | 1.191 | 0.687 | 100.0% | 10 | | total | 0.328 | 0.624 | 0.969 | 1.08 | 1.191 | 0.687 | 100.0% | 10 | | -> duration | 0.328 | 0.624 | 0.969 | 1.08 | 1.191 | 0.687 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.075801 Full duration: 35.783607 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.35 | 1.027 | 3.889 | 3.91 | 3.932 | 1.712 | 100.0% | 10 | | keystone_v3.list_users | 0.068 | 0.082 | 1.027 | 2.021 | 3.016 | 0.46 | 100.0% | 10 | | total | 0.506 | 1.592 | 4.22 | 4.293 | 4.365 | 2.262 | 100.0% | 10 | | -> duration | 0.506 | 1.592 | 4.22 | 4.293 | 4.365 | 2.262 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.473915 Full duration: 40.75065 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d452945-fdcd-4027-a407-b174827cb154 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.414 | 0.682 | 0.873 | 0.982 | 1.09 | 0.673 | 100.0% | 10 | | keystone_v3.create_users | 6.742 | 11.296 | 12.509 | 12.709 | 12.908 | 10.594 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 6.742 | 11.296 | 12.509 | 12.708 | 12.908 | 10.593 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.827 | 1.087 | 1.284 | 1.554 | 1.823 | 1.129 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 1.711 | 3.204 | 4.975 | 5.058 | 5.141 | 3.402 | 100.0% | 10 | | total | 7.639 | 13.323 | 14.573 | 15.493 | 16.412 | 12.6 | 100.0% | 10 | | -> duration | 7.639 | 13.323 | 14.573 | 15.493 | 16.412 | 12.6 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.744244 Full duration: 99.266729 HINTS: * To plot HTML graphics with this data, run: rally task report 5d452945-fdcd-4027-a407-b174827cb154 --out output.html * To generate a JUnit report, run: rally task export 5d452945-fdcd-4027-a407-b174827cb154 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5d452945-fdcd-4027-a407-b174827cb154 --json --out output.json 2021-03-20 17:02:43,971 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5d452945-fdcd-4027-a407-b174827cb154 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-03-20 17:02:43,991 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-03-20 17:02:44,017 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 17:02:44,405 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-03-20 17:18:39,477 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: ccb3390f-997c-4911-9509-eccf586f86ec 2021-03-20 17:18:40,870 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ccb3390f-997c-4911-9509-eccf586f86ec -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.164 | 2.846 | 4.976 | 5.122 | 5.267 | 3.339 | 100.0% | 10 | | neutron.update_network | 1.048 | 1.25 | 1.69 | 1.722 | 1.754 | 1.303 | 100.0% | 10 | | total | 3.296 | 4.548 | 6.04 | 6.252 | 6.464 | 4.642 | 100.0% | 10 | | -> duration | 3.296 | 4.548 | 6.04 | 6.252 | 6.464 | 4.642 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.857747 Full duration: 63.166546 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.304 | 5.567 | 6.91 | 6.949 | 6.988 | 5.639 | 100.0% | 10 | | neutron.update_port | 0.842 | 1.56 | 1.876 | 2.541 | 3.206 | 1.588 | 100.0% | 10 | | total | 5.182 | 7.235 | 8.632 | 8.645 | 8.657 | 7.227 | 100.0% | 10 | | -> duration | 5.182 | 7.235 | 8.632 | 8.645 | 8.657 | 7.227 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.473068 Full duration: 93.723756 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.847 | 2.677 | 3.673 | 4.329 | 4.984 | 2.694 | 100.0% | 10 | | neutron.create_subnet | 1.317 | 3.188 | 5.629 | 6.177 | 6.726 | 3.555 | 100.0% | 10 | | neutron.update_subnet | 0.777 | 1.546 | 2.013 | 2.129 | 2.245 | 1.533 | 100.0% | 10 | | total | 4.351 | 6.391 | 12.249 | 12.288 | 12.326 | 7.782 | 100.0% | 10 | | -> duration | 4.351 | 6.391 | 12.249 | 12.288 | 12.326 | 7.782 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.039091 Full duration: 75.666543 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.996 | 2.558 | 3.337 | 3.49 | 3.642 | 2.638 | 100.0% | 10 | | neutron.delete_network | 1.158 | 1.561 | 1.809 | 1.819 | 1.829 | 1.559 | 100.0% | 10 | | total | 3.217 | 4.117 | 4.86 | 4.984 | 5.108 | 4.197 | 100.0% | 10 | | -> duration | 3.217 | 4.117 | 4.86 | 4.984 | 5.108 | 4.197 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.893666 Full duration: 48.771541 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.161 | 3.353 | 4.037 | 4.233 | 4.428 | 3.303 | 100.0% | 10 | | neutron.delete_port | 0.718 | 1.313 | 1.807 | 1.985 | 2.163 | 1.335 | 100.0% | 10 | | total | 4.051 | 4.552 | 5.152 | 5.177 | 5.203 | 4.638 | 100.0% | 10 | | -> duration | 4.051 | 4.552 | 5.152 | 5.177 | 5.203 | 4.638 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.968052 Full duration: 69.46494 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.388 | 2.418 | 3.394 | 3.839 | 4.284 | 2.553 | 100.0% | 10 | | neutron.create_subnet | 1.404 | 2.455 | 2.807 | 3.094 | 3.38 | 2.323 | 100.0% | 10 | | neutron.delete_subnet | 1.003 | 1.478 | 2.135 | 2.192 | 2.25 | 1.523 | 100.0% | 10 | | total | 3.952 | 6.379 | 8.423 | 8.438 | 8.453 | 6.4 | 100.0% | 10 | | -> duration | 3.952 | 6.379 | 8.423 | 8.438 | 8.453 | 6.4 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.46518 Full duration: 64.425424 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.126 | 2.997 | 3.199 | 3.26 | 3.321 | 2.712 | 100.0% | 10 | | neutron.list_networks | 0.183 | 0.365 | 1.089 | 1.24 | 1.392 | 0.596 | 100.0% | 10 | | total | 1.442 | 3.549 | 4.139 | 4.293 | 4.448 | 3.308 | 100.0% | 10 | | -> duration | 1.442 | 3.549 | 4.139 | 4.293 | 4.448 | 3.308 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.259327 Full duration: 57.100776 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.626 | 3.515 | 4.09 | 4.168 | 4.246 | 3.397 | 100.0% | 10 | | neutron.list_ports | 0.091 | 0.129 | 0.271 | 0.361 | 0.451 | 0.169 | 100.0% | 10 | | total | 2.717 | 3.624 | 4.243 | 4.37 | 4.497 | 3.566 | 100.0% | 10 | | -> duration | 2.717 | 3.624 | 4.243 | 4.37 | 4.497 | 3.566 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.210837 Full duration: 72.646315 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.986 | 2.037 | 3.991 | 4.211 | 4.431 | 2.317 | 100.0% | 10 | | neutron.create_subnet | 1.91 | 2.713 | 3.647 | 3.659 | 3.671 | 2.796 | 100.0% | 10 | | neutron.list_subnets | 0.086 | 0.13 | 0.788 | 0.948 | 1.109 | 0.366 | 100.0% | 10 | | total | 4.077 | 5.129 | 7.392 | 7.568 | 7.745 | 5.478 | 100.0% | 10 | | -> duration | 4.077 | 5.129 | 7.392 | 7.568 | 7.745 | 5.478 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.954335 Full duration: 71.023455 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.59 | 3.033 | 4.79 | 4.8 | 4.809 | 3.076 | 100.0% | 10 | | neutron.delete_security_group | 0.334 | 0.726 | 1.895 | 2.097 | 2.3 | 0.905 | 100.0% | 10 | | total | 2.994 | 3.752 | 5.523 | 5.526 | 5.528 | 3.981 | 100.0% | 10 | | -> duration | 2.994 | 3.752 | 5.523 | 5.526 | 5.528 | 3.981 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.750329 Full duration: 48.573979 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.502 | 3.581 | 3.644 | 3.738 | 3.832 | 3.139 | 100.0% | 10 | | neutron.create_security_group_rule | 0.476 | 1.009 | 1.347 | 1.629 | 1.91 | 0.962 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.211 | 0.339 | 0.505 | 0.526 | 0.548 | 0.373 | 100.0% | 10 | | neutron.delete_security_group | 0.234 | 0.555 | 0.71 | 0.718 | 0.726 | 0.52 | 100.0% | 10 | | total | 3.279 | 5.355 | 5.559 | 5.63 | 5.701 | 4.994 | 100.0% | 10 | | -> duration | 3.279 | 5.355 | 5.559 | 5.63 | 5.701 | 4.994 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.392911 Full duration: 52.770566 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.08 | 2.858 | 4.206 | 4.393 | 4.579 | 2.842 | 100.0% | 10 | | neutron.create_security_group_rule | 0.829 | 1.461 | 2.054 | 2.252 | 2.449 | 1.489 | 100.0% | 10 | | neutron.list_security_group_rules | 0.079 | 0.201 | 0.561 | 0.641 | 0.721 | 0.293 | 100.0% | 10 | | total | 2.297 | 4.761 | 5.403 | 5.508 | 5.614 | 4.624 | 100.0% | 10 | | -> duration | 2.297 | 4.761 | 5.403 | 5.508 | 5.614 | 4.624 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.871635 Full duration: 51.11713 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.309 | 1.684 | 1.948 | 2.074 | 2.199 | 1.684 | 100.0% | 10 | | neutron.show_security_group | 0.06 | 0.08 | 0.369 | 0.389 | 0.409 | 0.153 | 100.0% | 10 | | total | 1.369 | 1.764 | 2.15 | 2.216 | 2.283 | 1.838 | 100.0% | 10 | | -> duration | 1.369 | 1.764 | 2.15 | 2.216 | 2.283 | 1.838 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.306204 Full duration: 44.948296 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 15.793519 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ccb3390f-997c-4911-9509-eccf586f86ec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 3.916 | 6.908 | 7.466 | 7.541 | 7.616 | 6.174 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.175 | 0.463 | 0.664 | 0.688 | 0.712 | 0.463 | 100.0% | 10 | | total | 4.628 | 7.19 | 7.871 | 8.066 | 8.261 | 6.638 | 100.0% | 10 | | -> duration | 4.628 | 7.19 | 7.871 | 8.066 | 8.261 | 6.638 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.371396 Full duration: 82.532375 HINTS: * To plot HTML graphics with this data, run: rally task report ccb3390f-997c-4911-9509-eccf586f86ec --out output.html * To generate a JUnit report, run: rally task export ccb3390f-997c-4911-9509-eccf586f86ec --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ccb3390f-997c-4911-9509-eccf586f86ec --json --out output.json At least one workload did not pass SLA criteria. 2021-03-20 17:18:44,095 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ccb3390f-997c-4911-9509-eccf586f86ec --out /home/opnfv/functest/results/rally_full/neutron.json 2021-03-20 17:18:44,118 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-03-20 17:18:44,160 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 17:18:44,614 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-03-20 17:31:56,362 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 52911b04-a294-40cc-8a96-1a8eaec61677 2021-03-20 17:31:57,657 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 52911b04-a294-40cc-8a96-1a8eaec61677 -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.807 | 1.168 | 1.782 | 1.799 | 1.817 | 1.309 | 100.0% | 10 | | nova.delete_keypair | 0.064 | 0.113 | 0.312 | 0.511 | 0.71 | 0.196 | 100.0% | 10 | | total | 0.937 | 1.527 | 1.898 | 1.905 | 1.913 | 1.505 | 100.0% | 10 | | -> duration | 0.937 | 1.527 | 1.898 | 1.905 | 1.913 | 1.505 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.411053 Full duration: 30.457572 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.908 | 1.199 | 1.583 | 1.64 | 1.697 | 1.249 | 100.0% | 10 | | nova.list_keypairs | 0.036 | 0.042 | 0.052 | 0.064 | 0.076 | 0.045 | 100.0% | 10 | | total | 0.953 | 1.245 | 1.624 | 1.698 | 1.773 | 1.294 | 100.0% | 10 | | -> duration | 0.953 | 1.245 | 1.624 | 1.698 | 1.773 | 1.294 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.573112 Full duration: 36.490129 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.885 | 26.401 | 29.247 | 30.721 | 32.196 | 25.76 | 100.0% | 10 | | nova.reboot_server | 8.097 | 13.425 | 24.406 | 24.75 | 25.095 | 15.92 | 100.0% | 10 | | nova.soft_reboot_server | 9.671 | 13.655 | 137.027 | 137.37 | 137.714 | 49.515 | 100.0% | 10 | | nova.stop_and_start_server | 12.153 | 24.407 | 26.914 | 27.01 | 27.105 | 22.185 | 100.0% | 10 | | -> nova.stop_server | 5.58 | 15.228 | 17.063 | 17.144 | 17.225 | 13.13 | 100.0% | 10 | | -> nova.start_server | 6.573 | 9.029 | 10.59 | 11.04 | 11.49 | 9.054 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 15.868 | 28.114 | 30.863 | 32.464 | 34.065 | 25.118 | 100.0% | 10 | | -> nova.rescue_server | 8.3 | 19.463 | 22.65 | 23.416 | 24.183 | 17.329 | 100.0% | 10 | | -> nova.unrescue_server | 5.801 | 7.494 | 8.82 | 9.351 | 9.882 | 7.788 | 100.0% | 10 | | nova.delete_server | 6.144 | 8.24 | 11.12 | 11.581 | 12.043 | 8.576 | 100.0% | 10 | | total | 73.687 | 107.675 | 255.466 | 256.901 | 258.335 | 147.117 | 100.0% | 10 | | -> duration | 64.687 | 98.675 | 246.466 | 247.901 | 249.335 | 138.117 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 376.237808 Full duration: 417.368757 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.611 | 26.481 | 29.775 | 31.01 | 32.244 | 26.56 | 100.0% | 10 | | nova.delete_server | 5.021 | 7.328 | 8.443 | 8.92 | 9.397 | 7.148 | 100.0% | 10 | | total | 25.632 | 34.171 | 38.032 | 38.911 | 39.79 | 33.708 | 100.0% | 10 | | -> duration | 24.632 | 33.171 | 37.032 | 37.911 | 38.79 | 32.708 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 96.185489 Full duration: 132.661024 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "image": { "name": "rally_full-img_b072d8d2-92cd-48e5-b41a-be65f6d39e40" }, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52911b04-a294-40cc-8a96-1a8eaec61677 has 1 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 5.602 | 28.584 | 34.335 | 35.43 | 36.525 | 26.916 | 90.0% | 10 | | nova.list_servers | 0.389 | 0.428 | 0.545 | 0.669 | 0.792 | 0.468 | 100.0% | 9 | | total | 5.603 | 29.03 | 34.8 | 36.058 | 37.317 | 27.338 | 90.0% | 10 | | -> duration | 4.603 | 28.03 | 33.8 | 35.058 | 36.317 | 26.338 | 90.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 90.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.225824 Full duration: 117.346321 HINTS: * To plot HTML graphics with this data, run: rally task report 52911b04-a294-40cc-8a96-1a8eaec61677 --out output.html * To generate a JUnit report, run: rally task export 52911b04-a294-40cc-8a96-1a8eaec61677 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 52911b04-a294-40cc-8a96-1a8eaec61677 --json --out output.json At least one workload did not pass SLA criteria. 2021-03-20 17:32:00,678 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 52911b04-a294-40cc-8a96-1a8eaec61677 --out /home/opnfv/functest/results/rally_full/nova.json 2021-03-20 17:32:00,692 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-03-20 17:32:00,719 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 17:32:01,160 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-03-20 17:33:52,467 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: a3722629-bf22-4981-8b73-57cf7d738c65 2021-03-20 17:33:53,729 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a3722629-bf22-4981-8b73-57cf7d738c65 -------------------------------------------------------------------------------- Task a3722629-bf22-4981-8b73-57cf7d738c65: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3722629-bf22-4981-8b73-57cf7d738c65 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.799 | 1.193 | 1.561 | 1.706 | 1.852 | 1.218 | 100.0% | 10 | | quotas.delete_quotas | 0.048 | 0.072 | 0.2 | 0.211 | 0.221 | 0.098 | 100.0% | 10 | | total | 0.876 | 1.243 | 1.623 | 1.797 | 1.971 | 1.317 | 100.0% | 10 | | -> duration | 0.876 | 1.243 | 1.623 | 1.797 | 1.971 | 1.317 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.354478 Full duration: 28.195361 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3722629-bf22-4981-8b73-57cf7d738c65 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.037 | 1.952 | 5.247 | 5.341 | 5.434 | 2.958 | 100.0% | 10 | | total | 1.037 | 1.952 | 5.248 | 5.341 | 5.434 | 2.958 | 100.0% | 10 | | -> duration | 1.037 | 1.952 | 5.248 | 5.341 | 5.434 | 2.958 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.724437 Full duration: 31.678367 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a3722629-bf22-4981-8b73-57cf7d738c65 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.773 | 2.413 | 3.43 | 3.656 | 3.882 | 2.705 | 100.0% | 10 | | total | 1.773 | 2.413 | 3.43 | 3.656 | 3.882 | 2.705 | 100.0% | 10 | | -> duration | 1.773 | 2.413 | 3.43 | 3.656 | 3.882 | 2.705 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.702112 Full duration: 33.185101 HINTS: * To plot HTML graphics with this data, run: rally task report a3722629-bf22-4981-8b73-57cf7d738c65 --out output.html * To generate a JUnit report, run: rally task export a3722629-bf22-4981-8b73-57cf7d738c65 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a3722629-bf22-4981-8b73-57cf7d738c65 --json --out output.json 2021-03-20 17:33:56,832 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a3722629-bf22-4981-8b73-57cf7d738c65 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-03-20 17:33:56,838 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-03-20 17:33:56,870 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 17:33:57,047 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-03-20 17:42:23,763 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 52db446c-22d4-4be4-8928-711b1d175bc0 2021-03-20 17:42:24,983 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 52db446c-22d4-4be4-8928-711b1d175bc0 -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.946 | 1.063 | 1.275 | 1.326 | 1.376 | 1.095 | 100.0% | 10 | | swift.upload_object (x2) | 0.911 | 0.993 | 1.118 | 1.122 | 1.125 | 1.004 | 100.0% | 10 | | swift.list_objects | 0.86 | 0.902 | 0.985 | 1.023 | 1.061 | 0.923 | 100.0% | 10 | | total | 2.799 | 2.961 | 3.247 | 3.363 | 3.479 | 3.023 | 100.0% | 10 | | -> duration | 2.799 | 2.961 | 3.247 | 3.363 | 3.479 | 3.023 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.286688 Full duration: 86.013854 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.261 | 1.377 | 1.536 | 1.549 | 1.562 | 1.399 | 100.0% | 10 | | swift.list_objects | 0.886 | 0.929 | 1.024 | 1.04 | 1.057 | 0.945 | 100.0% | 10 | | total | 2.221 | 2.32 | 2.445 | 2.494 | 2.543 | 2.344 | 100.0% | 10 | | -> duration | 2.221 | 2.32 | 2.445 | 2.494 | 2.543 | 2.344 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.4947 Full duration: 73.560867 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.017 | 1.117 | 1.235 | 1.236 | 1.236 | 1.128 | 100.0% | 10 | | swift.upload_object (x5) | 2.648 | 2.7 | 2.803 | 2.886 | 2.969 | 2.735 | 100.0% | 10 | | swift.download_object (x5) | 2.415 | 2.538 | 2.648 | 2.66 | 2.672 | 2.529 | 100.0% | 10 | | total | 6.18 | 6.367 | 6.527 | 6.642 | 6.756 | 6.394 | 100.0% | 10 | | -> duration | 6.18 | 6.367 | 6.527 | 6.642 | 6.756 | 6.394 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.996551 Full duration: 129.489599 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.916 | 1.097 | 1.236 | 1.257 | 1.277 | 1.099 | 100.0% | 10 | | swift.upload_object (x5) | 2.542 | 2.801 | 2.876 | 2.913 | 2.951 | 2.782 | 100.0% | 10 | | swift.delete_object (x5) | 2.508 | 2.609 | 2.692 | 2.7 | 2.707 | 2.613 | 100.0% | 10 | | swift.delete_container | 0.515 | 0.59 | 0.664 | 0.665 | 0.665 | 0.595 | 100.0% | 10 | | total | 6.543 | 7.137 | 7.283 | 7.287 | 7.292 | 7.092 | 100.0% | 10 | | -> duration | 6.543 | 7.137 | 7.283 | 7.287 | 7.292 | 7.092 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 70.978365 Full duration: 106.694982 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52db446c-22d4-4be4-8928-711b1d175bc0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.329 | 1.449 | 1.603 | 1.623 | 1.642 | 1.473 | 100.0% | 10 | | swift.list_objects | 0.911 | 1.015 | 1.058 | 1.061 | 1.064 | 1.004 | 100.0% | 10 | | swift.download_object (x5) | 2.351 | 2.464 | 2.521 | 2.527 | 2.533 | 2.453 | 100.0% | 10 | | total | 4.719 | 4.977 | 5.112 | 5.133 | 5.155 | 4.93 | 100.0% | 10 | | -> duration | 4.719 | 4.977 | 5.112 | 5.133 | 5.155 | 4.93 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.363182 Full duration: 85.76729 HINTS: * To plot HTML graphics with this data, run: rally task report 52db446c-22d4-4be4-8928-711b1d175bc0 --out output.html * To generate a JUnit report, run: rally task export 52db446c-22d4-4be4-8928-711b1d175bc0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 52db446c-22d4-4be4-8928-711b1d175bc0 --json --out output.json 2021-03-20 17:42:28,029 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 52db446c-22d4-4be4-8928-711b1d175bc0 --out /home/opnfv/functest/results/rally_full/swift.json 2021-03-20 17:42:28,046 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-03-20 17:42:28,050 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:34 | 60 | 100.00% | | glance | 00:06:09 | 39 | 89.74% | | cinder | 00:37:38 | 240 | 100.00% | | heat | 00:32:58 | 100 | 100.00% | | keystone | 00:08:15 | 110 | 100.00% | | neutron | 00:15:11 | 140 | 100.00% | | nova | 00:12:14 | 50 | 98.00% | | quotas | 00:01:33 | 30 | 100.00% | | swift | 00:08:01 | 50 | 100.00% | | | | | | | TOTAL: | 02:04:36 | 819 | 99.39% | +----------------+------------+----------------+-----------+ 2021-03-20 17:42:28,051 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.39% in 6/9 modules 2021-03-20 17:42:31,988 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-03-20 17:42:35,447 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-03-20 17:42:35,448 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 131:46 | FAIL | +--------------------+------------------+------------------+----------------+