2021-04-14 15:40:05,197 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | FNTWJEPPIJGY | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/FNTWJEPPIJGY/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-210 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/FNTWJEPPIJGY/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-210 | +-------------------------+------------------------------------------------------------+ 2021-04-14 15:40:05,216 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-04-14 15:40:08,105 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-04-14 15:40:14,920 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-04-14 15:40:21,391 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 37b858e3-b9c9-48c4-916a-4034dc275c38 | 2021-04-14T15:40:21.122029 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 37b858e3-b9c9-48c4-916a-4034dc275c38 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-04-14 15:40:26,254 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-04-14 15:40:27,792 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 15:40:27,963 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-04-14 15:43:16,190 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 8c317e12-0143-4f80-a1a0-8634117b398a 2021-04-14 15:43:17,376 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8c317e12-0143-4f80-a1a0-8634117b398a -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.844 | 1.192 | 1.702 | 1.706 | 1.709 | 1.28 | 100.0% | 10 | | total | 0.844 | 1.192 | 1.702 | 1.706 | 1.709 | 1.28 | 100.0% | 10 | | -> duration | 0.844 | 1.192 | 1.702 | 1.706 | 1.709 | 1.28 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.549889 Full duration: 26.934305 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.147 | 0.248 | 0.626 | 0.751 | 0.876 | 0.339 | 100.0% | 10 | | total | 0.745 | 0.983 | 1.332 | 1.508 | 1.684 | 1.076 | 100.0% | 10 | | -> duration | 0.745 | 0.983 | 1.332 | 1.508 | 1.684 | 1.076 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.028695 Full duration: 20.701082 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.204 | 0.365 | 0.542 | 0.598 | 0.655 | 0.373 | 100.0% | 10 | | total | 0.815 | 1.024 | 1.163 | 1.234 | 1.305 | 1.028 | 100.0% | 10 | | -> duration | 0.815 | 1.024 | 1.163 | 1.234 | 1.305 | 1.028 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.943659 Full duration: 24.965181 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.154 | 0.243 | 0.408 | 0.448 | 0.488 | 0.276 | 100.0% | 10 | | total | 0.642 | 0.873 | 1.034 | 1.036 | 1.038 | 0.861 | 100.0% | 10 | | -> duration | 0.642 | 0.873 | 1.034 | 1.036 | 1.038 | 0.861 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.537486 Full duration: 24.763727 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.359 | 0.553 | 0.677 | 0.772 | 0.867 | 0.557 | 100.0% | 10 | | total | 0.769 | 1.146 | 1.35 | 1.546 | 1.742 | 1.138 | 100.0% | 10 | | -> duration | 0.769 | 1.146 | 1.35 | 1.546 | 1.742 | 1.138 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.240212 Full duration: 22.731118 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8c317e12-0143-4f80-a1a0-8634117b398a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.148 | 0.188 | 0.331 | 0.551 | 0.771 | 0.253 | 100.0% | 10 | | total | 0.623 | 0.882 | 1.389 | 1.401 | 1.413 | 0.942 | 100.0% | 10 | | -> duration | 0.623 | 0.882 | 1.389 | 1.401 | 1.413 | 0.942 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.722207 Full duration: 25.505075 HINTS: * To plot HTML graphics with this data, run: rally task report 8c317e12-0143-4f80-a1a0-8634117b398a --out output.html * To generate a JUnit report, run: rally task export 8c317e12-0143-4f80-a1a0-8634117b398a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8c317e12-0143-4f80-a1a0-8634117b398a --json --out output.json 2021-04-14 15:43:20,303 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8c317e12-0143-4f80-a1a0-8634117b398a --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-04-14 15:43:20,314 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-04-14 15:43:20,349 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 15:43:20,534 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-04-14 15:50:16,127 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 7dd5f782-e695-474d-9ddd-3da6fc84491e 2021-04-14 15:50:17,377 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7dd5f782-e695-474d-9ddd-3da6fc84491e -------------------------------------------------------------------------------- Task 7dd5f782-e695-474d-9ddd-3da6fc84491e: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7dd5f782-e695-474d-9ddd-3da6fc84491e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.204 | 6.519 | 7.082 | 7.776 | 8.471 | 6.494 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.091 | 0.103 | 0.107 | 0.108 | 0.109 | 0.101 | 100.0% | 10 | | -> glance_v2.upload_data | 2.796 | 3.845 | 4.378 | 5.223 | 6.067 | 3.876 | 100.0% | 10 | | glance_v2.delete_image | 2.124 | 3.522 | 4.078 | 4.101 | 4.123 | 3.344 | 100.0% | 10 | | total | 8.616 | 9.812 | 10.741 | 10.814 | 10.886 | 9.839 | 100.0% | 10 | | -> duration | 8.616 | 9.812 | 10.741 | 10.814 | 10.886 | 9.839 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.884568 Full duration: 58.825705 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7dd5f782-e695-474d-9ddd-3da6fc84491e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.909 | 7.018 | 9.266 | 9.304 | 9.343 | 7.237 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.09 | 0.103 | 0.112 | 0.139 | 0.165 | 0.108 | 100.0% | 10 | | -> glance_v2.upload_data | 2.472 | 4.229 | 6.644 | 6.646 | 6.649 | 4.597 | 100.0% | 10 | | glance_v2.list_images | 0.053 | 0.059 | 0.079 | 0.081 | 0.083 | 0.064 | 100.0% | 10 | | total | 4.968 | 7.087 | 9.338 | 9.369 | 9.4 | 7.301 | 100.0% | 10 | | -> duration | 4.968 | 7.087 | 9.338 | 9.369 | 9.4 | 7.301 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.696695 Full duration: 65.803323 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7dd5f782-e695-474d-9ddd-3da6fc84491e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.154 | 0.228 | 0.528 | 0.556 | 0.584 | 0.281 | 100.0% | 10 | | total | 0.154 | 0.228 | 0.528 | 0.556 | 0.584 | 0.281 | 100.0% | 10 | | -> duration | 0.154 | 0.228 | 0.528 | 0.556 | 0.584 | 0.281 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.766389 Full duration: 22.657763 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7dd5f782-e695-474d-9ddd-3da6fc84491e has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-14T15:47:28Z', 'message': 'No valid host was found. There are not enough hosts available.'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-14T15:47:28Z', 'message': 'No valid host was found. There are not enough hosts available.'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.589 | 5.96 | 7.384 | 9.684 | 11.983 | 6.345 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.091 | 0.104 | 0.115 | 0.117 | 0.118 | 0.104 | 100.0% | 9 | | -> glance_v2.upload_data | 2.188 | 3.506 | 4.245 | 5.27 | 6.295 | 3.485 | 100.0% | 9 | | nova.boot_servers | 14.489 | 52.892 | 74.764 | 78.917 | 83.07 | 52.531 | 55.6% | 9 | | total | 26.473 | 58.852 | 80.438 | 84.836 | 89.235 | 58.876 | 55.6% | 9 | | -> duration | 25.473 | 57.852 | 79.438 | 83.836 | 88.235 | 57.876 | 55.6% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 55.6% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 155.971745 Full duration: 241.448646 HINTS: * To plot HTML graphics with this data, run: rally task report 7dd5f782-e695-474d-9ddd-3da6fc84491e --out output.html * To generate a JUnit report, run: rally task export 7dd5f782-e695-474d-9ddd-3da6fc84491e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7dd5f782-e695-474d-9ddd-3da6fc84491e --json --out output.json At least one workload did not pass SLA criteria. 2021-04-14 15:50:20,290 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7dd5f782-e695-474d-9ddd-3da6fc84491e --out /home/opnfv/functest/results/rally_full/glance.json 2021-04-14 15:50:20,304 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-04-14 15:50:20,347 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 15:50:20,794 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-04-14 16:34:19,235 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 2021-04-14 16:34:20,567 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "size": 1, "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 36.242 | 49.261 | 54.875 | 55.267 | 55.658 | 48.377 | 100.0% | 10 | | cinder_v3.create_volume | 3.004 | 5.76 | 7.863 | 8.583 | 9.303 | 5.562 | 100.0% | 10 | | nova.attach_volume | 8.238 | 11.47 | 15.045 | 15.108 | 15.172 | 11.922 | 100.0% | 10 | | nova.detach_volume | 3.881 | 4.761 | 6.056 | 6.062 | 6.069 | 4.986 | 100.0% | 10 | | cinder_v3.delete_volume | 2.64 | 5.376 | 6.218 | 6.636 | 7.053 | 4.962 | 100.0% | 10 | | nova.delete_server | 7.769 | 11.891 | 19.781 | 19.855 | 19.929 | 13.4 | 100.0% | 10 | | total | 70.797 | 90.993 | 98.365 | 100.288 | 102.211 | 89.209 | 100.0% | 10 | | -> duration | 69.797 | 89.993 | 97.365 | 99.288 | 101.211 | 88.209 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 253.483915 Full duration: 299.19785 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.482 | 6.664 | 9.351 | 9.374 | 9.397 | 7.243 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.036 | 0.043 | 0.049 | 0.049 | 0.05 | 0.043 | 100.0% | 10 | | total | 5.521 | 6.71 | 9.397 | 9.419 | 9.44 | 7.287 | 100.0% | 10 | | -> duration | 5.521 | 6.71 | 9.397 | 9.419 | 9.44 | 7.287 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.954756 Full duration: 98.857791 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.231 | 17.996 | 25.224 | 25.402 | 25.581 | 19.285 | 100.0% | 10 | | cinder_v3.list_volumes | 0.067 | 0.077 | 0.086 | 0.086 | 0.086 | 0.076 | 100.0% | 10 | | total | 14.311 | 18.071 | 25.31 | 25.488 | 25.667 | 19.361 | 100.0% | 10 | | -> duration | 14.311 | 18.071 | 25.31 | 25.488 | 25.667 | 19.361 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.757704 Full duration: 105.118513 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.992 | 7.315 | 14.795 | 15.024 | 15.253 | 9.444 | 100.0% | 10 | | cinder_v3.list_volumes | 0.066 | 0.073 | 0.082 | 0.093 | 0.104 | 0.076 | 100.0% | 10 | | total | 5.062 | 7.39 | 14.865 | 15.111 | 15.356 | 9.52 | 100.0% | 10 | | -> duration | 5.062 | 7.39 | 14.865 | 15.111 | 15.356 | 9.52 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.904097 Full duration: 77.499885 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.304 | 5.72 | 7.37 | 7.562 | 7.754 | 5.729 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 40.257 | 63.574 | 65.397 | 65.573 | 65.75 | 59.401 | 100.0% | 10 | | cinder_v3.delete_volume | 2.312 | 2.555 | 3.373 | 3.904 | 4.434 | 2.811 | 100.0% | 10 | | glance_v2.delete_image | 5.88 | 6.696 | 8.523 | 8.674 | 8.826 | 7.15 | 100.0% | 10 | | total | 52.521 | 80.452 | 81.777 | 82.439 | 83.101 | 75.091 | 100.0% | 10 | | -> duration | 52.521 | 80.452 | 81.777 | 82.439 | 83.101 | 75.091 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 216.526969 Full duration: 258.260672 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 29.258 | 40.337 | 47.984 | 49.432 | 50.88 | 39.674 | 100.0% | 10 | | cinder_v3.create_volume | 3.059 | 7.878 | 11.315 | 11.521 | 11.726 | 7.644 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.602 | 8.1 | 9.065 | 9.113 | 9.162 | 7.786 | 100.0% | 10 | | nova.attach_volume | 12.678 | 14.032 | 16.54 | 17.55 | 18.56 | 14.541 | 100.0% | 10 | | nova.detach_volume | 2.673 | 6.01 | 8.021 | 8.398 | 8.775 | 5.981 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.406 | 3.787 | 5.067 | 5.396 | 5.725 | 3.849 | 100.0% | 10 | | cinder_v3.delete_volume | 2.53 | 4.259 | 10.246 | 10.337 | 10.428 | 5.2 | 100.0% | 10 | | nova.delete_server | 11.674 | 20.054 | 23.053 | 23.497 | 23.94 | 18.85 | 100.0% | 10 | | total | 83.725 | 104.123 | 114.194 | 116.868 | 119.542 | 103.527 | 100.0% | 10 | | -> duration | 82.725 | 103.123 | 113.194 | 115.868 | 118.542 | 102.527 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 301.447497 Full duration: 354.634334 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.57 | 7.244 | 19.273 | 19.391 | 19.509 | 10.277 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.324 | 5.854 | 11.58 | 12.638 | 13.695 | 7.906 | 100.0% | 10 | | nova.boot_server | 30.781 | 41.395 | 44.939 | 44.946 | 44.953 | 39.497 | 100.0% | 10 | | nova.attach_volume | 5.616 | 14.574 | 26.04 | 26.107 | 26.174 | 14.313 | 100.0% | 10 | | nova.detach_volume | 4.046 | 4.445 | 5.885 | 6.615 | 7.345 | 4.89 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.21 | 2.509 | 5.054 | 5.284 | 5.514 | 3.193 | 100.0% | 10 | | cinder_v3.delete_volume | 2.559 | 3.148 | 5.403 | 6.005 | 6.607 | 3.696 | 100.0% | 10 | | nova.delete_server | 6.498 | 12.106 | 21.125 | 21.502 | 21.88 | 13.023 | 100.0% | 10 | | total | 75.42 | 96.606 | 109.187 | 122.904 | 136.621 | 96.797 | 100.0% | 10 | | -> duration | 74.42 | 95.606 | 108.187 | 121.904 | 135.621 | 95.797 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 275.029434 Full duration: 317.83366 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.275 | 9.292 | 12.651 | 13.161 | 13.671 | 9.163 | 100.0% | 10 | | total | 6.275 | 9.292 | 12.651 | 13.161 | 13.672 | 9.163 | 100.0% | 10 | | -> duration | 6.275 | 9.292 | 12.651 | 13.161 | 13.672 | 9.163 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.384397 Full duration: 65.840624 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.989 | 8.996 | 9.79 | 9.972 | 10.154 | 8.913 | 100.0% | 10 | | total | 6.989 | 8.996 | 9.79 | 9.972 | 10.154 | 8.913 | 100.0% | 10 | | -> duration | 6.989 | 8.996 | 9.79 | 9.972 | 10.154 | 8.913 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.686559 Full duration: 63.719589 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.648 | 0.881 | 1.3 | 1.517 | 1.733 | 1.0 | 100.0% | 10 | | total | 0.648 | 0.881 | 1.3 | 1.517 | 1.733 | 1.001 | 100.0% | 10 | | -> duration | 0.648 | 0.881 | 1.3 | 1.517 | 1.733 | 1.001 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.701203 Full duration: 95.425297 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.138 | 7.374 | 10.116 | 10.426 | 10.736 | 7.92 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.239 | 5.804 | 9.335 | 9.567 | 9.8 | 6.028 | 100.0% | 10 | | total | 7.845 | 13.21 | 19.362 | 19.461 | 19.559 | 13.949 | 100.0% | 10 | | -> duration | 7.845 | 13.21 | 19.362 | 19.461 | 19.559 | 13.949 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.078153 Full duration: 92.227737 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.156 | 8.862 | 16.39 | 16.698 | 17.006 | 10.518 | 100.0% | 10 | | cinder_v3.delete_volume | 2.617 | 3.556 | 5.267 | 5.879 | 6.491 | 3.958 | 100.0% | 10 | | total | 8.773 | 12.711 | 19.57 | 20.838 | 22.105 | 14.476 | 100.0% | 10 | | -> duration | 8.773 | 12.711 | 19.57 | 20.838 | 22.105 | 14.476 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.887469 Full duration: 71.324867 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.3 | 20.232 | 26.047 | 26.479 | 26.911 | 21.613 | 100.0% | 10 | | cinder_v3.delete_volume | 2.451 | 5.008 | 7.915 | 8.297 | 8.678 | 5.237 | 100.0% | 10 | | total | 21.01 | 27.116 | 30.624 | 30.974 | 31.323 | 26.851 | 100.0% | 10 | | -> duration | 21.01 | 27.116 | 30.624 | 30.974 | 31.323 | 26.851 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.739081 Full duration: 107.28379 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.31 | 6.241 | 8.199 | 10.57 | 12.941 | 6.944 | 100.0% | 10 | | cinder_v3.delete_volume | 3.522 | 6.807 | 8.0 | 8.062 | 8.124 | 6.559 | 100.0% | 10 | | total | 9.478 | 13.464 | 15.021 | 17.184 | 19.348 | 13.503 | 100.0% | 10 | | -> duration | 9.478 | 13.464 | 15.021 | 17.184 | 19.348 | 13.503 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.942017 Full duration: 74.439583 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.007 | 6.694 | 11.328 | 12.049 | 12.771 | 7.901 | 100.0% | 10 | | cinder_v3.extend_volume | 2.529 | 4.493 | 5.535 | 5.607 | 5.678 | 4.232 | 100.0% | 10 | | cinder_v3.delete_volume | 4.32 | 5.506 | 6.851 | 8.739 | 10.627 | 5.873 | 100.0% | 10 | | total | 13.544 | 17.289 | 22.674 | 22.718 | 22.762 | 18.006 | 100.0% | 10 | | -> duration | 13.544 | 17.289 | 22.674 | 22.718 | 22.762 | 18.006 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.377887 Full duration: 94.681327 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.002 | 8.737 | 10.449 | 10.659 | 10.87 | 8.617 | 100.0% | 10 | | cinder_v3.delete_volume | 4.707 | 7.826 | 13.421 | 13.506 | 13.591 | 8.738 | 100.0% | 10 | | total | 13.399 | 16.348 | 22.267 | 22.282 | 22.296 | 17.355 | 100.0% | 10 | | -> duration | 13.399 | 16.348 | 22.267 | 22.282 | 22.296 | 17.355 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.067053 Full duration: 104.605137 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.771 | 0.998 | 2.245 | 2.349 | 2.453 | 1.376 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.037 | 0.048 | 0.054 | 0.061 | 0.039 | 100.0% | 10 | | total | 0.808 | 1.045 | 2.277 | 2.381 | 2.485 | 1.415 | 100.0% | 10 | | -> duration | 0.808 | 1.045 | 2.277 | 2.381 | 2.485 | 1.415 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.044274 Full duration: 33.406389 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.84 | 1.126 | 1.403 | 1.737 | 2.071 | 1.185 | 100.0% | 10 | | cinder_v3.list_qos | 0.033 | 0.039 | 0.044 | 0.046 | 0.049 | 0.04 | 100.0% | 10 | | total | 0.884 | 1.162 | 1.451 | 1.781 | 2.111 | 1.225 | 100.0% | 10 | | -> duration | 0.884 | 1.162 | 1.451 | 1.781 | 2.111 | 1.225 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.432011 Full duration: 34.264433 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.566 | 1.169 | 1.86 | 1.866 | 1.872 | 1.255 | 100.0% | 10 | | cinder_v3.set_qos | 0.081 | 0.546 | 0.782 | 0.8 | 0.819 | 0.505 | 100.0% | 10 | | total | 0.696 | 1.916 | 2.264 | 2.362 | 2.459 | 1.76 | 100.0% | 10 | | -> duration | 0.696 | 1.916 | 2.264 | 2.362 | 2.459 | 1.76 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.707836 Full duration: 33.301658 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.717 | 0.904 | 1.722 | 1.766 | 1.81 | 1.105 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.027 | 0.041 | 0.057 | 0.057 | 0.057 | 0.041 | 100.0% | 10 | | total | 0.751 | 0.961 | 1.764 | 1.808 | 1.851 | 1.146 | 100.0% | 10 | | -> duration | 0.751 | 0.961 | 1.764 | 1.808 | 1.851 | 1.146 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.395977 Full duration: 34.818641 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.629 | 1.161 | 1.615 | 1.712 | 1.808 | 1.227 | 100.0% | 10 | | cinder_v3.list_types | 0.034 | 0.045 | 0.048 | 0.049 | 0.05 | 0.043 | 100.0% | 10 | | total | 0.677 | 1.2 | 1.652 | 1.753 | 1.854 | 1.271 | 100.0% | 10 | | -> duration | 0.677 | 1.2 | 1.652 | 1.753 | 1.854 | 1.271 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.731812 Full duration: 34.838256 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 1.154 | 2.647 | 3.15 | 3.185 | 3.219 | 2.354 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.381 | 0.662 | 1.185 | 1.558 | 1.931 | 0.814 | 100.0% | 10 | | total | 1.664 | 3.39 | 3.664 | 3.955 | 4.245 | 3.169 | 100.0% | 10 | | -> duration | 1.664 | 3.39 | 3.664 | 3.955 | 4.245 | 3.169 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.558536 Full duration: 40.228245 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.66 | 0.968 | 1.154 | 1.155 | 1.155 | 0.956 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.137 | 0.294 | 0.658 | 0.781 | 0.903 | 0.372 | 100.0% | 10 | | total | 1.04 | 1.19 | 1.813 | 1.936 | 2.058 | 1.329 | 100.0% | 10 | | -> duration | 1.04 | 1.19 | 1.813 | 1.936 | 2.058 | 1.329 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.693805 Full duration: 36.419321 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.941 | 1.766 | 2.005 | 2.382 | 2.759 | 1.607 | 100.0% | 10 | | cinder_v2.add_type_access | 0.444 | 1.421 | 1.71 | 1.841 | 1.973 | 1.292 | 100.0% | 10 | | cinder_v2.list_type_access | 0.033 | 0.046 | 0.052 | 0.056 | 0.06 | 0.044 | 100.0% | 10 | | total | 1.526 | 3.096 | 3.639 | 3.655 | 3.67 | 2.943 | 100.0% | 10 | | -> duration | 1.526 | 3.096 | 3.639 | 3.655 | 3.67 | 2.943 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.447613 Full duration: 41.510665 HINTS: * To plot HTML graphics with this data, run: rally task report 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 --out output.html * To generate a JUnit report, run: rally task export 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 --json --out output.json 2021-04-14 16:34:23,804 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 839b6fc9-b6b8-4e3a-8ee9-779c5f06cf21 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-04-14 16:34:23,886 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-04-14 16:34:23,907 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 16:34:24,343 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-04-14 17:15:06,336 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: f5020110-a858-44b1-8843-c728f80be64a 2021-04-14 17:15:07,594 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f5020110-a858-44b1-8843-c728f80be64a -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.012 | 11.12 | 13.019 | 13.703 | 14.388 | 10.56 | 100.0% | 10 | | heat.list_stacks | 0.053 | 0.068 | 0.079 | 0.085 | 0.091 | 0.068 | 100.0% | 10 | | total | 7.087 | 11.194 | 13.072 | 13.759 | 14.446 | 10.628 | 100.0% | 10 | | -> duration | 5.087 | 9.194 | 11.072 | 11.759 | 12.446 | 8.628 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.560262 Full duration: 96.246749 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 23.62 | 30.397 | 46.357 | 47.47 | 48.583 | 34.909 | 100.0% | 10 | | heat.update_stack | 15.309 | 25.138 | 28.209 | 29.224 | 30.24 | 24.089 | 100.0% | 10 | | heat.delete_stack | 11.259 | 15.054 | 29.901 | 30.794 | 31.688 | 20.166 | 100.0% | 10 | | total | 57.054 | 69.548 | 101.017 | 103.146 | 105.274 | 79.164 | 100.0% | 10 | | -> duration | 53.054 | 65.548 | 97.017 | 99.146 | 101.274 | 75.164 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 219.673227 Full duration: 265.407454 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 23.897 | 29.756 | 48.22 | 49.271 | 50.323 | 35.309 | 100.0% | 10 | | heat.update_stack | 8.394 | 12.311 | 17.302 | 19.109 | 20.915 | 13.389 | 100.0% | 10 | | heat.delete_stack | 10.672 | 15.253 | 29.866 | 29.917 | 29.968 | 19.079 | 100.0% | 10 | | total | 46.872 | 52.974 | 94.241 | 96.97 | 99.7 | 67.777 | 100.0% | 10 | | -> duration | 42.872 | 48.974 | 90.241 | 92.97 | 95.7 | 63.777 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 187.220536 Full duration: 235.921833 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 33.503 | 39.005 | 43.568 | 45.996 | 48.425 | 39.329 | 100.0% | 10 | | heat.update_stack | 22.304 | 46.595 | 52.627 | 53.038 | 53.449 | 43.731 | 100.0% | 10 | | heat.delete_stack | 19.345 | 37.48 | 40.371 | 41.584 | 42.797 | 34.097 | 100.0% | 10 | | total | 75.152 | 125.8 | 133.259 | 133.876 | 134.493 | 117.158 | 100.0% | 10 | | -> duration | 71.152 | 121.8 | 129.259 | 129.876 | 130.493 | 113.158 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 325.27603 Full duration: 372.910202 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 27.12 | 41.126 | 46.72 | 47.549 | 48.379 | 37.609 | 100.0% | 10 | | heat.update_stack | 12.606 | 30.816 | 32.272 | 33.246 | 34.221 | 27.51 | 100.0% | 10 | | heat.delete_stack | 18.337 | 38.945 | 40.504 | 41.855 | 43.207 | 34.954 | 100.0% | 10 | | total | 70.127 | 99.886 | 114.63 | 119.296 | 123.963 | 100.073 | 100.0% | 10 | | -> duration | 66.127 | 95.886 | 110.63 | 115.296 | 119.963 | 96.073 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 280.340243 Full duration: 326.171 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 44.798 | 49.46 | 51.444 | 52.216 | 52.987 | 48.941 | 100.0% | 10 | | heat.update_stack | 17.318 | 32.878 | 60.422 | 61.477 | 62.533 | 40.508 | 100.0% | 10 | | heat.delete_stack | 17.55 | 27.74 | 33.351 | 34.531 | 35.711 | 27.024 | 100.0% | 10 | | total | 83.054 | 110.811 | 143.415 | 144.839 | 146.263 | 116.473 | 100.0% | 10 | | -> duration | 79.054 | 106.811 | 139.415 | 140.839 | 142.263 | 112.473 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 322.918432 Full duration: 368.090649 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 22.105 | 26.617 | 49.697 | 49.964 | 50.231 | 33.515 | 100.0% | 10 | | heat.update_stack | 18.439 | 26.917 | 33.674 | 34.065 | 34.456 | 27.35 | 100.0% | 10 | | heat.delete_stack | 9.4 | 17.129 | 21.146 | 22.251 | 23.355 | 16.462 | 100.0% | 10 | | total | 52.072 | 75.663 | 99.192 | 100.305 | 101.418 | 77.327 | 100.0% | 10 | | -> duration | 48.072 | 71.663 | 95.192 | 96.305 | 97.418 | 73.327 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 213.892366 Full duration: 255.574669 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 24.608 | 29.443 | 32.084 | 32.277 | 32.471 | 29.108 | 100.0% | 10 | | heat.check_stack | 4.541 | 5.104 | 8.258 | 9.12 | 9.983 | 5.962 | 100.0% | 10 | | heat.delete_stack | 4.698 | 11.711 | 15.005 | 16.265 | 17.525 | 11.446 | 100.0% | 10 | | total | 35.66 | 47.594 | 51.752 | 53.417 | 55.081 | 46.516 | 100.0% | 10 | | -> duration | 33.66 | 45.594 | 49.752 | 51.417 | 53.081 | 44.516 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 132.143939 Full duration: 173.108917 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 19.721 | 31.043 | 35.824 | 36.06 | 36.295 | 29.336 | 100.0% | 10 | | heat.suspend_stack | 6.308 | 10.403 | 11.45 | 11.574 | 11.699 | 9.589 | 100.0% | 10 | | heat.resume_stack | 7.438 | 10.157 | 15.956 | 16.42 | 16.884 | 11.289 | 100.0% | 10 | | heat.delete_stack | 6.816 | 15.517 | 18.896 | 18.91 | 18.925 | 14.635 | 100.0% | 10 | | total | 52.438 | 60.373 | 78.15 | 80.195 | 82.241 | 64.849 | 100.0% | 10 | | -> duration | 50.438 | 58.373 | 76.15 | 78.195 | 80.241 | 62.849 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 185.168334 Full duration: 231.745936 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5020110-a858-44b1-8843-c728f80be64a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.627 | 0.847 | 1.317 | 1.327 | 1.338 | 0.947 | 100.0% | 10 | | total | 0.627 | 0.848 | 1.317 | 1.328 | 1.338 | 0.947 | 100.0% | 10 | | -> duration | 0.627 | 0.848 | 1.317 | 1.328 | 1.338 | 0.947 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.917509 Full duration: 39.664384 HINTS: * To plot HTML graphics with this data, run: rally task report f5020110-a858-44b1-8843-c728f80be64a --out output.html * To generate a JUnit report, run: rally task export f5020110-a858-44b1-8843-c728f80be64a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f5020110-a858-44b1-8843-c728f80be64a --json --out output.json 2021-04-14 17:15:10,649 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f5020110-a858-44b1-8843-c728f80be64a --out /home/opnfv/functest/results/rally_full/heat.json 2021-04-14 17:15:10,667 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-04-14 17:15:10,698 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 17:15:11,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-04-14 17:24:57,400 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 6127ab73-0b37-4d9a-b98c-3e27adda9c8e 2021-04-14 17:24:58,664 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6127ab73-0b37-4d9a-b98c-3e27adda9c8e -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.123 | 0.283 | 0.465 | 0.54 | 0.614 | 0.309 | 100.0% | 10 | | keystone_v3.add_role | 0.082 | 0.279 | 0.473 | 0.548 | 0.624 | 0.314 | 100.0% | 10 | | keystone_v3.revoke_role | 0.16 | 0.309 | 0.473 | 0.487 | 0.5 | 0.313 | 100.0% | 10 | | total | 0.599 | 0.866 | 1.364 | 1.463 | 1.562 | 0.936 | 100.0% | 10 | | -> duration | 0.599 | 0.866 | 1.364 | 1.463 | 1.562 | 0.936 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.295566 Full duration: 41.455969 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.117 | 0.606 | 1.069 | 1.195 | 1.321 | 0.635 | 100.0% | 10 | | keystone_v3.add_role | 0.073 | 0.261 | 0.57 | 0.697 | 0.823 | 0.316 | 100.0% | 10 | | keystone_v3.list_roles | 0.107 | 0.123 | 0.3 | 0.485 | 0.671 | 0.189 | 100.0% | 10 | | total | 0.439 | 1.295 | 1.555 | 1.575 | 1.594 | 1.139 | 100.0% | 10 | | -> duration | 0.439 | 1.295 | 1.555 | 1.575 | 1.594 | 1.139 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.583403 Full duration: 39.339374 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.232 | 0.949 | 1.411 | 1.577 | 1.743 | 0.919 | 100.0% | 10 | | keystone_v3.list_projects | 0.126 | 0.155 | 0.301 | 0.365 | 0.428 | 0.198 | 100.0% | 10 | | total | 0.385 | 1.124 | 1.619 | 1.795 | 1.971 | 1.118 | 100.0% | 10 | | -> duration | 0.385 | 1.124 | 1.619 | 1.795 | 1.971 | 1.118 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.11046 Full duration: 41.173036 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.138 | 0.331 | 0.699 | 0.841 | 0.982 | 0.41 | 100.0% | 10 | | keystone_v3.delete_role | 0.086 | 0.387 | 0.652 | 0.67 | 0.688 | 0.366 | 100.0% | 10 | | total | 0.224 | 0.751 | 1.335 | 1.366 | 1.397 | 0.776 | 100.0% | 10 | | -> duration | 0.224 | 0.751 | 1.335 | 1.366 | 1.397 | 0.776 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.218226 Full duration: 32.995565 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.207 | 0.526 | 1.237 | 1.474 | 1.711 | 0.673 | 100.0% | 10 | | keystone_v3.delete_service | 0.103 | 0.341 | 0.845 | 0.876 | 0.907 | 0.425 | 100.0% | 10 | | total | 0.324 | 1.106 | 1.432 | 2.025 | 2.618 | 1.098 | 100.0% | 10 | | -> duration | 0.324 | 1.106 | 1.432 | 2.025 | 2.618 | 1.098 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.394197 Full duration: 36.090278 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.274 | 2.202 | 5.749 | 6.109 | 6.469 | 2.765 | 100.0% | 10 | | keystone_v3.create_user | 0.428 | 1.479 | 2.208 | 2.669 | 3.13 | 1.513 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.046 | 0.056 | 0.219 | 0.515 | 0.811 | 0.141 | 100.0% | 10 | | -> keystone_v3.add_role | 0.117 | 0.618 | 1.01 | 1.037 | 1.064 | 0.537 | 100.0% | 10 | | keystone_v3.create_role | 0.164 | 0.287 | 0.595 | 0.707 | 0.818 | 0.353 | 100.0% | 10 | | keystone_v3.get_project | 0.034 | 0.044 | 0.06 | 0.09 | 0.121 | 0.05 | 100.0% | 10 | | keystone_v3.get_user | 0.037 | 0.042 | 0.119 | 0.121 | 0.122 | 0.064 | 100.0% | 10 | | keystone_v3.get_role | 0.034 | 0.037 | 0.051 | 0.082 | 0.112 | 0.045 | 100.0% | 10 | | keystone_v3.list_services | 0.04 | 0.071 | 0.399 | 0.42 | 0.441 | 0.169 | 100.0% | 10 | | keystone_v3.get_services | 0.035 | 0.038 | 0.13 | 0.505 | 0.881 | 0.123 | 100.0% | 10 | | total | 1.286 | 5.47 | 8.528 | 8.744 | 8.96 | 5.266 | 100.0% | 10 | | -> duration | 1.286 | 5.47 | 8.528 | 8.744 | 8.96 | 5.266 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.566705 Full duration: 69.433352 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.525 | 1.744 | 2.799 | 2.814 | 2.829 | 1.621 | 100.0% | 10 | | keystone_v3.update_project | 0.286 | 0.567 | 1.078 | 1.187 | 1.297 | 0.675 | 100.0% | 10 | | keystone_v3.delete_project | 0.161 | 0.691 | 1.23 | 1.403 | 1.576 | 0.749 | 100.0% | 10 | | total | 1.693 | 2.827 | 4.364 | 4.471 | 4.579 | 3.046 | 100.0% | 10 | | -> duration | 1.693 | 2.827 | 4.364 | 4.471 | 4.579 | 3.046 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.327145 Full duration: 41.829543 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.252 | 0.803 | 1.285 | 1.315 | 1.345 | 0.82 | 100.0% | 10 | | total | 0.33 | 0.883 | 1.379 | 1.435 | 1.49 | 0.91 | 100.0% | 10 | | -> duration | 0.33 | 0.883 | 1.379 | 1.435 | 1.49 | 0.91 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.46438 Full duration: 30.185156 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.349 | 0.767 | 1.079 | 1.17 | 1.261 | 0.762 | 100.0% | 10 | | total | 0.349 | 0.768 | 1.079 | 1.17 | 1.261 | 0.762 | 100.0% | 10 | | -> duration | 0.349 | 0.768 | 1.079 | 1.17 | 1.261 | 0.762 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.594028 Full duration: 29.724013 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.244 | 0.909 | 1.154 | 1.207 | 1.26 | 0.83 | 100.0% | 10 | | keystone_v3.list_users | 0.063 | 0.076 | 0.094 | 0.15 | 0.206 | 0.088 | 100.0% | 10 | | total | 0.388 | 1.21 | 1.414 | 1.417 | 1.419 | 1.033 | 100.0% | 10 | | -> duration | 0.388 | 1.21 | 1.414 | 1.417 | 1.419 | 1.033 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.813401 Full duration: 34.35576 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6127ab73-0b37-4d9a-b98c-3e27adda9c8e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.446 | 0.643 | 1.41 | 1.547 | 1.684 | 0.838 | 100.0% | 10 | | keystone_v3.create_users | 11.324 | 16.814 | 21.428 | 21.718 | 22.009 | 17.416 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 11.323 | 16.814 | 21.427 | 21.718 | 22.008 | 17.416 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.742 | 1.094 | 3.154 | 3.392 | 3.63 | 1.553 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.044 | 6.288 | 7.946 | 8.334 | 8.721 | 6.312 | 100.0% | 10 | | total | 13.717 | 18.204 | 23.997 | 24.228 | 24.46 | 19.53 | 100.0% | 10 | | -> duration | 13.717 | 18.204 | 23.997 | 24.228 | 24.46 | 19.53 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 60.790256 Full duration: 163.74991 HINTS: * To plot HTML graphics with this data, run: rally task report 6127ab73-0b37-4d9a-b98c-3e27adda9c8e --out output.html * To generate a JUnit report, run: rally task export 6127ab73-0b37-4d9a-b98c-3e27adda9c8e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6127ab73-0b37-4d9a-b98c-3e27adda9c8e --json --out output.json 2021-04-14 17:25:01,828 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6127ab73-0b37-4d9a-b98c-3e27adda9c8e --out /home/opnfv/functest/results/rally_full/keystone.json 2021-04-14 17:25:01,851 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-04-14 17:25:01,890 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 17:25:02,573 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-04-14 17:43:10,676 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 80be6cc3-7bbb-4a99-bc0f-b85b665f61de 2021-04-14 17:43:12,031 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 80be6cc3-7bbb-4a99-bc0f-b85b665f61de -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.609 | 3.751 | 7.867 | 7.877 | 7.887 | 5.064 | 100.0% | 10 | | neutron.update_network | 0.884 | 1.55 | 4.136 | 4.147 | 4.158 | 2.351 | 100.0% | 10 | | total | 4.16 | 7.897 | 8.935 | 9.013 | 9.09 | 7.415 | 100.0% | 10 | | -> duration | 4.16 | 7.897 | 8.935 | 9.013 | 9.09 | 7.415 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.535191 Full duration: 71.10342 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.255 | 4.124 | 6.313 | 6.324 | 6.335 | 4.581 | 100.0% | 10 | | neutron.update_port | 1.103 | 1.486 | 1.83 | 1.963 | 2.095 | 1.523 | 100.0% | 10 | | total | 4.781 | 5.352 | 7.824 | 8.127 | 8.43 | 6.104 | 100.0% | 10 | | -> duration | 4.781 | 5.352 | 7.824 | 8.127 | 8.43 | 6.104 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.517192 Full duration: 87.656446 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.23 | 3.585 | 6.385 | 7.523 | 8.661 | 4.407 | 100.0% | 10 | | neutron.create_subnet | 1.81 | 3.078 | 3.623 | 3.764 | 3.904 | 3.111 | 100.0% | 10 | | neutron.update_subnet | 0.638 | 2.146 | 3.42 | 3.499 | 3.578 | 2.05 | 100.0% | 10 | | total | 5.248 | 9.444 | 11.907 | 12.219 | 12.531 | 9.568 | 100.0% | 10 | | -> duration | 5.248 | 9.444 | 11.907 | 12.219 | 12.531 | 9.568 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.536913 Full duration: 76.6923 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.367 | 2.754 | 3.773 | 3.798 | 3.824 | 2.92 | 100.0% | 10 | | neutron.delete_network | 0.805 | 2.219 | 3.746 | 3.751 | 3.756 | 2.313 | 100.0% | 10 | | total | 3.428 | 5.57 | 6.338 | 6.362 | 6.386 | 5.233 | 100.0% | 10 | | -> duration | 3.428 | 5.57 | 6.338 | 6.362 | 6.386 | 5.233 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.034057 Full duration: 59.599918 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.934 | 6.494 | 7.673 | 8.029 | 8.385 | 6.1 | 100.0% | 10 | | neutron.delete_port | 0.77 | 1.867 | 4.749 | 4.818 | 4.886 | 2.347 | 100.0% | 10 | | total | 4.421 | 8.603 | 10.747 | 11.148 | 11.55 | 8.448 | 100.0% | 10 | | -> duration | 4.421 | 8.603 | 10.747 | 11.148 | 11.55 | 8.448 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.475806 Full duration: 97.588076 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.576 | 3.097 | 4.32 | 5.019 | 5.719 | 3.152 | 100.0% | 10 | | neutron.create_subnet | 1.301 | 2.863 | 4.254 | 4.397 | 4.54 | 2.953 | 100.0% | 10 | | neutron.delete_subnet | 0.853 | 1.748 | 2.074 | 2.105 | 2.136 | 1.658 | 100.0% | 10 | | total | 4.807 | 7.874 | 10.066 | 10.95 | 11.833 | 7.767 | 100.0% | 10 | | -> duration | 4.807 | 7.874 | 10.066 | 10.95 | 11.833 | 7.767 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.069807 Full duration: 74.750583 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.873 | 3.026 | 4.254 | 4.329 | 4.405 | 3.202 | 100.0% | 10 | | neutron.list_networks | 0.132 | 0.389 | 0.791 | 0.875 | 0.96 | 0.422 | 100.0% | 10 | | total | 2.424 | 3.762 | 4.448 | 4.492 | 4.536 | 3.624 | 100.0% | 10 | | -> duration | 2.424 | 3.762 | 4.448 | 4.492 | 4.536 | 3.624 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.12274 Full duration: 67.408896 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.494 | 5.287 | 6.04 | 7.11 | 8.18 | 5.292 | 100.0% | 10 | | neutron.list_ports | 0.099 | 0.504 | 0.998 | 1.136 | 1.274 | 0.528 | 100.0% | 10 | | total | 4.461 | 5.592 | 6.881 | 7.59 | 8.3 | 5.82 | 100.0% | 10 | | -> duration | 4.461 | 5.592 | 6.881 | 7.59 | 8.3 | 5.82 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.583112 Full duration: 96.052405 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.78 | 2.626 | 3.439 | 3.763 | 4.087 | 2.682 | 100.0% | 10 | | neutron.create_subnet | 1.106 | 2.443 | 3.255 | 3.439 | 3.624 | 2.426 | 100.0% | 10 | | neutron.list_subnets | 0.078 | 0.211 | 0.432 | 0.47 | 0.508 | 0.247 | 100.0% | 10 | | total | 3.006 | 5.282 | 6.726 | 7.174 | 7.622 | 5.355 | 100.0% | 10 | | -> duration | 3.006 | 5.282 | 6.726 | 7.174 | 7.622 | 5.355 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.662153 Full duration: 70.372173 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.775 | 1.985 | 2.254 | 2.612 | 2.969 | 2.079 | 100.0% | 10 | | neutron.delete_security_group | 0.235 | 0.581 | 0.866 | 0.935 | 1.004 | 0.582 | 100.0% | 10 | | total | 2.104 | 2.64 | 2.939 | 3.456 | 3.973 | 2.661 | 100.0% | 10 | | -> duration | 2.104 | 2.64 | 2.939 | 3.456 | 3.973 | 2.661 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.337067 Full duration: 49.916436 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.991 | 2.685 | 5.079 | 5.268 | 5.456 | 3.142 | 100.0% | 10 | | neutron.create_security_group_rule | 0.695 | 1.254 | 2.26 | 2.9 | 3.539 | 1.456 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.165 | 0.524 | 1.075 | 1.094 | 1.114 | 0.57 | 100.0% | 10 | | neutron.delete_security_group | 0.393 | 0.698 | 0.929 | 1.019 | 1.109 | 0.73 | 100.0% | 10 | | total | 3.534 | 5.619 | 8.141 | 8.286 | 8.43 | 5.898 | 100.0% | 10 | | -> duration | 3.534 | 5.619 | 8.141 | 8.286 | 8.43 | 5.898 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.607609 Full duration: 60.663956 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.329 | 2.337 | 2.959 | 3.123 | 3.286 | 2.243 | 100.0% | 10 | | neutron.create_security_group_rule | 0.497 | 1.009 | 1.406 | 1.412 | 1.418 | 0.966 | 100.0% | 10 | | neutron.list_security_group_rules | 0.08 | 0.119 | 0.422 | 0.605 | 0.789 | 0.234 | 100.0% | 10 | | total | 2.199 | 3.572 | 4.074 | 4.404 | 4.734 | 3.443 | 100.0% | 10 | | -> duration | 2.199 | 3.572 | 4.074 | 4.404 | 4.734 | 3.443 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.628719 Full duration: 58.96234 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.722 | 2.525 | 4.411 | 4.674 | 4.938 | 2.963 | 100.0% | 10 | | neutron.show_security_group | 0.068 | 0.085 | 0.095 | 0.096 | 0.098 | 0.082 | 100.0% | 10 | | total | 1.808 | 2.608 | 4.506 | 4.771 | 5.035 | 3.046 | 100.0% | 10 | | -> duration | 1.808 | 2.608 | 4.506 | 4.771 | 5.035 | 3.046 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.507155 Full duration: 54.814269 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 22.630763 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 80be6cc3-7bbb-4a99-bc0f-b85b665f61de has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 4.446 | 6.47 | 13.222 | 13.388 | 13.554 | 8.128 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.257 | 0.542 | 0.962 | 0.981 | 1.0 | 0.589 | 100.0% | 10 | | total | 4.715 | 7.449 | 13.742 | 13.933 | 14.124 | 8.717 | 100.0% | 10 | | -> duration | 4.715 | 7.449 | 13.742 | 13.933 | 14.124 | 8.717 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.02953 Full duration: 97.085212 HINTS: * To plot HTML graphics with this data, run: rally task report 80be6cc3-7bbb-4a99-bc0f-b85b665f61de --out output.html * To generate a JUnit report, run: rally task export 80be6cc3-7bbb-4a99-bc0f-b85b665f61de --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 80be6cc3-7bbb-4a99-bc0f-b85b665f61de --json --out output.json At least one workload did not pass SLA criteria. 2021-04-14 17:43:15,051 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 80be6cc3-7bbb-4a99-bc0f-b85b665f61de --out /home/opnfv/functest/results/rally_full/neutron.json 2021-04-14 17:43:15,074 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-04-14 17:43:15,115 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 17:43:15,944 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-04-14 17:57:53,146 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 3596e6cf-5421-4bda-85fc-137a055926f4 2021-04-14 17:57:54,430 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3596e6cf-5421-4bda-85fc-137a055926f4 -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.892 | 1.38 | 2.306 | 2.329 | 2.352 | 1.483 | 100.0% | 10 | | nova.delete_keypair | 0.078 | 0.31 | 0.419 | 0.639 | 0.86 | 0.312 | 100.0% | 10 | | total | 1.014 | 1.621 | 2.674 | 2.685 | 2.696 | 1.795 | 100.0% | 10 | | -> duration | 1.014 | 1.621 | 2.674 | 2.685 | 2.696 | 1.795 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.833938 Full duration: 31.504498 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.8 | 1.267 | 1.901 | 2.2 | 2.498 | 1.356 | 100.0% | 10 | | nova.list_keypairs | 0.03 | 0.037 | 0.043 | 0.045 | 0.047 | 0.037 | 100.0% | 10 | | total | 0.837 | 1.304 | 1.932 | 2.233 | 2.534 | 1.394 | 100.0% | 10 | | -> duration | 0.837 | 1.304 | 1.932 | 2.233 | 2.534 | 1.394 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.033298 Full duration: 34.257265 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.076 | 31.401 | 51.29 | 52.937 | 54.583 | 35.853 | 100.0% | 10 | | nova.reboot_server | 7.734 | 14.457 | 18.253 | 18.318 | 18.383 | 14.507 | 100.0% | 10 | | nova.soft_reboot_server | 10.589 | 13.478 | 136.115 | 137.257 | 138.399 | 38.517 | 100.0% | 10 | | nova.stop_and_start_server | 12.529 | 19.54 | 22.588 | 25.164 | 27.74 | 19.046 | 100.0% | 10 | | -> nova.stop_server | 5.522 | 9.009 | 16.356 | 18.595 | 20.835 | 10.88 | 100.0% | 10 | | -> nova.start_server | 5.761 | 7.602 | 10.923 | 10.975 | 11.028 | 8.166 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 16.432 | 19.859 | 28.243 | 29.001 | 29.76 | 22.042 | 100.0% | 10 | | -> nova.rescue_server | 9.724 | 12.883 | 21.595 | 22.026 | 22.457 | 15.106 | 100.0% | 10 | | -> nova.unrescue_server | 4.862 | 6.924 | 8.465 | 8.795 | 9.124 | 6.935 | 100.0% | 10 | | nova.delete_server | 5.514 | 8.618 | 12.32 | 13.308 | 14.296 | 8.903 | 100.0% | 10 | | total | 89.894 | 115.174 | 252.392 | 257.769 | 263.146 | 138.923 | 100.0% | 10 | | -> duration | 80.894 | 106.174 | 243.392 | 248.769 | 254.146 | 129.923 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 360.27256 Full duration: 403.893123 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 35.872 | 41.788 | 48.872 | 50.402 | 51.932 | 42.683 | 100.0% | 10 | | nova.delete_server | 13.571 | 15.668 | 23.001 | 23.805 | 24.608 | 17.409 | 100.0% | 10 | | total | 52.918 | 58.956 | 68.44 | 69.277 | 70.114 | 60.093 | 100.0% | 10 | | -> duration | 51.918 | 57.956 | 67.44 | 68.277 | 69.114 | 59.093 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 167.511301 Full duration: 204.959373 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "image": { "name": "rally_full-img_0ccd7a4d-d666-4191-a60d-4291ce9eca51" }, "nics": [ { "net-id": "f04a13f7-80f2-46f1-bb2c-019d93aea452" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3596e6cf-5421-4bda-85fc-137a055926f4 has 1 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.575 | 27.036 | 41.906 | 43.335 | 44.763 | 29.616 | 90.0% | 10 | | nova.list_servers | 0.387 | 0.413 | 0.455 | 0.46 | 0.466 | 0.418 | 100.0% | 9 | | total | 9.575 | 27.438 | 42.3 | 43.758 | 45.216 | 29.992 | 90.0% | 10 | | -> duration | 8.575 | 26.438 | 41.3 | 42.758 | 44.216 | 28.992 | 90.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 90.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 85.014673 Full duration: 146.503855 HINTS: * To plot HTML graphics with this data, run: rally task report 3596e6cf-5421-4bda-85fc-137a055926f4 --out output.html * To generate a JUnit report, run: rally task export 3596e6cf-5421-4bda-85fc-137a055926f4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3596e6cf-5421-4bda-85fc-137a055926f4 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-14 17:57:57,622 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3596e6cf-5421-4bda-85fc-137a055926f4 --out /home/opnfv/functest/results/rally_full/nova.json 2021-04-14 17:57:57,636 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-04-14 17:57:57,664 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 17:57:58,111 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-04-14 17:59:44,992 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: b33e1ecc-002c-474d-9f25-58f068aa4bfe 2021-04-14 17:59:46,201 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b33e1ecc-002c-474d-9f25-58f068aa4bfe -------------------------------------------------------------------------------- Task b33e1ecc-002c-474d-9f25-58f068aa4bfe: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b33e1ecc-002c-474d-9f25-58f068aa4bfe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.389 | 1.766 | 1.879 | 1.898 | 1.917 | 1.678 | 100.0% | 10 | | quotas.delete_quotas | 0.03 | 0.29 | 0.462 | 0.521 | 0.579 | 0.292 | 100.0% | 10 | | total | 1.562 | 1.979 | 2.18 | 2.191 | 2.202 | 1.97 | 100.0% | 10 | | -> duration | 1.562 | 1.979 | 2.18 | 2.191 | 2.202 | 1.97 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.955559 Full duration: 26.969078 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b33e1ecc-002c-474d-9f25-58f068aa4bfe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.024 | 2.352 | 2.584 | 2.72 | 2.855 | 2.118 | 100.0% | 10 | | total | 1.024 | 2.352 | 2.584 | 2.72 | 2.855 | 2.118 | 100.0% | 10 | | -> duration | 1.024 | 2.352 | 2.584 | 2.72 | 2.855 | 2.118 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.528891 Full duration: 31.207519 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b33e1ecc-002c-474d-9f25-58f068aa4bfe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.95 | 3.039 | 3.311 | 3.316 | 3.321 | 2.866 | 100.0% | 10 | | total | 1.95 | 3.039 | 3.311 | 3.316 | 3.321 | 2.866 | 100.0% | 10 | | -> duration | 1.95 | 3.039 | 3.311 | 3.316 | 3.321 | 2.866 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.953709 Full duration: 29.891768 HINTS: * To plot HTML graphics with this data, run: rally task report b33e1ecc-002c-474d-9f25-58f068aa4bfe --out output.html * To generate a JUnit report, run: rally task export b33e1ecc-002c-474d-9f25-58f068aa4bfe --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b33e1ecc-002c-474d-9f25-58f068aa4bfe --json --out output.json 2021-04-14 17:59:49,179 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b33e1ecc-002c-474d-9f25-58f068aa4bfe --out /home/opnfv/functest/results/rally_full/quotas.json 2021-04-14 17:59:49,185 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-04-14 17:59:49,217 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-14 17:59:49,384 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-04-14 18:08:50,631 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: a2b63276-0f3b-4891-8997-7c5d6ae571c5 2021-04-14 18:08:51,954 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a2b63276-0f3b-4891-8997-7c5d6ae571c5 -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.067 | 1.18 | 1.383 | 1.663 | 1.943 | 1.248 | 100.0% | 10 | | swift.upload_object (x2) | 1.076 | 1.184 | 1.229 | 1.233 | 1.237 | 1.177 | 100.0% | 10 | | swift.list_objects | 1.002 | 1.051 | 1.115 | 1.119 | 1.123 | 1.056 | 100.0% | 10 | | total | 3.272 | 3.429 | 3.592 | 3.908 | 4.225 | 3.482 | 100.0% | 10 | | -> duration | 3.272 | 3.429 | 3.592 | 3.908 | 4.225 | 3.482 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.876238 Full duration: 104.434992 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.403 | 1.496 | 1.686 | 1.703 | 1.72 | 1.538 | 100.0% | 10 | | swift.list_objects | 0.984 | 1.025 | 1.075 | 1.075 | 1.075 | 1.029 | 100.0% | 10 | | total | 2.418 | 2.539 | 2.709 | 2.729 | 2.749 | 2.567 | 100.0% | 10 | | -> duration | 2.418 | 2.539 | 2.709 | 2.729 | 2.749 | 2.567 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.729914 Full duration: 74.056398 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.015 | 1.222 | 1.333 | 1.381 | 1.428 | 1.194 | 100.0% | 10 | | swift.upload_object (x5) | 2.729 | 2.876 | 2.916 | 2.916 | 2.917 | 2.857 | 100.0% | 10 | | swift.download_object (x5) | 2.479 | 2.598 | 2.629 | 2.643 | 2.656 | 2.581 | 100.0% | 10 | | total | 6.45 | 6.657 | 6.746 | 6.775 | 6.804 | 6.634 | 100.0% | 10 | | -> duration | 6.45 | 6.657 | 6.746 | 6.775 | 6.804 | 6.634 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 66.395394 Full duration: 132.878966 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.892 | 1.084 | 1.305 | 1.316 | 1.327 | 1.124 | 100.0% | 10 | | swift.upload_object (x5) | 2.748 | 2.901 | 3.016 | 3.237 | 3.458 | 2.947 | 100.0% | 10 | | swift.delete_object (x5) | 2.611 | 2.735 | 2.872 | 2.906 | 2.941 | 2.757 | 100.0% | 10 | | swift.delete_container | 0.572 | 0.611 | 0.726 | 0.735 | 0.745 | 0.633 | 100.0% | 10 | | total | 7.117 | 7.422 | 7.664 | 7.951 | 8.238 | 7.462 | 100.0% | 10 | | -> duration | 7.117 | 7.422 | 7.664 | 7.951 | 8.238 | 7.462 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.678565 Full duration: 112.284933 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a2b63276-0f3b-4891-8997-7c5d6ae571c5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.273 | 1.457 | 1.561 | 1.58 | 1.599 | 1.447 | 100.0% | 10 | | swift.list_objects | 0.876 | 0.946 | 1.013 | 1.026 | 1.039 | 0.95 | 100.0% | 10 | | swift.download_object (x5) | 2.271 | 2.35 | 2.439 | 2.458 | 2.476 | 2.363 | 100.0% | 10 | | total | 4.506 | 4.732 | 4.906 | 4.92 | 4.934 | 4.761 | 100.0% | 10 | | -> duration | 4.506 | 4.732 | 4.906 | 4.92 | 4.934 | 4.761 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.662466 Full duration: 93.071834 HINTS: * To plot HTML graphics with this data, run: rally task report a2b63276-0f3b-4891-8997-7c5d6ae571c5 --out output.html * To generate a JUnit report, run: rally task export a2b63276-0f3b-4891-8997-7c5d6ae571c5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a2b63276-0f3b-4891-8997-7c5d6ae571c5 --json --out output.json 2021-04-14 18:08:54,962 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a2b63276-0f3b-4891-8997-7c5d6ae571c5 --out /home/opnfv/functest/results/rally_full/swift.json 2021-04-14 18:08:54,979 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-04-14 18:08:54,982 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:25 | 60 | 100.00% | | glance | 00:06:28 | 39 | 89.74% | | cinder | 00:42:49 | 240 | 100.00% | | heat | 00:39:24 | 100 | 100.00% | | keystone | 00:09:20 | 110 | 100.00% | | neutron | 00:17:25 | 140 | 100.00% | | nova | 00:13:41 | 50 | 98.00% | | quotas | 00:01:28 | 30 | 100.00% | | swift | 00:08:36 | 50 | 100.00% | | | | | | | TOTAL: | 02:21:40 | 819 | 99.39% | +----------------+------------+----------------+-----------+ 2021-04-14 18:08:54,982 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.39% in 6/9 modules 2021-04-14 18:08:58,762 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-04-14 18:09:02,300 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-04-14 18:09:02,301 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 148:54 | FAIL | +--------------------+------------------+------------------+----------------+