2021-07-03 18:47:30,254 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | VNUVWHZQNXYT | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/VNUVWHZQNXYT/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-227 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/VNUVWHZQNXYT/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-227 | +-------------------------+------------------------------------------------------------+ 2021-07-03 18:47:30,274 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-07-03 18:47:33,682 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-07-03 18:47:38,409 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-07-03 18:47:44,923 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | bf0f63ce-3b6c-4d78-b0b7-703e05162c59 | 2021-07-03T18:47:44.658830 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: bf0f63ce-3b6c-4d78-b0b7-703e05162c59 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-07-03 18:47:49,829 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-07-03 18:47:57,005 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 18:47:57,182 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-07-03 18:51:04,454 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: acae2147-dd27-46d8-a6a7-ee5f16744a32 2021-07-03 18:51:05,676 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid acae2147-dd27-46d8-a6a7-ee5f16744a32 -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.952 | 1.455 | 1.594 | 1.598 | 1.603 | 1.342 | 100.0% | 10 | | total | 0.952 | 1.455 | 1.594 | 1.599 | 1.603 | 1.342 | 100.0% | 10 | | -> duration | 0.952 | 1.455 | 1.594 | 1.599 | 1.603 | 1.342 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.098143 Full duration: 26.560166 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.145 | 0.355 | 0.552 | 0.572 | 0.592 | 0.343 | 100.0% | 10 | | total | 0.561 | 0.975 | 1.068 | 1.128 | 1.189 | 0.892 | 100.0% | 10 | | -> duration | 0.561 | 0.975 | 1.068 | 1.128 | 1.189 | 0.892 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.581506 Full duration: 26.404054 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.212 | 0.278 | 0.841 | 0.883 | 0.925 | 0.408 | 100.0% | 10 | | total | 0.706 | 1.225 | 1.549 | 1.565 | 1.58 | 1.214 | 100.0% | 10 | | -> duration | 0.706 | 1.225 | 1.549 | 1.565 | 1.58 | 1.214 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.333492 Full duration: 32.343707 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.152 | 0.334 | 0.668 | 0.833 | 0.999 | 0.376 | 100.0% | 10 | | total | 0.613 | 0.975 | 1.383 | 1.771 | 2.16 | 1.042 | 100.0% | 10 | | -> duration | 0.613 | 0.975 | 1.383 | 1.771 | 2.16 | 1.042 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.91118 Full duration: 26.365814 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.383 | 0.792 | 0.965 | 0.965 | 0.966 | 0.714 | 100.0% | 10 | | total | 0.856 | 1.497 | 1.611 | 1.614 | 1.616 | 1.344 | 100.0% | 10 | | -> duration | 0.856 | 1.497 | 1.611 | 1.614 | 1.616 | 1.344 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.836266 Full duration: 27.100606 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acae2147-dd27-46d8-a6a7-ee5f16744a32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.162 | 0.355 | 0.629 | 0.659 | 0.689 | 0.394 | 100.0% | 10 | | total | 0.758 | 1.383 | 1.753 | 1.768 | 1.782 | 1.335 | 100.0% | 10 | | -> duration | 0.758 | 1.383 | 1.753 | 1.768 | 1.782 | 1.335 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.832641 Full duration: 23.417701 HINTS: * To plot HTML graphics with this data, run: rally task report acae2147-dd27-46d8-a6a7-ee5f16744a32 --out output.html * To generate a JUnit report, run: rally task export acae2147-dd27-46d8-a6a7-ee5f16744a32 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report acae2147-dd27-46d8-a6a7-ee5f16744a32 --json --out output.json 2021-07-03 18:51:08,748 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid acae2147-dd27-46d8-a6a7-ee5f16744a32 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-07-03 18:51:08,758 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-07-03 18:51:08,788 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 18:51:09,280 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-07-03 19:03:52,523 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 68a949e1-75b3-42b9-968a-a46d95faf876 2021-07-03 19:03:53,843 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 68a949e1-75b3-42b9-968a-a46d95faf876 -------------------------------------------------------------------------------- Task 68a949e1-75b3-42b9-968a-a46d95faf876: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 68a949e1-75b3-42b9-968a-a46d95faf876 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.599 | 6.656 | 9.74 | 9.756 | 9.771 | 6.994 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.098 | 0.108 | 0.126 | 0.132 | 0.139 | 0.111 | 100.0% | 10 | | -> glance_v2.upload_data | 3.209 | 3.42 | 3.968 | 4.144 | 4.319 | 3.535 | 100.0% | 10 | | glance_v2.delete_image | 2.299 | 3.204 | 7.339 | 7.714 | 8.088 | 3.966 | 100.0% | 10 | | total | 8.636 | 10.358 | 13.307 | 13.497 | 13.687 | 10.96 | 100.0% | 10 | | -> duration | 8.636 | 10.358 | 13.307 | 13.497 | 13.687 | 10.96 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.400282 Full duration: 71.330128 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 68a949e1-75b3-42b9-968a-a46d95faf876 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.318 | 6.866 | 7.727 | 8.141 | 8.555 | 6.917 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.1 | 0.11 | 0.126 | 0.128 | 0.13 | 0.113 | 100.0% | 10 | | -> glance_v2.upload_data | 2.254 | 3.83 | 4.618 | 4.782 | 4.945 | 3.782 | 100.0% | 10 | | glance_v2.list_images | 0.052 | 0.062 | 0.089 | 0.093 | 0.098 | 0.067 | 100.0% | 10 | | total | 5.375 | 6.928 | 7.823 | 8.227 | 8.631 | 6.984 | 100.0% | 10 | | -> duration | 5.375 | 6.928 | 7.823 | 8.227 | 8.631 | 6.984 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.697476 Full duration: 63.310376 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 68a949e1-75b3-42b9-968a-a46d95faf876 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.145 | 0.207 | 0.495 | 0.612 | 0.73 | 0.282 | 100.0% | 10 | | total | 0.145 | 0.208 | 0.495 | 0.612 | 0.73 | 0.282 | 100.0% | 10 | | -> duration | 0.145 | 0.208 | 0.495 | 0.612 | 0.73 | 0.282 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.418954 Full duration: 30.075308 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 68a949e1-75b3-42b9-968a-a46d95faf876 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 7.039 | 11.705 | 18.043 | 19.49 | 20.937 | 12.164 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.098 | 0.113 | 0.147 | 0.182 | 0.216 | 0.124 | 100.0% | 10 | | -> glance_v2.upload_data | 4.46 | 6.273 | 12.259 | 13.339 | 14.419 | 7.748 | 100.0% | 10 | | nova.boot_servers | 78.492 | 127.732 | 199.589 | 218.622 | 237.655 | 143.655 | 60.0% | 10 | | total | 85.532 | 135.42 | 214.27 | 234.823 | 255.377 | 155.82 | 60.0% | 10 | | -> duration | 84.532 | 134.42 | 213.27 | 233.823 | 254.377 | 154.82 | 60.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 60.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 427.743677 Full duration: 575.310448 HINTS: * To plot HTML graphics with this data, run: rally task report 68a949e1-75b3-42b9-968a-a46d95faf876 --out output.html * To generate a JUnit report, run: rally task export 68a949e1-75b3-42b9-968a-a46d95faf876 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 68a949e1-75b3-42b9-968a-a46d95faf876 --json --out output.json At least one workload did not pass SLA criteria. 2021-07-03 19:03:56,980 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 68a949e1-75b3-42b9-968a-a46d95faf876 --out /home/opnfv/functest/results/rally_full/glance.json 2021-07-03 19:03:57,060 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-07-03 19:03:57,103 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 19:03:57,538 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-07-03 19:59:04,928 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: a422b80e-c8dd-47af-96b0-594e9c8e1292 2021-07-03 19:59:06,249 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a422b80e-c8dd-47af-96b0-594e9c8e1292 -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "size": 1, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 47.897 | 55.578 | 85.335 | 85.798 | 86.261 | 60.868 | 100.0% | 10 | | cinder_v3.create_volume | 6.111 | 14.229 | 22.969 | 24.12 | 25.271 | 14.666 | 100.0% | 10 | | nova.attach_volume | 15.83 | 18.86 | 28.607 | 29.66 | 30.712 | 22.054 | 100.0% | 10 | | nova.detach_volume | 6.463 | 7.518 | 12.459 | 12.863 | 13.266 | 8.719 | 100.0% | 10 | | cinder_v3.delete_volume | 2.31 | 8.562 | 15.261 | 16.611 | 17.96 | 9.706 | 100.0% | 10 | | nova.delete_server | 19.101 | 24.423 | 39.333 | 39.852 | 40.372 | 26.026 | 100.0% | 10 | | total | 111.707 | 136.467 | 163.655 | 165.985 | 168.316 | 142.04 | 100.0% | 10 | | -> duration | 110.707 | 135.467 | 162.655 | 164.985 | 167.316 | 141.04 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 421.823689 Full duration: 478.202218 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.605 | 8.527 | 10.451 | 10.691 | 10.931 | 7.875 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.034 | 0.04 | 0.044 | 0.045 | 0.047 | 0.04 | 100.0% | 10 | | total | 4.645 | 8.571 | 10.494 | 10.732 | 10.97 | 7.915 | 100.0% | 10 | | -> duration | 4.645 | 8.571 | 10.494 | 10.732 | 10.97 | 7.915 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.169463 Full duration: 97.720749 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 23.713 | 25.739 | 30.091 | 34.181 | 38.271 | 26.95 | 100.0% | 10 | | cinder_v3.list_volumes | 0.066 | 0.074 | 0.082 | 0.085 | 0.088 | 0.075 | 100.0% | 10 | | total | 23.781 | 25.809 | 30.169 | 34.261 | 38.353 | 27.025 | 100.0% | 10 | | -> duration | 23.781 | 25.809 | 30.169 | 34.261 | 38.353 | 27.025 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.330064 Full duration: 149.187209 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.116 | 13.03 | 18.114 | 18.12 | 18.126 | 13.039 | 100.0% | 10 | | cinder_v3.list_volumes | 0.064 | 0.074 | 0.29 | 0.301 | 0.311 | 0.123 | 100.0% | 10 | | total | 4.188 | 13.115 | 18.405 | 18.421 | 18.437 | 13.162 | 100.0% | 10 | | -> duration | 4.188 | 13.115 | 18.405 | 18.421 | 18.437 | 13.162 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.272824 Full duration: 113.272217 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.739 | 6.804 | 8.657 | 9.25 | 9.844 | 6.629 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 23.452 | 52.748 | 65.935 | 65.977 | 66.019 | 49.924 | 100.0% | 10 | | cinder_v3.delete_volume | 2.256 | 5.375 | 6.693 | 6.829 | 6.964 | 4.833 | 100.0% | 10 | | glance_v2.delete_image | 5.557 | 8.051 | 10.056 | 10.37 | 10.684 | 8.13 | 100.0% | 10 | | total | 34.005 | 74.754 | 88.283 | 88.745 | 89.207 | 69.517 | 100.0% | 10 | | -> duration | 34.005 | 74.754 | 88.283 | 88.745 | 89.207 | 69.517 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 195.159607 Full duration: 229.326351 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 45.35 | 61.911 | 82.174 | 89.809 | 97.444 | 65.653 | 100.0% | 10 | | cinder_v3.create_volume | 5.202 | 14.331 | 30.913 | 34.064 | 37.215 | 16.934 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.367 | 10.13 | 22.222 | 22.374 | 22.527 | 12.065 | 100.0% | 10 | | nova.attach_volume | 8.757 | 27.583 | 40.914 | 40.971 | 41.028 | 27.049 | 100.0% | 10 | | nova.detach_volume | 4.039 | 6.621 | 12.99 | 14.178 | 15.366 | 7.756 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.265 | 5.274 | 15.767 | 16.144 | 16.522 | 7.163 | 100.0% | 10 | | cinder_v3.delete_volume | 2.769 | 11.747 | 27.195 | 30.344 | 33.493 | 13.705 | 100.0% | 10 | | nova.delete_server | 7.257 | 28.686 | 46.466 | 48.603 | 50.74 | 29.007 | 100.0% | 10 | | total | 92.256 | 183.608 | 230.398 | 235.104 | 239.811 | 179.333 | 100.0% | 10 | | -> duration | 91.256 | 182.608 | 229.398 | 234.104 | 238.811 | 178.333 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 487.947116 Full duration: 527.605628 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.032 | 9.968 | 30.34 | 30.532 | 30.723 | 15.678 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.035 | 7.228 | 28.95 | 29.699 | 30.449 | 12.135 | 100.0% | 10 | | nova.boot_server | 37.435 | 59.835 | 70.75 | 73.788 | 76.826 | 57.533 | 100.0% | 10 | | nova.attach_volume | 7.218 | 26.004 | 31.791 | 32.469 | 33.146 | 23.683 | 100.0% | 10 | | nova.detach_volume | 3.971 | 5.556 | 17.057 | 21.259 | 25.461 | 8.619 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.564 | 6.933 | 13.891 | 16.646 | 19.4 | 8.465 | 100.0% | 10 | | cinder_v3.delete_volume | 2.905 | 7.305 | 10.152 | 11.593 | 13.035 | 7.449 | 100.0% | 10 | | nova.delete_server | 9.875 | 13.721 | 37.643 | 39.896 | 42.149 | 18.488 | 100.0% | 10 | | total | 91.698 | 134.624 | 205.212 | 207.115 | 209.019 | 152.051 | 100.0% | 10 | | -> duration | 90.698 | 133.624 | 204.212 | 206.115 | 208.019 | 151.051 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 420.114673 Full duration: 463.93714 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.021 | 10.589 | 12.919 | 14.101 | 15.283 | 10.135 | 100.0% | 10 | | total | 6.021 | 10.589 | 12.919 | 14.101 | 15.283 | 10.136 | 100.0% | 10 | | -> duration | 6.021 | 10.589 | 12.919 | 14.101 | 15.283 | 10.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.73696 Full duration: 81.340546 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.252 | 11.806 | 22.246 | 22.252 | 22.257 | 13.795 | 100.0% | 10 | | total | 6.253 | 11.806 | 22.247 | 22.252 | 22.257 | 13.795 | 100.0% | 10 | | -> duration | 6.253 | 11.806 | 22.247 | 22.252 | 22.257 | 13.795 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.569464 Full duration: 101.970293 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.547 | 0.676 | 1.176 | 1.217 | 1.258 | 0.821 | 100.0% | 10 | | total | 0.547 | 0.676 | 1.176 | 1.218 | 1.259 | 0.822 | 100.0% | 10 | | -> duration | 0.547 | 0.676 | 1.176 | 1.218 | 1.259 | 0.822 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.399503 Full duration: 105.300759 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 6.502 | 13.832 | 19.786 | 20.741 | 21.696 | 14.114 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.348 | 3.491 | 7.201 | 9.628 | 12.055 | 4.775 | 100.0% | 10 | | total | 8.94 | 20.097 | 24.338 | 24.734 | 25.129 | 18.889 | 100.0% | 10 | | -> duration | 8.94 | 20.097 | 24.338 | 24.734 | 25.129 | 18.889 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.983722 Full duration: 105.360816 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.493 | 5.181 | 11.61 | 12.81 | 14.01 | 7.419 | 100.0% | 10 | | cinder_v3.delete_volume | 2.335 | 7.332 | 9.906 | 10.906 | 11.907 | 7.14 | 100.0% | 10 | | total | 7.003 | 15.063 | 19.694 | 20.364 | 21.035 | 14.559 | 100.0% | 10 | | -> duration | 7.003 | 15.063 | 19.694 | 20.364 | 21.035 | 14.559 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.661986 Full duration: 66.720778 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.508 | 21.775 | 26.38 | 27.507 | 28.634 | 22.081 | 100.0% | 10 | | cinder_v3.delete_volume | 2.367 | 6.253 | 10.853 | 10.863 | 10.873 | 6.434 | 100.0% | 10 | | total | 18.566 | 30.694 | 35.465 | 35.663 | 35.862 | 28.516 | 100.0% | 10 | | -> duration | 18.566 | 30.694 | 35.465 | 35.663 | 35.862 | 28.516 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.70422 Full duration: 120.805317 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.957 | 9.367 | 16.348 | 16.891 | 17.434 | 11.081 | 100.0% | 10 | | cinder_v3.delete_volume | 2.268 | 4.962 | 11.273 | 12.095 | 12.918 | 6.573 | 100.0% | 10 | | total | 9.928 | 13.047 | 26.903 | 27.713 | 28.524 | 17.654 | 100.0% | 10 | | -> duration | 9.928 | 13.047 | 26.903 | 27.713 | 28.524 | 17.654 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.398834 Full duration: 82.415073 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.673 | 12.152 | 16.383 | 16.535 | 16.687 | 11.505 | 100.0% | 10 | | cinder_v3.extend_volume | 3.34 | 5.939 | 8.312 | 8.731 | 9.15 | 5.835 | 100.0% | 10 | | cinder_v3.delete_volume | 2.269 | 6.496 | 9.387 | 9.448 | 9.509 | 6.262 | 100.0% | 10 | | total | 13.198 | 25.906 | 32.422 | 32.788 | 33.155 | 23.602 | 100.0% | 10 | | -> duration | 13.198 | 25.906 | 32.422 | 32.788 | 33.155 | 23.602 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 70.02481 Full duration: 100.814731 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 11.137 | 14.239 | 15.602 | 16.366 | 17.129 | 13.854 | 100.0% | 10 | | cinder_v3.delete_volume | 5.962 | 8.863 | 11.345 | 11.7 | 12.054 | 8.863 | 100.0% | 10 | | total | 19.626 | 22.103 | 27.528 | 27.717 | 27.905 | 22.717 | 100.0% | 10 | | -> duration | 19.626 | 22.103 | 27.528 | 27.717 | 27.905 | 22.717 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.748731 Full duration: 124.168143 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.596 | 1.26 | 1.815 | 1.864 | 1.913 | 1.342 | 100.0% | 10 | | cinder_v3.get_qos | 0.03 | 0.039 | 0.067 | 0.141 | 0.215 | 0.055 | 100.0% | 10 | | total | 0.811 | 1.296 | 1.857 | 1.911 | 1.964 | 1.397 | 100.0% | 10 | | -> duration | 0.811 | 1.296 | 1.857 | 1.911 | 1.964 | 1.397 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.120955 Full duration: 29.950313 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.577 | 0.983 | 1.343 | 1.374 | 1.405 | 0.998 | 100.0% | 10 | | cinder_v3.list_qos | 0.035 | 0.039 | 0.046 | 0.047 | 0.048 | 0.04 | 100.0% | 10 | | total | 0.623 | 1.027 | 1.382 | 1.413 | 1.444 | 1.039 | 100.0% | 10 | | -> duration | 0.623 | 1.027 | 1.382 | 1.413 | 1.444 | 1.039 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.825786 Full duration: 36.68558 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.611 | 0.945 | 1.311 | 1.521 | 1.73 | 1.001 | 100.0% | 10 | | cinder_v3.set_qos | 0.16 | 0.749 | 2.122 | 2.144 | 2.165 | 1.087 | 100.0% | 10 | | total | 0.771 | 2.106 | 2.962 | 2.975 | 2.988 | 2.088 | 100.0% | 10 | | -> duration | 0.771 | 2.106 | 2.962 | 2.975 | 2.988 | 2.088 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.88345 Full duration: 40.215874 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.029 | 1.678 | 2.243 | 2.335 | 2.426 | 1.573 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.029 | 0.035 | 0.038 | 0.04 | 0.042 | 0.035 | 100.0% | 10 | | total | 1.062 | 1.712 | 2.279 | 2.372 | 2.464 | 1.608 | 100.0% | 10 | | -> duration | 1.062 | 1.712 | 2.279 | 2.372 | 2.464 | 1.608 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.620601 Full duration: 35.062485 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.587 | 0.999 | 1.597 | 1.64 | 1.683 | 1.087 | 100.0% | 10 | | cinder_v3.list_types | 0.039 | 0.047 | 0.056 | 0.061 | 0.067 | 0.048 | 100.0% | 10 | | total | 0.642 | 1.057 | 1.646 | 1.688 | 1.729 | 1.136 | 100.0% | 10 | | -> duration | 0.642 | 1.057 | 1.646 | 1.688 | 1.729 | 1.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.020789 Full duration: 39.144289 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.95 | 1.247 | 1.359 | 1.394 | 1.428 | 1.201 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.136 | 0.589 | 1.792 | 1.798 | 1.803 | 0.853 | 100.0% | 10 | | total | 1.225 | 1.768 | 3.063 | 3.109 | 3.155 | 2.053 | 100.0% | 10 | | -> duration | 1.225 | 1.768 | 3.063 | 3.109 | 3.155 | 2.053 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.950844 Full duration: 41.249681 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.675 | 1.167 | 1.907 | 2.118 | 2.329 | 1.251 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.087 | 0.502 | 1.179 | 1.319 | 1.459 | 0.6 | 100.0% | 10 | | total | 0.809 | 1.736 | 2.647 | 2.983 | 3.319 | 1.851 | 100.0% | 10 | | -> duration | 0.809 | 1.736 | 2.647 | 2.983 | 3.319 | 1.851 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.826401 Full duration: 33.012947 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a422b80e-c8dd-47af-96b0-594e9c8e1292 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.646 | 1.332 | 1.448 | 1.449 | 1.45 | 1.215 | 100.0% | 10 | | cinder_v2.add_type_access | 0.066 | 0.105 | 0.174 | 0.225 | 0.275 | 0.119 | 100.0% | 10 | | cinder_v2.list_type_access | 0.038 | 0.043 | 0.047 | 0.051 | 0.054 | 0.043 | 100.0% | 10 | | total | 0.769 | 1.508 | 1.585 | 1.599 | 1.613 | 1.377 | 100.0% | 10 | | -> duration | 0.769 | 1.508 | 1.585 | 1.599 | 1.613 | 1.377 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.867451 Full duration: 39.334044 HINTS: * To plot HTML graphics with this data, run: rally task report a422b80e-c8dd-47af-96b0-594e9c8e1292 --out output.html * To generate a JUnit report, run: rally task export a422b80e-c8dd-47af-96b0-594e9c8e1292 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a422b80e-c8dd-47af-96b0-594e9c8e1292 --json --out output.json 2021-07-03 19:59:09,452 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a422b80e-c8dd-47af-96b0-594e9c8e1292 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-07-03 19:59:09,486 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-07-03 19:59:09,517 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 19:59:09,953 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-07-03 21:06:25,568 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 4847af34-450f-4a02-b2b8-26aee5c41aff 2021-07-03 21:06:26,830 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4847af34-450f-4a02-b2b8-26aee5c41aff -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.979 | 11.153 | 17.136 | 17.147 | 17.157 | 12.473 | 100.0% | 10 | | heat.list_stacks | 0.052 | 0.073 | 0.127 | 0.132 | 0.137 | 0.082 | 100.0% | 10 | | total | 7.039 | 11.256 | 17.201 | 17.207 | 17.212 | 12.554 | 100.0% | 10 | | -> duration | 5.039 | 9.256 | 15.201 | 15.207 | 15.212 | 10.554 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.728008 Full duration: 137.763686 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 32.369 | 46.134 | 50.88 | 64.546 | 78.212 | 46.82 | 100.0% | 10 | | heat.update_stack | 15.972 | 25.952 | 70.111 | 71.087 | 72.064 | 40.522 | 100.0% | 10 | | heat.delete_stack | 12.919 | 23.398 | 79.36 | 80.545 | 81.73 | 40.534 | 100.0% | 10 | | total | 65.565 | 109.332 | 198.913 | 198.92 | 198.926 | 127.876 | 100.0% | 10 | | -> duration | 61.565 | 105.332 | 194.913 | 194.92 | 194.926 | 123.876 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 348.800632 Full duration: 393.298629 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 22.679 | 39.667 | 62.285 | 64.347 | 66.409 | 44.092 | 100.0% | 10 | | heat.update_stack | 7.994 | 26.86 | 28.614 | 31.483 | 34.351 | 23.873 | 100.0% | 10 | | heat.delete_stack | 10.915 | 29.25 | 38.505 | 39.331 | 40.156 | 26.614 | 100.0% | 10 | | total | 58.95 | 92.944 | 120.382 | 121.403 | 122.424 | 94.579 | 100.0% | 10 | | -> duration | 54.95 | 88.944 | 116.382 | 117.403 | 118.424 | 90.579 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 260.807488 Full duration: 307.19818 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 59.189 | 69.058 | 86.139 | 88.126 | 90.114 | 72.709 | 100.0% | 10 | | heat.update_stack | 17.921 | 70.32 | 79.437 | 79.589 | 79.74 | 62.583 | 100.0% | 10 | | heat.delete_stack | 28.974 | 50.071 | 71.086 | 72.541 | 73.995 | 51.962 | 100.0% | 10 | | total | 116.21 | 191.77 | 223.354 | 225.492 | 227.629 | 187.255 | 100.0% | 10 | | -> duration | 112.21 | 187.77 | 219.354 | 221.492 | 223.629 | 183.255 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 525.306074 Full duration: 576.7817 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 71.62 | 81.379 | 142.875 | 144.018 | 145.161 | 102.619 | 100.0% | 10 | | heat.update_stack | 12.758 | 77.028 | 82.1 | 83.875 | 85.65 | 64.768 | 100.0% | 10 | | heat.delete_stack | 23.906 | 73.438 | 83.135 | 85.796 | 88.456 | 65.584 | 100.0% | 10 | | total | 108.284 | 240.844 | 288.004 | 297.549 | 307.095 | 232.971 | 100.0% | 10 | | -> duration | 104.284 | 236.844 | 284.004 | 293.549 | 303.095 | 228.971 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 624.773262 Full duration: 674.486875 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 42.517 | 67.44 | 112.114 | 115.583 | 119.052 | 77.991 | 100.0% | 10 | | heat.update_stack | 20.269 | 63.22 | 79.061 | 79.764 | 80.467 | 59.925 | 100.0% | 10 | | heat.delete_stack | 28.186 | 56.877 | 61.172 | 61.197 | 61.223 | 51.901 | 100.0% | 10 | | total | 112.845 | 191.411 | 232.611 | 237.078 | 241.544 | 189.818 | 100.0% | 10 | | -> duration | 108.845 | 187.411 | 228.611 | 233.078 | 237.544 | 185.818 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 517.416387 Full duration: 564.926352 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 33.715 | 51.634 | 95.853 | 100.082 | 104.311 | 65.277 | 100.0% | 10 | | heat.update_stack | 29.762 | 61.173 | 80.54 | 82.235 | 83.93 | 59.409 | 100.0% | 10 | | heat.delete_stack | 16.161 | 28.929 | 32.725 | 32.827 | 32.928 | 27.63 | 100.0% | 10 | | total | 96.456 | 161.759 | 176.018 | 177.703 | 179.389 | 152.317 | 100.0% | 10 | | -> duration | 92.456 | 157.759 | 172.018 | 173.703 | 175.389 | 148.317 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 422.287171 Full duration: 476.66324 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.121 | 43.088 | 51.539 | 51.539 | 51.54 | 44.29 | 100.0% | 10 | | heat.check_stack | 3.51 | 17.852 | 18.54 | 18.588 | 18.637 | 15.111 | 100.0% | 10 | | heat.delete_stack | 5.071 | 25.868 | 28.363 | 29.694 | 31.025 | 22.586 | 100.0% | 10 | | total | 45.8 | 89.073 | 95.362 | 96.154 | 96.946 | 81.988 | 100.0% | 10 | | -> duration | 43.8 | 87.073 | 93.362 | 94.154 | 94.946 | 79.988 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 224.554073 Full duration: 266.303266 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.847 | 72.899 | 138.006 | 144.218 | 150.431 | 81.394 | 100.0% | 10 | | heat.suspend_stack | 9.816 | 14.534 | 45.373 | 67.887 | 90.401 | 28.661 | 100.0% | 10 | | heat.resume_stack | 11.958 | 17.773 | 38.977 | 39.023 | 39.069 | 23.755 | 100.0% | 10 | | heat.delete_stack | 12.364 | 26.84 | 48.742 | 55.005 | 61.269 | 31.911 | 100.0% | 10 | | total | 85.749 | 116.121 | 264.853 | 272.729 | 280.605 | 165.721 | 100.0% | 10 | | -> duration | 83.749 | 114.121 | 262.853 | 270.729 | 278.605 | 163.721 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 462.136837 Full duration: 514.586524 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4847af34-450f-4a02-b2b8-26aee5c41aff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.509 | 0.82 | 0.922 | 0.929 | 0.935 | 0.756 | 100.0% | 10 | | total | 0.509 | 0.82 | 0.922 | 0.929 | 0.935 | 0.756 | 100.0% | 10 | | -> duration | 0.509 | 0.82 | 0.922 | 0.929 | 0.935 | 0.756 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.285805 Full duration: 46.852377 HINTS: * To plot HTML graphics with this data, run: rally task report 4847af34-450f-4a02-b2b8-26aee5c41aff --out output.html * To generate a JUnit report, run: rally task export 4847af34-450f-4a02-b2b8-26aee5c41aff --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4847af34-450f-4a02-b2b8-26aee5c41aff --json --out output.json 2021-07-03 21:06:29,825 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4847af34-450f-4a02-b2b8-26aee5c41aff --out /home/opnfv/functest/results/rally_full/heat.json 2021-07-03 21:06:29,843 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-07-03 21:06:29,873 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 21:06:30,290 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-07-03 21:17:15,880 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: f5b51aa1-f2b9-48b3-94cf-62bad71023d4 2021-07-03 21:17:17,165 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f5b51aa1-f2b9-48b3-94cf-62bad71023d4 -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.336 | 0.519 | 1.386 | 1.517 | 1.648 | 0.745 | 100.0% | 10 | | keystone_v3.add_role | 0.095 | 0.291 | 0.449 | 0.54 | 0.63 | 0.285 | 100.0% | 10 | | keystone_v3.revoke_role | 0.286 | 0.453 | 0.576 | 0.632 | 0.688 | 0.466 | 100.0% | 10 | | total | 1.064 | 1.245 | 1.995 | 2.128 | 2.261 | 1.496 | 100.0% | 10 | | -> duration | 1.064 | 1.245 | 1.995 | 2.128 | 2.261 | 1.496 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.006312 Full duration: 46.148759 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.131 | 0.507 | 0.759 | 0.912 | 1.064 | 0.487 | 100.0% | 10 | | keystone_v3.add_role | 0.094 | 0.461 | 0.794 | 0.866 | 0.937 | 0.509 | 100.0% | 10 | | keystone_v3.list_roles | 0.104 | 0.132 | 0.341 | 0.589 | 0.837 | 0.214 | 100.0% | 10 | | total | 0.66 | 1.173 | 1.423 | 1.706 | 1.989 | 1.211 | 100.0% | 10 | | -> duration | 0.66 | 1.173 | 1.423 | 1.706 | 1.989 | 1.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.56884 Full duration: 47.738531 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.32 | 1.226 | 1.625 | 1.825 | 2.026 | 1.168 | 100.0% | 10 | | keystone_v3.list_projects | 0.112 | 0.138 | 0.73 | 1.047 | 1.364 | 0.316 | 100.0% | 10 | | total | 0.466 | 1.678 | 2.165 | 2.201 | 2.238 | 1.484 | 100.0% | 10 | | -> duration | 0.466 | 1.678 | 2.165 | 2.201 | 2.238 | 1.484 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.369181 Full duration: 42.042788 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.193 | 0.495 | 3.28 | 3.379 | 3.478 | 1.047 | 100.0% | 10 | | keystone_v3.delete_role | 0.084 | 0.259 | 1.786 | 2.49 | 3.195 | 0.781 | 100.0% | 10 | | total | 0.31 | 1.518 | 3.647 | 3.746 | 3.845 | 1.828 | 100.0% | 10 | | -> duration | 0.31 | 1.518 | 3.647 | 3.746 | 3.845 | 1.828 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.041999 Full duration: 38.47803 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.121 | 0.375 | 0.809 | 0.81 | 0.811 | 0.419 | 100.0% | 10 | | keystone_v3.delete_service | 0.249 | 0.385 | 0.568 | 0.58 | 0.593 | 0.412 | 100.0% | 10 | | total | 0.403 | 0.842 | 1.115 | 1.132 | 1.148 | 0.831 | 100.0% | 10 | | -> duration | 0.403 | 0.842 | 1.115 | 1.132 | 1.148 | 0.831 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.368713 Full duration: 32.712038 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.253 | 0.641 | 1.002 | 1.067 | 1.131 | 0.644 | 100.0% | 10 | | keystone_v3.create_user | 0.491 | 0.809 | 1.226 | 1.361 | 1.495 | 0.898 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.045 | 0.059 | 0.239 | 0.268 | 0.296 | 0.111 | 100.0% | 10 | | -> keystone_v3.add_role | 0.115 | 0.225 | 0.62 | 0.682 | 0.745 | 0.303 | 100.0% | 10 | | keystone_v3.create_role | 0.088 | 0.168 | 0.58 | 0.644 | 0.709 | 0.249 | 100.0% | 10 | | keystone_v3.get_project | 0.036 | 0.038 | 0.104 | 0.111 | 0.118 | 0.054 | 100.0% | 10 | | keystone_v3.get_user | 0.035 | 0.041 | 0.316 | 0.335 | 0.354 | 0.133 | 100.0% | 10 | | keystone_v3.get_role | 0.03 | 0.038 | 0.045 | 0.046 | 0.047 | 0.039 | 100.0% | 10 | | keystone_v3.list_services | 0.041 | 0.056 | 0.292 | 0.32 | 0.349 | 0.121 | 100.0% | 10 | | keystone_v3.get_services | 0.036 | 0.146 | 0.477 | 0.595 | 0.712 | 0.228 | 100.0% | 10 | | total | 1.768 | 2.421 | 2.997 | 3.031 | 3.065 | 2.504 | 100.0% | 10 | | -> duration | 1.768 | 2.421 | 2.997 | 3.031 | 3.065 | 2.504 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.19947 Full duration: 69.438221 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.25 | 0.845 | 1.665 | 1.676 | 1.687 | 1.013 | 100.0% | 10 | | keystone_v3.update_project | 0.16 | 0.48 | 0.646 | 0.668 | 0.691 | 0.44 | 100.0% | 10 | | keystone_v3.delete_project | 0.184 | 0.523 | 0.921 | 0.991 | 1.062 | 0.602 | 100.0% | 10 | | total | 1.143 | 2.138 | 2.455 | 2.555 | 2.656 | 2.055 | 100.0% | 10 | | -> duration | 1.143 | 2.138 | 2.455 | 2.555 | 2.656 | 2.055 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.437036 Full duration: 36.721091 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.228 | 0.619 | 0.901 | 1.072 | 1.242 | 0.576 | 100.0% | 10 | | total | 0.321 | 0.726 | 0.987 | 1.156 | 1.324 | 0.667 | 100.0% | 10 | | -> duration | 0.321 | 0.726 | 0.987 | 1.156 | 1.324 | 0.667 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.524874 Full duration: 30.803529 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.432 | 0.968 | 1.45 | 1.496 | 1.542 | 0.999 | 100.0% | 10 | | total | 0.432 | 0.968 | 1.45 | 1.496 | 1.542 | 0.999 | 100.0% | 10 | | -> duration | 0.432 | 0.968 | 1.45 | 1.496 | 1.542 | 0.999 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.475675 Full duration: 30.58245 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.312 | 0.762 | 1.253 | 1.388 | 1.523 | 0.795 | 100.0% | 10 | | keystone_v3.list_users | 0.068 | 0.079 | 0.126 | 0.28 | 0.435 | 0.115 | 100.0% | 10 | | total | 0.651 | 0.947 | 1.424 | 1.554 | 1.684 | 1.034 | 100.0% | 10 | | -> duration | 0.651 | 0.947 | 1.424 | 1.554 | 1.684 | 1.034 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.881871 Full duration: 28.783014 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5b51aa1-f2b9-48b3-94cf-62bad71023d4 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.262 | 0.55 | 1.301 | 1.511 | 1.72 | 0.678 | 100.0% | 10 | | keystone_v3.create_users | 10.859 | 19.75 | 42.716 | 42.999 | 43.283 | 27.02 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 10.859 | 19.749 | 42.716 | 42.999 | 43.282 | 27.019 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.531 | 1.117 | 3.949 | 4.915 | 5.881 | 1.901 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.419 | 8.526 | 20.3 | 21.308 | 22.316 | 11.065 | 100.0% | 10 | | total | 12.234 | 21.895 | 44.996 | 45.05 | 45.103 | 29.077 | 100.0% | 10 | | -> duration | 12.234 | 21.895 | 44.996 | 45.05 | 45.103 | 29.077 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.548439 Full duration: 212.960162 HINTS: * To plot HTML graphics with this data, run: rally task report f5b51aa1-f2b9-48b3-94cf-62bad71023d4 --out output.html * To generate a JUnit report, run: rally task export f5b51aa1-f2b9-48b3-94cf-62bad71023d4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f5b51aa1-f2b9-48b3-94cf-62bad71023d4 --json --out output.json 2021-07-03 21:17:20,178 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f5b51aa1-f2b9-48b3-94cf-62bad71023d4 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-07-03 21:17:20,203 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-07-03 21:17:20,244 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 21:17:20,785 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-07-03 21:36:05,948 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: dc3df188-130a-4a1a-90e0-576b10769166 2021-07-03 21:36:07,246 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid dc3df188-130a-4a1a-90e0-576b10769166 -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.566 | 3.652 | 7.829 | 7.891 | 7.952 | 4.692 | 100.0% | 10 | | neutron.update_network | 0.808 | 1.227 | 1.829 | 2.183 | 2.536 | 1.351 | 100.0% | 10 | | total | 2.404 | 5.443 | 8.936 | 9.152 | 9.369 | 6.043 | 100.0% | 10 | | -> duration | 2.404 | 5.443 | 8.936 | 9.152 | 9.369 | 6.043 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.512819 Full duration: 69.902277 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.404 | 5.105 | 5.738 | 6.144 | 6.549 | 4.813 | 100.0% | 10 | | neutron.update_port | 0.869 | 1.341 | 5.026 | 5.027 | 5.028 | 2.04 | 100.0% | 10 | | total | 4.665 | 6.061 | 10.331 | 10.504 | 10.677 | 6.853 | 100.0% | 10 | | -> duration | 4.665 | 6.061 | 10.331 | 10.504 | 10.677 | 6.853 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.299985 Full duration: 96.743383 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.366 | 2.317 | 4.193 | 4.324 | 4.455 | 2.577 | 100.0% | 10 | | neutron.create_subnet | 2.49 | 4.375 | 6.61 | 6.62 | 6.63 | 4.404 | 100.0% | 10 | | neutron.update_subnet | 0.737 | 1.64 | 3.364 | 3.414 | 3.464 | 2.087 | 100.0% | 10 | | total | 5.855 | 8.891 | 11.549 | 11.597 | 11.644 | 9.068 | 100.0% | 10 | | -> duration | 5.855 | 8.891 | 11.549 | 11.597 | 11.644 | 9.068 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.542085 Full duration: 82.087014 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.925 | 4.1 | 6.091 | 6.103 | 6.114 | 4.273 | 100.0% | 10 | | neutron.delete_network | 0.838 | 1.497 | 1.661 | 1.842 | 2.023 | 1.423 | 100.0% | 10 | | total | 2.763 | 5.508 | 7.711 | 7.715 | 7.718 | 5.696 | 100.0% | 10 | | -> duration | 2.763 | 5.508 | 7.711 | 7.715 | 7.718 | 5.696 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.058053 Full duration: 67.04013 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.339 | 6.134 | 9.427 | 10.21 | 10.992 | 6.607 | 100.0% | 10 | | neutron.delete_port | 0.884 | 1.653 | 3.873 | 4.676 | 5.48 | 2.222 | 100.0% | 10 | | total | 5.088 | 8.601 | 12.929 | 12.938 | 12.947 | 8.829 | 100.0% | 10 | | -> duration | 5.088 | 8.601 | 12.929 | 12.938 | 12.947 | 8.829 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.021271 Full duration: 90.445915 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.161 | 3.022 | 4.047 | 5.272 | 6.498 | 3.306 | 100.0% | 10 | | neutron.create_subnet | 1.672 | 3.489 | 5.889 | 5.919 | 5.95 | 3.636 | 100.0% | 10 | | neutron.delete_subnet | 0.94 | 1.822 | 2.185 | 2.266 | 2.347 | 1.74 | 100.0% | 10 | | total | 6.181 | 8.25 | 11.364 | 12.492 | 13.619 | 8.684 | 100.0% | 10 | | -> duration | 6.181 | 8.25 | 11.364 | 12.492 | 13.619 | 8.684 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.115615 Full duration: 79.560947 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.542 | 2.439 | 6.654 | 6.87 | 7.087 | 3.524 | 100.0% | 10 | | neutron.list_networks | 0.178 | 0.37 | 1.296 | 1.813 | 2.33 | 0.612 | 100.0% | 10 | | total | 1.739 | 3.15 | 7.556 | 7.672 | 7.787 | 4.136 | 100.0% | 10 | | -> duration | 1.739 | 3.15 | 7.556 | 7.672 | 7.787 | 4.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.54305 Full duration: 69.058454 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.985 | 4.7 | 6.429 | 6.459 | 6.49 | 4.673 | 100.0% | 10 | | neutron.list_ports | 0.101 | 0.151 | 0.202 | 0.319 | 0.437 | 0.172 | 100.0% | 10 | | total | 3.139 | 4.826 | 6.589 | 6.758 | 6.927 | 4.845 | 100.0% | 10 | | -> duration | 3.139 | 4.826 | 6.589 | 6.758 | 6.927 | 4.845 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.239363 Full duration: 108.28883 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.281 | 2.514 | 4.971 | 5.004 | 5.038 | 2.991 | 100.0% | 10 | | neutron.create_subnet | 1.476 | 3.849 | 4.69 | 4.719 | 4.747 | 3.539 | 100.0% | 10 | | neutron.list_subnets | 0.083 | 0.168 | 2.256 | 2.419 | 2.581 | 0.609 | 100.0% | 10 | | total | 2.945 | 6.629 | 9.783 | 9.949 | 10.115 | 7.139 | 100.0% | 10 | | -> duration | 2.945 | 6.629 | 9.783 | 9.949 | 10.115 | 7.139 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.885812 Full duration: 76.044382 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.24 | 2.005 | 2.929 | 3.282 | 3.634 | 2.131 | 100.0% | 10 | | neutron.delete_security_group | 0.43 | 0.692 | 0.864 | 0.907 | 0.95 | 0.687 | 100.0% | 10 | | total | 2.048 | 2.687 | 3.628 | 3.988 | 4.348 | 2.818 | 100.0% | 10 | | -> duration | 2.048 | 2.687 | 3.628 | 3.988 | 4.348 | 2.818 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.052752 Full duration: 46.436755 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.134 | 1.84 | 3.472 | 3.611 | 3.749 | 2.067 | 100.0% | 10 | | neutron.create_security_group_rule | 0.558 | 1.591 | 2.48 | 2.547 | 2.614 | 1.578 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.191 | 0.399 | 0.795 | 0.874 | 0.953 | 0.463 | 100.0% | 10 | | neutron.delete_security_group | 0.418 | 0.608 | 1.15 | 1.302 | 1.454 | 0.745 | 100.0% | 10 | | total | 3.236 | 5.298 | 5.537 | 5.826 | 6.114 | 4.854 | 100.0% | 10 | | -> duration | 3.236 | 5.298 | 5.537 | 5.826 | 6.114 | 4.854 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.842196 Full duration: 57.121773 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.404 | 2.248 | 2.916 | 3.245 | 3.575 | 2.316 | 100.0% | 10 | | neutron.create_security_group_rule | 0.558 | 1.642 | 2.69 | 2.735 | 2.78 | 1.561 | 100.0% | 10 | | neutron.list_security_group_rules | 0.075 | 0.145 | 0.806 | 0.913 | 1.021 | 0.334 | 100.0% | 10 | | total | 3.059 | 3.992 | 5.341 | 5.453 | 5.565 | 4.211 | 100.0% | 10 | | -> duration | 3.059 | 3.992 | 5.341 | 5.453 | 5.565 | 4.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.289873 Full duration: 56.412111 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.112 | 1.967 | 3.444 | 3.603 | 3.762 | 2.192 | 100.0% | 10 | | neutron.show_security_group | 0.064 | 0.073 | 0.081 | 0.084 | 0.087 | 0.075 | 100.0% | 10 | | total | 1.176 | 2.044 | 3.516 | 3.677 | 3.839 | 2.266 | 100.0% | 10 | | -> duration | 1.176 | 2.044 | 3.516 | 3.677 | 3.839 | 2.266 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.668542 Full duration: 51.226818 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 28.717823 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dc3df188-130a-4a1a-90e0-576b10769166 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 7.597 | 9.749 | 11.514 | 11.529 | 11.544 | 9.761 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.17 | 0.29 | 0.764 | 1.039 | 1.314 | 0.461 | 100.0% | 10 | | total | 8.911 | 10.204 | 11.69 | 11.729 | 11.768 | 10.223 | 100.0% | 10 | | -> duration | 8.911 | 10.204 | 11.69 | 11.729 | 11.768 | 10.223 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.378358 Full duration: 105.523443 HINTS: * To plot HTML graphics with this data, run: rally task report dc3df188-130a-4a1a-90e0-576b10769166 --out output.html * To generate a JUnit report, run: rally task export dc3df188-130a-4a1a-90e0-576b10769166 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report dc3df188-130a-4a1a-90e0-576b10769166 --json --out output.json At least one workload did not pass SLA criteria. 2021-07-03 21:36:10,439 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid dc3df188-130a-4a1a-90e0-576b10769166 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-07-03 21:36:10,461 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-07-03 21:36:10,505 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 21:36:10,996 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-07-03 22:28:50,598 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 8846a268-31be-4be3-9790-2d99c073b52e 2021-07-03 22:28:51,877 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8846a268-31be-4be3-9790-2d99c073b52e -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.995 | 1.613 | 2.018 | 2.044 | 2.07 | 1.533 | 100.0% | 10 | | nova.delete_keypair | 0.141 | 0.483 | 1.154 | 1.247 | 1.34 | 0.564 | 100.0% | 10 | | total | 1.284 | 2.038 | 2.727 | 2.817 | 2.906 | 2.097 | 100.0% | 10 | | -> duration | 1.284 | 2.038 | 2.727 | 2.817 | 2.906 | 2.097 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.913071 Full duration: 33.997929 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.859 | 1.626 | 2.034 | 2.05 | 2.067 | 1.481 | 100.0% | 10 | | nova.list_keypairs | 0.033 | 0.041 | 0.053 | 0.056 | 0.058 | 0.042 | 100.0% | 10 | | total | 0.892 | 1.67 | 2.09 | 2.1 | 2.109 | 1.524 | 100.0% | 10 | | -> duration | 0.892 | 1.67 | 2.09 | 2.1 | 2.109 | 1.524 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.895639 Full duration: 36.807197 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 32.446 | 52.111 | 63.225 | 69.511 | 75.797 | 53.071 | 100.0% | 10 | | nova.reboot_server | 9.508 | 20.295 | 24.252 | 24.857 | 25.462 | 18.001 | 100.0% | 10 | | nova.soft_reboot_server | 9.911 | 16.262 | 42.312 | 92.608 | 142.904 | 29.456 | 100.0% | 10 | | nova.stop_and_start_server | 11.213 | 17.804 | 25.724 | 27.87 | 30.016 | 19.548 | 100.0% | 10 | | -> nova.stop_server | 5.185 | 7.823 | 15.349 | 16.498 | 17.647 | 9.415 | 100.0% | 10 | | -> nova.start_server | 4.65 | 8.534 | 13.874 | 18.674 | 23.473 | 10.133 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 14.997 | 21.418 | 31.315 | 31.874 | 32.433 | 23.857 | 100.0% | 10 | | -> nova.rescue_server | 9.907 | 12.76 | 21.316 | 21.319 | 21.322 | 14.853 | 100.0% | 10 | | -> nova.unrescue_server | 5.09 | 7.613 | 11.716 | 14.441 | 17.165 | 9.004 | 100.0% | 10 | | nova.delete_server | 5.294 | 13.21 | 24.368 | 24.894 | 25.42 | 14.679 | 100.0% | 10 | | total | 125.943 | 148.842 | 175.567 | 239.883 | 304.199 | 158.666 | 100.0% | 10 | | -> duration | 116.943 | 139.842 | 166.567 | 230.883 | 295.199 | 149.666 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 421.260076 Full duration: 464.953677 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 28.753 | 51.272 | 86.665 | 90.508 | 94.351 | 57.714 | 100.0% | 10 | | nova.delete_server | 5.66 | 15.581 | 37.493 | 38.107 | 38.721 | 20.132 | 100.0% | 10 | | total | 43.889 | 85.769 | 103.396 | 106.887 | 110.378 | 77.846 | 100.0% | 10 | | -> duration | 42.889 | 84.769 | 102.396 | 105.887 | 109.378 | 76.846 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 212.608017 Full duration: 246.727899 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 41.571 | 50.003 | 63.076 | 64.915 | 66.755 | 51.422 | 100.0% | 10 | | nova.list_servers | 0.381 | 0.413 | 0.485 | 0.613 | 0.74 | 0.445 | 100.0% | 10 | | total | 41.975 | 50.393 | 63.52 | 65.508 | 67.495 | 51.867 | 100.0% | 10 | | -> duration | 40.975 | 49.393 | 62.52 | 64.508 | 66.495 | 50.867 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 146.979892 Full duration: 277.649132 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "from_image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "to_image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 43.103 | 56.632 | 63.25 | 66.164 | 69.079 | 55.816 | 100.0% | 10 | | nova.rebuild_server | 20.474 | 38.072 | 41.912 | 42.644 | 43.376 | 35.414 | 100.0% | 10 | | nova.delete_server | 16.322 | 21.129 | 31.007 | 32.776 | 34.544 | 22.904 | 100.0% | 10 | | total | 91.155 | 116.875 | 124.389 | 134.88 | 145.372 | 114.134 | 100.0% | 10 | | -> duration | 89.155 | 114.875 | 122.389 | 132.88 | 143.372 | 112.134 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 322.919238 Full duration: 366.679678 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 77.395 | 142.388 | 163.971 | 166.282 | 168.593 | 135.145 | 100.0% | 10 | | nova.snapshot_server | 18.673 | 39.624 | 56.951 | 57.194 | 57.436 | 38.525 | 100.0% | 10 | | -> glance_v2.get_image | 0.061 | 0.081 | 0.096 | 0.099 | 0.103 | 0.082 | 100.0% | 10 | | -> glance.wait_for_image | 14.386 | 27.647 | 45.187 | 46.112 | 47.037 | 29.078 | 100.0% | 10 | | --> glance_v2.get_image (x20) | 0.85 | 0.85 | 0.85 | 0.85 | 0.85 | 0.85 | 100.0% | 1 | | --> glance_v2.get_image (x16) | 0.663 | 0.663 | 0.663 | 0.663 | 0.663 | 0.663 | 100.0% | 1 | | --> glance_v2.get_image (x15) | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 100.0% | 1 | | --> glance_v2.get_image (x14) | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | --> glance_v2.get_image (x23) | 0.929 | 0.929 | 0.929 | 0.929 | 0.929 | 0.929 | 100.0% | 1 | | --> glance_v2.get_image (x24) | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 100.0% | 1 | | --> glance_v2.get_image (x11) | 0.467 | 0.516 | 0.555 | 0.56 | 0.565 | 0.516 | 100.0% | 2 | | --> glance_v2.get_image (x8) | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 100.0% | 1 | | --> glance_v2.get_image (x10) | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 100.0% | 1 | | nova.delete_server (x2) | 22.118 | 49.551 | 74.297 | 80.202 | 86.106 | 51.485 | 100.0% | 10 | | nova.delete_image | 5.884 | 9.832 | 10.536 | 11.676 | 12.816 | 9.38 | 100.0% | 10 | | -> glance_v2.delete_image | 5.851 | 9.792 | 10.471 | 11.619 | 12.767 | 9.337 | 100.0% | 10 | | -> glance.wait_for_delete | 0.032 | 0.039 | 0.048 | 0.056 | 0.065 | 0.041 | 100.0% | 10 | | --> glance_v2.get_image | 0.032 | 0.039 | 0.048 | 0.056 | 0.064 | 0.041 | 0.0% | 10 | | total | 132.446 | 245.774 | 279.06 | 281.916 | 284.771 | 234.535 | 100.0% | 10 | | -> duration | 130.446 | 243.774 | 277.06 | 279.916 | 282.771 | 232.535 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 649.825442 Full duration: 703.191387 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "volume_size": 1, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 18.952 | 27.688 | 41.002 | 42.864 | 44.725 | 29.294 | 100.0% | 10 | | nova.boot_server | 27.008 | 98.005 | 124.111 | 125.867 | 127.624 | 91.169 | 100.0% | 10 | | total | 57.864 | 127.255 | 148.162 | 153.941 | 159.72 | 120.463 | 100.0% | 10 | | -> duration | 56.864 | 126.255 | 147.162 | 152.941 | 158.72 | 119.463 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 328.912275 Full duration: 449.099702 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 23.6 | 47.266 | 83.604 | 85.177 | 86.751 | 54.628 | 100.0% | 10 | | total | 23.601 | 47.266 | 83.604 | 85.177 | 86.751 | 54.628 | 100.0% | 10 | | -> duration | 22.601 | 46.266 | 82.604 | 84.177 | 85.751 | 53.628 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 147.251269 Full duration: 272.713154 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 35.378146 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "image": { "name": "rally_full-img_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "to_flavor": { "name": "rally_full-flavor_alt_99a8affd-d68f-4ed4-9dc8-36d8836244c5" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "189ea886-45dd-41bb-a95e-9fabdac02856" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8846a268-31be-4be3-9790-2d99c073b52e has 5 error(s) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-602749f6-79fa-4578-b969-26c114831709) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-602749f6-79fa-4578-b969-26c114831709) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-b913a6af-ddac-459f-b878-7da5a4a88e08) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-b913a6af-ddac-459f-b878-7da5a4a88e08) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-2bd9b6bc-7cca-4c6c-88a9-1a44a865986d) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-2bd9b6bc-7cca-4c6c-88a9-1a44a865986d) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-98aa0464-3145-44e2-a518-65a54ae32822) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-98aa0464-3145-44e2-a518-65a54ae32822) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-711de06c-d26e-4243-8867-a8c23e5953ed) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-711de06c-d26e-4243-8867-a8c23e5953ed) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 33.75 | 78.136 | 91.056 | 93.053 | 95.05 | 71.569 | 100.0% | 5 | | nova.resize | 5.919 | 33.626 | 42.907 | 44.201 | 45.494 | 31.308 | 0.0% | 5 | | total | 39.669 | 117.164 | 123.99 | 125.756 | 127.522 | 102.877 | 0.0% | 5 | | -> duration | 38.669 | 116.164 | 122.99 | 124.756 | 126.522 | 101.877 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 150.043233 Full duration: 204.299272 HINTS: * To plot HTML graphics with this data, run: rally task report 8846a268-31be-4be3-9790-2d99c073b52e --out output.html * To generate a JUnit report, run: rally task export 8846a268-31be-4be3-9790-2d99c073b52e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8846a268-31be-4be3-9790-2d99c073b52e --json --out output.json At least one workload did not pass SLA criteria. 2021-07-03 22:28:54,986 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8846a268-31be-4be3-9790-2d99c073b52e --out /home/opnfv/functest/results/rally_full/nova.json 2021-07-03 22:28:55,009 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-07-03 22:28:55,036 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 22:28:55,463 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-07-03 22:31:52,410 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 2d92453d-5827-4c89-b937-cbf97d46ecc8 2021-07-03 22:31:53,567 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2d92453d-5827-4c89-b937-cbf97d46ecc8 -------------------------------------------------------------------------------- Task 2d92453d-5827-4c89-b937-cbf97d46ecc8: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d92453d-5827-4c89-b937-cbf97d46ecc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.771 | 2.258 | 4.02 | 4.097 | 4.174 | 2.573 | 100.0% | 10 | | quotas.delete_quotas | 0.03 | 0.191 | 0.872 | 0.953 | 1.034 | 0.413 | 100.0% | 10 | | total | 0.824 | 2.426 | 4.86 | 4.871 | 4.882 | 2.986 | 100.0% | 10 | | -> duration | 0.824 | 2.426 | 4.86 | 4.871 | 4.882 | 2.986 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.517534 Full duration: 43.373467 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d92453d-5827-4c89-b937-cbf97d46ecc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.627 | 5.39 | 10.61 | 11.816 | 13.021 | 7.352 | 100.0% | 10 | | total | 4.627 | 5.39 | 10.61 | 11.816 | 13.022 | 7.352 | 100.0% | 10 | | -> duration | 4.627 | 5.39 | 10.61 | 11.816 | 13.022 | 7.352 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.889086 Full duration: 51.836551 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d92453d-5827-4c89-b937-cbf97d46ecc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 8.501 | 12.267 | 13.592 | 13.891 | 14.19 | 11.864 | 100.0% | 10 | | total | 8.501 | 12.267 | 13.592 | 13.891 | 14.19 | 11.864 | 100.0% | 10 | | -> duration | 8.501 | 12.267 | 13.592 | 13.891 | 14.19 | 11.864 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.760219 Full duration: 62.636201 HINTS: * To plot HTML graphics with this data, run: rally task report 2d92453d-5827-4c89-b937-cbf97d46ecc8 --out output.html * To generate a JUnit report, run: rally task export 2d92453d-5827-4c89-b937-cbf97d46ecc8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2d92453d-5827-4c89-b937-cbf97d46ecc8 --json --out output.json 2021-07-03 22:31:56,558 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2d92453d-5827-4c89-b937-cbf97d46ecc8 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-07-03 22:31:56,564 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-07-03 22:31:56,596 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-07-03 22:31:56,769 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-07-03 22:41:14,842 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 0b923ee1-db38-4084-8033-e213fd7bf341 2021-07-03 22:41:16,091 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0b923ee1-db38-4084-8033-e213fd7bf341 -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.941 | 1.162 | 1.364 | 1.484 | 1.604 | 1.197 | 100.0% | 10 | | swift.upload_object (x2) | 1.002 | 1.135 | 1.216 | 1.218 | 1.221 | 1.13 | 100.0% | 10 | | swift.list_objects | 0.998 | 1.04 | 1.076 | 1.077 | 1.077 | 1.042 | 100.0% | 10 | | total | 3.088 | 3.35 | 3.586 | 3.672 | 3.757 | 3.371 | 100.0% | 10 | | -> duration | 3.088 | 3.35 | 3.586 | 3.672 | 3.757 | 3.371 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.76547 Full duration: 100.278786 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.292 | 1.389 | 1.447 | 1.491 | 1.534 | 1.397 | 100.0% | 10 | | swift.list_objects | 0.903 | 0.998 | 1.078 | 1.211 | 1.345 | 1.019 | 100.0% | 10 | | total | 2.289 | 2.369 | 2.578 | 2.651 | 2.724 | 2.416 | 100.0% | 10 | | -> duration | 2.289 | 2.369 | 2.578 | 2.651 | 2.724 | 2.416 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.217693 Full duration: 90.203566 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.032 | 1.127 | 1.262 | 1.263 | 1.265 | 1.146 | 100.0% | 10 | | swift.upload_object (x5) | 2.668 | 2.748 | 2.842 | 2.854 | 2.866 | 2.762 | 100.0% | 10 | | swift.download_object (x5) | 2.365 | 2.454 | 2.501 | 2.525 | 2.548 | 2.451 | 100.0% | 10 | | total | 6.209 | 6.285 | 6.604 | 6.629 | 6.654 | 6.361 | 100.0% | 10 | | -> duration | 6.209 | 6.285 | 6.604 | 6.629 | 6.654 | 6.361 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.666191 Full duration: 130.079597 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.041 | 1.155 | 1.306 | 1.308 | 1.309 | 1.161 | 100.0% | 10 | | swift.upload_object (x5) | 2.875 | 3.004 | 3.062 | 3.077 | 3.092 | 2.991 | 100.0% | 10 | | swift.delete_object (x5) | 2.657 | 2.775 | 2.867 | 2.917 | 2.966 | 2.789 | 100.0% | 10 | | swift.delete_container | 0.562 | 0.654 | 0.79 | 0.805 | 0.82 | 0.681 | 100.0% | 10 | | total | 7.434 | 7.622 | 7.704 | 7.756 | 7.809 | 7.624 | 100.0% | 10 | | -> duration | 7.434 | 7.622 | 7.704 | 7.756 | 7.809 | 7.624 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.292796 Full duration: 114.684775 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0b923ee1-db38-4084-8033-e213fd7bf341 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.413 | 1.496 | 1.678 | 1.702 | 1.727 | 1.532 | 100.0% | 10 | | swift.list_objects | 0.975 | 1.031 | 1.079 | 1.088 | 1.096 | 1.036 | 100.0% | 10 | | swift.download_object (x5) | 2.438 | 2.551 | 2.655 | 2.856 | 3.058 | 2.578 | 100.0% | 10 | | total | 4.924 | 5.098 | 5.385 | 5.416 | 5.447 | 5.147 | 100.0% | 10 | | -> duration | 4.924 | 5.098 | 5.385 | 5.416 | 5.447 | 5.147 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.529634 Full duration: 97.298812 HINTS: * To plot HTML graphics with this data, run: rally task report 0b923ee1-db38-4084-8033-e213fd7bf341 --out output.html * To generate a JUnit report, run: rally task export 0b923ee1-db38-4084-8033-e213fd7bf341 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0b923ee1-db38-4084-8033-e213fd7bf341 --json --out output.json 2021-07-03 22:41:19,092 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0b923ee1-db38-4084-8033-e213fd7bf341 --out /home/opnfv/functest/results/rally_full/swift.json 2021-07-03 22:41:19,110 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-07-03 22:41:19,114 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:42 | 60 | 100.00% | | glance | 00:12:20 | 40 | 90.00% | | cinder | 00:54:02 | 240 | 100.00% | | heat | 01:05:58 | 100 | 100.00% | | keystone | 00:10:16 | 110 | 100.00% | | neutron | 00:18:04 | 140 | 100.00% | | nova | 00:51:31 | 95 | 94.74% | | quotas | 00:02:37 | 30 | 100.00% | | swift | 00:08:52 | 50 | 100.00% | | | | | | | TOTAL: | 03:46:26 | 865 | 98.96% | +----------------+------------+----------------+-----------+ 2021-07-03 22:41:19,114 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.96% in 6/9 modules 2021-07-03 22:41:22,950 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-07-03 22:41:26,372 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-07-03 22:41:26,373 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 233:52 | FAIL | +--------------------+------------------+------------------+----------------+