2021-05-08 17:20:08,651 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | HUIGD5DQ2S3E | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/HUIGD5DQ2S3E/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-216 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/HUIGD5DQ2S3E/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-216 | +-------------------------+------------------------------------------------------------+ 2021-05-08 17:20:08,669 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-05-08 17:20:12,907 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-05-08 17:20:17,681 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-05-08 17:20:24,064 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | feeb0908-dcb6-4ca2-b0e2-65acf91af76a | 2021-05-08T17:20:23.772813 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: feeb0908-dcb6-4ca2-b0e2-65acf91af76a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-05-08 17:20:29,102 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-05-08 17:20:31,909 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 17:20:32,267 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-05-08 17:23:08,770 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 6639e763-c90e-4511-8275-b8ebd364d9c2 2021-05-08 17:23:09,996 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6639e763-c90e-4511-8275-b8ebd364d9c2 -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.843 | 1.229 | 1.768 | 1.791 | 1.815 | 1.335 | 100.0% | 10 | | total | 0.843 | 1.229 | 1.768 | 1.791 | 1.815 | 1.335 | 100.0% | 10 | | -> duration | 0.843 | 1.229 | 1.768 | 1.791 | 1.815 | 1.335 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.307536 Full duration: 27.125831 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.142 | 0.256 | 0.567 | 0.593 | 0.619 | 0.314 | 100.0% | 10 | | total | 0.593 | 0.996 | 1.187 | 1.414 | 1.641 | 0.945 | 100.0% | 10 | | -> duration | 0.593 | 0.996 | 1.187 | 1.414 | 1.641 | 0.945 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.705909 Full duration: 20.261072 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.247 | 0.362 | 0.763 | 0.901 | 1.039 | 0.474 | 100.0% | 10 | | total | 0.673 | 1.025 | 1.715 | 1.803 | 1.891 | 1.141 | 100.0% | 10 | | -> duration | 0.673 | 1.025 | 1.715 | 1.803 | 1.891 | 1.141 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.017406 Full duration: 21.740199 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.158 | 0.299 | 0.635 | 0.727 | 0.819 | 0.378 | 100.0% | 10 | | total | 0.626 | 1.089 | 1.303 | 1.408 | 1.514 | 1.086 | 100.0% | 10 | | -> duration | 0.626 | 1.089 | 1.303 | 1.408 | 1.514 | 1.086 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.029809 Full duration: 23.233215 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.531 | 0.864 | 0.993 | 1.227 | 1.461 | 0.846 | 100.0% | 10 | | total | 1.063 | 1.449 | 1.587 | 1.714 | 1.842 | 1.388 | 100.0% | 10 | | -> duration | 1.063 | 1.449 | 1.587 | 1.714 | 1.842 | 1.388 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.138266 Full duration: 21.823064 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6639e763-c90e-4511-8275-b8ebd364d9c2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.187 | 0.278 | 0.435 | 0.532 | 0.629 | 0.325 | 100.0% | 10 | | total | 0.67 | 0.828 | 1.123 | 1.443 | 1.763 | 0.941 | 100.0% | 10 | | -> duration | 0.67 | 0.828 | 1.123 | 1.443 | 1.763 | 0.941 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.556318 Full duration: 21.509429 HINTS: * To plot HTML graphics with this data, run: rally task report 6639e763-c90e-4511-8275-b8ebd364d9c2 --out output.html * To generate a JUnit report, run: rally task export 6639e763-c90e-4511-8275-b8ebd364d9c2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6639e763-c90e-4511-8275-b8ebd364d9c2 --json --out output.json 2021-05-08 17:23:13,239 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6639e763-c90e-4511-8275-b8ebd364d9c2 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-05-08 17:23:13,251 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-05-08 17:23:13,287 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 17:23:13,450 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-05-08 17:33:51,127 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 268287ad-9957-4de0-b202-e497be5eda10 2021-05-08 17:33:52,421 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 268287ad-9957-4de0-b202-e497be5eda10 -------------------------------------------------------------------------------- Task 268287ad-9957-4de0-b202-e497be5eda10: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 268287ad-9957-4de0-b202-e497be5eda10 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.927 | 5.952 | 7.387 | 7.465 | 7.543 | 6.125 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.108 | 0.185 | 0.204 | 0.222 | 0.127 | 100.0% | 10 | | -> glance_v2.upload_data | 2.306 | 3.033 | 4.131 | 4.158 | 4.186 | 3.173 | 100.0% | 10 | | glance_v2.delete_image | 1.655 | 2.016 | 3.297 | 3.335 | 3.372 | 2.243 | 100.0% | 10 | | total | 6.593 | 7.818 | 10.18 | 10.506 | 10.833 | 8.368 | 100.0% | 10 | | -> duration | 6.593 | 7.818 | 10.18 | 10.506 | 10.833 | 8.368 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.241023 Full duration: 45.769702 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 268287ad-9957-4de0-b202-e497be5eda10 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.366 | 6.223 | 6.983 | 7.006 | 7.028 | 6.163 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.088 | 0.107 | 0.119 | 0.119 | 0.12 | 0.106 | 100.0% | 10 | | -> glance_v2.upload_data | 2.771 | 3.572 | 3.988 | 4.155 | 4.323 | 3.501 | 100.0% | 10 | | glance_v2.list_images | 0.058 | 0.063 | 0.066 | 0.067 | 0.067 | 0.062 | 100.0% | 10 | | total | 5.428 | 6.288 | 7.051 | 7.069 | 7.088 | 6.226 | 100.0% | 10 | | -> duration | 5.428 | 6.288 | 7.051 | 7.069 | 7.088 | 6.226 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.642736 Full duration: 51.585422 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 268287ad-9957-4de0-b202-e497be5eda10 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.144 | 0.174 | 0.229 | 0.254 | 0.278 | 0.184 | 100.0% | 10 | | total | 0.144 | 0.174 | 0.229 | 0.254 | 0.278 | 0.184 | 100.0% | 10 | | -> duration | 0.144 | 0.174 | 0.229 | 0.254 | 0.278 | 0.184 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.47198 Full duration: 30.299969 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 268287ad-9957-4de0-b202-e497be5eda10 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.587 | 10.719 | 17.083 | 17.459 | 17.835 | 10.791 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.104 | 0.114 | 0.139 | 0.145 | 0.15 | 0.12 | 100.0% | 10 | | -> glance_v2.upload_data | 3.095 | 5.477 | 10.556 | 11.028 | 11.501 | 6.345 | 100.0% | 10 | | nova.boot_servers | 74.148 | 117.844 | 161.287 | 167.704 | 174.12 | 123.284 | 60.0% | 10 | | total | 80.676 | 127.008 | 171.714 | 181.834 | 191.955 | 134.075 | 60.0% | 10 | | -> duration | 79.676 | 126.008 | 170.714 | 180.834 | 190.955 | 133.075 | 60.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 60.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 365.718832 Full duration: 485.135017 HINTS: * To plot HTML graphics with this data, run: rally task report 268287ad-9957-4de0-b202-e497be5eda10 --out output.html * To generate a JUnit report, run: rally task export 268287ad-9957-4de0-b202-e497be5eda10 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 268287ad-9957-4de0-b202-e497be5eda10 --json --out output.json At least one workload did not pass SLA criteria. 2021-05-08 17:33:55,402 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 268287ad-9957-4de0-b202-e497be5eda10 --out /home/opnfv/functest/results/rally_full/glance.json 2021-05-08 17:33:55,492 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-05-08 17:33:55,535 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 17:33:55,928 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-05-08 18:22:43,906 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 2021-05-08 18:22:45,284 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "size": 1, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 43.562 | 52.217 | 61.343 | 61.784 | 62.226 | 53.152 | 100.0% | 10 | | cinder_v3.create_volume | 2.82 | 8.052 | 15.736 | 16.918 | 18.101 | 9.092 | 100.0% | 10 | | nova.attach_volume | 4.28 | 18.755 | 27.377 | 32.382 | 37.387 | 20.541 | 100.0% | 10 | | nova.detach_volume | 3.667 | 5.831 | 7.81 | 10.149 | 12.488 | 6.131 | 100.0% | 10 | | cinder_v3.delete_volume | 2.26 | 6.873 | 13.277 | 14.228 | 15.179 | 7.346 | 100.0% | 10 | | nova.delete_server | 5.698 | 22.911 | 28.35 | 28.424 | 28.498 | 19.878 | 100.0% | 10 | | total | 85.691 | 117.915 | 136.476 | 145.494 | 154.512 | 116.141 | 100.0% | 10 | | -> duration | 84.691 | 116.915 | 135.476 | 144.494 | 153.512 | 115.141 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 325.049285 Full duration: 367.100497 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.135 | 6.886 | 8.4 | 8.529 | 8.657 | 6.83 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.037 | 0.041 | 0.046 | 0.048 | 0.05 | 0.042 | 100.0% | 10 | | total | 4.173 | 6.927 | 8.438 | 8.57 | 8.702 | 6.872 | 100.0% | 10 | | -> duration | 4.173 | 6.927 | 8.438 | 8.57 | 8.702 | 6.872 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.118589 Full duration: 89.049831 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 13.869 | 19.296 | 25.128 | 25.183 | 25.237 | 18.961 | 100.0% | 10 | | cinder_v3.list_volumes | 0.07 | 0.087 | 0.109 | 0.111 | 0.113 | 0.088 | 100.0% | 10 | | total | 13.974 | 19.383 | 25.221 | 25.264 | 25.308 | 19.05 | 100.0% | 10 | | -> duration | 13.974 | 19.383 | 25.221 | 25.264 | 25.308 | 19.05 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 54.661098 Full duration: 109.321575 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.057 | 12.533 | 14.951 | 15.068 | 15.184 | 12.407 | 100.0% | 10 | | cinder_v3.list_volumes | 0.061 | 0.074 | 0.096 | 0.099 | 0.102 | 0.077 | 100.0% | 10 | | total | 7.119 | 12.632 | 15.025 | 15.142 | 15.258 | 12.485 | 100.0% | 10 | | -> duration | 7.119 | 12.632 | 15.025 | 15.142 | 15.258 | 12.485 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.634588 Full duration: 87.111145 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.093 | 4.72 | 7.483 | 8.218 | 8.954 | 5.226 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 36.555 | 57.68 | 62.839 | 63.029 | 63.218 | 54.241 | 100.0% | 10 | | cinder_v3.delete_volume | 2.314 | 2.697 | 4.681 | 4.7 | 4.719 | 3.091 | 100.0% | 10 | | glance_v2.delete_image | 5.489 | 6.866 | 9.079 | 9.363 | 9.646 | 7.029 | 100.0% | 10 | | total | 49.855 | 70.356 | 82.006 | 82.183 | 82.359 | 69.588 | 100.0% | 10 | | -> duration | 49.855 | 70.356 | 82.006 | 82.183 | 82.359 | 69.588 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 200.368253 Full duration: 234.069322 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 35.106 | 53.164 | 89.919 | 92.959 | 95.999 | 60.451 | 100.0% | 10 | | cinder_v3.create_volume | 4.925 | 15.09 | 21.142 | 27.341 | 33.54 | 15.748 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.751 | 11.402 | 16.626 | 16.737 | 16.848 | 11.358 | 100.0% | 10 | | nova.attach_volume | 12.206 | 20.096 | 21.737 | 23.109 | 24.482 | 19.142 | 100.0% | 10 | | nova.detach_volume | 1.22 | 5.586 | 8.01 | 8.076 | 8.141 | 5.422 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.938 | 4.67 | 8.035 | 8.184 | 8.332 | 5.586 | 100.0% | 10 | | cinder_v3.delete_volume | 2.799 | 7.551 | 15.234 | 17.526 | 19.818 | 9.437 | 100.0% | 10 | | nova.delete_server | 13.413 | 22.963 | 31.384 | 32.079 | 32.773 | 23.207 | 100.0% | 10 | | total | 86.933 | 149.976 | 194.584 | 194.853 | 195.123 | 150.352 | 100.0% | 10 | | -> duration | 85.933 | 148.976 | 193.584 | 193.853 | 194.123 | 149.352 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 413.900019 Full duration: 452.162445 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.692 | 12.281 | 26.669 | 27.323 | 27.978 | 15.545 | 100.0% | 10 | | cinder_v3.create_snapshot | 6.505 | 10.279 | 14.168 | 14.324 | 14.48 | 10.717 | 100.0% | 10 | | nova.boot_server | 42.111 | 51.543 | 57.447 | 58.132 | 58.817 | 51.027 | 100.0% | 10 | | nova.attach_volume | 8.097 | 18.896 | 24.23 | 24.276 | 24.322 | 18.721 | 100.0% | 10 | | nova.detach_volume | 3.897 | 7.503 | 12.466 | 13.903 | 15.339 | 8.022 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.492 | 5.563 | 6.607 | 6.966 | 7.325 | 5.255 | 100.0% | 10 | | cinder_v3.delete_volume | 2.994 | 8.351 | 15.534 | 17.287 | 19.04 | 8.575 | 100.0% | 10 | | nova.delete_server | 9.342 | 23.085 | 28.263 | 30.252 | 32.241 | 22.222 | 100.0% | 10 | | total | 119.931 | 141.117 | 158.263 | 159.699 | 161.135 | 140.087 | 100.0% | 10 | | -> duration | 118.931 | 140.117 | 157.263 | 158.699 | 160.135 | 139.087 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 397.371065 Full duration: 446.410713 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.059 | 13.748 | 16.885 | 18.21 | 19.535 | 12.427 | 100.0% | 10 | | total | 5.059 | 13.748 | 16.886 | 18.211 | 19.536 | 12.427 | 100.0% | 10 | | -> duration | 5.059 | 13.748 | 16.886 | 18.211 | 19.536 | 12.427 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.696735 Full duration: 73.112653 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.496 | 10.339 | 11.956 | 12.326 | 12.695 | 10.053 | 100.0% | 10 | | total | 7.496 | 10.339 | 11.956 | 12.326 | 12.695 | 10.054 | 100.0% | 10 | | -> duration | 7.496 | 10.339 | 11.956 | 12.326 | 12.695 | 10.054 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.111948 Full duration: 80.868905 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.616 | 0.789 | 1.127 | 1.127 | 1.127 | 0.85 | 100.0% | 10 | | total | 0.617 | 0.789 | 1.127 | 1.127 | 1.127 | 0.851 | 100.0% | 10 | | -> duration | 0.617 | 0.789 | 1.127 | 1.127 | 1.127 | 0.851 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.684726 Full duration: 91.504058 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.184 | 7.539 | 11.356 | 11.46 | 11.563 | 7.795 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.208 | 3.525 | 7.557 | 7.62 | 7.682 | 4.448 | 100.0% | 10 | | total | 6.475 | 13.399 | 16.908 | 17.384 | 17.86 | 12.244 | 100.0% | 10 | | -> duration | 6.475 | 13.399 | 16.908 | 17.384 | 17.86 | 12.244 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.000595 Full duration: 86.556291 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.393 | 9.101 | 12.302 | 12.352 | 12.402 | 9.419 | 100.0% | 10 | | cinder_v3.delete_volume | 3.519 | 6.857 | 8.794 | 9.638 | 10.482 | 6.975 | 100.0% | 10 | | total | 13.105 | 16.281 | 18.965 | 19.173 | 19.382 | 16.394 | 100.0% | 10 | | -> duration | 13.105 | 16.281 | 18.965 | 19.173 | 19.382 | 16.394 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.188837 Full duration: 83.278013 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.808 | 20.209 | 21.542 | 21.777 | 22.011 | 19.839 | 100.0% | 10 | | cinder_v3.delete_volume | 5.204 | 7.378 | 9.69 | 10.286 | 10.882 | 7.619 | 100.0% | 10 | | total | 26.255 | 27.178 | 28.171 | 28.76 | 29.349 | 27.458 | 100.0% | 10 | | -> duration | 26.255 | 27.178 | 28.171 | 28.76 | 29.349 | 27.458 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 82.18896 Full duration: 121.574823 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.735 | 8.004 | 16.686 | 21.062 | 25.439 | 11.044 | 100.0% | 10 | | cinder_v3.delete_volume | 3.091 | 4.977 | 24.073 | 24.606 | 25.14 | 10.99 | 100.0% | 10 | | total | 9.292 | 12.185 | 40.743 | 40.799 | 40.854 | 22.035 | 100.0% | 10 | | -> duration | 9.292 | 12.185 | 40.743 | 40.799 | 40.854 | 22.035 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 61.47132 Full duration: 96.837755 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.119 | 7.449 | 13.028 | 13.564 | 14.1 | 8.512 | 100.0% | 10 | | cinder_v3.extend_volume | 2.931 | 3.364 | 9.36 | 9.413 | 9.465 | 5.141 | 100.0% | 10 | | cinder_v3.delete_volume | 2.374 | 3.618 | 11.219 | 12.334 | 13.448 | 6.454 | 100.0% | 10 | | total | 11.182 | 16.821 | 30.014 | 31.738 | 33.461 | 20.107 | 100.0% | 10 | | -> duration | 11.182 | 16.821 | 30.014 | 31.738 | 33.461 | 20.107 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.8355 Full duration: 87.025685 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.817 | 9.964 | 14.344 | 14.862 | 15.38 | 10.251 | 100.0% | 10 | | cinder_v3.delete_volume | 4.665 | 5.704 | 9.163 | 9.742 | 10.32 | 6.598 | 100.0% | 10 | | total | 9.483 | 17.346 | 22.03 | 23.222 | 24.415 | 16.85 | 100.0% | 10 | | -> duration | 9.483 | 17.346 | 22.03 | 23.222 | 24.415 | 16.85 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.51967 Full duration: 103.906488 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.721 | 1.025 | 1.449 | 1.452 | 1.455 | 1.098 | 100.0% | 10 | | cinder_v3.get_qos | 0.026 | 0.037 | 0.041 | 0.046 | 0.051 | 0.037 | 100.0% | 10 | | total | 0.753 | 1.057 | 1.495 | 1.497 | 1.5 | 1.135 | 100.0% | 10 | | -> duration | 0.753 | 1.057 | 1.495 | 1.497 | 1.5 | 1.135 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.315003 Full duration: 34.02476 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.524 | 0.884 | 1.217 | 1.302 | 1.387 | 0.906 | 100.0% | 10 | | cinder_v3.list_qos | 0.033 | 0.037 | 0.051 | 0.053 | 0.055 | 0.04 | 100.0% | 10 | | total | 0.562 | 0.923 | 1.252 | 1.338 | 1.425 | 0.947 | 100.0% | 10 | | -> duration | 0.562 | 0.923 | 1.252 | 1.338 | 1.425 | 0.947 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.132999 Full duration: 33.851218 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.912 | 1.106 | 1.479 | 1.495 | 1.512 | 1.173 | 100.0% | 10 | | cinder_v3.set_qos | 0.082 | 0.219 | 0.459 | 0.481 | 0.504 | 0.251 | 100.0% | 10 | | total | 1.016 | 1.526 | 1.62 | 1.736 | 1.852 | 1.425 | 100.0% | 10 | | -> duration | 1.016 | 1.526 | 1.62 | 1.736 | 1.852 | 1.425 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.174803 Full duration: 29.836 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.777 | 1.389 | 1.564 | 1.599 | 1.633 | 1.209 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.03 | 0.037 | 0.044 | 0.051 | 0.057 | 0.038 | 100.0% | 10 | | total | 0.81 | 1.43 | 1.596 | 1.634 | 1.672 | 1.247 | 100.0% | 10 | | -> duration | 0.81 | 1.43 | 1.596 | 1.634 | 1.672 | 1.247 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.202486 Full duration: 26.502468 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.761 | 0.97 | 1.069 | 1.08 | 1.092 | 0.946 | 100.0% | 10 | | cinder_v3.list_types | 0.036 | 0.045 | 0.058 | 0.063 | 0.069 | 0.048 | 100.0% | 10 | | total | 0.805 | 1.025 | 1.114 | 1.131 | 1.148 | 0.995 | 100.0% | 10 | | -> duration | 0.805 | 1.025 | 1.114 | 1.131 | 1.148 | 0.995 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.008482 Full duration: 30.461664 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.71 | 1.409 | 1.769 | 1.954 | 2.14 | 1.362 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.068 | 0.266 | 0.47 | 0.672 | 0.875 | 0.298 | 100.0% | 10 | | total | 0.8 | 1.788 | 2.568 | 2.585 | 2.603 | 1.66 | 100.0% | 10 | | -> duration | 0.8 | 1.788 | 2.568 | 2.585 | 2.603 | 1.66 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.449146 Full duration: 29.927156 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.958 | 1.583 | 2.41 | 2.411 | 2.412 | 1.573 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.225 | 0.763 | 1.045 | 1.243 | 1.44 | 0.696 | 100.0% | 10 | | total | 1.254 | 2.346 | 3.251 | 3.3 | 3.349 | 2.269 | 100.0% | 10 | | -> duration | 1.254 | 2.346 | 3.251 | 3.3 | 3.349 | 2.269 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.938928 Full duration: 35.853005 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.916 | 1.826 | 2.443 | 2.448 | 2.453 | 1.807 | 100.0% | 10 | | cinder_v2.add_type_access | 0.098 | 1.073 | 1.509 | 1.646 | 1.784 | 0.98 | 100.0% | 10 | | cinder_v2.list_type_access | 0.035 | 0.04 | 0.047 | 0.051 | 0.055 | 0.041 | 100.0% | 10 | | total | 1.085 | 3.041 | 3.605 | 3.733 | 3.861 | 2.829 | 100.0% | 10 | | -> duration | 1.085 | 3.041 | 3.605 | 3.733 | 3.861 | 2.829 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.935745 Full duration: 32.844206 HINTS: * To plot HTML graphics with this data, run: rally task report 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 --out output.html * To generate a JUnit report, run: rally task export 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 --json --out output.json 2021-05-08 18:22:48,399 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2f5378a1-afdd-4a64-b2d5-9f953ddb8690 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-05-08 18:22:48,435 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-05-08 18:22:48,466 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 18:22:48,909 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-05-08 19:17:07,333 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: d395526a-04c9-46c5-a7fd-7492bcb0a6e1 2021-05-08 19:17:08,573 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d395526a-04c9-46c5-a7fd-7492bcb0a6e1 -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.006 | 11.863 | 16.791 | 16.855 | 16.919 | 11.953 | 100.0% | 10 | | heat.list_stacks | 0.053 | 0.064 | 0.075 | 0.076 | 0.077 | 0.065 | 100.0% | 10 | | total | 8.059 | 11.938 | 16.855 | 16.921 | 16.987 | 12.019 | 100.0% | 10 | | -> duration | 6.059 | 9.938 | 14.855 | 14.921 | 14.987 | 10.019 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.219885 Full duration: 135.657185 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 23.411 | 47.701 | 75.817 | 76.41 | 77.002 | 51.67 | 100.0% | 10 | | heat.update_stack | 11.481 | 53.1 | 63.563 | 63.575 | 63.586 | 47.5 | 100.0% | 10 | | heat.delete_stack | 14.689 | 51.189 | 59.181 | 62.319 | 65.457 | 44.759 | 100.0% | 10 | | total | 71.927 | 157.661 | 181.379 | 182.707 | 184.036 | 143.929 | 100.0% | 10 | | -> duration | 67.927 | 153.661 | 177.379 | 178.707 | 180.036 | 139.929 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 379.194156 Full duration: 420.901474 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 24.308 | 41.884 | 44.492 | 45.879 | 47.265 | 37.379 | 100.0% | 10 | | heat.update_stack | 8.267 | 20.818 | 22.75 | 23.235 | 23.72 | 17.768 | 100.0% | 10 | | heat.delete_stack | 8.292 | 27.482 | 33.284 | 33.563 | 33.842 | 24.885 | 100.0% | 10 | | total | 60.694 | 75.125 | 100.125 | 100.143 | 100.162 | 80.033 | 100.0% | 10 | | -> duration | 56.694 | 71.125 | 96.125 | 96.143 | 96.162 | 76.033 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 221.998754 Full duration: 276.632306 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 39.499 | 66.34 | 81.345 | 82.849 | 84.353 | 66.132 | 100.0% | 10 | | heat.update_stack | 25.498 | 57.876 | 62.472 | 63.352 | 64.232 | 52.489 | 100.0% | 10 | | heat.delete_stack | 24.955 | 43.436 | 54.897 | 54.909 | 54.921 | 43.754 | 100.0% | 10 | | total | 90.996 | 175.674 | 184.43 | 187.22 | 190.009 | 162.375 | 100.0% | 10 | | -> duration | 86.996 | 171.674 | 180.43 | 183.22 | 186.009 | 158.375 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 446.59887 Full duration: 489.803824 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 22.92 | 49.087 | 75.814 | 77.421 | 79.028 | 50.04 | 100.0% | 10 | | heat.update_stack | 17.269 | 37.822 | 40.653 | 41.652 | 42.652 | 35.112 | 100.0% | 10 | | heat.delete_stack | 19.955 | 43.059 | 51.68 | 57.949 | 64.218 | 40.563 | 100.0% | 10 | | total | 85.144 | 109.987 | 163.25 | 174.574 | 185.898 | 125.716 | 100.0% | 10 | | -> duration | 81.144 | 105.987 | 159.25 | 170.574 | 181.898 | 121.716 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 346.004651 Full duration: 394.016576 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 52.595 | 80.128 | 87.935 | 88.24 | 88.545 | 72.911 | 100.0% | 10 | | heat.update_stack | 25.069 | 46.792 | 54.996 | 56.313 | 57.63 | 47.6 | 100.0% | 10 | | heat.delete_stack | 17.009 | 46.796 | 55.046 | 55.443 | 55.841 | 44.751 | 100.0% | 10 | | total | 141.521 | 152.985 | 192.762 | 194.007 | 195.252 | 165.262 | 100.0% | 10 | | -> duration | 137.521 | 148.985 | 188.762 | 190.007 | 191.252 | 161.262 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 482.479322 Full duration: 526.437474 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.955 | 41.613 | 48.021 | 48.235 | 48.449 | 34.854 | 100.0% | 10 | | heat.update_stack | 26.99 | 35.564 | 46.128 | 46.733 | 47.338 | 37.482 | 100.0% | 10 | | heat.delete_stack | 14.264 | 20.378 | 26.335 | 26.567 | 26.799 | 20.83 | 100.0% | 10 | | total | 68.261 | 94.951 | 109.748 | 115.929 | 122.11 | 93.166 | 100.0% | 10 | | -> duration | 64.261 | 90.951 | 105.748 | 111.929 | 118.11 | 89.166 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 271.779149 Full duration: 329.014261 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 15.481 | 52.992 | 55.431 | 57.359 | 59.286 | 46.474 | 100.0% | 10 | | heat.check_stack | 4.291 | 15.247 | 33.774 | 33.892 | 34.01 | 16.409 | 100.0% | 10 | | heat.delete_stack | 8.298 | 24.44 | 26.361 | 26.704 | 27.048 | 21.741 | 100.0% | 10 | | total | 69.029 | 88.506 | 94.846 | 95.542 | 96.238 | 84.624 | 100.0% | 10 | | -> duration | 67.029 | 86.506 | 92.846 | 93.542 | 94.238 | 82.624 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 237.385768 Full duration: 284.184297 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.776 | 46.661 | 51.893 | 52.329 | 52.765 | 37.462 | 100.0% | 10 | | heat.suspend_stack | 9.701 | 11.963 | 18.517 | 20.96 | 23.403 | 14.173 | 100.0% | 10 | | heat.resume_stack | 10.494 | 12.007 | 22.175 | 22.195 | 22.216 | 14.518 | 100.0% | 10 | | heat.delete_stack | 7.483 | 21.66 | 25.209 | 26.781 | 28.353 | 19.23 | 100.0% | 10 | | total | 54.358 | 77.906 | 110.209 | 115.143 | 120.077 | 85.383 | 100.0% | 10 | | -> duration | 52.358 | 75.906 | 108.209 | 113.143 | 118.077 | 83.383 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 246.370114 Full duration: 292.245203 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d395526a-04c9-46c5-a7fd-7492bcb0a6e1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.599 | 0.838 | 1.211 | 1.535 | 1.859 | 0.895 | 100.0% | 10 | | total | 0.599 | 0.838 | 1.211 | 1.535 | 1.859 | 0.895 | 100.0% | 10 | | -> duration | 0.599 | 0.838 | 1.211 | 1.535 | 1.859 | 0.895 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.572004 Full duration: 35.239798 HINTS: * To plot HTML graphics with this data, run: rally task report d395526a-04c9-46c5-a7fd-7492bcb0a6e1 --out output.html * To generate a JUnit report, run: rally task export d395526a-04c9-46c5-a7fd-7492bcb0a6e1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d395526a-04c9-46c5-a7fd-7492bcb0a6e1 --json --out output.json 2021-05-08 19:17:11,643 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d395526a-04c9-46c5-a7fd-7492bcb0a6e1 --out /home/opnfv/functest/results/rally_full/heat.json 2021-05-08 19:17:11,662 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-05-08 19:17:11,696 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 19:17:12,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-05-08 19:29:59,538 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: f5ef208f-c653-450b-9381-4f1f605a2066 2021-05-08 19:30:00,898 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f5ef208f-c653-450b-9381-4f1f605a2066 -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.185 | 0.667 | 1.043 | 1.244 | 1.445 | 0.668 | 100.0% | 10 | | keystone_v3.add_role | 0.083 | 0.408 | 0.628 | 0.683 | 0.738 | 0.378 | 100.0% | 10 | | keystone_v3.revoke_role | 0.313 | 0.447 | 0.661 | 0.744 | 0.826 | 0.493 | 100.0% | 10 | | total | 0.983 | 1.665 | 1.976 | 2.089 | 2.203 | 1.539 | 100.0% | 10 | | -> duration | 0.983 | 1.665 | 1.976 | 2.089 | 2.203 | 1.539 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.769957 Full duration: 46.393663 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.255 | 0.482 | 1.121 | 1.342 | 1.563 | 0.66 | 100.0% | 10 | | keystone_v3.add_role | 0.098 | 0.427 | 0.874 | 0.895 | 0.916 | 0.45 | 100.0% | 10 | | keystone_v3.list_roles | 0.116 | 0.122 | 0.172 | 0.31 | 0.447 | 0.157 | 100.0% | 10 | | total | 0.68 | 1.193 | 2.003 | 2.113 | 2.222 | 1.268 | 100.0% | 10 | | -> duration | 0.68 | 1.193 | 2.003 | 2.113 | 2.222 | 1.268 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.6197 Full duration: 42.287577 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.269 | 0.736 | 1.766 | 1.959 | 2.152 | 0.962 | 100.0% | 10 | | keystone_v3.list_projects | 0.107 | 0.132 | 0.368 | 0.452 | 0.535 | 0.194 | 100.0% | 10 | | total | 0.453 | 0.978 | 1.909 | 2.089 | 2.269 | 1.156 | 100.0% | 10 | | -> duration | 0.453 | 0.978 | 1.909 | 2.089 | 2.269 | 1.156 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.723293 Full duration: 42.610081 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.134 | 0.363 | 0.842 | 0.883 | 0.924 | 0.453 | 100.0% | 10 | | keystone_v3.delete_role | 0.093 | 0.327 | 0.879 | 1.035 | 1.191 | 0.425 | 100.0% | 10 | | total | 0.283 | 0.908 | 1.293 | 1.45 | 1.607 | 0.878 | 100.0% | 10 | | -> duration | 0.283 | 0.908 | 1.293 | 1.45 | 1.607 | 0.878 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.022411 Full duration: 37.848262 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.154 | 0.61 | 1.208 | 1.265 | 1.322 | 0.685 | 100.0% | 10 | | keystone_v3.delete_service | 0.087 | 0.233 | 0.717 | 1.533 | 2.35 | 0.441 | 100.0% | 10 | | total | 0.409 | 0.871 | 1.73 | 2.388 | 3.047 | 1.126 | 100.0% | 10 | | -> duration | 0.409 | 0.871 | 1.73 | 2.388 | 3.047 | 1.126 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.110825 Full duration: 41.909191 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.252 | 1.25 | 1.695 | 1.811 | 1.927 | 1.188 | 100.0% | 9 | | keystone_v3.create_user | 0.65 | 1.065 | 3.199 | 3.649 | 4.1 | 1.598 | 100.0% | 9 | | -> keystone_v3.list_roles | 0.044 | 0.059 | 0.259 | 0.51 | 0.761 | 0.15 | 100.0% | 9 | | -> keystone_v3.add_role | 0.096 | 0.347 | 0.801 | 1.007 | 1.214 | 0.466 | 100.0% | 9 | | keystone_v3.create_role | 0.159 | 0.755 | 1.167 | 1.255 | 1.343 | 0.708 | 100.0% | 9 | | keystone_v3.get_project | 0.034 | 0.043 | 0.241 | 0.498 | 0.755 | 0.129 | 100.0% | 9 | | keystone_v3.get_user | 0.03 | 0.038 | 0.051 | 0.065 | 0.079 | 0.042 | 100.0% | 9 | | keystone_v3.get_role | 0.03 | 0.038 | 0.081 | 0.163 | 0.244 | 0.06 | 100.0% | 9 | | keystone_v3.list_services | 0.034 | 0.045 | 0.331 | 0.377 | 0.423 | 0.123 | 100.0% | 9 | | keystone_v3.get_services | 0.036 | 0.048 | 0.299 | 0.587 | 0.876 | 0.153 | 100.0% | 9 | | total | 2.48 | 3.625 | 6.702 | 6.77 | 6.837 | 4.249 | 100.0% | 9 | | -> duration | 2.48 | 3.625 | 6.702 | 6.77 | 6.837 | 4.249 | 100.0% | 9 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 9 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.786216 Full duration: 92.779405 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.513 | 1.006 | 2.69 | 2.699 | 2.709 | 1.226 | 100.0% | 10 | | keystone_v3.update_project | 0.178 | 0.371 | 1.174 | 1.293 | 1.413 | 0.537 | 100.0% | 10 | | keystone_v3.delete_project | 0.154 | 0.678 | 1.583 | 2.259 | 2.935 | 0.903 | 100.0% | 10 | | total | 0.939 | 2.671 | 4.08 | 4.369 | 4.659 | 2.667 | 100.0% | 10 | | -> duration | 0.939 | 2.671 | 4.08 | 4.369 | 4.659 | 2.667 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.975606 Full duration: 50.549366 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.429 | 1.106 | 3.189 | 3.197 | 3.205 | 1.432 | 100.0% | 10 | | total | 0.505 | 1.208 | 3.261 | 3.272 | 3.283 | 1.531 | 100.0% | 10 | | -> duration | 0.505 | 1.208 | 3.261 | 3.272 | 3.283 | 1.531 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.160879 Full duration: 31.717082 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.312 | 0.625 | 1.101 | 1.132 | 1.163 | 0.703 | 100.0% | 10 | | total | 0.312 | 0.625 | 1.101 | 1.132 | 1.163 | 0.703 | 100.0% | 10 | | -> duration | 0.312 | 0.625 | 1.101 | 1.132 | 1.163 | 0.703 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.106579 Full duration: 31.692724 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.213 | 0.57 | 2.501 | 2.879 | 3.257 | 1.17 | 100.0% | 10 | | keystone_v3.list_users | 0.073 | 0.085 | 0.96 | 1.284 | 1.609 | 0.316 | 100.0% | 10 | | total | 0.372 | 0.727 | 3.499 | 3.798 | 4.097 | 1.564 | 100.0% | 10 | | -> duration | 0.372 | 0.727 | 3.499 | 3.798 | 4.097 | 1.564 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.743044 Full duration: 33.426654 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5ef208f-c653-450b-9381-4f1f605a2066 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.407 | 1.255 | 1.725 | 1.805 | 1.885 | 1.245 | 100.0% | 10 | | keystone_v3.create_users | 15.575 | 23.012 | 27.835 | 27.865 | 27.895 | 22.723 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 15.574 | 23.011 | 27.835 | 27.865 | 27.895 | 22.723 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.521 | 1.054 | 2.207 | 2.605 | 3.003 | 1.313 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 5.199 | 8.326 | 10.476 | 12.153 | 13.83 | 8.536 | 100.0% | 10 | | total | 18.263 | 26.679 | 33.252 | 34.707 | 36.162 | 26.769 | 100.0% | 10 | | -> duration | 18.263 | 26.679 | 33.252 | 34.707 | 36.162 | 26.769 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.608218 Full duration: 283.390737 HINTS: * To plot HTML graphics with this data, run: rally task report f5ef208f-c653-450b-9381-4f1f605a2066 --out output.html * To generate a JUnit report, run: rally task export f5ef208f-c653-450b-9381-4f1f605a2066 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f5ef208f-c653-450b-9381-4f1f605a2066 --json --out output.json 2021-05-08 19:30:04,247 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f5ef208f-c653-450b-9381-4f1f605a2066 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-05-08 19:30:04,267 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-05-08 19:30:04,305 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 19:30:04,801 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-05-08 19:53:11,985 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 2daf29ae-7733-482d-bb56-e124209f63d8 2021-05-08 19:53:13,291 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2daf29ae-7733-482d-bb56-e124209f63d8 -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.081 | 3.35 | 3.846 | 3.935 | 4.024 | 2.964 | 100.0% | 10 | | neutron.update_network | 0.871 | 1.251 | 1.969 | 2.306 | 2.643 | 1.461 | 100.0% | 10 | | total | 2.287 | 4.602 | 5.679 | 5.85 | 6.022 | 4.425 | 100.0% | 10 | | -> duration | 2.287 | 4.602 | 5.679 | 5.85 | 6.022 | 4.425 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.251766 Full duration: 66.488871 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.914 | 3.327 | 4.745 | 4.862 | 4.98 | 3.589 | 100.0% | 10 | | neutron.update_port | 0.825 | 1.71 | 3.06 | 3.736 | 4.413 | 2.024 | 100.0% | 10 | | total | 3.912 | 5.679 | 6.877 | 7.102 | 7.327 | 5.613 | 100.0% | 10 | | -> duration | 3.912 | 5.679 | 6.877 | 7.102 | 7.327 | 5.613 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.843867 Full duration: 88.713662 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.638 | 3.217 | 5.331 | 6.241 | 7.152 | 3.84 | 100.0% | 10 | | neutron.create_subnet | 1.51 | 2.981 | 3.803 | 3.926 | 4.049 | 2.927 | 100.0% | 10 | | neutron.update_subnet | 0.773 | 2.069 | 3.956 | 4.423 | 4.89 | 2.316 | 100.0% | 10 | | total | 4.998 | 9.238 | 11.898 | 11.921 | 11.944 | 9.083 | 100.0% | 10 | | -> duration | 4.998 | 9.238 | 11.898 | 11.921 | 11.944 | 9.083 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.169486 Full duration: 101.066828 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 8.453 | 15.613 | 34.172 | 34.344 | 34.516 | 19.641 | 100.0% | 10 | | neutron.delete_network | 4.632 | 7.041 | 10.255 | 16.225 | 22.195 | 8.247 | 100.0% | 10 | | total | 13.56 | 24.271 | 38.987 | 39.068 | 39.148 | 27.888 | 100.0% | 10 | | -> duration | 13.56 | 24.271 | 38.987 | 39.068 | 39.148 | 27.888 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.577067 Full duration: 169.959978 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.966 | 4.474 | 5.276 | 5.451 | 5.626 | 4.594 | 100.0% | 10 | | neutron.delete_port | 1.251 | 1.553 | 2.005 | 2.006 | 2.008 | 1.642 | 100.0% | 10 | | total | 5.217 | 6.209 | 7.223 | 7.427 | 7.63 | 6.236 | 100.0% | 10 | | -> duration | 5.217 | 6.209 | 7.223 | 7.427 | 7.63 | 6.236 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.757646 Full duration: 106.438274 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.415 | 3.799 | 5.213 | 5.658 | 6.104 | 3.798 | 100.0% | 10 | | neutron.create_subnet | 2.007 | 4.138 | 5.254 | 5.431 | 5.608 | 3.89 | 100.0% | 10 | | neutron.delete_subnet | 1.272 | 2.292 | 3.019 | 3.927 | 4.835 | 2.327 | 100.0% | 10 | | total | 6.17 | 9.649 | 11.808 | 12.617 | 13.426 | 10.015 | 100.0% | 10 | | -> duration | 6.17 | 9.649 | 11.808 | 12.617 | 13.426 | 10.015 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.234029 Full duration: 95.899632 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.725 | 2.526 | 3.476 | 3.517 | 3.557 | 2.676 | 100.0% | 10 | | neutron.list_networks | 0.161 | 0.339 | 0.733 | 0.821 | 0.909 | 0.411 | 100.0% | 10 | | total | 1.886 | 3.15 | 3.761 | 3.862 | 3.963 | 3.087 | 100.0% | 10 | | -> duration | 1.886 | 3.15 | 3.761 | 3.862 | 3.963 | 3.087 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.199386 Full duration: 67.783473 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.421 | 4.514 | 6.197 | 6.245 | 6.294 | 4.404 | 100.0% | 10 | | neutron.list_ports | 0.123 | 0.387 | 1.334 | 1.567 | 1.801 | 0.553 | 100.0% | 10 | | total | 2.789 | 4.862 | 6.371 | 6.394 | 6.417 | 4.958 | 100.0% | 10 | | -> duration | 2.789 | 4.862 | 6.371 | 6.394 | 6.417 | 4.958 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.954467 Full duration: 98.221567 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.076 | 5.145 | 10.51 | 11.531 | 12.552 | 7.04 | 100.0% | 10 | | neutron.create_subnet | 2.334 | 3.493 | 9.573 | 9.664 | 9.756 | 4.983 | 100.0% | 10 | | neutron.list_subnets | 0.092 | 0.118 | 0.66 | 0.696 | 0.731 | 0.251 | 100.0% | 10 | | total | 7.507 | 8.433 | 19.739 | 19.821 | 19.902 | 12.274 | 100.0% | 10 | | -> duration | 7.507 | 8.433 | 19.739 | 19.821 | 19.902 | 12.274 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.135889 Full duration: 101.183652 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.592 | 3.357 | 4.3 | 4.509 | 4.718 | 3.112 | 100.0% | 10 | | neutron.delete_security_group | 0.27 | 0.865 | 1.9 | 2.297 | 2.694 | 1.024 | 100.0% | 10 | | total | 2.044 | 4.342 | 5.267 | 6.107 | 6.948 | 4.136 | 100.0% | 10 | | -> duration | 2.044 | 4.342 | 5.267 | 6.107 | 6.948 | 4.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.549889 Full duration: 54.159277 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.283 | 3.866 | 6.057 | 6.104 | 6.151 | 3.975 | 100.0% | 10 | | neutron.create_security_group_rule | 1.338 | 3.654 | 4.78 | 5.117 | 5.453 | 3.448 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.528 | 1.167 | 2.014 | 2.228 | 2.442 | 1.303 | 100.0% | 10 | | neutron.delete_security_group | 0.342 | 1.02 | 1.805 | 1.974 | 2.142 | 1.103 | 100.0% | 10 | | total | 7.337 | 10.155 | 11.772 | 11.977 | 12.182 | 9.829 | 100.0% | 10 | | -> duration | 7.337 | 10.155 | 11.772 | 11.977 | 12.182 | 9.829 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.383585 Full duration: 74.924527 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.881 | 6.044 | 9.83 | 10.064 | 10.298 | 5.823 | 100.0% | 10 | | neutron.create_security_group_rule | 0.522 | 2.714 | 3.578 | 5.113 | 6.647 | 2.632 | 100.0% | 10 | | neutron.list_security_group_rules | 0.097 | 0.149 | 0.634 | 0.692 | 0.751 | 0.246 | 100.0% | 10 | | total | 2.371 | 9.353 | 11.557 | 11.823 | 12.089 | 8.702 | 100.0% | 10 | | -> duration | 2.371 | 9.353 | 11.557 | 11.823 | 12.089 | 8.702 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.308814 Full duration: 78.900277 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.805 | 3.509 | 5.403 | 5.799 | 6.195 | 3.999 | 100.0% | 10 | | neutron.show_security_group | 0.069 | 0.081 | 0.101 | 0.109 | 0.116 | 0.086 | 100.0% | 10 | | total | 2.902 | 3.587 | 5.489 | 5.9 | 6.312 | 4.085 | 100.0% | 10 | | -> duration | 2.902 | 3.587 | 5.489 | 5.9 | 6.312 | 4.085 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.63252 Full duration: 72.210715 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 58.692971 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2daf29ae-7733-482d-bb56-e124209f63d8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 5.216 | 6.807 | 7.693 | 7.871 | 8.049 | 6.74 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.171 | 0.662 | 1.031 | 1.046 | 1.062 | 0.618 | 100.0% | 10 | | total | 5.388 | 7.283 | 8.723 | 8.757 | 8.79 | 7.358 | 100.0% | 10 | | -> duration | 5.388 | 7.283 | 8.723 | 8.757 | 8.79 | 7.358 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.965532 Full duration: 114.468236 HINTS: * To plot HTML graphics with this data, run: rally task report 2daf29ae-7733-482d-bb56-e124209f63d8 --out output.html * To generate a JUnit report, run: rally task export 2daf29ae-7733-482d-bb56-e124209f63d8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2daf29ae-7733-482d-bb56-e124209f63d8 --json --out output.json At least one workload did not pass SLA criteria. 2021-05-08 19:53:16,386 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2daf29ae-7733-482d-bb56-e124209f63d8 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-05-08 19:53:16,408 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-05-08 19:53:16,450 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 19:53:16,914 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-05-08 20:42:00,449 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 113348b1-01a7-4305-b6e5-45d25b320253 2021-05-08 20:42:01,720 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 113348b1-01a7-4305-b6e5-45d25b320253 -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.945 | 1.949 | 4.293 | 4.501 | 4.708 | 2.276 | 100.0% | 10 | | nova.delete_keypair | 0.094 | 0.451 | 2.181 | 2.493 | 2.806 | 0.864 | 100.0% | 10 | | total | 1.549 | 2.459 | 5.104 | 5.152 | 5.2 | 3.139 | 100.0% | 10 | | -> duration | 1.549 | 2.459 | 5.104 | 5.152 | 5.2 | 3.139 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.52371 Full duration: 47.265231 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.716 | 2.148 | 2.816 | 3.166 | 3.516 | 1.94 | 100.0% | 10 | | nova.list_keypairs | 0.036 | 0.047 | 0.051 | 0.054 | 0.057 | 0.045 | 100.0% | 10 | | total | 0.753 | 2.2 | 2.863 | 3.211 | 3.559 | 1.985 | 100.0% | 10 | | -> duration | 0.753 | 2.2 | 2.863 | 3.211 | 3.559 | 1.985 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.365409 Full duration: 42.595766 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 44.696 | 55.184 | 90.256 | 92.626 | 94.995 | 64.419 | 100.0% | 10 | | nova.reboot_server | 7.521 | 16.487 | 26.654 | 27.736 | 28.817 | 17.782 | 100.0% | 10 | | nova.soft_reboot_server | 11.566 | 18.645 | 24.237 | 24.289 | 24.342 | 17.841 | 100.0% | 10 | | nova.stop_and_start_server | 13.552 | 19.156 | 22.722 | 22.893 | 23.063 | 18.838 | 100.0% | 10 | | -> nova.stop_server | 6.056 | 8.325 | 10.756 | 11.697 | 12.638 | 8.763 | 100.0% | 10 | | -> nova.start_server | 5.49 | 10.582 | 12.405 | 12.738 | 13.072 | 10.074 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 18.6 | 31.722 | 48.539 | 48.84 | 49.142 | 33.412 | 100.0% | 10 | | -> nova.rescue_server | 11.357 | 13.943 | 30.335 | 32.129 | 33.923 | 18.311 | 100.0% | 10 | | -> nova.unrescue_server | 5.217 | 15.487 | 20.139 | 24.341 | 28.544 | 15.101 | 100.0% | 10 | | nova.delete_server | 6.946 | 25.129 | 39.618 | 39.767 | 39.916 | 25.091 | 100.0% | 10 | | total | 109.141 | 175.079 | 222.492 | 225.478 | 228.464 | 177.442 | 100.0% | 10 | | -> duration | 100.141 | 166.079 | 213.492 | 216.478 | 219.464 | 168.442 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 487.901019 Full duration: 546.502502 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 49.136 | 60.765 | 66.523 | 72.405 | 78.286 | 60.408 | 100.0% | 10 | | nova.delete_server | 5.52 | 25.536 | 42.164 | 43.498 | 44.832 | 25.896 | 100.0% | 10 | | total | 54.722 | 87.233 | 104.011 | 107.03 | 110.048 | 86.303 | 100.0% | 10 | | -> duration | 53.722 | 86.233 | 103.011 | 106.03 | 109.048 | 85.303 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 241.063462 Full duration: 285.359911 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 37.785 | 45.352 | 66.151 | 66.221 | 66.292 | 49.936 | 100.0% | 10 | | nova.list_servers | 0.383 | 0.434 | 0.517 | 0.638 | 0.759 | 0.463 | 100.0% | 10 | | total | 38.184 | 45.815 | 66.552 | 66.638 | 66.723 | 50.4 | 100.0% | 10 | | -> duration | 37.184 | 44.815 | 65.552 | 65.638 | 65.723 | 49.4 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 139.787778 Full duration: 245.078319 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "from_image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "to_image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 39.229 | 53.488 | 68.425 | 69.665 | 70.906 | 55.202 | 100.0% | 10 | | nova.rebuild_server | 13.643 | 27.206 | 39.065 | 41.548 | 44.032 | 28.345 | 100.0% | 10 | | nova.delete_server | 7.547 | 23.206 | 30.62 | 31.863 | 33.106 | 21.184 | 100.0% | 10 | | total | 70.29 | 101.436 | 138.398 | 139.08 | 139.762 | 104.731 | 100.0% | 10 | | -> duration | 68.29 | 99.436 | 136.398 | 137.08 | 137.762 | 102.731 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 283.892228 Full duration: 320.184452 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 105.605 | 122.095 | 129.813 | 129.942 | 130.071 | 120.706 | 100.0% | 10 | | nova.snapshot_server | 18.233 | 30.589 | 36.332 | 36.867 | 37.401 | 29.743 | 100.0% | 10 | | -> glance_v2.get_image | 0.068 | 0.086 | 0.096 | 0.096 | 0.097 | 0.085 | 100.0% | 10 | | -> glance.wait_for_image | 16.396 | 24.568 | 30.732 | 30.773 | 30.814 | 24.391 | 100.0% | 10 | | --> glance_v2.get_image (x14) | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 0.587 | 100.0% | 1 | | --> glance_v2.get_image (x13) | 0.534 | 0.544 | 0.615 | 0.624 | 0.633 | 0.57 | 100.0% | 3 | | --> glance_v2.get_image (x16) | 0.688 | 0.734 | 0.772 | 0.776 | 0.781 | 0.734 | 100.0% | 2 | | --> glance_v2.get_image (x12) | 0.505 | 0.511 | 0.515 | 0.516 | 0.517 | 0.511 | 100.0% | 2 | | --> glance_v2.get_image (x9) | 0.377 | 0.377 | 0.377 | 0.377 | 0.377 | 0.377 | 100.0% | 1 | | --> glance_v2.get_image (x11) | 0.458 | 0.458 | 0.458 | 0.458 | 0.458 | 0.458 | 100.0% | 1 | | nova.delete_server (x2) | 14.156 | 49.535 | 79.805 | 83.258 | 86.711 | 49.918 | 100.0% | 10 | | nova.delete_image | 3.711 | 11.261 | 26.351 | 27.221 | 28.091 | 12.447 | 100.0% | 10 | | -> glance_v2.delete_image | 3.674 | 11.218 | 26.295 | 27.173 | 28.052 | 12.405 | 100.0% | 10 | | -> glance.wait_for_delete | 0.033 | 0.039 | 0.045 | 0.049 | 0.054 | 0.04 | 100.0% | 10 | | --> glance_v2.get_image | 0.033 | 0.038 | 0.045 | 0.048 | 0.052 | 0.04 | 0.0% | 10 | | total | 155.973 | 219.956 | 246.97 | 249.96 | 252.951 | 212.815 | 100.0% | 10 | | -> duration | 153.973 | 217.956 | 244.97 | 247.96 | 250.951 | 210.815 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 600.543445 Full duration: 637.874377 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "volume_size": 1, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.874 | 23.684 | 36.921 | 43.108 | 49.296 | 26.113 | 100.0% | 10 | | nova.boot_server | 23.593 | 71.703 | 87.539 | 90.238 | 92.937 | 65.139 | 100.0% | 10 | | total | 50.78 | 95.28 | 114.52 | 118.503 | 122.485 | 91.252 | 100.0% | 10 | | -> duration | 49.78 | 94.28 | 113.52 | 117.503 | 121.485 | 90.252 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 249.102172 Full duration: 357.783365 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.34 | 42.653 | 69.906 | 70.066 | 70.227 | 48.921 | 100.0% | 10 | | total | 31.34 | 42.653 | 69.907 | 70.067 | 70.227 | 48.921 | 100.0% | 10 | | -> duration | 30.34 | 41.653 | 68.907 | 69.067 | 69.227 | 47.921 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 132.74589 Full duration: 197.469741 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 23.052714 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "image": { "name": "rally_full-img_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "to_flavor": { "name": "rally_full-flavor_alt_42ce226a-5f51-4c0d-887a-88adb8df626a" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "94998c9e-fa17-49d1-8422-005213c0cbeb" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 113348b1-01a7-4305-b6e5-45d25b320253 has 5 error(s) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-bf58cf98-221f-409d-9f60-d280672732fd) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-bf58cf98-221f-409d-9f60-d280672732fd) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-20da2881-8639-4005-9203-9e746e65bb98) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-20da2881-8639-4005-9203-9e746e65bb98) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-56e7da11-8fcb-4255-8dc6-c7ef213176e5) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-56e7da11-8fcb-4255-8dc6-c7ef213176e5) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-6e150f02-3b28-472a-877e-2f24d080d745) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-6e150f02-3b28-472a-877e-2f24d080d745) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-b4d04207-b35f-434e-bf2a-5fcedd45dd54) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-b4d04207-b35f-434e-bf2a-5fcedd45dd54) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.446 | 42.212 | 46.981 | 48.533 | 50.084 | 39.803 | 100.0% | 5 | | nova.resize | 6.291 | 22.341 | 24.755 | 25.166 | 25.576 | 19.673 | 0.0% | 5 | | total | 33.737 | 62.843 | 70.616 | 71.521 | 72.425 | 59.476 | 0.0% | 5 | | -> duration | 32.737 | 61.843 | 69.616 | 70.521 | 71.425 | 58.476 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 93.242473 Full duration: 152.261747 HINTS: * To plot HTML graphics with this data, run: rally task report 113348b1-01a7-4305-b6e5-45d25b320253 --out output.html * To generate a JUnit report, run: rally task export 113348b1-01a7-4305-b6e5-45d25b320253 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 113348b1-01a7-4305-b6e5-45d25b320253 --json --out output.json At least one workload did not pass SLA criteria. 2021-05-08 20:42:04,712 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 113348b1-01a7-4305-b6e5-45d25b320253 --out /home/opnfv/functest/results/rally_full/nova.json 2021-05-08 20:42:04,735 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-05-08 20:42:04,762 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 20:42:05,528 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-05-08 20:44:49,032 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 050399f0-cba0-4118-bb90-e5b4bbf3aba9 2021-05-08 20:44:50,358 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 050399f0-cba0-4118-bb90-e5b4bbf3aba9 -------------------------------------------------------------------------------- Task 050399f0-cba0-4118-bb90-e5b4bbf3aba9: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 050399f0-cba0-4118-bb90-e5b4bbf3aba9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.289 | 2.196 | 5.378 | 5.487 | 5.597 | 2.823 | 100.0% | 10 | | quotas.delete_quotas | 0.044 | 0.91 | 1.344 | 1.459 | 1.575 | 0.806 | 100.0% | 10 | | total | 1.344 | 2.922 | 5.754 | 5.886 | 6.019 | 3.63 | 100.0% | 10 | | -> duration | 1.344 | 2.922 | 5.754 | 5.886 | 6.019 | 3.63 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.441456 Full duration: 41.396708 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 050399f0-cba0-4118-bb90-e5b4bbf3aba9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.515 | 2.886 | 3.452 | 3.467 | 3.481 | 2.671 | 100.0% | 10 | | total | 1.515 | 2.886 | 3.453 | 3.467 | 3.481 | 2.671 | 100.0% | 10 | | -> duration | 1.515 | 2.886 | 3.453 | 3.467 | 3.481 | 2.671 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.749776 Full duration: 50.864626 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 050399f0-cba0-4118-bb90-e5b4bbf3aba9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.373 | 7.9 | 10.421 | 11.467 | 12.514 | 8.174 | 100.0% | 10 | | total | 4.373 | 7.9 | 10.421 | 11.467 | 12.514 | 8.174 | 100.0% | 10 | | -> duration | 4.373 | 7.9 | 10.421 | 11.467 | 12.514 | 8.174 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.445943 Full duration: 46.989233 HINTS: * To plot HTML graphics with this data, run: rally task report 050399f0-cba0-4118-bb90-e5b4bbf3aba9 --out output.html * To generate a JUnit report, run: rally task export 050399f0-cba0-4118-bb90-e5b4bbf3aba9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 050399f0-cba0-4118-bb90-e5b4bbf3aba9 --json --out output.json 2021-05-08 20:44:53,366 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 050399f0-cba0-4118-bb90-e5b4bbf3aba9 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-05-08 20:44:53,372 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-05-08 20:44:53,403 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-05-08 20:44:53,560 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-05-08 20:54:16,556 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 2021-05-08 20:54:17,910 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.887 | 1.138 | 1.3 | 1.419 | 1.539 | 1.153 | 100.0% | 10 | | swift.upload_object (x2) | 1.054 | 1.098 | 1.141 | 1.145 | 1.15 | 1.1 | 100.0% | 10 | | swift.list_objects | 1.003 | 1.031 | 1.076 | 1.085 | 1.093 | 1.036 | 100.0% | 10 | | total | 2.958 | 3.257 | 3.441 | 3.612 | 3.783 | 3.29 | 100.0% | 10 | | -> duration | 2.958 | 3.257 | 3.441 | 3.612 | 3.783 | 3.29 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.958762 Full duration: 97.144796 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.313 | 1.456 | 1.523 | 1.54 | 1.557 | 1.464 | 100.0% | 10 | | swift.list_objects | 0.978 | 1.017 | 1.035 | 1.046 | 1.057 | 1.015 | 100.0% | 10 | | total | 2.316 | 2.475 | 2.543 | 2.561 | 2.579 | 2.48 | 100.0% | 10 | | -> duration | 2.316 | 2.475 | 2.543 | 2.561 | 2.579 | 2.48 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.86282 Full duration: 77.46051 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.038 | 1.132 | 1.268 | 1.281 | 1.294 | 1.144 | 100.0% | 10 | | swift.upload_object (x5) | 2.522 | 2.778 | 2.862 | 2.883 | 2.904 | 2.764 | 100.0% | 10 | | swift.download_object (x5) | 2.391 | 2.488 | 2.559 | 2.57 | 2.58 | 2.484 | 100.0% | 10 | | total | 6.054 | 6.463 | 6.561 | 6.612 | 6.662 | 6.392 | 100.0% | 10 | | -> duration | 6.054 | 6.463 | 6.561 | 6.612 | 6.662 | 6.392 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.981031 Full duration: 145.069052 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.974 | 1.176 | 1.317 | 1.344 | 1.372 | 1.154 | 100.0% | 10 | | swift.upload_object (x5) | 2.556 | 2.928 | 2.993 | 3.009 | 3.025 | 2.883 | 100.0% | 10 | | swift.delete_object (x5) | 2.627 | 2.69 | 2.766 | 2.809 | 2.853 | 2.703 | 100.0% | 10 | | swift.delete_container | 0.57 | 0.634 | 0.674 | 0.687 | 0.701 | 0.631 | 100.0% | 10 | | total | 6.992 | 7.445 | 7.649 | 7.666 | 7.684 | 7.374 | 100.0% | 10 | | -> duration | 6.992 | 7.445 | 7.649 | 7.666 | 7.684 | 7.374 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.795079 Full duration: 115.290909 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.404 | 1.479 | 1.606 | 1.658 | 1.711 | 1.504 | 100.0% | 10 | | swift.list_objects | 1.011 | 1.043 | 1.06 | 1.066 | 1.071 | 1.041 | 100.0% | 10 | | swift.download_object (x5) | 2.361 | 2.55 | 2.604 | 2.686 | 2.767 | 2.549 | 100.0% | 10 | | total | 4.852 | 5.076 | 5.296 | 5.317 | 5.338 | 5.094 | 100.0% | 10 | | -> duration | 4.852 | 5.076 | 5.296 | 5.317 | 5.338 | 5.094 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.000272 Full duration: 98.425302 HINTS: * To plot HTML graphics with this data, run: rally task report 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 --out output.html * To generate a JUnit report, run: rally task export 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 --json --out output.json 2021-05-08 20:54:20,994 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2bdd41fc-d69d-46e9-aa94-80a43a9a69e8 --out /home/opnfv/functest/results/rally_full/swift.json 2021-05-08 20:54:21,008 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-05-08 20:54:21,012 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:15 | 60 | 100.00% | | glance | 00:10:12 | 40 | 90.00% | | cinder | 00:47:43 | 240 | 100.00% | | heat | 00:53:04 | 100 | 100.00% | | keystone | 00:12:14 | 109 | 100.00% | | neutron | 00:22:29 | 140 | 100.00% | | nova | 00:47:35 | 95 | 94.74% | | quotas | 00:02:19 | 30 | 100.00% | | swift | 00:08:53 | 50 | 100.00% | | | | | | | TOTAL: | 03:26:47 | 864 | 98.96% | +----------------+------------+----------------+-----------+ 2021-05-08 20:54:21,012 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.96% in 6/9 modules 2021-05-08 20:54:24,899 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-05-08 20:54:28,378 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-05-08 20:54:28,379 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 214:15 | FAIL | +--------------------+------------------+------------------+----------------+