2020-12-26 10:53:43,189 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | 1D9RN5IYHE01 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/1D9RN5IYHE01/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-189 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/1D9RN5IYHE01/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-189 | +-------------------------+------------------------------------------------------------+ 2020-12-26 10:53:43,207 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2020-12-26 10:53:47,871 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2020-12-26 10:53:54,027 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-26 10:54:00,452 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | e2096f25-2eac-4c67-ae06-7ed5cebecca2 | 2020-12-26T10:54:00.188895 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: e2096f25-2eac-4c67-ae06-7ed5cebecca2 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-26 10:54:05,456 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-26 10:54:07,309 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 10:54:07,465 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-26 10:57:06,670 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd 2020-12-26 10:57:07,917 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.787 | 1.111 | 1.593 | 1.641 | 1.688 | 1.193 | 100.0% | 10 | | total | 0.787 | 1.111 | 1.594 | 1.641 | 1.688 | 1.193 | 100.0% | 10 | | -> duration | 0.787 | 1.111 | 1.594 | 1.641 | 1.688 | 1.193 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.444237 Full duration: 30.166516 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.151 | 0.178 | 0.385 | 0.531 | 0.676 | 0.266 | 100.0% | 10 | | total | 0.567 | 0.778 | 1.11 | 1.427 | 1.744 | 0.869 | 100.0% | 10 | | -> duration | 0.567 | 0.778 | 1.11 | 1.427 | 1.744 | 0.869 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.364417 Full duration: 26.780007 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.206 | 0.309 | 0.467 | 0.539 | 0.611 | 0.336 | 100.0% | 10 | | total | 0.628 | 1.023 | 1.103 | 1.13 | 1.156 | 0.973 | 100.0% | 10 | | -> duration | 0.628 | 1.023 | 1.103 | 1.13 | 1.156 | 0.973 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.759049 Full duration: 25.190694 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.178 | 0.215 | 0.393 | 0.479 | 0.565 | 0.268 | 100.0% | 10 | | total | 0.599 | 1.016 | 1.256 | 1.345 | 1.434 | 0.972 | 100.0% | 10 | | -> duration | 0.599 | 1.016 | 1.256 | 1.345 | 1.434 | 0.972 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.643762 Full duration: 23.484712 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.371 | 0.484 | 1.042 | 1.121 | 1.201 | 0.631 | 100.0% | 10 | | total | 0.799 | 1.171 | 1.658 | 1.728 | 1.799 | 1.242 | 100.0% | 10 | | -> duration | 0.799 | 1.171 | 1.658 | 1.728 | 1.799 | 1.242 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.751162 Full duration: 24.315948 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.157 | 0.219 | 0.6 | 0.721 | 0.842 | 0.307 | 100.0% | 10 | | total | 0.592 | 0.976 | 1.152 | 1.597 | 2.043 | 0.956 | 100.0% | 10 | | -> duration | 0.592 | 0.976 | 1.152 | 1.597 | 2.043 | 0.956 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.662151 Full duration: 24.075522 HINTS: * To plot HTML graphics with this data, run: rally task report 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd --out output.html * To generate a JUnit report, run: rally task export 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd --json --out output.json 2020-12-26 10:57:10,988 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0ab6f4ba-eb53-4245-a611-16c4cbc8bafd --out /home/opnfv/functest/results/rally_full/authenticate.json 2020-12-26 10:57:10,998 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-26 10:57:11,030 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 10:57:11,194 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-26 11:08:05,162 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 92c32039-8e85-4ae2-bc31-167c6d909662 2020-12-26 11:08:06,466 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 92c32039-8e85-4ae2-bc31-167c6d909662 -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.989 | 6.44 | 7.185 | 7.376 | 7.567 | 6.389 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.101 | 0.11 | 0.113 | 0.117 | 0.102 | 100.0% | 10 | | -> glance_v2.upload_data | 2.385 | 3.584 | 4.182 | 4.269 | 4.355 | 3.505 | 100.0% | 10 | | glance_v2.delete_image | 2.44 | 2.896 | 5.135 | 5.506 | 5.878 | 3.367 | 100.0% | 10 | | total | 7.941 | 9.531 | 11.567 | 11.881 | 12.195 | 9.756 | 100.0% | 10 | | -> duration | 7.941 | 9.531 | 11.567 | 11.881 | 12.195 | 9.756 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.563901 Full duration: 55.41461 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.736 | 5.58 | 5.933 | 6.16 | 6.388 | 5.617 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.088 | 0.107 | 0.129 | 0.158 | 0.186 | 0.114 | 100.0% | 10 | | -> glance_v2.upload_data | 2.218 | 2.921 | 3.025 | 3.025 | 3.026 | 2.813 | 100.0% | 10 | | glance_v2.list_images | 0.057 | 0.063 | 0.138 | 0.209 | 0.28 | 0.09 | 100.0% | 10 | | total | 5.017 | 5.644 | 6.047 | 6.248 | 6.449 | 5.707 | 100.0% | 10 | | -> duration | 5.017 | 5.644 | 6.047 | 6.248 | 6.449 | 5.707 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.379957 Full duration: 55.548804 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.154 | 0.228 | 0.553 | 0.572 | 0.591 | 0.281 | 100.0% | 10 | | total | 0.155 | 0.229 | 0.553 | 0.572 | 0.592 | 0.282 | 100.0% | 10 | | -> duration | 0.155 | 0.229 | 0.553 | 0.572 | 0.592 | 0.282 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.176258 Full duration: 32.828977 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.739 | 9.175 | 11.052 | 12.19 | 13.327 | 9.163 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.107 | 0.122 | 0.122 | 0.123 | 0.109 | 100.0% | 10 | | -> glance_v2.upload_data | 3.257 | 6.141 | 7.918 | 8.25 | 8.581 | 5.907 | 100.0% | 10 | | nova.boot_servers | 53.453 | 86.497 | 92.229 | 93.251 | 94.272 | 81.775 | 100.0% | 10 | | total | 61.374 | 94.738 | 100.21 | 101.1 | 101.99 | 90.938 | 100.0% | 10 | | -> duration | 60.374 | 93.738 | 99.21 | 100.1 | 100.99 | 89.938 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 280.511588 Full duration: 434.869755 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 92c32039-8e85-4ae2-bc31-167c6d909662 has 5 error(s) -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.067 | 6.077 | 6.699 | 6.87 | 7.041 | 5.939 | 100.0% | 5 | | -> glance_v2.get_image (x2) | 0.094 | 0.102 | 0.115 | 0.117 | 0.12 | 0.104 | 100.0% | 5 | | -> glance_v2.upload_data | 2.16 | 2.346 | 3.097 | 3.169 | 3.241 | 2.595 | 100.0% | 5 | | glance_v2.deactivate_image | 0.028 | 0.041 | 0.105 | 0.122 | 0.139 | 0.059 | 0.0% | 5 | | total | 5.102 | 6.105 | 6.779 | 6.93 | 7.082 | 5.998 | 0.0% | 5 | | -> duration | 5.102 | 6.105 | 6.779 | 6.93 | 7.082 | 5.998 | 0.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 5 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.490268 Full duration: 49.443757 HINTS: * To plot HTML graphics with this data, run: rally task report 92c32039-8e85-4ae2-bc31-167c6d909662 --out output.html * To generate a JUnit report, run: rally task export 92c32039-8e85-4ae2-bc31-167c6d909662 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 92c32039-8e85-4ae2-bc31-167c6d909662 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-26 11:08:09,650 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 92c32039-8e85-4ae2-bc31-167c6d909662 --out /home/opnfv/functest/results/rally_full/glance.json 2020-12-26 11:08:09,705 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2020-12-26 11:08:09,743 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 11:08:10,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-26 11:56:37,146 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 9391d31d-8016-4a13-a939-1c256c32bc1c 2020-12-26 11:56:38,495 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 9391d31d-8016-4a13-a939-1c256c32bc1c -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "size": 1, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 36.657 | 49.091 | 54.466 | 56.71 | 58.955 | 47.637 | 100.0% | 10 | | cinder_v3.create_volume | 4.801 | 9.626 | 12.379 | 12.496 | 12.614 | 9.524 | 100.0% | 10 | | nova.attach_volume | 9.714 | 14.701 | 27.117 | 29.677 | 32.237 | 17.696 | 100.0% | 10 | | nova.detach_volume | 3.572 | 5.48 | 11.743 | 12.639 | 13.534 | 6.736 | 100.0% | 10 | | cinder_v3.delete_volume | 2.989 | 10.998 | 14.965 | 15.958 | 16.95 | 10.269 | 100.0% | 10 | | nova.delete_server | 6.872 | 17.847 | 22.845 | 23.393 | 23.942 | 16.67 | 100.0% | 10 | | total | 78.319 | 113.66 | 120.189 | 123.535 | 126.882 | 108.531 | 100.0% | 10 | | -> duration | 77.319 | 112.66 | 119.189 | 122.535 | 125.882 | 107.531 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 304.679989 Full duration: 354.145152 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.092 | 11.814 | 14.811 | 15.641 | 16.471 | 10.772 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.04 | 0.045 | 0.092 | 0.282 | 0.472 | 0.087 | 100.0% | 10 | | total | 3.14 | 11.855 | 14.853 | 15.686 | 16.518 | 10.859 | 100.0% | 10 | | -> duration | 3.14 | 11.855 | 14.853 | 15.686 | 16.518 | 10.859 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.905083 Full duration: 106.143546 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 19.533 | 23.47 | 28.173 | 28.285 | 28.397 | 23.986 | 100.0% | 10 | | cinder_v3.list_volumes | 0.063 | 0.073 | 0.096 | 0.163 | 0.231 | 0.088 | 100.0% | 10 | | total | 19.596 | 23.542 | 28.242 | 28.354 | 28.467 | 24.074 | 100.0% | 10 | | -> duration | 19.596 | 23.542 | 28.242 | 28.354 | 28.467 | 24.074 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.81843 Full duration: 126.571232 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.42 | 9.468 | 13.906 | 14.876 | 15.846 | 10.647 | 100.0% | 10 | | cinder_v3.list_volumes | 0.065 | 0.077 | 0.116 | 0.163 | 0.21 | 0.093 | 100.0% | 10 | | total | 8.509 | 9.557 | 13.978 | 14.949 | 15.921 | 10.741 | 100.0% | 10 | | -> duration | 8.509 | 9.557 | 13.978 | 14.949 | 15.921 | 10.741 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.902233 Full duration: 84.869561 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.602 | 6.994 | 9.849 | 10.333 | 10.818 | 7.524 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 32.653 | 46.356 | 48.886 | 49.294 | 49.703 | 43.912 | 100.0% | 10 | | cinder_v3.delete_volume | 2.777 | 6.067 | 10.971 | 11.016 | 11.061 | 6.56 | 100.0% | 10 | | glance_v2.delete_image | 5.947 | 7.627 | 10.832 | 10.871 | 10.91 | 8.345 | 100.0% | 10 | | total | 59.039 | 68.138 | 69.882 | 71.053 | 72.225 | 66.34 | 100.0% | 10 | | -> duration | 59.039 | 68.138 | 69.882 | 71.053 | 72.225 | 66.34 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 194.214115 Full duration: 240.36826 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 41.685 | 46.363 | 62.105 | 63.677 | 65.249 | 49.752 | 100.0% | 10 | | cinder_v3.create_volume | 4.764 | 6.07 | 17.137 | 18.597 | 20.057 | 10.022 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.803 | 7.131 | 9.8 | 14.221 | 18.643 | 7.841 | 100.0% | 10 | | nova.attach_volume | 4.985 | 16.327 | 32.494 | 33.678 | 34.862 | 19.728 | 100.0% | 10 | | nova.detach_volume | 3.829 | 5.762 | 9.993 | 10.389 | 10.786 | 6.621 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.521 | 5.613 | 9.498 | 10.98 | 12.462 | 6.014 | 100.0% | 10 | | cinder_v3.delete_volume | 2.748 | 7.234 | 13.463 | 14.986 | 16.51 | 8.336 | 100.0% | 10 | | nova.delete_server | 8.629 | 19.19 | 24.537 | 27.665 | 30.793 | 18.577 | 100.0% | 10 | | total | 92.346 | 128.644 | 146.552 | 152.236 | 157.92 | 126.892 | 100.0% | 10 | | -> duration | 91.346 | 127.644 | 145.552 | 151.236 | 156.92 | 125.892 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 353.60285 Full duration: 400.254594 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.444 | 8.861 | 13.448 | 14.328 | 15.207 | 9.568 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.733 | 6.585 | 13.176 | 13.583 | 13.989 | 8.184 | 100.0% | 10 | | nova.boot_server | 33.364 | 42.604 | 45.234 | 45.29 | 45.346 | 42.033 | 100.0% | 10 | | nova.attach_volume | 9.184 | 14.247 | 24.739 | 24.866 | 24.993 | 16.384 | 100.0% | 10 | | nova.detach_volume | 3.752 | 5.68 | 9.024 | 9.095 | 9.167 | 6.337 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.403 | 6.009 | 10.158 | 10.695 | 11.232 | 6.509 | 100.0% | 10 | | cinder_v3.delete_volume | 2.785 | 6.826 | 14.565 | 15.364 | 16.162 | 7.556 | 100.0% | 10 | | nova.delete_server | 13.237 | 17.905 | 21.8 | 23.169 | 24.539 | 18.377 | 100.0% | 10 | | total | 87.577 | 120.652 | 127.493 | 128.196 | 128.9 | 114.949 | 100.0% | 10 | | -> duration | 86.577 | 119.652 | 126.493 | 127.196 | 127.9 | 113.949 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 329.814367 Full duration: 371.062011 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.231 | 9.69 | 15.285 | 15.803 | 16.32 | 10.947 | 100.0% | 10 | | total | 6.232 | 9.69 | 15.285 | 15.803 | 16.321 | 10.947 | 100.0% | 10 | | -> duration | 6.232 | 9.69 | 15.285 | 15.803 | 16.321 | 10.947 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.587642 Full duration: 76.977197 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.456 | 9.954 | 15.676 | 16.73 | 17.784 | 11.361 | 100.0% | 10 | | total | 5.456 | 9.955 | 15.676 | 16.73 | 17.784 | 11.362 | 100.0% | 10 | | -> duration | 5.456 | 9.955 | 15.676 | 16.73 | 17.784 | 11.362 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.555744 Full duration: 85.081067 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.544 | 0.77 | 1.156 | 1.239 | 1.322 | 0.84 | 100.0% | 10 | | total | 0.544 | 0.77 | 1.157 | 1.239 | 1.322 | 0.84 | 100.0% | 10 | | -> duration | 0.544 | 0.77 | 1.157 | 1.239 | 1.322 | 0.84 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.338031 Full duration: 132.139903 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.293 | 10.021 | 11.0 | 11.203 | 11.406 | 9.326 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.28 | 5.192 | 6.94 | 7.649 | 8.359 | 4.951 | 100.0% | 10 | | total | 7.996 | 14.368 | 16.928 | 17.969 | 19.011 | 14.278 | 100.0% | 10 | | -> duration | 7.996 | 14.368 | 16.928 | 17.969 | 19.011 | 14.278 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.810495 Full duration: 117.332077 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.169 | 11.218 | 15.718 | 17.645 | 19.571 | 11.488 | 100.0% | 10 | | cinder_v3.delete_volume | 2.867 | 9.778 | 20.612 | 20.821 | 21.03 | 10.786 | 100.0% | 10 | | total | 9.497 | 23.649 | 30.566 | 31.438 | 32.31 | 22.274 | 100.0% | 10 | | -> duration | 9.497 | 23.649 | 30.566 | 31.438 | 32.31 | 22.274 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.512027 Full duration: 89.082574 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.114 | 25.016 | 26.63 | 27.715 | 28.799 | 23.294 | 100.0% | 10 | | cinder_v3.delete_volume | 2.922 | 5.003 | 8.831 | 8.925 | 9.019 | 5.555 | 100.0% | 10 | | total | 20.393 | 30.625 | 34.628 | 34.793 | 34.958 | 28.85 | 100.0% | 10 | | -> duration | 20.393 | 30.625 | 34.628 | 34.793 | 34.958 | 28.85 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.792134 Full duration: 112.857656 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.841 | 9.201 | 11.105 | 11.134 | 11.162 | 8.943 | 100.0% | 10 | | cinder_v3.delete_volume | 3.215 | 6.478 | 8.336 | 8.447 | 8.557 | 6.356 | 100.0% | 10 | | total | 11.849 | 15.75 | 17.694 | 17.897 | 18.101 | 15.3 | 100.0% | 10 | | -> duration | 11.849 | 15.75 | 17.694 | 17.897 | 18.101 | 15.3 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.234386 Full duration: 75.268882 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.341 | 8.586 | 11.125 | 11.716 | 12.306 | 9.057 | 100.0% | 10 | | cinder_v3.extend_volume | 2.545 | 5.267 | 9.914 | 10.783 | 11.652 | 6.463 | 100.0% | 10 | | cinder_v3.delete_volume | 2.402 | 3.271 | 8.284 | 8.845 | 9.407 | 4.648 | 100.0% | 10 | | total | 12.383 | 16.484 | 29.706 | 29.899 | 30.092 | 20.169 | 100.0% | 10 | | -> duration | 12.383 | 16.484 | 29.706 | 29.899 | 30.092 | 20.169 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.861448 Full duration: 93.410887 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.23 | 11.527 | 12.523 | 12.593 | 12.663 | 10.961 | 100.0% | 10 | | cinder_v3.delete_volume | 4.923 | 6.084 | 8.163 | 9.237 | 10.311 | 6.496 | 100.0% | 10 | | total | 12.194 | 17.511 | 20.811 | 21.815 | 22.819 | 17.458 | 100.0% | 10 | | -> duration | 12.194 | 17.511 | 20.811 | 21.815 | 22.819 | 17.458 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.874549 Full duration: 113.239644 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.921 | 1.507 | 1.824 | 2.03 | 2.236 | 1.47 | 100.0% | 10 | | cinder_v3.get_qos | 0.027 | 0.037 | 0.042 | 0.048 | 0.054 | 0.037 | 100.0% | 10 | | total | 0.974 | 1.542 | 1.86 | 2.067 | 2.275 | 1.507 | 100.0% | 10 | | -> duration | 0.974 | 1.542 | 1.86 | 2.067 | 2.275 | 1.507 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.27508 Full duration: 36.578086 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.644 | 0.861 | 1.343 | 1.364 | 1.385 | 0.942 | 100.0% | 10 | | cinder_v3.list_qos | 0.031 | 0.039 | 0.046 | 0.057 | 0.069 | 0.041 | 100.0% | 10 | | total | 0.684 | 0.9 | 1.408 | 1.412 | 1.417 | 0.983 | 100.0% | 10 | | -> duration | 0.684 | 0.9 | 1.408 | 1.412 | 1.417 | 0.983 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.887409 Full duration: 29.215072 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.846 | 1.266 | 1.99 | 2.028 | 2.067 | 1.376 | 100.0% | 10 | | cinder_v3.set_qos | 0.44 | 0.869 | 2.172 | 2.254 | 2.337 | 1.136 | 100.0% | 10 | | total | 1.631 | 2.485 | 3.502 | 3.511 | 3.52 | 2.513 | 100.0% | 10 | | -> duration | 1.631 | 2.485 | 3.502 | 3.511 | 3.52 | 2.513 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.036476 Full duration: 39.992583 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.915 | 1.339 | 1.718 | 1.857 | 1.997 | 1.32 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.03 | 0.035 | 0.038 | 0.038 | 0.039 | 0.035 | 100.0% | 10 | | total | 0.945 | 1.376 | 1.75 | 1.893 | 2.036 | 1.354 | 100.0% | 10 | | -> duration | 0.945 | 1.376 | 1.75 | 1.893 | 2.036 | 1.354 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.99747 Full duration: 33.943317 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.741 | 0.843 | 1.221 | 1.225 | 1.229 | 0.938 | 100.0% | 10 | | cinder_v3.list_types | 0.036 | 0.048 | 0.054 | 0.056 | 0.059 | 0.048 | 100.0% | 10 | | total | 0.789 | 0.899 | 1.27 | 1.276 | 1.282 | 0.986 | 100.0% | 10 | | -> duration | 0.789 | 0.899 | 1.27 | 1.276 | 1.282 | 0.986 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.578704 Full duration: 33.809477 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.725 | 1.086 | 1.289 | 1.382 | 1.476 | 1.043 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.124 | 0.343 | 0.523 | 0.589 | 0.655 | 0.366 | 100.0% | 10 | | total | 0.97 | 1.461 | 1.793 | 1.833 | 1.874 | 1.409 | 100.0% | 10 | | -> duration | 0.97 | 1.461 | 1.793 | 1.833 | 1.874 | 1.409 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.875427 Full duration: 31.891251 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.816 | 1.07 | 1.378 | 1.394 | 1.41 | 1.097 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.082 | 0.677 | 1.397 | 1.4 | 1.402 | 0.793 | 100.0% | 10 | | total | 1.114 | 1.661 | 2.779 | 2.793 | 2.806 | 1.89 | 100.0% | 10 | | -> duration | 1.114 | 1.661 | 2.779 | 2.793 | 2.806 | 1.89 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.437654 Full duration: 28.422044 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9391d31d-8016-4a13-a939-1c256c32bc1c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.676 | 0.927 | 2.683 | 2.832 | 2.981 | 1.318 | 100.0% | 10 | | cinder_v2.add_type_access | 0.106 | 0.604 | 0.844 | 1.0 | 1.155 | 0.557 | 100.0% | 10 | | cinder_v2.list_type_access | 0.034 | 0.04 | 0.043 | 0.044 | 0.044 | 0.04 | 100.0% | 10 | | total | 0.97 | 1.654 | 3.504 | 3.537 | 3.57 | 1.916 | 100.0% | 10 | | -> duration | 0.97 | 1.654 | 3.504 | 3.537 | 3.57 | 1.916 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.134026 Full duration: 33.590797 HINTS: * To plot HTML graphics with this data, run: rally task report 9391d31d-8016-4a13-a939-1c256c32bc1c --out output.html * To generate a JUnit report, run: rally task export 9391d31d-8016-4a13-a939-1c256c32bc1c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 9391d31d-8016-4a13-a939-1c256c32bc1c --json --out output.json 2020-12-26 11:56:41,710 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 9391d31d-8016-4a13-a939-1c256c32bc1c --out /home/opnfv/functest/results/rally_full/cinder.json 2020-12-26 11:56:41,746 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-26 11:56:41,777 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 11:56:42,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-26 12:48:01,446 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: ad59f35d-f7c7-48d9-bb8a-171e71674beb 2020-12-26 12:48:02,718 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ad59f35d-f7c7-48d9-bb8a-171e71674beb -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.194 | 11.626 | 13.31 | 13.364 | 13.419 | 11.713 | 100.0% | 10 | | heat.list_stacks | 0.056 | 0.072 | 0.078 | 0.085 | 0.092 | 0.069 | 100.0% | 10 | | total | 10.287 | 11.693 | 13.37 | 13.423 | 13.475 | 11.783 | 100.0% | 10 | | -> duration | 8.287 | 9.693 | 11.37 | 11.423 | 11.475 | 9.783 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.599704 Full duration: 107.636938 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.019 | 25.839 | 29.948 | 30.526 | 31.105 | 25.503 | 100.0% | 10 | | heat.update_stack | 11.445 | 20.258 | 43.173 | 44.063 | 44.954 | 26.692 | 100.0% | 10 | | heat.delete_stack | 16.345 | 23.513 | 35.924 | 36.662 | 37.399 | 26.555 | 100.0% | 10 | | total | 45.856 | 72.45 | 103.741 | 104.27 | 104.799 | 78.751 | 100.0% | 10 | | -> duration | 41.856 | 68.45 | 99.741 | 100.27 | 100.799 | 74.751 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 215.816839 Full duration: 258.593282 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 27.794 | 31.516 | 48.318 | 48.96 | 49.602 | 37.13 | 100.0% | 10 | | heat.update_stack | 8.984 | 16.451 | 21.504 | 21.954 | 22.404 | 15.748 | 100.0% | 10 | | heat.delete_stack | 5.069 | 13.679 | 20.479 | 21.504 | 22.53 | 14.035 | 100.0% | 10 | | total | 41.848 | 62.642 | 82.559 | 82.596 | 82.634 | 66.914 | 100.0% | 10 | | -> duration | 37.848 | 58.642 | 78.559 | 78.596 | 78.634 | 62.914 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 192.326031 Full duration: 241.385779 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.954 | 45.764 | 63.453 | 65.391 | 67.329 | 51.504 | 100.0% | 10 | | heat.update_stack | 22.836 | 50.669 | 53.631 | 56.381 | 59.131 | 46.169 | 100.0% | 10 | | heat.delete_stack | 22.771 | 58.885 | 64.418 | 64.517 | 64.617 | 53.332 | 100.0% | 10 | | total | 84.796 | 162.147 | 171.611 | 175.755 | 179.899 | 151.005 | 100.0% | 10 | | -> duration | 80.796 | 158.147 | 167.611 | 171.755 | 175.899 | 147.005 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 413.816293 Full duration: 476.538986 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 34.468 | 53.048 | 57.428 | 57.559 | 57.69 | 50.54 | 100.0% | 10 | | heat.update_stack | 17.532 | 38.827 | 48.995 | 49.503 | 50.01 | 38.069 | 100.0% | 10 | | heat.delete_stack | 19.836 | 39.399 | 41.576 | 42.932 | 44.289 | 36.391 | 100.0% | 10 | | total | 72.056 | 131.546 | 147.226 | 148.977 | 150.729 | 125.0 | 100.0% | 10 | | -> duration | 68.056 | 127.546 | 143.226 | 144.977 | 146.729 | 121.0 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 342.76456 Full duration: 391.335497 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 43.411 | 68.568 | 92.156 | 92.726 | 93.297 | 71.238 | 100.0% | 10 | | heat.update_stack | 20.608 | 40.424 | 52.215 | 52.703 | 53.191 | 40.599 | 100.0% | 10 | | heat.delete_stack | 19.838 | 41.828 | 57.775 | 57.82 | 57.866 | 42.175 | 100.0% | 10 | | total | 84.695 | 159.392 | 184.988 | 185.535 | 186.083 | 154.012 | 100.0% | 10 | | -> duration | 80.695 | 155.392 | 180.988 | 181.535 | 182.083 | 150.012 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 423.855567 Full duration: 467.799359 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.09 | 47.454 | 72.831 | 73.402 | 73.973 | 49.918 | 100.0% | 10 | | heat.update_stack | 27.433 | 35.939 | 44.138 | 45.619 | 47.099 | 36.5 | 100.0% | 10 | | heat.delete_stack | 12.592 | 23.227 | 38.266 | 41.167 | 44.068 | 24.266 | 100.0% | 10 | | total | 79.648 | 97.589 | 145.824 | 148.949 | 152.075 | 110.684 | 100.0% | 10 | | -> duration | 75.648 | 93.589 | 141.824 | 144.949 | 148.075 | 106.684 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 318.550922 Full duration: 403.251131 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 44.185 | 52.779 | 58.547 | 60.044 | 61.541 | 53.291 | 100.0% | 10 | | heat.check_stack | 3.722 | 10.458 | 14.71 | 14.963 | 15.215 | 10.416 | 100.0% | 10 | | heat.delete_stack | 13.749 | 24.966 | 29.02 | 29.502 | 29.984 | 23.1 | 100.0% | 10 | | total | 69.902 | 92.403 | 98.475 | 98.607 | 98.738 | 86.806 | 100.0% | 10 | | -> duration | 67.902 | 90.403 | 96.475 | 96.607 | 96.738 | 84.806 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 241.284461 Full duration: 302.667556 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.805 | 44.918 | 55.257 | 55.914 | 56.571 | 45.652 | 100.0% | 10 | | heat.suspend_stack | 5.313 | 15.333 | 18.611 | 20.243 | 21.875 | 14.603 | 100.0% | 10 | | heat.resume_stack | 4.647 | 14.732 | 18.882 | 19.889 | 20.897 | 13.501 | 100.0% | 10 | | heat.delete_stack | 4.712 | 21.773 | 25.469 | 25.866 | 26.263 | 19.329 | 100.0% | 10 | | total | 52.742 | 97.154 | 111.4 | 112.349 | 113.298 | 93.086 | 100.0% | 10 | | -> duration | 50.742 | 95.154 | 109.4 | 110.349 | 111.298 | 91.086 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 257.746578 Full duration: 310.734715 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad59f35d-f7c7-48d9-bb8a-171e71674beb has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.513 | 0.847 | 1.008 | 1.03 | 1.051 | 0.807 | 100.0% | 10 | | total | 0.513 | 0.847 | 1.008 | 1.03 | 1.051 | 0.807 | 100.0% | 10 | | -> duration | 0.513 | 0.847 | 1.008 | 1.03 | 1.051 | 0.807 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.378169 Full duration: 48.27167 HINTS: * To plot HTML graphics with this data, run: rally task report ad59f35d-f7c7-48d9-bb8a-171e71674beb --out output.html * To generate a JUnit report, run: rally task export ad59f35d-f7c7-48d9-bb8a-171e71674beb --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ad59f35d-f7c7-48d9-bb8a-171e71674beb --json --out output.json 2020-12-26 12:48:05,879 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ad59f35d-f7c7-48d9-bb8a-171e71674beb --out /home/opnfv/functest/results/rally_full/heat.json 2020-12-26 12:48:05,898 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-26 12:48:05,928 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 12:48:06,391 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-26 13:00:53,781 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b 2020-12-26 13:00:55,081 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.123 | 0.987 | 1.741 | 1.802 | 1.864 | 1.072 | 100.0% | 10 | | keystone_v3.add_role | 0.065 | 0.502 | 0.907 | 0.928 | 0.949 | 0.519 | 100.0% | 10 | | keystone_v3.revoke_role | 0.143 | 0.461 | 1.319 | 1.407 | 1.495 | 0.717 | 100.0% | 10 | | total | 0.331 | 2.396 | 3.101 | 3.504 | 3.907 | 2.309 | 100.0% | 10 | | -> duration | 0.331 | 2.396 | 3.101 | 3.504 | 3.907 | 2.309 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.478061 Full duration: 49.584353 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.272 | 0.472 | 1.394 | 1.626 | 1.858 | 0.701 | 100.0% | 10 | | keystone_v3.add_role | 0.119 | 0.57 | 1.248 | 1.26 | 1.271 | 0.619 | 100.0% | 10 | | keystone_v3.list_roles | 0.107 | 0.123 | 0.174 | 0.353 | 0.532 | 0.162 | 100.0% | 10 | | total | 0.553 | 1.568 | 2.334 | 2.371 | 2.408 | 1.481 | 100.0% | 10 | | -> duration | 0.553 | 1.568 | 2.334 | 2.371 | 2.408 | 1.481 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.622931 Full duration: 58.040887 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.514 | 1.046 | 1.236 | 1.278 | 1.32 | 0.974 | 100.0% | 10 | | keystone_v3.list_projects | 0.11 | 0.123 | 0.139 | 0.152 | 0.165 | 0.126 | 100.0% | 10 | | total | 0.65 | 1.189 | 1.366 | 1.406 | 1.446 | 1.1 | 100.0% | 10 | | -> duration | 0.65 | 1.189 | 1.366 | 1.406 | 1.446 | 1.1 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.360347 Full duration: 46.005662 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.204 | 1.399 | 3.359 | 3.438 | 3.518 | 1.682 | 100.0% | 10 | | keystone_v3.delete_role | 0.199 | 0.46 | 1.985 | 2.133 | 2.281 | 0.74 | 100.0% | 10 | | total | 0.956 | 2.487 | 3.819 | 3.83 | 3.841 | 2.423 | 100.0% | 10 | | -> duration | 0.956 | 2.487 | 3.819 | 3.83 | 3.841 | 2.423 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.893144 Full duration: 50.396822 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.456 | 0.94 | 8.006 | 10.019 | 12.032 | 2.898 | 100.0% | 10 | | keystone_v3.delete_service | 0.151 | 1.204 | 11.01 | 14.802 | 18.595 | 4.74 | 100.0% | 10 | | total | 1.181 | 3.676 | 19.815 | 19.968 | 20.12 | 7.638 | 100.0% | 10 | | -> duration | 1.181 | 3.676 | 19.815 | 19.968 | 20.12 | 7.638 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.694646 Full duration: 71.507479 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.573 | 0.88 | 2.173 | 2.608 | 3.044 | 1.187 | 100.0% | 10 | | keystone_v3.create_user | 0.882 | 1.492 | 3.123 | 3.14 | 3.157 | 1.858 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.047 | 0.067 | 0.232 | 0.433 | 0.633 | 0.144 | 100.0% | 10 | | -> keystone_v3.add_role | 0.101 | 0.431 | 1.45 | 1.814 | 2.179 | 0.648 | 100.0% | 10 | | keystone_v3.create_role | 0.065 | 0.329 | 0.704 | 0.709 | 0.713 | 0.353 | 100.0% | 10 | | keystone_v3.get_project | 0.034 | 0.043 | 0.151 | 0.182 | 0.214 | 0.076 | 100.0% | 10 | | keystone_v3.get_user | 0.035 | 0.043 | 0.06 | 0.114 | 0.168 | 0.054 | 100.0% | 10 | | keystone_v3.get_role | 0.035 | 0.04 | 0.104 | 0.27 | 0.435 | 0.084 | 100.0% | 10 | | keystone_v3.list_services | 0.039 | 0.043 | 0.066 | 0.153 | 0.239 | 0.062 | 100.0% | 10 | | keystone_v3.get_services | 0.037 | 0.143 | 0.799 | 1.51 | 2.22 | 0.418 | 100.0% | 10 | | total | 2.747 | 3.757 | 5.55 | 6.689 | 7.827 | 4.212 | 100.0% | 10 | | -> duration | 2.747 | 3.757 | 5.55 | 6.689 | 7.827 | 4.212 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.586139 Full duration: 92.588259 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.797 | 2.288 | 2.983 | 3.014 | 3.045 | 2.081 | 100.0% | 10 | | keystone_v3.update_project | 0.266 | 0.78 | 0.998 | 1.063 | 1.127 | 0.675 | 100.0% | 10 | | keystone_v3.delete_project | 0.164 | 0.976 | 1.713 | 1.762 | 1.811 | 0.985 | 100.0% | 10 | | total | 2.141 | 3.233 | 5.675 | 5.795 | 5.915 | 3.742 | 100.0% | 10 | | -> duration | 2.141 | 3.233 | 5.675 | 5.795 | 5.915 | 3.742 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.121337 Full duration: 47.229976 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.587 | 1.129 | 2.202 | 2.294 | 2.387 | 1.314 | 100.0% | 10 | | total | 0.719 | 1.36 | 2.284 | 2.372 | 2.46 | 1.445 | 100.0% | 10 | | -> duration | 0.719 | 1.36 | 2.284 | 2.372 | 2.46 | 1.445 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.770344 Full duration: 38.724893 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.341 | 1.068 | 1.876 | 1.972 | 2.068 | 1.152 | 100.0% | 10 | | total | 0.341 | 1.068 | 1.876 | 1.972 | 2.068 | 1.152 | 100.0% | 10 | | -> duration | 0.341 | 1.068 | 1.876 | 1.972 | 2.068 | 1.152 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.914754 Full duration: 35.764281 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.577 | 1.359 | 1.953 | 2.012 | 2.071 | 1.322 | 100.0% | 10 | | keystone_v3.list_users | 0.063 | 0.085 | 0.335 | 0.636 | 0.936 | 0.198 | 100.0% | 10 | | total | 0.761 | 1.865 | 2.269 | 2.392 | 2.515 | 1.73 | 100.0% | 10 | | -> duration | 0.761 | 1.865 | 2.269 | 2.392 | 2.515 | 1.73 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.193092 Full duration: 38.879174 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.364 | 0.63 | 2.55 | 2.574 | 2.599 | 1.078 | 100.0% | 10 | | keystone_v3.create_users | 9.346 | 23.069 | 28.178 | 28.241 | 28.304 | 21.922 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 9.346 | 23.068 | 28.178 | 28.241 | 28.303 | 21.922 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.508 | 0.792 | 1.644 | 3.235 | 4.827 | 1.182 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 3.0 | 7.472 | 11.877 | 12.44 | 13.003 | 8.095 | 100.0% | 10 | | total | 10.26 | 26.125 | 29.838 | 30.117 | 30.395 | 24.43 | 100.0% | 10 | | -> duration | 10.26 | 26.125 | 29.838 | 30.117 | 30.395 | 24.43 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.083898 Full duration: 206.836419 HINTS: * To plot HTML graphics with this data, run: rally task report 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b --out output.html * To generate a JUnit report, run: rally task export 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b --json --out output.json 2020-12-26 13:00:58,178 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5a3aa18c-ffe1-4ad8-a4af-cb370fc2e39b --out /home/opnfv/functest/results/rally_full/keystone.json 2020-12-26 13:00:58,200 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-26 13:00:58,235 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 13:00:58,672 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-26 13:20:50,627 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: fe8be435-2661-4996-8a34-3d61412d2f81 2020-12-26 13:20:51,879 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fe8be435-2661-4996-8a34-3d61412d2f81 -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.508 | 3.697 | 5.556 | 5.598 | 5.64 | 3.886 | 100.0% | 10 | | neutron.update_network | 0.645 | 1.834 | 2.377 | 2.95 | 3.524 | 1.774 | 100.0% | 10 | | total | 3.215 | 5.65 | 7.372 | 7.376 | 7.38 | 5.66 | 100.0% | 10 | | -> duration | 3.215 | 5.65 | 7.372 | 7.376 | 7.38 | 5.66 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.842013 Full duration: 66.14692 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.583 | 5.867 | 8.871 | 8.911 | 8.95 | 6.172 | 100.0% | 10 | | neutron.update_port | 1.268 | 1.965 | 2.418 | 2.624 | 2.83 | 1.897 | 100.0% | 10 | | total | 3.954 | 8.077 | 11.11 | 11.216 | 11.322 | 8.069 | 100.0% | 10 | | -> duration | 3.954 | 8.077 | 11.11 | 11.216 | 11.322 | 8.069 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.426815 Full duration: 101.362957 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.47 | 4.213 | 5.524 | 5.683 | 5.842 | 4.124 | 100.0% | 10 | | neutron.create_subnet | 1.829 | 3.867 | 5.224 | 5.32 | 5.415 | 3.847 | 100.0% | 10 | | neutron.update_subnet | 1.037 | 1.42 | 2.997 | 3.563 | 4.13 | 1.84 | 100.0% | 10 | | total | 7.931 | 9.418 | 11.655 | 11.819 | 11.983 | 9.811 | 100.0% | 10 | | -> duration | 7.931 | 9.418 | 11.655 | 11.819 | 11.983 | 9.811 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.630676 Full duration: 95.175571 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.349 | 3.761 | 4.77 | 4.937 | 5.105 | 3.977 | 100.0% | 10 | | neutron.delete_network | 1.298 | 1.625 | 2.73 | 2.748 | 2.766 | 1.873 | 100.0% | 10 | | total | 4.771 | 5.555 | 7.244 | 7.398 | 7.553 | 5.85 | 100.0% | 10 | | -> duration | 4.771 | 5.555 | 7.244 | 7.398 | 7.553 | 5.85 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.544055 Full duration: 67.454218 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.753 | 4.844 | 7.395 | 7.402 | 7.409 | 5.13 | 100.0% | 10 | | neutron.delete_port | 0.739 | 2.684 | 2.953 | 2.953 | 2.953 | 2.267 | 100.0% | 10 | | total | 4.422 | 7.197 | 10.348 | 10.355 | 10.361 | 7.397 | 100.0% | 10 | | -> duration | 4.422 | 7.197 | 10.348 | 10.355 | 10.361 | 7.397 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.76795 Full duration: 106.186611 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.942 | 3.684 | 9.363 | 9.607 | 9.85 | 4.586 | 100.0% | 10 | | neutron.create_subnet | 1.448 | 5.914 | 7.488 | 8.412 | 9.336 | 5.564 | 100.0% | 10 | | neutron.delete_subnet | 1.074 | 1.855 | 3.856 | 4.887 | 5.919 | 2.363 | 100.0% | 10 | | total | 6.359 | 12.609 | 17.299 | 17.33 | 17.361 | 12.516 | 100.0% | 10 | | -> duration | 6.359 | 12.609 | 17.299 | 17.33 | 17.361 | 12.516 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.440614 Full duration: 82.08766 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.884 | 3.728 | 7.403 | 7.454 | 7.505 | 4.246 | 100.0% | 10 | | neutron.list_networks | 0.161 | 0.272 | 3.0 | 3.266 | 3.533 | 0.928 | 100.0% | 10 | | total | 2.057 | 4.133 | 7.776 | 8.169 | 8.561 | 5.174 | 100.0% | 10 | | -> duration | 2.057 | 4.133 | 7.776 | 8.169 | 8.561 | 5.174 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.75553 Full duration: 71.700122 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.353 | 3.774 | 6.85 | 7.213 | 7.576 | 4.49 | 100.0% | 10 | | neutron.list_ports | 0.115 | 0.252 | 0.531 | 0.559 | 0.587 | 0.315 | 100.0% | 10 | | total | 2.501 | 4.237 | 7.329 | 7.52 | 7.711 | 4.806 | 100.0% | 10 | | -> duration | 2.501 | 4.237 | 7.329 | 7.52 | 7.711 | 4.806 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.88954 Full duration: 79.651566 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.84 | 2.866 | 4.259 | 4.454 | 4.65 | 2.87 | 100.0% | 10 | | neutron.create_subnet | 1.898 | 2.667 | 4.705 | 4.768 | 4.83 | 3.061 | 100.0% | 10 | | neutron.list_subnets | 0.111 | 0.265 | 0.662 | 1.134 | 1.607 | 0.408 | 100.0% | 10 | | total | 3.294 | 6.328 | 8.996 | 9.014 | 9.033 | 6.339 | 100.0% | 10 | | -> duration | 3.294 | 6.328 | 8.996 | 9.014 | 9.033 | 6.339 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.782904 Full duration: 85.114328 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.724 | 3.083 | 5.354 | 5.372 | 5.389 | 3.423 | 100.0% | 10 | | neutron.delete_security_group | 0.255 | 0.855 | 0.988 | 1.098 | 1.208 | 0.813 | 100.0% | 10 | | total | 2.568 | 3.693 | 6.204 | 6.279 | 6.353 | 4.235 | 100.0% | 10 | | -> duration | 2.568 | 3.693 | 6.204 | 6.279 | 6.353 | 4.235 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.835467 Full duration: 54.091255 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.441 | 3.317 | 6.334 | 6.672 | 7.01 | 4.053 | 100.0% | 10 | | neutron.create_security_group_rule | 0.423 | 1.827 | 3.532 | 3.724 | 3.915 | 2.106 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.34 | 1.579 | 2.019 | 2.363 | 2.707 | 1.544 | 100.0% | 10 | | neutron.delete_security_group | 0.62 | 1.323 | 2.781 | 2.864 | 2.948 | 1.603 | 100.0% | 10 | | total | 6.119 | 7.482 | 13.423 | 13.48 | 13.537 | 9.306 | 100.0% | 10 | | -> duration | 6.119 | 7.482 | 13.423 | 13.48 | 13.537 | 9.306 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.360913 Full duration: 73.657312 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.235 | 3.696 | 4.118 | 4.282 | 4.445 | 3.438 | 100.0% | 10 | | neutron.create_security_group_rule | 0.574 | 1.698 | 2.868 | 3.468 | 4.068 | 1.916 | 100.0% | 10 | | neutron.list_security_group_rules | 0.071 | 0.258 | 1.475 | 1.682 | 1.888 | 0.595 | 100.0% | 10 | | total | 4.769 | 5.893 | 6.782 | 6.825 | 6.867 | 5.95 | 100.0% | 10 | | -> duration | 4.769 | 5.893 | 6.782 | 6.825 | 6.867 | 5.95 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.275153 Full duration: 75.304893 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.522 | 2.143 | 4.476 | 4.702 | 4.928 | 2.672 | 100.0% | 10 | | neutron.show_security_group | 0.053 | 0.093 | 0.431 | 0.435 | 0.438 | 0.154 | 100.0% | 10 | | total | 1.591 | 2.224 | 4.606 | 4.986 | 5.367 | 2.827 | 100.0% | 10 | | -> duration | 1.591 | 2.224 | 4.606 | 4.986 | 5.367 | 2.827 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.278236 Full duration: 66.721581 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 19.435244 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe8be435-2661-4996-8a34-3d61412d2f81 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 5.044 | 7.726 | 8.276 | 8.458 | 8.64 | 7.453 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.318 | 0.911 | 1.751 | 1.796 | 1.84 | 0.913 | 100.0% | 10 | | total | 5.916 | 8.507 | 9.137 | 9.557 | 9.977 | 8.366 | 100.0% | 10 | | -> duration | 5.916 | 8.507 | 9.137 | 9.557 | 9.977 | 8.366 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.778417 Full duration: 111.109471 HINTS: * To plot HTML graphics with this data, run: rally task report fe8be435-2661-4996-8a34-3d61412d2f81 --out output.html * To generate a JUnit report, run: rally task export fe8be435-2661-4996-8a34-3d61412d2f81 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fe8be435-2661-4996-8a34-3d61412d2f81 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-26 13:20:54,997 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fe8be435-2661-4996-8a34-3d61412d2f81 --out /home/opnfv/functest/results/rally_full/neutron.json 2020-12-26 13:20:55,019 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2020-12-26 13:20:55,059 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 13:20:55,529 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-26 14:04:03,435 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: cd443ac4-feaa-46a5-94a5-4fa12375e4fa 2020-12-26 14:04:04,784 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid cd443ac4-feaa-46a5-94a5-4fa12375e4fa -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.089 | 1.649 | 2.786 | 2.787 | 2.788 | 1.931 | 100.0% | 10 | | nova.delete_keypair | 0.157 | 0.359 | 0.982 | 1.109 | 1.236 | 0.502 | 100.0% | 10 | | total | 1.246 | 2.506 | 3.153 | 3.289 | 3.425 | 2.433 | 100.0% | 10 | | -> duration | 1.246 | 2.506 | 3.153 | 3.289 | 3.425 | 2.433 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.459635 Full duration: 47.080678 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.8 | 1.724 | 2.237 | 2.327 | 2.418 | 1.695 | 100.0% | 10 | | nova.list_keypairs | 0.034 | 0.044 | 0.051 | 0.057 | 0.062 | 0.045 | 100.0% | 10 | | total | 0.839 | 1.78 | 2.284 | 2.376 | 2.468 | 1.74 | 100.0% | 10 | | -> duration | 0.839 | 1.78 | 2.284 | 2.376 | 2.468 | 1.74 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.839057 Full duration: 44.941159 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.851 | 39.257 | 44.454 | 48.671 | 52.887 | 37.005 | 100.0% | 10 | | nova.reboot_server | 8.211 | 12.249 | 15.559 | 15.699 | 15.839 | 12.159 | 100.0% | 10 | | nova.soft_reboot_server | 12.37 | 15.222 | 29.022 | 82.703 | 136.383 | 27.145 | 100.0% | 10 | | nova.stop_and_start_server | 14.094 | 21.132 | 30.931 | 32.258 | 33.584 | 22.885 | 100.0% | 10 | | -> nova.stop_server | 6.261 | 8.546 | 20.294 | 21.02 | 21.746 | 11.223 | 100.0% | 10 | | -> nova.start_server | 4.936 | 9.757 | 16.46 | 21.086 | 25.712 | 11.662 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 16.323 | 23.816 | 71.79 | 76.844 | 81.899 | 35.154 | 100.0% | 10 | | -> nova.rescue_server | 10.174 | 13.089 | 65.118 | 65.384 | 65.649 | 24.273 | 100.0% | 10 | | -> nova.unrescue_server | 5.608 | 11.28 | 16.139 | 16.194 | 16.25 | 10.881 | 100.0% | 10 | | nova.delete_server | 9.027 | 15.256 | 24.65 | 27.17 | 29.69 | 16.025 | 100.0% | 10 | | total | 100.7 | 145.241 | 192.816 | 215.212 | 237.609 | 150.42 | 100.0% | 10 | | -> duration | 91.7 | 136.241 | 183.816 | 206.212 | 228.609 | 141.42 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 388.76072 Full duration: 441.471586 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 23.04 | 57.952 | 72.779 | 73.921 | 75.062 | 54.08 | 100.0% | 10 | | nova.delete_server | 10.878 | 19.651 | 26.049 | 27.197 | 28.345 | 20.132 | 100.0% | 10 | | total | 34.591 | 82.799 | 91.12 | 91.644 | 92.168 | 74.212 | 100.0% | 10 | | -> duration | 33.591 | 81.799 | 90.12 | 90.644 | 91.168 | 73.212 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 201.832553 Full duration: 244.000934 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 28.393 | 48.353 | 55.927 | 57.078 | 58.228 | 46.386 | 100.0% | 10 | | nova.list_servers | 0.384 | 0.435 | 0.807 | 0.841 | 0.876 | 0.509 | 100.0% | 10 | | total | 28.873 | 49.191 | 56.343 | 57.522 | 58.701 | 46.895 | 100.0% | 10 | | -> duration | 27.873 | 48.191 | 55.343 | 56.522 | 57.701 | 45.895 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 130.175706 Full duration: 231.376645 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "from_image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "to_image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 42.012 | 48.891 | 60.304 | 60.64 | 60.976 | 51.123 | 100.0% | 10 | | nova.rebuild_server | 17.657 | 28.437 | 36.912 | 38.544 | 40.175 | 28.456 | 100.0% | 10 | | nova.delete_server | 5.713 | 20.154 | 27.474 | 28.039 | 28.605 | 19.003 | 100.0% | 10 | | total | 65.844 | 103.788 | 112.014 | 116.166 | 120.317 | 98.583 | 100.0% | 10 | | -> duration | 63.844 | 101.788 | 110.014 | 114.166 | 118.317 | 96.583 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 269.11904 Full duration: 320.419185 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 46.079 | 102.415 | 108.302 | 109.668 | 111.034 | 92.747 | 100.0% | 10 | | nova.snapshot_server | 13.578 | 30.035 | 50.184 | 51.144 | 52.105 | 32.296 | 100.0% | 10 | | -> glance_v2.get_image | 0.067 | 0.081 | 0.099 | 0.107 | 0.114 | 0.084 | 100.0% | 10 | | -> glance.wait_for_image | 12.307 | 27.656 | 39.704 | 43.373 | 47.041 | 27.869 | 100.0% | 10 | | --> glance_v2.get_image (x20) | 0.789 | 0.815 | 0.836 | 0.839 | 0.842 | 0.815 | 100.0% | 2 | | --> glance_v2.get_image (x18) | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 100.0% | 1 | | --> glance_v2.get_image (x24) | 0.985 | 0.985 | 0.985 | 0.985 | 0.985 | 0.985 | 100.0% | 1 | | --> glance_v2.get_image (x16) | 0.704 | 0.704 | 0.704 | 0.704 | 0.704 | 0.704 | 100.0% | 1 | | --> glance_v2.get_image (x9) | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 100.0% | 1 | | --> glance_v2.get_image (x13) | 0.542 | 0.542 | 0.542 | 0.542 | 0.542 | 0.542 | 100.0% | 1 | | --> glance_v2.get_image (x12) | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 100.0% | 1 | | --> glance_v2.get_image (x7) | 0.292 | 0.302 | 0.309 | 0.31 | 0.311 | 0.302 | 100.0% | 2 | | nova.delete_server (x2) | 12.109 | 41.745 | 49.595 | 50.38 | 51.166 | 37.289 | 100.0% | 10 | | nova.delete_image | 3.093 | 4.039 | 7.376 | 8.162 | 8.947 | 4.76 | 100.0% | 10 | | -> glance_v2.delete_image | 3.059 | 3.994 | 7.323 | 8.108 | 8.894 | 4.717 | 100.0% | 10 | | -> glance.wait_for_delete | 0.027 | 0.043 | 0.052 | 0.052 | 0.052 | 0.041 | 100.0% | 10 | | --> glance_v2.get_image | 0.027 | 0.042 | 0.051 | 0.051 | 0.051 | 0.041 | 0.0% | 10 | | total | 76.65 | 178.508 | 204.748 | 204.8 | 204.853 | 167.092 | 100.0% | 10 | | -> duration | 74.65 | 176.508 | 202.748 | 202.8 | 202.853 | 165.092 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 452.928733 Full duration: 499.000845 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "volume_size": 1, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 23.037 | 25.969 | 27.966 | 30.095 | 32.224 | 26.326 | 100.0% | 10 | | nova.boot_server | 19.84 | 44.007 | 49.201 | 49.841 | 50.482 | 39.157 | 100.0% | 10 | | total | 45.884 | 69.966 | 74.532 | 75.714 | 76.896 | 65.483 | 100.0% | 10 | | -> duration | 44.884 | 68.966 | 73.532 | 74.714 | 75.896 | 64.483 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 186.369612 Full duration: 290.286836 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.581 | 40.288 | 46.064 | 47.955 | 49.846 | 37.891 | 100.0% | 10 | | total | 19.581 | 40.297 | 46.064 | 47.955 | 49.846 | 37.893 | 100.0% | 10 | | -> duration | 18.581 | 39.297 | 45.064 | 46.955 | 48.846 | 36.893 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 104.252626 Full duration: 177.633039 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 25.563377 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "image": { "name": "rally_full-img_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "to_flavor": { "name": "rally_full-flavor_alt_83bbbf8f-6e49-4620-aee7-bea687a6dab6" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "2376e43b-c56b-47b4-8b43-8382b81ab164" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cd443ac4-feaa-46a5-94a5-4fa12375e4fa has 5 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 28.926 | 39.234 | 44.433 | 45.105 | 45.778 | 38.736 | 100.0% | 5 | | nova.resize | 15.965 | 30.552 | 33.873 | 34.432 | 34.991 | 28.687 | 0.0% | 5 | | total | 44.891 | 68.967 | 78.306 | 79.538 | 80.769 | 67.423 | 0.0% | 5 | | -> duration | 43.891 | 67.967 | 77.306 | 78.538 | 79.769 | 66.423 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 111.802931 Full duration: 189.975567 HINTS: * To plot HTML graphics with this data, run: rally task report cd443ac4-feaa-46a5-94a5-4fa12375e4fa --out output.html * To generate a JUnit report, run: rally task export cd443ac4-feaa-46a5-94a5-4fa12375e4fa --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cd443ac4-feaa-46a5-94a5-4fa12375e4fa --json --out output.json At least one workload did not pass SLA criteria. 2020-12-26 14:04:08,005 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid cd443ac4-feaa-46a5-94a5-4fa12375e4fa --out /home/opnfv/functest/results/rally_full/nova.json 2020-12-26 14:04:08,027 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-26 14:04:08,053 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 14:04:08,755 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-26 14:06:32,447 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: cbd64488-a993-4505-a843-416dc6832227 2020-12-26 14:06:33,729 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid cbd64488-a993-4505-a843-416dc6832227 -------------------------------------------------------------------------------- Task cbd64488-a993-4505-a843-416dc6832227: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbd64488-a993-4505-a843-416dc6832227 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.875 | 2.999 | 5.037 | 5.614 | 6.191 | 3.184 | 100.0% | 10 | | quotas.delete_quotas | 0.031 | 0.185 | 5.135 | 5.184 | 5.232 | 1.685 | 100.0% | 10 | | total | 1.067 | 3.127 | 9.779 | 9.907 | 10.034 | 4.869 | 100.0% | 10 | | -> duration | 1.067 | 3.127 | 9.779 | 9.907 | 10.034 | 4.869 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.271522 Full duration: 42.175046 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbd64488-a993-4505-a843-416dc6832227 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.616 | 2.52 | 3.721 | 3.776 | 3.831 | 2.706 | 100.0% | 10 | | total | 1.616 | 2.52 | 3.721 | 3.776 | 3.831 | 2.707 | 100.0% | 10 | | -> duration | 1.616 | 2.52 | 3.721 | 3.776 | 3.831 | 2.707 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.230941 Full duration: 35.608224 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbd64488-a993-4505-a843-416dc6832227 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 3.391 | 5.127 | 5.597 | 5.99 | 6.383 | 4.745 | 100.0% | 10 | | total | 3.392 | 5.127 | 5.597 | 5.99 | 6.383 | 4.745 | 100.0% | 10 | | -> duration | 3.392 | 5.127 | 5.597 | 5.99 | 6.383 | 4.745 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.174355 Full duration: 40.64319 HINTS: * To plot HTML graphics with this data, run: rally task report cbd64488-a993-4505-a843-416dc6832227 --out output.html * To generate a JUnit report, run: rally task export cbd64488-a993-4505-a843-416dc6832227 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cbd64488-a993-4505-a843-416dc6832227 --json --out output.json 2020-12-26 14:06:36,871 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid cbd64488-a993-4505-a843-416dc6832227 --out /home/opnfv/functest/results/rally_full/quotas.json 2020-12-26 14:06:36,877 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-26 14:06:36,912 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-26 14:06:37,100 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-26 14:16:09,105 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 71e1f9e4-6d25-4a05-b201-71ec1e549c11 2020-12-26 14:16:10,341 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 71e1f9e4-6d25-4a05-b201-71ec1e549c11 -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.88 | 1.131 | 1.411 | 1.666 | 1.92 | 1.196 | 100.0% | 10 | | swift.upload_object (x2) | 1.043 | 1.13 | 1.208 | 1.216 | 1.224 | 1.134 | 100.0% | 10 | | swift.list_objects | 0.96 | 1.008 | 1.037 | 1.066 | 1.096 | 1.012 | 100.0% | 10 | | total | 3.008 | 3.232 | 3.529 | 3.797 | 4.065 | 3.343 | 100.0% | 10 | | -> duration | 3.008 | 3.232 | 3.529 | 3.797 | 4.065 | 3.343 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.477786 Full duration: 99.308949 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.358 | 1.454 | 1.565 | 1.607 | 1.649 | 1.463 | 100.0% | 10 | | swift.list_objects | 0.887 | 1.015 | 1.038 | 1.039 | 1.039 | 1.003 | 100.0% | 10 | | total | 2.309 | 2.473 | 2.581 | 2.619 | 2.657 | 2.466 | 100.0% | 10 | | -> duration | 2.309 | 2.473 | 2.581 | 2.619 | 2.657 | 2.466 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.71068 Full duration: 81.866864 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.908 | 1.127 | 1.298 | 1.301 | 1.304 | 1.128 | 100.0% | 10 | | swift.upload_object (x5) | 2.725 | 2.8 | 2.899 | 2.902 | 2.905 | 2.808 | 100.0% | 10 | | swift.download_object (x5) | 2.357 | 2.481 | 2.56 | 2.575 | 2.589 | 2.475 | 100.0% | 10 | | total | 6.276 | 6.405 | 6.589 | 6.594 | 6.598 | 6.413 | 100.0% | 10 | | -> duration | 6.276 | 6.405 | 6.589 | 6.594 | 6.598 | 6.413 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.181897 Full duration: 134.985275 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.942 | 1.129 | 1.371 | 1.398 | 1.426 | 1.142 | 100.0% | 10 | | swift.upload_object (x5) | 2.718 | 2.815 | 2.896 | 2.941 | 2.985 | 2.809 | 100.0% | 10 | | swift.delete_object (x5) | 2.425 | 2.638 | 2.759 | 2.768 | 2.777 | 2.626 | 100.0% | 10 | | swift.delete_container | 0.553 | 0.676 | 0.746 | 0.756 | 0.765 | 0.659 | 100.0% | 10 | | total | 7.008 | 7.15 | 7.487 | 7.538 | 7.588 | 7.238 | 100.0% | 10 | | -> duration | 7.008 | 7.15 | 7.487 | 7.538 | 7.588 | 7.238 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.437762 Full duration: 123.662961 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71e1f9e4-6d25-4a05-b201-71ec1e549c11 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.412 | 1.501 | 1.629 | 1.638 | 1.648 | 1.517 | 100.0% | 10 | | swift.list_objects | 0.913 | 0.997 | 1.039 | 1.041 | 1.043 | 0.994 | 100.0% | 10 | | swift.download_object (x5) | 2.318 | 2.459 | 2.555 | 2.559 | 2.563 | 2.447 | 100.0% | 10 | | total | 4.776 | 5.004 | 5.063 | 5.105 | 5.147 | 4.958 | 100.0% | 10 | | -> duration | 4.776 | 5.004 | 5.063 | 5.105 | 5.147 | 4.958 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.643402 Full duration: 106.683342 HINTS: * To plot HTML graphics with this data, run: rally task report 71e1f9e4-6d25-4a05-b201-71ec1e549c11 --out output.html * To generate a JUnit report, run: rally task export 71e1f9e4-6d25-4a05-b201-71ec1e549c11 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 71e1f9e4-6d25-4a05-b201-71ec1e549c11 --json --out output.json 2020-12-26 14:16:13,337 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 71e1f9e4-6d25-4a05-b201-71ec1e549c11 --out /home/opnfv/functest/results/rally_full/swift.json 2020-12-26 14:16:13,352 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-26 14:16:13,355 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:34 | 60 | 100.00% | | glance | 00:10:28 | 45 | 88.89% | | cinder | 00:47:26 | 240 | 100.00% | | heat | 00:50:08 | 100 | 100.00% | | keystone | 00:12:15 | 110 | 100.00% | | neutron | 00:19:15 | 140 | 100.00% | | nova | 00:41:51 | 95 | 94.74% | | quotas | 00:01:58 | 30 | 100.00% | | swift | 00:09:06 | 50 | 100.00% | | | | | | | TOTAL: | 03:15:04 | 870 | 98.85% | +----------------+------------+----------------+-----------+ 2020-12-26 14:16:13,356 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.85% in 6/9 modules 2020-12-26 14:16:17,220 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2020-12-26 14:16:20,696 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2020-12-26 14:16:20,697 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 202:32 | FAIL | +--------------------+------------------+------------------+----------------+