2020-12-09 16:12:18,045 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | E4QQGUBM31BK | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/E4QQGUBM31BK/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-186 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/E4QQGUBM31BK/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-186 | +-------------------------+------------------------------------------------------------+ 2020-12-09 16:12:18,062 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2020-12-09 16:12:23,370 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2020-12-09 16:12:30,695 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-09 16:12:37,181 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 486db3c1-4b6e-4cea-b2e7-b81f99d4e409 | 2020-12-09T16:12:36.893832 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 486db3c1-4b6e-4cea-b2e7-b81f99d4e409 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-09 16:12:42,215 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-09 16:12:44,321 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 16:12:44,495 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-09 16:17:07,814 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 3c70ecbb-b152-4573-8e33-4623f0322ba3 2020-12-09 16:17:09,076 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3c70ecbb-b152-4573-8e33-4623f0322ba3 -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.846 | 1.157 | 1.383 | 1.401 | 1.418 | 1.141 | 100.0% | 10 | | total | 0.846 | 1.157 | 1.383 | 1.401 | 1.418 | 1.141 | 100.0% | 10 | | -> duration | 0.846 | 1.157 | 1.383 | 1.401 | 1.418 | 1.141 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.305673 Full duration: 37.23521 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.142 | 0.193 | 0.437 | 0.545 | 0.654 | 0.266 | 100.0% | 10 | | total | 0.621 | 0.921 | 1.198 | 1.254 | 1.31 | 0.934 | 100.0% | 10 | | -> duration | 0.621 | 0.921 | 1.198 | 1.254 | 1.31 | 0.934 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.608705 Full duration: 32.575511 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.208 | 0.262 | 0.479 | 0.506 | 0.533 | 0.319 | 100.0% | 10 | | total | 0.67 | 1.012 | 1.184 | 1.456 | 1.729 | 0.993 | 100.0% | 10 | | -> duration | 0.67 | 1.012 | 1.184 | 1.456 | 1.729 | 0.993 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.545842 Full duration: 42.083603 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.142 | 0.29 | 0.481 | 0.557 | 0.633 | 0.307 | 100.0% | 10 | | total | 0.652 | 0.968 | 1.19 | 1.532 | 1.874 | 1.02 | 100.0% | 10 | | -> duration | 0.652 | 0.968 | 1.19 | 1.532 | 1.874 | 1.02 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.931283 Full duration: 31.994255 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.403 | 0.698 | 1.018 | 1.106 | 1.195 | 0.719 | 100.0% | 10 | | total | 0.868 | 1.285 | 2.07 | 2.096 | 2.122 | 1.37 | 100.0% | 10 | | -> duration | 0.868 | 1.285 | 2.07 | 2.096 | 2.122 | 1.37 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.031899 Full duration: 33.132611 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3c70ecbb-b152-4573-8e33-4623f0322ba3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.155 | 0.201 | 0.535 | 0.777 | 1.019 | 0.309 | 100.0% | 10 | | total | 0.614 | 0.884 | 1.656 | 1.73 | 1.804 | 1.019 | 100.0% | 10 | | -> duration | 0.614 | 0.884 | 1.656 | 1.73 | 1.804 | 1.019 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.787835 Full duration: 57.749009 HINTS: * To plot HTML graphics with this data, run: rally task report 3c70ecbb-b152-4573-8e33-4623f0322ba3 --out output.html * To generate a JUnit report, run: rally task export 3c70ecbb-b152-4573-8e33-4623f0322ba3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3c70ecbb-b152-4573-8e33-4623f0322ba3 --json --out output.json 2020-12-09 16:17:12,026 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3c70ecbb-b152-4573-8e33-4623f0322ba3 --out /home/opnfv/functest/results/rally_full/authenticate.json 2020-12-09 16:17:12,039 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-09 16:17:12,072 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 16:17:12,277 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-09 16:31:37,014 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c 2020-12-09 16:31:38,260 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.67 | 12.014 | 19.287 | 19.455 | 19.623 | 13.038 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.093 | 0.106 | 0.111 | 0.113 | 0.115 | 0.105 | 100.0% | 10 | | -> glance_v2.upload_data | 2.88 | 6.917 | 15.483 | 15.505 | 15.526 | 8.963 | 100.0% | 10 | | glance_v2.delete_image | 2.882 | 7.771 | 9.363 | 9.774 | 10.185 | 7.184 | 100.0% | 10 | | total | 9.717 | 20.391 | 27.26 | 28.534 | 29.808 | 20.223 | 100.0% | 10 | | -> duration | 9.717 | 20.391 | 27.26 | 28.534 | 29.808 | 20.223 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 55.991141 Full duration: 89.854199 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.957 | 7.784 | 11.556 | 12.132 | 12.708 | 8.565 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.093 | 0.103 | 0.119 | 0.123 | 0.127 | 0.106 | 100.0% | 10 | | -> glance_v2.upload_data | 2.427 | 4.017 | 5.377 | 5.675 | 5.973 | 4.066 | 100.0% | 10 | | glance_v2.list_images | 0.057 | 0.064 | 0.077 | 0.08 | 0.083 | 0.066 | 100.0% | 10 | | total | 5.016 | 7.854 | 11.638 | 12.208 | 12.779 | 8.632 | 100.0% | 10 | | -> duration | 5.016 | 7.854 | 11.638 | 12.208 | 12.779 | 8.632 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.370521 Full duration: 60.724101 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.15 | 0.166 | 0.421 | 0.486 | 0.551 | 0.228 | 100.0% | 10 | | total | 0.15 | 0.167 | 0.421 | 0.486 | 0.551 | 0.228 | 100.0% | 10 | | -> duration | 0.15 | 0.167 | 0.421 | 0.486 | 0.551 | 0.228 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.174806 Full duration: 28.124723 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 8.287 | 10.523 | 18.099 | 18.531 | 18.963 | 12.229 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.105 | 0.21 | 0.255 | 0.3 | 0.133 | 100.0% | 10 | | -> glance_v2.upload_data | 5.507 | 6.597 | 10.853 | 11.113 | 11.372 | 7.588 | 100.0% | 10 | | nova.boot_servers | 98.467 | 129.427 | 146.759 | 149.486 | 152.214 | 125.831 | 100.0% | 10 | | total | 108.643 | 139.765 | 156.724 | 159.741 | 162.759 | 138.06 | 100.0% | 10 | | -> duration | 107.643 | 138.765 | 155.724 | 158.741 | 161.759 | 137.06 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 397.568158 Full duration: 609.069201 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c has 5 error(s) -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.41 | 6.041 | 6.111 | 6.12 | 6.128 | 5.896 | 100.0% | 5 | | -> glance_v2.get_image (x2) | 0.091 | 0.098 | 0.103 | 0.104 | 0.104 | 0.097 | 100.0% | 5 | | -> glance_v2.upload_data | 2.46 | 3.151 | 3.336 | 3.365 | 3.394 | 3.017 | 100.0% | 5 | | glance_v2.deactivate_image | 0.039 | 0.043 | 0.053 | 0.055 | 0.057 | 0.045 | 0.0% | 5 | | total | 5.453 | 6.098 | 6.15 | 6.158 | 6.167 | 5.941 | 0.0% | 5 | | -> duration | 5.453 | 6.098 | 6.15 | 6.158 | 6.167 | 5.941 | 0.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 5 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.971576 Full duration: 48.453672 HINTS: * To plot HTML graphics with this data, run: rally task report 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c --out output.html * To generate a JUnit report, run: rally task export 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c --json --out output.json At least one workload did not pass SLA criteria. 2020-12-09 16:31:41,400 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 580b044e-bbeb-48fb-8c09-59a7f7a8cf8c --out /home/opnfv/functest/results/rally_full/glance.json 2020-12-09 16:31:41,480 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2020-12-09 16:31:41,515 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 16:31:41,914 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-09 17:41:16,567 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 2020-12-09 17:41:17,924 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "size": 1, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 43.486 | 64.182 | 70.219 | 75.179 | 80.139 | 62.284 | 100.0% | 10 | | cinder_v3.create_volume | 4.119 | 15.536 | 20.117 | 20.159 | 20.201 | 13.883 | 100.0% | 10 | | nova.attach_volume | 17.219 | 27.92 | 61.04 | 64.368 | 67.696 | 33.273 | 100.0% | 10 | | nova.detach_volume | 8.557 | 11.339 | 17.308 | 21.828 | 26.348 | 12.97 | 100.0% | 10 | | cinder_v3.delete_volume | 7.168 | 16.445 | 21.551 | 22.487 | 23.422 | 16.191 | 100.0% | 10 | | nova.delete_server | 27.957 | 37.563 | 47.764 | 49.329 | 50.894 | 38.253 | 100.0% | 10 | | total | 149.633 | 174.249 | 207.17 | 211.233 | 215.296 | 176.855 | 100.0% | 10 | | -> duration | 148.633 | 173.249 | 206.17 | 210.233 | 214.296 | 175.855 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 538.996721 Full duration: 614.956373 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 6.705 | 7.764 | 9.54 | 9.548 | 9.556 | 7.948 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.036 | 0.042 | 0.046 | 0.047 | 0.047 | 0.041 | 100.0% | 10 | | total | 6.743 | 7.806 | 9.577 | 9.59 | 9.603 | 7.99 | 100.0% | 10 | | -> duration | 6.743 | 7.806 | 9.577 | 9.59 | 9.603 | 7.99 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.742262 Full duration: 92.507302 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 26.959 | 32.565 | 49.264 | 50.109 | 50.955 | 36.729 | 100.0% | 10 | | cinder_v3.list_volumes | 0.067 | 0.078 | 0.082 | 0.083 | 0.083 | 0.075 | 100.0% | 10 | | total | 27.039 | 32.645 | 49.333 | 50.178 | 51.023 | 36.804 | 100.0% | 10 | | -> duration | 27.039 | 32.645 | 49.333 | 50.178 | 51.023 | 36.804 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 104.145994 Full duration: 201.811118 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.636 | 16.856 | 25.92 | 26.8 | 27.68 | 17.048 | 100.0% | 10 | | cinder_v3.list_volumes | 0.064 | 0.071 | 0.077 | 0.077 | 0.077 | 0.071 | 100.0% | 10 | | total | 6.713 | 16.922 | 25.989 | 26.87 | 27.751 | 17.119 | 100.0% | 10 | | -> duration | 6.713 | 16.922 | 25.989 | 26.87 | 27.751 | 17.119 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.686042 Full duration: 107.155043 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.345 | 12.41 | 20.224 | 20.892 | 21.56 | 12.932 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 32.671 | 45.72 | 53.754 | 53.936 | 54.117 | 45.489 | 100.0% | 10 | | cinder_v3.delete_volume | 5.179 | 9.529 | 14.808 | 15.091 | 15.373 | 10.296 | 100.0% | 10 | | glance_v2.delete_image | 5.585 | 11.68 | 13.356 | 13.531 | 13.706 | 10.314 | 100.0% | 10 | | total | 56.085 | 80.087 | 91.836 | 92.663 | 93.489 | 79.032 | 100.0% | 10 | | -> duration | 56.085 | 80.087 | 91.836 | 92.663 | 93.489 | 79.032 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 232.627725 Full duration: 276.477638 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 41.744 | 65.997 | 86.625 | 88.563 | 90.501 | 66.954 | 100.0% | 10 | | cinder_v3.create_volume | 5.5 | 19.938 | 22.619 | 24.934 | 27.249 | 18.056 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.904 | 10.761 | 13.69 | 14.248 | 14.807 | 10.127 | 100.0% | 10 | | nova.attach_volume | 10.198 | 22.409 | 53.842 | 54.899 | 55.956 | 31.38 | 100.0% | 10 | | nova.detach_volume | 5.049 | 12.286 | 36.716 | 37.196 | 37.676 | 15.844 | 100.0% | 10 | | cinder_v3.delete_snapshot | 5.199 | 11.968 | 22.069 | 27.688 | 33.308 | 13.888 | 100.0% | 10 | | cinder_v3.delete_volume | 6.143 | 13.787 | 24.951 | 30.629 | 36.308 | 15.762 | 100.0% | 10 | | nova.delete_server | 23.176 | 26.781 | 30.264 | 31.243 | 32.221 | 26.949 | 100.0% | 10 | | total | 120.866 | 205.34 | 237.431 | 238.899 | 240.368 | 198.962 | 100.0% | 10 | | -> duration | 119.866 | 204.34 | 236.431 | 237.899 | 239.368 | 197.962 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 562.62536 Full duration: 638.76996 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.726 | 13.909 | 22.863 | 23.743 | 24.624 | 14.869 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.032 | 11.115 | 17.487 | 17.99 | 18.492 | 11.671 | 100.0% | 10 | | nova.boot_server | 46.969 | 63.282 | 68.862 | 70.776 | 72.69 | 61.773 | 100.0% | 10 | | nova.attach_volume | 8.497 | 16.939 | 24.407 | 30.743 | 37.079 | 18.732 | 100.0% | 10 | | nova.detach_volume | 3.817 | 5.285 | 6.688 | 7.26 | 7.832 | 5.399 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.499 | 5.273 | 9.236 | 9.534 | 9.833 | 5.836 | 100.0% | 10 | | cinder_v3.delete_volume | 2.297 | 7.241 | 11.837 | 13.413 | 14.989 | 7.623 | 100.0% | 10 | | nova.delete_server | 5.483 | 18.452 | 28.001 | 28.918 | 29.835 | 17.28 | 100.0% | 10 | | total | 107.706 | 143.578 | 165.612 | 169.901 | 174.19 | 143.184 | 100.0% | 10 | | -> duration | 106.706 | 142.578 | 164.612 | 168.901 | 173.19 | 142.184 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 396.699516 Full duration: 453.395097 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.335 | 14.019 | 23.173 | 24.29 | 25.406 | 15.612 | 100.0% | 10 | | total | 8.335 | 14.019 | 23.173 | 24.29 | 25.407 | 15.613 | 100.0% | 10 | | -> duration | 8.335 | 14.019 | 23.173 | 24.29 | 25.407 | 15.613 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.724917 Full duration: 126.742502 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.561 | 10.651 | 27.013 | 27.038 | 27.063 | 16.454 | 100.0% | 10 | | total | 8.561 | 10.651 | 27.013 | 27.039 | 27.064 | 16.454 | 100.0% | 10 | | -> duration | 8.561 | 10.651 | 27.013 | 27.039 | 27.064 | 16.454 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.165191 Full duration: 123.009516 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.614 | 0.778 | 1.305 | 1.385 | 1.465 | 0.87 | 100.0% | 10 | | total | 0.614 | 0.778 | 1.305 | 1.385 | 1.465 | 0.871 | 100.0% | 10 | | -> duration | 0.614 | 0.778 | 1.305 | 1.385 | 1.465 | 0.871 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.293579 Full duration: 144.229665 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 9.193 | 12.256 | 16.739 | 17.381 | 18.023 | 12.604 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.402 | 5.581 | 10.461 | 11.071 | 11.68 | 6.457 | 100.0% | 10 | | total | 12.092 | 20.692 | 22.513 | 23.252 | 23.991 | 19.062 | 100.0% | 10 | | -> duration | 12.092 | 20.692 | 22.513 | 23.252 | 23.991 | 19.062 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 55.840456 Full duration: 136.232242 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.675 | 11.27 | 14.891 | 14.964 | 15.037 | 10.825 | 100.0% | 10 | | cinder_v3.delete_volume | 2.737 | 11.562 | 13.16 | 14.115 | 15.07 | 9.666 | 100.0% | 10 | | total | 16.556 | 20.011 | 23.295 | 25.126 | 26.957 | 20.492 | 100.0% | 10 | | -> duration | 16.556 | 20.011 | 23.295 | 25.126 | 26.957 | 20.492 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.949622 Full duration: 95.265498 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 21.83 | 30.395 | 32.468 | 32.499 | 32.53 | 28.933 | 100.0% | 10 | | cinder_v3.delete_volume | 3.421 | 10.076 | 13.543 | 13.842 | 14.14 | 9.509 | 100.0% | 10 | | total | 27.602 | 40.948 | 43.124 | 43.381 | 43.637 | 38.443 | 100.0% | 10 | | -> duration | 27.602 | 40.948 | 43.124 | 43.381 | 43.637 | 38.443 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 109.485803 Full duration: 160.78026 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.05 | 23.419 | 27.108 | 28.61 | 30.112 | 23.14 | 100.0% | 10 | | cinder_v3.delete_volume | 7.577 | 18.311 | 27.628 | 27.827 | 28.027 | 19.006 | 100.0% | 10 | | total | 27.033 | 41.97 | 51.412 | 52.115 | 52.819 | 42.147 | 100.0% | 10 | | -> duration | 27.033 | 41.97 | 51.412 | 52.115 | 52.819 | 42.147 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 119.215968 Full duration: 187.826668 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 10.333 | 15.409 | 23.854 | 24.505 | 25.157 | 16.715 | 100.0% | 10 | | cinder_v3.extend_volume | 5.188 | 8.935 | 11.012 | 11.029 | 11.046 | 8.53 | 100.0% | 10 | | cinder_v3.delete_volume | 2.737 | 9.961 | 14.688 | 14.749 | 14.81 | 9.797 | 100.0% | 10 | | total | 26.491 | 37.559 | 40.192 | 42.886 | 45.58 | 35.043 | 100.0% | 10 | | -> duration | 26.491 | 37.559 | 40.192 | 42.886 | 45.58 | 35.043 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 99.777003 Full duration: 157.017347 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.239 | 10.869 | 12.893 | 12.957 | 13.021 | 10.827 | 100.0% | 10 | | cinder_v3.delete_volume | 4.883 | 6.444 | 7.304 | 8.209 | 9.114 | 6.283 | 100.0% | 10 | | total | 13.783 | 17.106 | 19.372 | 20.753 | 22.135 | 17.11 | 100.0% | 10 | | -> duration | 13.783 | 17.106 | 19.372 | 20.753 | 22.135 | 17.11 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.067811 Full duration: 143.649459 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.777 | 2.689 | 5.08 | 5.523 | 5.967 | 3.286 | 100.0% | 10 | | cinder_v3.get_qos | 0.027 | 0.034 | 0.048 | 0.052 | 0.057 | 0.037 | 100.0% | 10 | | total | 1.811 | 2.737 | 5.125 | 5.562 | 5.998 | 3.323 | 100.0% | 10 | | -> duration | 1.811 | 2.737 | 5.125 | 5.562 | 5.998 | 3.323 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.323762 Full duration: 56.874814 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.692 | 1.158 | 1.299 | 1.488 | 1.677 | 1.126 | 100.0% | 10 | | cinder_v3.list_qos | 0.036 | 0.042 | 0.047 | 0.052 | 0.057 | 0.043 | 100.0% | 10 | | total | 0.733 | 1.202 | 1.344 | 1.53 | 1.716 | 1.169 | 100.0% | 10 | | -> duration | 0.733 | 1.202 | 1.344 | 1.53 | 1.716 | 1.169 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.697514 Full duration: 49.19838 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.628 | 2.583 | 4.987 | 5.038 | 5.088 | 3.07 | 100.0% | 10 | | cinder_v3.set_qos | 1.668 | 1.811 | 4.04 | 4.212 | 4.384 | 2.285 | 100.0% | 10 | | total | 3.674 | 4.345 | 7.547 | 7.838 | 8.128 | 5.355 | 100.0% | 10 | | -> duration | 3.674 | 4.345 | 7.547 | 7.838 | 8.128 | 5.355 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.417603 Full duration: 73.949213 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.844 | 1.319 | 1.434 | 1.511 | 1.587 | 1.264 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.033 | 0.039 | 0.046 | 0.048 | 0.049 | 0.04 | 100.0% | 10 | | total | 0.878 | 1.356 | 1.482 | 1.553 | 1.623 | 1.303 | 100.0% | 10 | | -> duration | 0.878 | 1.356 | 1.482 | 1.553 | 1.623 | 1.303 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.050021 Full duration: 66.409603 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.733 | 1.803 | 3.388 | 3.489 | 3.589 | 2.003 | 100.0% | 10 | | cinder_v3.list_types | 0.038 | 0.047 | 0.051 | 0.056 | 0.061 | 0.047 | 100.0% | 10 | | total | 0.783 | 1.855 | 3.436 | 3.535 | 3.634 | 2.05 | 100.0% | 10 | | -> duration | 0.783 | 1.855 | 3.436 | 3.535 | 3.634 | 2.05 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.50055 Full duration: 41.962355 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.883 | 1.391 | 2.545 | 2.576 | 2.608 | 1.576 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.107 | 0.637 | 1.619 | 1.91 | 2.201 | 0.898 | 100.0% | 10 | | total | 1.186 | 2.119 | 3.999 | 4.046 | 4.092 | 2.474 | 100.0% | 10 | | -> duration | 1.186 | 2.119 | 3.999 | 4.046 | 4.092 | 2.474 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.843096 Full duration: 47.585787 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.798 | 0.965 | 1.395 | 1.614 | 1.834 | 1.061 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.109 | 0.81 | 1.208 | 1.371 | 1.534 | 0.784 | 100.0% | 10 | | total | 0.985 | 1.97 | 2.389 | 2.493 | 2.598 | 1.845 | 100.0% | 10 | | -> duration | 0.985 | 1.97 | 2.389 | 2.493 | 2.598 | 1.845 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.881385 Full duration: 51.043283 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.973 | 1.864 | 2.32 | 2.433 | 2.545 | 1.86 | 100.0% | 10 | | cinder_v2.add_type_access | 1.092 | 1.417 | 1.806 | 1.953 | 2.099 | 1.435 | 100.0% | 10 | | cinder_v2.list_type_access | 0.037 | 0.04 | 0.043 | 0.043 | 0.043 | 0.04 | 100.0% | 10 | | total | 2.362 | 3.41 | 3.785 | 3.932 | 4.079 | 3.336 | 100.0% | 10 | | -> duration | 2.362 | 3.41 | 3.785 | 3.932 | 4.079 | 3.336 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.770254 Full duration: 60.638764 HINTS: * To plot HTML graphics with this data, run: rally task report fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 --out output.html * To generate a JUnit report, run: rally task export fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 --json --out output.json 2020-12-09 17:41:21,105 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fedb4486-bbcc-4870-8d71-5cc1fd4df5f0 --out /home/opnfv/functest/results/rally_full/cinder.json 2020-12-09 17:41:21,139 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-09 17:41:21,167 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 17:41:21,605 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-09 18:39:49,867 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 35a44714-c29a-4f33-96a2-f3b487d3d924 2020-12-09 18:39:51,141 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 35a44714-c29a-4f33-96a2-f3b487d3d924 -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 9.97 | 17.264 | 18.527 | 18.942 | 19.357 | 16.163 | 100.0% | 10 | | heat.list_stacks | 0.058 | 0.069 | 0.099 | 0.192 | 0.285 | 0.091 | 100.0% | 10 | | total | 10.044 | 17.411 | 18.595 | 19.013 | 19.431 | 16.254 | 100.0% | 10 | | -> duration | 8.044 | 15.411 | 16.595 | 17.013 | 17.431 | 14.254 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.886812 Full duration: 173.084964 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 21.687 | 32.947 | 59.633 | 61.899 | 64.165 | 40.848 | 100.0% | 10 | | heat.update_stack | 15.258 | 19.625 | 64.304 | 64.564 | 64.824 | 35.78 | 100.0% | 10 | | heat.delete_stack | 9.697 | 16.656 | 61.932 | 62.521 | 63.109 | 32.731 | 100.0% | 10 | | total | 55.793 | 65.54 | 183.065 | 183.08 | 183.094 | 109.359 | 100.0% | 10 | | -> duration | 51.793 | 61.54 | 179.065 | 179.08 | 179.094 | 105.359 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 299.532366 Full duration: 354.11134 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 19.907 | 33.43 | 71.677 | 72.348 | 73.018 | 45.83 | 100.0% | 10 | | heat.update_stack | 9.028 | 25.385 | 41.926 | 41.986 | 42.046 | 27.602 | 100.0% | 10 | | heat.delete_stack | 5.094 | 22.008 | 35.431 | 35.727 | 36.023 | 23.392 | 100.0% | 10 | | total | 34.689 | 110.472 | 116.487 | 116.578 | 116.67 | 96.824 | 100.0% | 10 | | -> duration | 30.689 | 106.472 | 112.487 | 112.578 | 112.67 | 92.824 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 255.413162 Full duration: 302.120781 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 39.619 | 56.793 | 93.364 | 93.701 | 94.037 | 67.688 | 100.0% | 10 | | heat.update_stack | 31.231 | 39.998 | 50.459 | 50.675 | 50.891 | 41.786 | 100.0% | 10 | | heat.delete_stack | 22.403 | 50.388 | 52.317 | 52.641 | 52.964 | 45.582 | 100.0% | 10 | | total | 94.573 | 147.605 | 193.591 | 194.153 | 194.716 | 155.056 | 100.0% | 10 | | -> duration | 90.573 | 143.605 | 189.591 | 190.153 | 190.716 | 151.056 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 431.764011 Full duration: 478.579523 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 29.706 | 51.971 | 75.207 | 75.612 | 76.018 | 55.607 | 100.0% | 10 | | heat.update_stack | 20.577 | 33.92 | 65.776 | 67.172 | 68.568 | 43.895 | 100.0% | 10 | | heat.delete_stack | 20.579 | 34.347 | 42.056 | 42.109 | 42.161 | 32.36 | 100.0% | 10 | | total | 72.203 | 114.843 | 182.186 | 182.33 | 182.473 | 131.862 | 100.0% | 10 | | -> duration | 68.203 | 110.843 | 178.186 | 178.33 | 178.473 | 127.862 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 359.280957 Full duration: 419.576017 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 49.403 | 62.37 | 68.11 | 69.247 | 70.384 | 60.222 | 100.0% | 10 | | heat.update_stack | 18.957 | 25.299 | 53.504 | 53.854 | 54.203 | 34.187 | 100.0% | 10 | | heat.delete_stack | 29.811 | 35.701 | 42.814 | 54.187 | 65.561 | 38.487 | 100.0% | 10 | | total | 115.041 | 127.395 | 146.928 | 159.166 | 171.404 | 132.896 | 100.0% | 10 | | -> duration | 111.041 | 123.395 | 142.928 | 155.166 | 167.404 | 128.896 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 385.666684 Full duration: 443.020408 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 49.649 | 61.047 | 68.862 | 70.428 | 71.994 | 61.569 | 100.0% | 10 | | heat.update_stack | 16.162 | 50.554 | 54.517 | 54.863 | 55.208 | 44.66 | 100.0% | 10 | | heat.delete_stack | 10.809 | 28.474 | 47.355 | 47.44 | 47.524 | 31.512 | 100.0% | 10 | | total | 82.267 | 146.886 | 160.199 | 160.204 | 160.208 | 137.742 | 100.0% | 10 | | -> duration | 78.267 | 142.886 | 156.199 | 156.204 | 156.208 | 133.742 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 376.748152 Full duration: 428.718219 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.284 | 49.088 | 51.12 | 51.621 | 52.122 | 46.672 | 100.0% | 10 | | heat.check_stack | 6.711 | 19.198 | 21.672 | 22.342 | 23.012 | 17.636 | 100.0% | 10 | | heat.delete_stack | 15.333 | 25.195 | 47.617 | 49.909 | 52.202 | 31.651 | 100.0% | 10 | | total | 58.328 | 93.102 | 117.751 | 118.234 | 118.717 | 95.958 | 100.0% | 10 | | -> duration | 56.328 | 91.102 | 115.751 | 116.234 | 116.717 | 93.958 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 266.927531 Full duration: 332.573764 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.388 | 69.316 | 83.354 | 83.421 | 83.488 | 61.535 | 100.0% | 10 | | heat.suspend_stack | 1.542 | 26.441 | 32.516 | 32.754 | 32.991 | 21.027 | 100.0% | 10 | | heat.resume_stack | 8.932 | 15.298 | 34.379 | 34.563 | 34.747 | 17.856 | 100.0% | 10 | | heat.delete_stack | 17.905 | 23.328 | 42.296 | 42.748 | 43.2 | 27.098 | 100.0% | 10 | | total | 74.503 | 132.726 | 173.068 | 173.701 | 174.334 | 127.516 | 100.0% | 10 | | -> duration | 72.503 | 130.726 | 171.068 | 171.701 | 172.334 | 125.516 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 366.846077 Full duration: 435.879677 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 35a44714-c29a-4f33-96a2-f3b487d3d924 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.591 | 0.833 | 0.926 | 1.072 | 1.217 | 0.817 | 100.0% | 10 | | total | 0.591 | 0.833 | 0.927 | 1.072 | 1.217 | 0.817 | 100.0% | 10 | | -> duration | 0.591 | 0.833 | 0.927 | 1.072 | 1.217 | 0.817 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.365339 Full duration: 51.389037 HINTS: * To plot HTML graphics with this data, run: rally task report 35a44714-c29a-4f33-96a2-f3b487d3d924 --out output.html * To generate a JUnit report, run: rally task export 35a44714-c29a-4f33-96a2-f3b487d3d924 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 35a44714-c29a-4f33-96a2-f3b487d3d924 --json --out output.json 2020-12-09 18:39:54,195 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 35a44714-c29a-4f33-96a2-f3b487d3d924 --out /home/opnfv/functest/results/rally_full/heat.json 2020-12-09 18:39:54,214 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-09 18:39:54,240 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 18:39:54,763 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-09 18:57:50,573 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 20119fa2-7ae5-4460-b8e7-a313982f3dff 2020-12-09 18:57:51,826 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 20119fa2-7ae5-4460-b8e7-a313982f3dff -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.128 | 1.368 | 2.31 | 2.5 | 2.69 | 1.259 | 100.0% | 10 | | keystone_v3.add_role | 0.094 | 1.202 | 1.939 | 2.904 | 3.869 | 1.351 | 100.0% | 10 | | keystone_v3.revoke_role | 0.337 | 0.745 | 1.18 | 2.383 | 3.586 | 0.971 | 100.0% | 10 | | total | 0.559 | 3.476 | 6.506 | 6.672 | 6.838 | 3.581 | 100.0% | 10 | | -> duration | 0.559 | 3.476 | 6.506 | 6.672 | 6.838 | 3.581 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.942903 Full duration: 72.697821 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.198 | 0.398 | 0.941 | 1.252 | 1.563 | 0.534 | 100.0% | 10 | | keystone_v3.add_role | 0.106 | 0.385 | 0.849 | 1.016 | 1.184 | 0.45 | 100.0% | 10 | | keystone_v3.list_roles | 0.11 | 0.134 | 0.546 | 0.575 | 0.604 | 0.221 | 100.0% | 10 | | total | 0.72 | 1.105 | 1.79 | 1.833 | 1.877 | 1.205 | 100.0% | 10 | | -> duration | 0.72 | 1.105 | 1.79 | 1.833 | 1.877 | 1.205 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.203052 Full duration: 72.389563 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.577 | 2.023 | 3.243 | 3.287 | 3.331 | 1.994 | 100.0% | 10 | | keystone_v3.list_projects | 0.135 | 0.152 | 0.482 | 0.514 | 0.546 | 0.255 | 100.0% | 10 | | total | 0.845 | 2.254 | 3.511 | 3.659 | 3.806 | 2.249 | 100.0% | 10 | | -> duration | 0.845 | 2.254 | 3.511 | 3.659 | 3.806 | 2.249 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.452163 Full duration: 95.192011 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.962 | 3.438 | 5.308 | 6.179 | 7.049 | 3.368 | 100.0% | 10 | | keystone_v3.delete_role | 0.671 | 1.616 | 2.377 | 2.905 | 3.433 | 1.724 | 100.0% | 10 | | total | 2.18 | 5.12 | 6.848 | 7.872 | 8.897 | 5.092 | 100.0% | 10 | | -> duration | 2.18 | 5.12 | 6.848 | 7.872 | 8.897 | 5.092 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.022489 Full duration: 82.884057 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.14 | 0.697 | 2.445 | 3.527 | 4.61 | 1.225 | 100.0% | 10 | | keystone_v3.delete_service | 0.171 | 0.486 | 2.208 | 2.473 | 2.738 | 1.063 | 100.0% | 10 | | total | 0.311 | 1.588 | 5.124 | 5.942 | 6.76 | 2.288 | 100.0% | 10 | | -> duration | 0.311 | 1.588 | 5.124 | 5.942 | 6.76 | 2.288 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.904408 Full duration: 70.178635 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.651 | 2.511 | 5.591 | 6.079 | 6.567 | 2.8 | 100.0% | 10 | | keystone_v3.create_user | 1.313 | 2.658 | 7.498 | 11.818 | 16.138 | 4.226 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.053 | 0.093 | 0.231 | 0.352 | 0.474 | 0.135 | 100.0% | 10 | | -> keystone_v3.add_role | 0.467 | 0.908 | 2.931 | 5.133 | 7.335 | 1.75 | 100.0% | 10 | | keystone_v3.create_role | 0.1 | 1.23 | 6.577 | 6.621 | 6.665 | 2.091 | 100.0% | 10 | | keystone_v3.get_project | 0.031 | 0.043 | 0.153 | 0.203 | 0.252 | 0.071 | 100.0% | 10 | | keystone_v3.get_user | 0.034 | 0.045 | 0.993 | 3.927 | 6.862 | 0.763 | 100.0% | 10 | | keystone_v3.get_role | 0.037 | 0.044 | 0.755 | 3.648 | 6.542 | 0.699 | 100.0% | 10 | | keystone_v3.list_services | 0.043 | 0.047 | 0.447 | 0.452 | 0.458 | 0.137 | 100.0% | 10 | | keystone_v3.get_services | 0.034 | 0.043 | 0.634 | 1.216 | 1.798 | 0.279 | 100.0% | 10 | | total | 2.926 | 8.519 | 22.936 | 23.53 | 24.123 | 11.224 | 100.0% | 10 | | -> duration | 2.926 | 8.519 | 22.936 | 23.53 | 24.123 | 11.224 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.142599 Full duration: 140.670816 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.583 | 1.344 | 3.533 | 4.082 | 4.632 | 1.793 | 100.0% | 10 | | keystone_v3.update_project | 0.173 | 0.431 | 2.08 | 2.343 | 2.606 | 0.792 | 100.0% | 10 | | keystone_v3.delete_project | 0.339 | 1.21 | 3.742 | 4.219 | 4.696 | 1.799 | 100.0% | 10 | | total | 1.598 | 4.659 | 6.019 | 6.113 | 6.207 | 4.386 | 100.0% | 10 | | -> duration | 1.598 | 4.659 | 6.019 | 6.113 | 6.207 | 4.386 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.652584 Full duration: 65.237879 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.376 | 1.028 | 2.499 | 2.858 | 3.217 | 1.405 | 100.0% | 10 | | total | 0.445 | 1.109 | 2.577 | 2.928 | 3.279 | 1.486 | 100.0% | 10 | | -> duration | 0.445 | 1.109 | 2.577 | 2.928 | 3.279 | 1.486 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.473138 Full duration: 40.785068 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.323 | 1.358 | 2.131 | 2.148 | 2.166 | 1.285 | 100.0% | 10 | | total | 0.323 | 1.358 | 2.131 | 2.148 | 2.166 | 1.285 | 100.0% | 10 | | -> duration | 0.323 | 1.358 | 2.131 | 2.148 | 2.166 | 1.285 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.917119 Full duration: 42.27845 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.793 | 1.773 | 4.385 | 4.541 | 4.697 | 2.262 | 100.0% | 10 | | keystone_v3.list_users | 0.079 | 0.094 | 0.331 | 0.365 | 0.399 | 0.168 | 100.0% | 10 | | total | 0.984 | 2.095 | 4.566 | 4.719 | 4.873 | 2.509 | 100.0% | 10 | | -> duration | 0.984 | 2.095 | 4.566 | 4.719 | 4.873 | 2.509 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.541664 Full duration: 67.934213 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 20119fa2-7ae5-4460-b8e7-a313982f3dff has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.399 | 1.036 | 3.142 | 3.713 | 4.285 | 1.539 | 100.0% | 10 | | keystone_v3.create_users | 18.812 | 30.082 | 43.117 | 44.62 | 46.124 | 32.661 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 18.812 | 30.082 | 43.116 | 44.62 | 46.123 | 32.66 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.535 | 0.699 | 1.606 | 1.636 | 1.666 | 0.892 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 6.707 | 12.601 | 19.12 | 19.242 | 19.363 | 12.915 | 100.0% | 10 | | total | 21.163 | 32.71 | 53.59 | 53.721 | 53.852 | 37.606 | 100.0% | 10 | | -> duration | 21.163 | 32.71 | 53.59 | 53.721 | 53.852 | 37.606 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 111.156451 Full duration: 292.339278 HINTS: * To plot HTML graphics with this data, run: rally task report 20119fa2-7ae5-4460-b8e7-a313982f3dff --out output.html * To generate a JUnit report, run: rally task export 20119fa2-7ae5-4460-b8e7-a313982f3dff --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 20119fa2-7ae5-4460-b8e7-a313982f3dff --json --out output.json 2020-12-09 18:57:54,844 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 20119fa2-7ae5-4460-b8e7-a313982f3dff --out /home/opnfv/functest/results/rally_full/keystone.json 2020-12-09 18:57:54,867 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-09 18:57:54,898 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 18:57:55,454 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-09 19:24:01,731 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 4793229d-58bf-4fe4-9660-58b47c66a4db 2020-12-09 19:24:03,054 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4793229d-58bf-4fe4-9660-58b47c66a4db -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.65 | 7.724 | 11.214 | 11.342 | 11.47 | 7.672 | 100.0% | 10 | | neutron.update_network | 1.189 | 2.939 | 4.477 | 4.774 | 5.07 | 2.927 | 100.0% | 10 | | total | 4.839 | 11.444 | 14.923 | 15.129 | 15.336 | 10.599 | 100.0% | 10 | | -> duration | 4.839 | 11.444 | 14.923 | 15.129 | 15.336 | 10.599 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.779631 Full duration: 102.175911 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.465 | 4.259 | 5.697 | 5.744 | 5.79 | 4.566 | 100.0% | 10 | | neutron.update_port | 0.906 | 1.412 | 1.934 | 2.118 | 2.303 | 1.463 | 100.0% | 10 | | total | 5.007 | 5.546 | 7.683 | 7.684 | 7.684 | 6.029 | 100.0% | 10 | | -> duration | 5.007 | 5.546 | 7.683 | 7.684 | 7.684 | 6.029 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.115983 Full duration: 139.785398 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.305 | 4.076 | 5.622 | 6.113 | 6.603 | 4.433 | 100.0% | 10 | | neutron.create_subnet | 2.927 | 4.332 | 7.328 | 7.424 | 7.521 | 4.799 | 100.0% | 10 | | neutron.update_subnet | 0.819 | 1.576 | 3.844 | 4.434 | 5.025 | 2.289 | 100.0% | 10 | | total | 8.815 | 11.171 | 14.435 | 14.935 | 15.434 | 11.52 | 100.0% | 10 | | -> duration | 8.815 | 11.171 | 14.435 | 14.935 | 15.434 | 11.52 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.589288 Full duration: 93.867907 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.754 | 5.717 | 6.822 | 6.994 | 7.167 | 5.37 | 100.0% | 10 | | neutron.delete_network | 0.996 | 1.965 | 2.614 | 2.769 | 2.925 | 1.95 | 100.0% | 10 | | total | 3.757 | 7.802 | 8.761 | 8.969 | 9.178 | 7.32 | 100.0% | 10 | | -> duration | 3.757 | 7.802 | 8.761 | 8.969 | 9.178 | 7.32 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.237822 Full duration: 69.39566 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.99 | 10.621 | 23.17 | 23.249 | 23.329 | 12.031 | 100.0% | 10 | | neutron.delete_port | 1.167 | 3.997 | 12.01 | 12.71 | 13.411 | 5.544 | 100.0% | 10 | | total | 8.95 | 15.784 | 27.039 | 27.113 | 27.187 | 17.575 | 100.0% | 10 | | -> duration | 8.95 | 15.784 | 27.039 | 27.113 | 27.187 | 17.575 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.415202 Full duration: 133.936149 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.835 | 4.439 | 8.465 | 8.765 | 9.065 | 4.933 | 100.0% | 10 | | neutron.create_subnet | 2.562 | 3.76 | 5.634 | 7.026 | 8.417 | 4.228 | 100.0% | 10 | | neutron.delete_subnet | 0.75 | 1.921 | 3.648 | 4.475 | 5.303 | 2.173 | 100.0% | 10 | | total | 6.963 | 12.191 | 13.882 | 14.461 | 15.04 | 11.338 | 100.0% | 10 | | -> duration | 6.963 | 12.191 | 13.882 | 14.461 | 15.04 | 11.338 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.975142 Full duration: 107.235651 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.824 | 7.521 | 10.649 | 10.917 | 11.184 | 7.576 | 100.0% | 10 | | neutron.list_networks | 0.172 | 0.732 | 1.727 | 1.885 | 2.044 | 0.87 | 100.0% | 10 | | total | 3.996 | 8.318 | 10.832 | 11.109 | 11.385 | 8.446 | 100.0% | 10 | | -> duration | 3.996 | 8.318 | 10.832 | 11.109 | 11.385 | 8.446 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.432834 Full duration: 96.507589 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 5.739 | 7.441 | 11.174 | 11.181 | 11.189 | 8.264 | 100.0% | 10 | | neutron.list_ports | 0.101 | 0.15 | 1.267 | 1.564 | 1.861 | 0.579 | 100.0% | 10 | | total | 5.88 | 7.755 | 12.144 | 12.167 | 12.19 | 8.842 | 100.0% | 10 | | -> duration | 5.88 | 7.755 | 12.144 | 12.167 | 12.19 | 8.842 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.552704 Full duration: 122.996826 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.663 | 4.008 | 7.436 | 7.569 | 7.702 | 4.648 | 100.0% | 10 | | neutron.create_subnet | 2.51 | 6.203 | 10.511 | 10.899 | 11.287 | 6.705 | 100.0% | 10 | | neutron.list_subnets | 0.085 | 0.107 | 1.291 | 3.19 | 5.09 | 0.737 | 100.0% | 10 | | total | 7.846 | 10.969 | 15.586 | 17.026 | 18.466 | 12.09 | 100.0% | 10 | | -> duration | 7.846 | 10.969 | 15.586 | 17.026 | 18.466 | 12.09 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.760938 Full duration: 107.685497 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.733 | 4.326 | 11.016 | 11.114 | 11.213 | 6.25 | 100.0% | 10 | | neutron.delete_security_group | 0.402 | 1.062 | 1.687 | 1.772 | 1.857 | 1.076 | 100.0% | 10 | | total | 2.602 | 5.795 | 11.475 | 11.834 | 12.193 | 7.326 | 100.0% | 10 | | -> duration | 2.602 | 5.795 | 11.475 | 11.834 | 12.193 | 7.326 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.706991 Full duration: 78.248029 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.28 | 3.979 | 9.032 | 10.041 | 11.05 | 5.305 | 100.0% | 10 | | neutron.create_security_group_rule | 1.952 | 3.793 | 10.911 | 11.008 | 11.106 | 5.899 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.365 | 0.671 | 1.656 | 1.728 | 1.8 | 0.933 | 100.0% | 10 | | neutron.delete_security_group | 0.454 | 1.505 | 2.76 | 2.824 | 2.888 | 1.633 | 100.0% | 10 | | total | 6.978 | 10.713 | 21.49 | 21.863 | 22.236 | 13.771 | 100.0% | 10 | | -> duration | 6.978 | 10.713 | 21.49 | 21.863 | 22.236 | 13.771 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.657945 Full duration: 107.572042 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.93 | 7.671 | 9.812 | 10.598 | 11.383 | 7.597 | 100.0% | 10 | | neutron.create_security_group_rule | 2.689 | 6.264 | 12.95 | 13.515 | 14.081 | 7.734 | 100.0% | 10 | | neutron.list_security_group_rules | 0.089 | 0.287 | 1.017 | 1.026 | 1.036 | 0.424 | 100.0% | 10 | | total | 6.51 | 14.073 | 22.092 | 22.712 | 23.332 | 15.755 | 100.0% | 10 | | -> duration | 6.51 | 14.073 | 22.092 | 22.712 | 23.332 | 15.755 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.235157 Full duration: 113.902751 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.883 | 2.433 | 3.744 | 3.759 | 3.774 | 2.374 | 100.0% | 10 | | neutron.show_security_group | 0.06 | 0.079 | 0.114 | 0.164 | 0.214 | 0.094 | 100.0% | 10 | | total | 0.955 | 2.515 | 3.814 | 3.824 | 3.833 | 2.468 | 100.0% | 10 | | -> duration | 0.955 | 2.515 | 3.814 | 3.824 | 3.833 | 2.468 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.840951 Full duration: 67.424367 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 22.264787 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_routers args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 34.281243 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4793229d-58bf-4fe4-9660-58b47c66a4db has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 6.918 | 10.525 | 12.695 | 13.092 | 13.489 | 10.497 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.638 | 1.606 | 2.352 | 3.223 | 4.095 | 1.784 | 100.0% | 10 | | total | 8.221 | 12.086 | 15.034 | 15.234 | 15.433 | 12.282 | 100.0% | 10 | | -> duration | 8.221 | 12.086 | 15.034 | 15.234 | 15.433 | 12.282 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.926031 Full duration: 128.331281 HINTS: * To plot HTML graphics with this data, run: rally task report 4793229d-58bf-4fe4-9660-58b47c66a4db --out output.html * To generate a JUnit report, run: rally task export 4793229d-58bf-4fe4-9660-58b47c66a4db --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4793229d-58bf-4fe4-9660-58b47c66a4db --json --out output.json At least one workload did not pass SLA criteria. 2020-12-09 19:24:06,164 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4793229d-58bf-4fe4-9660-58b47c66a4db --out /home/opnfv/functest/results/rally_full/neutron.json 2020-12-09 19:24:06,188 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2020-12-09 19:24:06,226 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 19:24:06,684 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-09 19:48:40,321 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 8d4713e8-24eb-4a30-b20b-ad5d38465496 2020-12-09 19:48:41,572 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8d4713e8-24eb-4a30-b20b-ad5d38465496 -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.934 | 1.559 | 2.665 | 2.704 | 2.743 | 1.754 | 100.0% | 10 | | nova.delete_keypair | 0.178 | 1.154 | 2.192 | 2.545 | 2.899 | 1.362 | 100.0% | 10 | | total | 1.112 | 2.824 | 4.856 | 5.249 | 5.642 | 3.116 | 100.0% | 10 | | -> duration | 1.112 | 2.824 | 4.856 | 5.249 | 5.642 | 3.116 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.941692 Full duration: 78.328174 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.026 | 1.62 | 2.022 | 2.034 | 2.047 | 1.568 | 100.0% | 10 | | nova.list_keypairs | 0.034 | 0.047 | 0.069 | 0.1 | 0.132 | 0.053 | 100.0% | 10 | | total | 1.06 | 1.676 | 2.068 | 2.076 | 2.084 | 1.621 | 100.0% | 10 | | -> duration | 1.06 | 1.676 | 2.068 | 2.076 | 2.084 | 1.621 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.582521 Full duration: 62.520989 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 47.835999 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 48.182334 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 44.640529 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "from_image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "to_image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 54.805988 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 51.243455 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "volume_size": 1, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 26.26 | 45.176 | 48.565 | 49.371 | 50.177 | 42.085 | 100.0% | 10 | | nova.boot_server | 51.685 | 84.765 | 93.215 | 99.674 | 106.134 | 80.541 | 100.0% | 10 | | total | 97.212 | 126.757 | 133.146 | 136.53 | 139.914 | 122.627 | 100.0% | 10 | | -> duration | 96.212 | 125.757 | 132.146 | 135.53 | 138.914 | 121.627 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 352.176767 Full duration: 493.306624 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 48.209 | 62.963 | 80.949 | 83.519 | 86.089 | 64.839 | 100.0% | 10 | | total | 48.209 | 62.963 | 80.949 | 83.519 | 86.089 | 64.839 | 100.0% | 10 | | -> duration | 47.209 | 61.963 | 79.949 | 82.519 | 85.089 | 63.839 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 177.336926 Full duration: 276.613116 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 26.952557 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "image": { "name": "rally_full-img_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "to_flavor": { "name": "rally_full-flavor_alt_813f39fb-5c94-413e-b5aa-12dd1ec3c64d" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8d4713e8-24eb-4a30-b20b-ad5d38465496 has 5 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 34.317 | 57.581 | 59.838 | 60.135 | 60.431 | 52.917 | 100.0% | 5 | | nova.resize | 15.958 | 24.278 | 30.097 | 31.004 | 31.912 | 24.396 | 0.0% | 5 | | total | 50.275 | 80.037 | 89.935 | 91.139 | 92.343 | 77.312 | 0.0% | 5 | | -> duration | 49.275 | 79.037 | 88.935 | 90.139 | 91.343 | 76.312 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 126.873553 Full duration: 209.202294 HINTS: * To plot HTML graphics with this data, run: rally task report 8d4713e8-24eb-4a30-b20b-ad5d38465496 --out output.html * To generate a JUnit report, run: rally task export 8d4713e8-24eb-4a30-b20b-ad5d38465496 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8d4713e8-24eb-4a30-b20b-ad5d38465496 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-09 19:48:44,710 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8d4713e8-24eb-4a30-b20b-ad5d38465496 --out /home/opnfv/functest/results/rally_full/nova.json 2020-12-09 19:48:44,725 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-09 19:48:44,751 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 19:48:45,228 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-09 19:51:37,752 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 9a0aa385-1833-4d4c-8eb0-25b19b0c066b 2020-12-09 19:51:38,993 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 9a0aa385-1833-4d4c-8eb0-25b19b0c066b -------------------------------------------------------------------------------- Task 9a0aa385-1833-4d4c-8eb0-25b19b0c066b: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9a0aa385-1833-4d4c-8eb0-25b19b0c066b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.636 | 4.885 | 6.501 | 7.553 | 8.605 | 5.016 | 100.0% | 10 | | quotas.delete_quotas | 0.474 | 1.523 | 4.184 | 5.068 | 5.952 | 2.048 | 100.0% | 10 | | total | 3.899 | 6.249 | 10.307 | 11.068 | 11.83 | 7.065 | 100.0% | 10 | | -> duration | 3.899 | 6.249 | 10.307 | 11.068 | 11.83 | 7.065 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.653549 Full duration: 51.957212 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9a0aa385-1833-4d4c-8eb0-25b19b0c066b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.118 | 3.088 | 3.781 | 3.786 | 3.79 | 3.081 | 100.0% | 10 | | total | 2.118 | 3.088 | 3.781 | 3.786 | 3.79 | 3.081 | 100.0% | 10 | | -> duration | 2.118 | 3.088 | 3.781 | 3.786 | 3.79 | 3.081 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.328314 Full duration: 42.609906 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9a0aa385-1833-4d4c-8eb0-25b19b0c066b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.103 | 9.479 | 10.209 | 10.223 | 10.237 | 8.132 | 100.0% | 10 | | total | 4.103 | 9.479 | 10.209 | 10.223 | 10.237 | 8.132 | 100.0% | 10 | | -> duration | 4.103 | 9.479 | 10.209 | 10.223 | 10.237 | 8.132 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.060739 Full duration: 52.355892 HINTS: * To plot HTML graphics with this data, run: rally task report 9a0aa385-1833-4d4c-8eb0-25b19b0c066b --out output.html * To generate a JUnit report, run: rally task export 9a0aa385-1833-4d4c-8eb0-25b19b0c066b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 9a0aa385-1833-4d4c-8eb0-25b19b0c066b --json --out output.json 2020-12-09 19:51:42,020 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 9a0aa385-1833-4d4c-8eb0-25b19b0c066b --out /home/opnfv/functest/results/rally_full/quotas.json 2020-12-09 19:51:42,026 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-09 19:51:42,055 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 19:51:42,555 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-09 20:01:40,931 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: a482da0c-b9c8-42ae-9c65-1c9eab0222b6 2020-12-09 20:01:42,135 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a482da0c-b9c8-42ae-9c65-1c9eab0222b6 -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.915 | 1.173 | 1.436 | 1.48 | 1.523 | 1.179 | 100.0% | 10 | | swift.upload_object (x2) | 0.989 | 1.114 | 1.222 | 1.224 | 1.225 | 1.118 | 100.0% | 10 | | swift.list_objects | 0.896 | 0.968 | 1.025 | 1.034 | 1.044 | 0.967 | 100.0% | 10 | | total | 2.929 | 3.254 | 3.505 | 3.649 | 3.793 | 3.265 | 100.0% | 10 | | -> duration | 2.929 | 3.254 | 3.505 | 3.649 | 3.793 | 3.265 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.708198 Full duration: 113.836856 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.32 | 1.423 | 1.489 | 1.506 | 1.522 | 1.407 | 100.0% | 10 | | swift.list_objects | 0.92 | 1.013 | 1.048 | 1.051 | 1.054 | 1.005 | 100.0% | 10 | | total | 2.24 | 2.423 | 2.533 | 2.533 | 2.533 | 2.412 | 100.0% | 10 | | -> duration | 2.24 | 2.423 | 2.533 | 2.533 | 2.533 | 2.412 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.176969 Full duration: 80.843979 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.001 | 1.164 | 1.286 | 1.333 | 1.38 | 1.15 | 100.0% | 10 | | swift.upload_object (x5) | 2.675 | 2.802 | 2.874 | 2.904 | 2.933 | 2.792 | 100.0% | 10 | | swift.download_object (x5) | 2.358 | 2.508 | 2.625 | 2.656 | 2.687 | 2.508 | 100.0% | 10 | | total | 6.284 | 6.402 | 6.607 | 6.683 | 6.758 | 6.451 | 100.0% | 10 | | -> duration | 6.284 | 6.402 | 6.607 | 6.683 | 6.758 | 6.451 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.572441 Full duration: 159.771373 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.945 | 1.17 | 1.311 | 1.329 | 1.347 | 1.167 | 100.0% | 10 | | swift.upload_object (x5) | 2.578 | 2.812 | 2.945 | 2.965 | 2.984 | 2.781 | 100.0% | 10 | | swift.delete_object (x5) | 2.515 | 2.581 | 2.68 | 2.763 | 2.847 | 2.604 | 100.0% | 10 | | swift.delete_container | 0.524 | 0.639 | 0.746 | 0.771 | 0.795 | 0.648 | 100.0% | 10 | | total | 6.958 | 7.171 | 7.355 | 7.438 | 7.521 | 7.203 | 100.0% | 10 | | -> duration | 6.958 | 7.171 | 7.355 | 7.438 | 7.521 | 7.203 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.081752 Full duration: 123.275686 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a482da0c-b9c8-42ae-9c65-1c9eab0222b6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.33 | 1.477 | 1.59 | 1.628 | 1.666 | 1.48 | 100.0% | 10 | | swift.list_objects | 0.981 | 1.027 | 1.046 | 1.049 | 1.052 | 1.022 | 100.0% | 10 | | swift.download_object (x5) | 2.44 | 2.509 | 2.549 | 2.55 | 2.55 | 2.502 | 100.0% | 10 | | total | 4.909 | 4.983 | 5.102 | 5.103 | 5.104 | 5.004 | 100.0% | 10 | | -> duration | 4.909 | 4.983 | 5.102 | 5.103 | 5.104 | 5.004 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.099939 Full duration: 96.268851 HINTS: * To plot HTML graphics with this data, run: rally task report a482da0c-b9c8-42ae-9c65-1c9eab0222b6 --out output.html * To generate a JUnit report, run: rally task export a482da0c-b9c8-42ae-9c65-1c9eab0222b6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a482da0c-b9c8-42ae-9c65-1c9eab0222b6 --json --out output.json 2020-12-09 20:01:45,168 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a482da0c-b9c8-42ae-9c65-1c9eab0222b6 --out /home/opnfv/functest/results/rally_full/swift.json 2020-12-09 20:01:45,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-09 20:01:45,187 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:03:54 | 60 | 100.00% | | glance | 00:13:56 | 45 | 88.89% | | cinder | 01:08:27 | 240 | 100.00% | | heat | 00:56:59 | 100 | 100.00% | | keystone | 00:17:22 | 110 | 100.00% | | neutron | 00:25:25 | 140 | 100.00% | | nova | 00:23:13 | 45 | 88.89% | | quotas | 00:02:26 | 30 | 100.00% | | swift | 00:09:33 | 50 | 100.00% | | | | | | | TOTAL: | 03:41:20 | 820 | 98.78% | +----------------+------------+----------------+-----------+ 2020-12-09 20:01:45,187 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.78% in 6/9 modules 2020-12-09 20:01:48,912 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2020-12-09 20:01:52,340 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2020-12-09 20:01:52,341 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 229:28 | FAIL | +--------------------+------------------+------------------+----------------+