2021-03-10 16:53:32,140 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | EJL5QHAUSN23 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/EJL5QHAUSN23/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-201 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/EJL5QHAUSN23/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-201 | +-------------------------+------------------------------------------------------------+ 2021-03-10 16:53:32,158 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-03-10 16:53:35,449 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-03-10 16:53:41,855 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-03-10 16:53:48,236 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | ca66a062-1204-4eca-a2ff-9f5dbc1aa0e8 | 2021-03-10T16:53:47.966643 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ca66a062-1204-4eca-a2ff-9f5dbc1aa0e8 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-03-10 16:53:52,960 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-03-10 16:53:56,704 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 16:53:56,858 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-03-10 16:56:54,811 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: a7d2a827-816e-4a9b-84de-a7ea25dbc018 2021-03-10 16:56:56,070 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a7d2a827-816e-4a9b-84de-a7ea25dbc018 -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.916 | 1.386 | 1.595 | 1.612 | 1.63 | 1.32 | 100.0% | 10 | | total | 0.916 | 1.386 | 1.595 | 1.612 | 1.63 | 1.32 | 100.0% | 10 | | -> duration | 0.916 | 1.386 | 1.595 | 1.612 | 1.63 | 1.32 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.06492 Full duration: 28.637445 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.142 | 0.194 | 0.502 | 0.53 | 0.559 | 0.294 | 100.0% | 10 | | total | 0.559 | 1.114 | 1.21 | 1.233 | 1.257 | 0.946 | 100.0% | 10 | | -> duration | 0.559 | 1.114 | 1.21 | 1.233 | 1.257 | 0.946 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.421905 Full duration: 22.669583 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.245 | 0.376 | 0.585 | 0.655 | 0.724 | 0.415 | 100.0% | 10 | | total | 0.725 | 1.07 | 1.427 | 1.565 | 1.704 | 1.105 | 100.0% | 10 | | -> duration | 0.725 | 1.07 | 1.427 | 1.565 | 1.704 | 1.105 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.971943 Full duration: 23.728712 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.164 | 0.248 | 0.377 | 0.421 | 0.465 | 0.274 | 100.0% | 10 | | total | 0.623 | 0.949 | 1.246 | 1.364 | 1.482 | 0.947 | 100.0% | 10 | | -> duration | 0.623 | 0.949 | 1.246 | 1.364 | 1.482 | 0.947 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.669518 Full duration: 27.904881 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.387 | 0.491 | 0.762 | 0.874 | 0.986 | 0.568 | 100.0% | 10 | | total | 0.756 | 1.116 | 1.779 | 2.223 | 2.666 | 1.29 | 100.0% | 10 | | -> duration | 0.756 | 1.116 | 1.779 | 2.223 | 2.666 | 1.29 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.577251 Full duration: 29.162706 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7d2a827-816e-4a9b-84de-a7ea25dbc018 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.154 | 0.273 | 0.521 | 0.528 | 0.535 | 0.308 | 100.0% | 10 | | total | 0.554 | 0.912 | 1.29 | 1.304 | 1.317 | 0.929 | 100.0% | 10 | | -> duration | 0.554 | 0.912 | 1.29 | 1.304 | 1.317 | 0.929 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.51617 Full duration: 23.972592 HINTS: * To plot HTML graphics with this data, run: rally task report a7d2a827-816e-4a9b-84de-a7ea25dbc018 --out output.html * To generate a JUnit report, run: rally task export a7d2a827-816e-4a9b-84de-a7ea25dbc018 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a7d2a827-816e-4a9b-84de-a7ea25dbc018 --json --out output.json 2021-03-10 16:56:59,140 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a7d2a827-816e-4a9b-84de-a7ea25dbc018 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-03-10 16:56:59,149 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-03-10 16:56:59,180 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 16:56:59,349 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-03-10 17:00:51,763 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 1229efaf-9760-4f58-bf3b-e9aaabffbe5c 2021-03-10 17:00:52,999 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 1229efaf-9760-4f58-bf3b-e9aaabffbe5c -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.086 | 6.135 | 7.013 | 7.083 | 7.153 | 6.076 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.107 | 0.15 | 0.152 | 0.154 | 0.118 | 100.0% | 10 | | -> glance_v2.upload_data | 2.461 | 3.015 | 4.001 | 4.245 | 4.49 | 3.152 | 100.0% | 10 | | glance_v2.delete_image | 1.94 | 2.671 | 3.332 | 3.415 | 3.497 | 2.712 | 100.0% | 10 | | total | 7.026 | 8.804 | 10.47 | 10.482 | 10.495 | 8.788 | 100.0% | 10 | | -> duration | 7.026 | 8.804 | 10.47 | 10.482 | 10.495 | 8.788 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.829837 Full duration: 53.68561 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.244 | 5.736 | 6.023 | 6.285 | 6.548 | 5.781 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.095 | 0.103 | 0.111 | 0.115 | 0.118 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 2.249 | 3.061 | 3.299 | 3.577 | 3.854 | 2.996 | 100.0% | 10 | | glance_v2.list_images | 0.053 | 0.06 | 0.071 | 0.072 | 0.073 | 0.062 | 100.0% | 10 | | total | 5.302 | 5.796 | 6.093 | 6.352 | 6.611 | 5.843 | 100.0% | 10 | | -> duration | 5.302 | 5.796 | 6.093 | 6.352 | 6.611 | 5.843 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.39739 Full duration: 53.972291 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.148 | 0.235 | 0.674 | 0.705 | 0.736 | 0.301 | 100.0% | 10 | | total | 0.148 | 0.235 | 0.674 | 0.705 | 0.736 | 0.301 | 100.0% | 10 | | -> duration | 0.148 | 0.235 | 0.674 | 0.705 | 0.736 | 0.301 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.425748 Full duration: 24.39634 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 18.949275 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1229efaf-9760-4f58-bf3b-e9aaabffbe5c has 5 error(s) -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run service.deactivate_image(image.id) File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image self._clients.glance("2").images.deactivate(image_id) File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate resp, body = self.http_client.post(url) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action. -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 8.48 | 12.674 | 13.442 | 13.443 | 13.444 | 11.467 | 100.0% | 5 | | -> glance_v2.get_image (x2) | 0.099 | 0.105 | 0.114 | 0.115 | 0.116 | 0.107 | 100.0% | 5 | | -> glance_v2.upload_data | 2.652 | 5.713 | 6.606 | 6.684 | 6.762 | 5.145 | 100.0% | 5 | | glance_v2.deactivate_image | 0.033 | 0.037 | 0.04 | 0.04 | 0.04 | 0.037 | 0.0% | 5 | | total | 8.517 | 12.714 | 13.479 | 13.48 | 13.48 | 11.504 | 0.0% | 5 | | -> duration | 8.517 | 12.714 | 13.479 | 13.48 | 13.48 | 11.504 | 0.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 5 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.886258 Full duration: 53.183228 HINTS: * To plot HTML graphics with this data, run: rally task report 1229efaf-9760-4f58-bf3b-e9aaabffbe5c --out output.html * To generate a JUnit report, run: rally task export 1229efaf-9760-4f58-bf3b-e9aaabffbe5c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1229efaf-9760-4f58-bf3b-e9aaabffbe5c --json --out output.json At least one workload did not pass SLA criteria. 2021-03-10 17:00:55,988 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 1229efaf-9760-4f58-bf3b-e9aaabffbe5c --out /home/opnfv/functest/results/rally_full/glance.json 2021-03-10 17:00:56,000 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-03-10 17:00:56,043 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 17:00:56,457 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-03-10 17:44:50,398 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: fe660c1c-6340-463e-b0de-a75df2aba7d2 2021-03-10 17:44:51,730 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fe660c1c-6340-463e-b0de-a75df2aba7d2 -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "size": 1, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 32.019 | 35.573 | 46.334 | 48.596 | 50.858 | 38.196 | 100.0% | 10 | | cinder_v3.create_volume | 3.828 | 7.679 | 11.198 | 12.68 | 14.163 | 8.237 | 100.0% | 10 | | nova.attach_volume | 8.532 | 12.811 | 15.142 | 15.831 | 16.52 | 12.548 | 100.0% | 10 | | nova.detach_volume | 1.364 | 5.39 | 7.802 | 8.213 | 8.624 | 5.34 | 100.0% | 10 | | cinder_v3.delete_volume | 2.694 | 7.064 | 11.036 | 11.559 | 12.081 | 7.216 | 100.0% | 10 | | nova.delete_server | 7.81 | 17.103 | 21.89 | 22.365 | 22.84 | 16.706 | 100.0% | 10 | | total | 59.823 | 90.537 | 103.611 | 105.452 | 107.294 | 88.244 | 100.0% | 10 | | -> duration | 58.823 | 89.537 | 102.611 | 104.452 | 106.294 | 87.244 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 247.318863 Full duration: 289.408767 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.538 | 5.503 | 7.314 | 8.165 | 9.016 | 5.761 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.037 | 0.044 | 0.056 | 0.056 | 0.057 | 0.045 | 100.0% | 10 | | total | 3.594 | 5.546 | 7.36 | 8.21 | 9.059 | 5.806 | 100.0% | 10 | | -> duration | 3.594 | 5.546 | 7.36 | 8.21 | 9.059 | 5.806 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.411782 Full duration: 80.35915 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.683 | 20.663 | 22.883 | 23.038 | 23.192 | 20.597 | 100.0% | 10 | | cinder_v3.list_volumes | 0.07 | 0.076 | 0.117 | 0.179 | 0.24 | 0.095 | 100.0% | 10 | | total | 17.756 | 20.736 | 22.959 | 23.112 | 23.265 | 20.692 | 100.0% | 10 | | -> duration | 17.756 | 20.736 | 22.959 | 23.112 | 23.265 | 20.692 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 58.533899 Full duration: 106.151552 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.196 | 8.673 | 10.348 | 10.868 | 11.388 | 8.149 | 100.0% | 10 | | cinder_v3.list_volumes | 0.067 | 0.073 | 0.111 | 0.129 | 0.147 | 0.082 | 100.0% | 10 | | total | 4.271 | 8.762 | 10.423 | 10.942 | 11.461 | 8.232 | 100.0% | 10 | | -> duration | 4.271 | 8.762 | 10.423 | 10.942 | 11.461 | 8.232 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.270598 Full duration: 71.095575 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.007 | 3.938 | 7.423 | 7.726 | 8.03 | 5.041 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 34.273 | 58.378 | 63.878 | 63.891 | 63.903 | 56.212 | 100.0% | 10 | | cinder_v3.delete_volume | 2.28 | 2.714 | 6.364 | 6.431 | 6.498 | 4.004 | 100.0% | 10 | | glance_v2.delete_image | 5.268 | 6.698 | 7.908 | 8.063 | 8.217 | 6.754 | 100.0% | 10 | | total | 50.957 | 75.97 | 81.083 | 81.307 | 81.531 | 72.011 | 100.0% | 10 | | -> duration | 50.957 | 75.97 | 81.083 | 81.307 | 81.531 | 72.011 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 205.635365 Full duration: 242.811448 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 30.248 | 44.119 | 57.899 | 58.602 | 59.304 | 44.741 | 100.0% | 10 | | cinder_v3.create_volume | 3.245 | 12.952 | 18.147 | 19.414 | 20.68 | 12.12 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.415 | 7.911 | 10.718 | 12.101 | 13.484 | 8.097 | 100.0% | 10 | | nova.attach_volume | 6.854 | 22.52 | 24.381 | 25.075 | 25.768 | 19.157 | 100.0% | 10 | | nova.detach_volume | 3.566 | 5.701 | 8.333 | 8.468 | 8.604 | 5.781 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.361 | 5.829 | 8.089 | 10.538 | 12.987 | 6.038 | 100.0% | 10 | | cinder_v3.delete_volume | 2.889 | 9.149 | 13.124 | 13.987 | 14.849 | 9.129 | 100.0% | 10 | | nova.delete_server | 8.377 | 16.433 | 23.93 | 24.165 | 24.399 | 17.429 | 100.0% | 10 | | total | 82.406 | 122.434 | 149.14 | 153.206 | 157.271 | 122.494 | 100.0% | 10 | | -> duration | 81.406 | 121.434 | 148.14 | 152.206 | 156.271 | 121.494 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 338.641225 Full duration: 385.273827 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.815 | 11.393 | 19.695 | 20.557 | 21.418 | 12.466 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.055 | 8.401 | 14.036 | 15.792 | 17.548 | 9.207 | 100.0% | 10 | | nova.boot_server | 27.376 | 58.898 | 67.647 | 69.458 | 71.269 | 52.634 | 100.0% | 10 | | nova.attach_volume | 4.85 | 15.568 | 27.813 | 29.8 | 31.787 | 16.88 | 100.0% | 10 | | nova.detach_volume | 3.501 | 6.257 | 11.372 | 11.939 | 12.506 | 6.846 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.405 | 4.582 | 8.06 | 8.578 | 9.095 | 5.097 | 100.0% | 10 | | cinder_v3.delete_volume | 2.638 | 9.201 | 14.226 | 14.261 | 14.296 | 8.594 | 100.0% | 10 | | nova.delete_server | 5.386 | 22.04 | 23.946 | 25.158 | 26.369 | 19.189 | 100.0% | 10 | | total | 79.982 | 134.542 | 160.821 | 167.255 | 173.689 | 130.913 | 100.0% | 10 | | -> duration | 78.982 | 133.542 | 159.821 | 166.255 | 172.689 | 129.913 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 366.097959 Full duration: 404.239653 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.197 | 7.924 | 8.396 | 8.537 | 8.678 | 7.715 | 100.0% | 10 | | total | 6.197 | 7.924 | 8.397 | 8.537 | 8.678 | 7.715 | 100.0% | 10 | | -> duration | 6.197 | 7.924 | 8.397 | 8.537 | 8.678 | 7.715 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.66874 Full duration: 61.925935 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.486 | 7.868 | 13.78 | 14.317 | 14.853 | 9.253 | 100.0% | 10 | | total | 5.486 | 7.868 | 13.78 | 14.317 | 14.853 | 9.253 | 100.0% | 10 | | -> duration | 5.486 | 7.868 | 13.78 | 14.317 | 14.853 | 9.253 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.712936 Full duration: 67.599626 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.535 | 0.695 | 1.254 | 1.283 | 1.311 | 0.836 | 100.0% | 10 | | total | 0.535 | 0.695 | 1.254 | 1.283 | 1.311 | 0.836 | 100.0% | 10 | | -> duration | 0.535 | 0.695 | 1.254 | 1.283 | 1.311 | 0.836 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.590401 Full duration: 95.425482 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.174 | 6.937 | 7.927 | 8.34 | 8.752 | 6.623 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.232 | 3.292 | 5.406 | 5.903 | 6.4 | 3.774 | 100.0% | 10 | | total | 6.452 | 10.395 | 13.547 | 13.599 | 13.65 | 10.397 | 100.0% | 10 | | -> duration | 6.452 | 10.395 | 13.547 | 13.599 | 13.65 | 10.397 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.871762 Full duration: 91.17457 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.444 | 8.396 | 9.925 | 10.911 | 11.897 | 8.088 | 100.0% | 10 | | cinder_v3.delete_volume | 2.588 | 5.134 | 8.985 | 9.1 | 9.215 | 5.592 | 100.0% | 10 | | total | 8.267 | 11.384 | 18.751 | 19.305 | 19.858 | 13.68 | 100.0% | 10 | | -> duration | 8.267 | 11.384 | 18.751 | 19.305 | 19.858 | 13.68 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.126775 Full duration: 71.023815 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.164 | 17.4 | 21.855 | 22.083 | 22.31 | 18.59 | 100.0% | 10 | | cinder_v3.delete_volume | 2.794 | 5.9 | 7.742 | 7.77 | 7.797 | 5.719 | 100.0% | 10 | | total | 17.958 | 24.399 | 27.209 | 27.901 | 28.592 | 24.31 | 100.0% | 10 | | -> duration | 17.958 | 24.399 | 27.209 | 27.901 | 28.592 | 24.31 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.646329 Full duration: 106.016981 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.463 | 6.451 | 9.378 | 11.943 | 14.508 | 7.166 | 100.0% | 10 | | cinder_v3.delete_volume | 2.602 | 3.06 | 16.353 | 16.948 | 17.544 | 7.585 | 100.0% | 10 | | total | 6.095 | 10.031 | 25.097 | 25.724 | 26.352 | 14.751 | 100.0% | 10 | | -> duration | 6.095 | 10.031 | 25.097 | 25.724 | 26.352 | 14.751 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.378647 Full duration: 69.964948 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.287 | 8.068 | 10.125 | 10.472 | 10.819 | 7.375 | 100.0% | 10 | | cinder_v3.extend_volume | 2.635 | 3.346 | 4.514 | 5.412 | 6.311 | 3.645 | 100.0% | 10 | | cinder_v3.delete_volume | 2.463 | 4.436 | 7.603 | 8.407 | 9.212 | 4.852 | 100.0% | 10 | | total | 11.303 | 16.308 | 19.815 | 20.288 | 20.762 | 15.872 | 100.0% | 10 | | -> duration | 11.303 | 16.308 | 19.815 | 20.288 | 20.762 | 15.872 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.283219 Full duration: 74.088623 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.137 | 9.899 | 12.547 | 15.493 | 18.44 | 10.34 | 100.0% | 10 | | cinder_v3.delete_volume | 2.895 | 6.081 | 10.802 | 11.191 | 11.579 | 6.98 | 100.0% | 10 | | total | 11.091 | 16.621 | 23.165 | 25.341 | 27.518 | 17.321 | 100.0% | 10 | | -> duration | 11.091 | 16.621 | 23.165 | 25.341 | 27.518 | 17.321 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.918864 Full duration: 104.648942 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.625 | 0.727 | 1.644 | 1.787 | 1.93 | 0.927 | 100.0% | 10 | | cinder_v3.get_qos | 0.028 | 0.039 | 0.05 | 0.052 | 0.054 | 0.04 | 100.0% | 10 | | total | 0.665 | 0.769 | 1.679 | 1.819 | 1.959 | 0.967 | 100.0% | 10 | | -> duration | 0.665 | 0.769 | 1.679 | 1.819 | 1.959 | 0.967 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.519167 Full duration: 32.497831 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.709 | 1.202 | 1.582 | 1.592 | 1.601 | 1.181 | 100.0% | 10 | | cinder_v3.list_qos | 0.039 | 0.042 | 0.048 | 0.049 | 0.049 | 0.043 | 100.0% | 10 | | total | 0.755 | 1.246 | 1.621 | 1.631 | 1.64 | 1.224 | 100.0% | 10 | | -> duration | 0.755 | 1.246 | 1.621 | 1.631 | 1.64 | 1.224 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.843512 Full duration: 28.374673 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.986 | 1.45 | 1.833 | 2.08 | 2.326 | 1.487 | 100.0% | 10 | | cinder_v3.set_qos | 0.065 | 0.4 | 1.121 | 1.133 | 1.144 | 0.535 | 100.0% | 10 | | total | 1.051 | 1.953 | 2.802 | 2.806 | 2.81 | 2.022 | 100.0% | 10 | | -> duration | 1.051 | 1.953 | 2.802 | 2.806 | 2.81 | 2.022 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.61965 Full duration: 34.427716 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.599 | 1.021 | 1.184 | 1.259 | 1.334 | 0.957 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.031 | 0.037 | 0.043 | 0.045 | 0.046 | 0.038 | 100.0% | 10 | | total | 0.642 | 1.062 | 1.22 | 1.295 | 1.371 | 0.995 | 100.0% | 10 | | -> duration | 0.642 | 1.062 | 1.22 | 1.295 | 1.371 | 0.995 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.960487 Full duration: 30.047745 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.626 | 0.826 | 1.401 | 1.592 | 1.782 | 0.995 | 100.0% | 10 | | cinder_v3.list_types | 0.033 | 0.047 | 0.057 | 0.057 | 0.057 | 0.046 | 100.0% | 10 | | total | 0.682 | 0.868 | 1.437 | 1.636 | 1.835 | 1.041 | 100.0% | 10 | | -> duration | 0.682 | 0.868 | 1.437 | 1.636 | 1.835 | 1.041 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.734693 Full duration: 29.339918 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.647 | 1.132 | 1.357 | 1.358 | 1.358 | 1.063 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.267 | 0.527 | 0.734 | 0.735 | 0.736 | 0.512 | 100.0% | 10 | | total | 1.008 | 1.62 | 1.87 | 1.887 | 1.904 | 1.576 | 100.0% | 10 | | -> duration | 1.008 | 1.62 | 1.87 | 1.887 | 1.904 | 1.576 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.705711 Full duration: 31.756153 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.655 | 0.961 | 1.097 | 1.172 | 1.248 | 0.961 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.112 | 0.281 | 0.498 | 0.621 | 0.743 | 0.317 | 100.0% | 10 | | total | 1.033 | 1.209 | 1.665 | 1.675 | 1.685 | 1.277 | 100.0% | 10 | | -> duration | 1.033 | 1.209 | 1.665 | 1.675 | 1.685 | 1.277 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.410024 Full duration: 33.089166 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fe660c1c-6340-463e-b0de-a75df2aba7d2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.598 | 1.121 | 2.105 | 2.117 | 2.13 | 1.217 | 100.0% | 10 | | cinder_v2.add_type_access | 0.063 | 0.179 | 0.586 | 0.602 | 0.617 | 0.26 | 100.0% | 10 | | cinder_v2.list_type_access | 0.037 | 0.043 | 0.057 | 0.063 | 0.068 | 0.045 | 100.0% | 10 | | total | 0.704 | 1.521 | 2.244 | 2.249 | 2.254 | 1.522 | 100.0% | 10 | | -> duration | 0.704 | 1.521 | 2.244 | 2.249 | 2.254 | 1.522 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.051067 Full duration: 33.114741 HINTS: * To plot HTML graphics with this data, run: rally task report fe660c1c-6340-463e-b0de-a75df2aba7d2 --out output.html * To generate a JUnit report, run: rally task export fe660c1c-6340-463e-b0de-a75df2aba7d2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fe660c1c-6340-463e-b0de-a75df2aba7d2 --json --out output.json 2021-03-10 17:44:54,868 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fe660c1c-6340-463e-b0de-a75df2aba7d2 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-03-10 17:44:54,942 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-03-10 17:44:54,972 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 17:44:55,419 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-03-10 18:38:40,932 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 515e55f0-01cd-45f3-9e49-19bbcc1577ea 2021-03-10 18:38:42,165 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 515e55f0-01cd-45f3-9e49-19bbcc1577ea -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.226 | 15.183 | 19.813 | 20.119 | 20.425 | 14.005 | 100.0% | 10 | | heat.list_stacks | 0.059 | 0.064 | 0.076 | 0.078 | 0.079 | 0.067 | 100.0% | 10 | | total | 7.289 | 15.254 | 19.882 | 20.186 | 20.49 | 14.072 | 100.0% | 10 | | -> duration | 5.289 | 13.254 | 17.882 | 18.186 | 18.49 | 12.072 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.615765 Full duration: 124.564831 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 29.28 | 41.331 | 59.658 | 61.646 | 63.635 | 44.88 | 100.0% | 10 | | heat.update_stack | 14.77 | 37.756 | 43.84 | 43.854 | 43.869 | 34.973 | 100.0% | 10 | | heat.delete_stack | 23.408 | 34.956 | 39.357 | 39.935 | 40.513 | 32.675 | 100.0% | 10 | | total | 81.807 | 115.354 | 130.349 | 131.659 | 132.969 | 112.528 | 100.0% | 10 | | -> duration | 77.807 | 111.354 | 126.349 | 127.659 | 128.969 | 108.528 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 316.911705 Full duration: 359.411638 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 17.896 | 27.511 | 65.486 | 68.889 | 72.291 | 39.3 | 100.0% | 10 | | heat.update_stack | 5.408 | 26.163 | 35.123 | 36.198 | 37.272 | 24.323 | 100.0% | 10 | | heat.delete_stack | 4.877 | 22.388 | 24.964 | 26.168 | 27.372 | 19.471 | 100.0% | 10 | | total | 39.623 | 69.41 | 121.325 | 123.783 | 126.241 | 83.094 | 100.0% | 10 | | -> duration | 35.623 | 65.41 | 117.325 | 119.783 | 122.241 | 79.094 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 220.850622 Full duration: 263.466044 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 46.899 | 72.921 | 77.024 | 78.499 | 79.974 | 64.629 | 100.0% | 10 | | heat.update_stack | 32.478 | 64.75 | 77.801 | 78.213 | 78.624 | 62.636 | 100.0% | 10 | | heat.delete_stack | 35.592 | 58.957 | 70.257 | 71.167 | 72.077 | 56.244 | 100.0% | 10 | | total | 146.504 | 171.183 | 224.693 | 225.735 | 226.777 | 183.51 | 100.0% | 10 | | -> duration | 142.504 | 167.183 | 220.693 | 221.735 | 222.777 | 179.51 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 518.916707 Full duration: 563.448588 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.031 | 47.356 | 80.495 | 82.191 | 83.888 | 57.845 | 100.0% | 10 | | heat.update_stack | 14.162 | 50.699 | 53.603 | 54.057 | 54.512 | 44.222 | 100.0% | 10 | | heat.delete_stack | 22.189 | 39.642 | 54.178 | 55.055 | 55.932 | 39.655 | 100.0% | 10 | | total | 79.642 | 155.26 | 166.582 | 167.39 | 168.198 | 141.723 | 100.0% | 10 | | -> duration | 75.642 | 151.26 | 162.582 | 163.39 | 164.198 | 137.723 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 389.046892 Full duration: 431.830092 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 45.553 | 54.806 | 96.912 | 99.024 | 101.135 | 66.748 | 100.0% | 10 | | heat.update_stack | 18.681 | 46.86 | 59.742 | 61.743 | 63.744 | 46.298 | 100.0% | 10 | | heat.delete_stack | 20.099 | 43.687 | 55.188 | 55.95 | 56.712 | 42.391 | 100.0% | 10 | | total | 95.9 | 149.418 | 197.503 | 199.199 | 200.894 | 155.437 | 100.0% | 10 | | -> duration | 91.9 | 145.418 | 193.503 | 195.199 | 196.894 | 151.437 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 430.835928 Full duration: 472.476032 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.889 | 52.908 | 55.503 | 55.708 | 55.913 | 43.493 | 100.0% | 10 | | heat.update_stack | 24.159 | 37.58 | 48.836 | 49.392 | 49.947 | 38.801 | 100.0% | 10 | | heat.delete_stack | 13.311 | 25.208 | 28.715 | 30.261 | 31.806 | 24.002 | 100.0% | 10 | | total | 83.256 | 98.538 | 131.926 | 132.532 | 133.138 | 106.296 | 100.0% | 10 | | -> duration | 79.256 | 94.538 | 127.926 | 128.532 | 129.138 | 102.296 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 303.125588 Full duration: 343.779147 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 20.719 | 36.024 | 47.813 | 48.263 | 48.713 | 36.073 | 100.0% | 10 | | heat.check_stack | 6.618 | 9.709 | 13.801 | 15.301 | 16.801 | 10.518 | 100.0% | 10 | | heat.delete_stack | 8.518 | 17.982 | 21.204 | 21.596 | 21.988 | 16.981 | 100.0% | 10 | | total | 45.606 | 56.185 | 81.557 | 81.893 | 82.229 | 63.572 | 100.0% | 10 | | -> duration | 43.606 | 54.185 | 79.557 | 79.893 | 80.229 | 61.572 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 183.937688 Full duration: 223.676302 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 17.934 | 38.184 | 50.607 | 52.114 | 53.622 | 38.457 | 100.0% | 10 | | heat.suspend_stack | 13.271 | 18.218 | 24.332 | 27.527 | 30.723 | 20.086 | 100.0% | 10 | | heat.resume_stack | 12.735 | 19.479 | 21.85 | 22.026 | 22.202 | 17.91 | 100.0% | 10 | | heat.delete_stack | 14.928 | 21.316 | 26.331 | 28.336 | 30.341 | 21.705 | 100.0% | 10 | | total | 65.874 | 95.508 | 120.431 | 121.071 | 121.711 | 98.158 | 100.0% | 10 | | -> duration | 63.874 | 93.508 | 118.431 | 119.071 | 119.711 | 96.158 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 290.40206 Full duration: 329.913398 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 515e55f0-01cd-45f3-9e49-19bbcc1577ea has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.503 | 0.858 | 1.099 | 1.239 | 1.379 | 0.88 | 100.0% | 10 | | total | 0.503 | 0.858 | 1.099 | 1.239 | 1.379 | 0.88 | 100.0% | 10 | | -> duration | 0.503 | 0.858 | 1.099 | 1.239 | 1.379 | 0.88 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.394887 Full duration: 38.944707 HINTS: * To plot HTML graphics with this data, run: rally task report 515e55f0-01cd-45f3-9e49-19bbcc1577ea --out output.html * To generate a JUnit report, run: rally task export 515e55f0-01cd-45f3-9e49-19bbcc1577ea --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 515e55f0-01cd-45f3-9e49-19bbcc1577ea --json --out output.json 2021-03-10 18:38:45,296 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 515e55f0-01cd-45f3-9e49-19bbcc1577ea --out /home/opnfv/functest/results/rally_full/heat.json 2021-03-10 18:38:45,315 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-03-10 18:38:45,346 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 18:38:45,932 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-03-10 18:50:02,314 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 4a57079e-9d49-4fcf-8ffd-6508edb618dc 2021-03-10 18:50:03,587 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4a57079e-9d49-4fcf-8ffd-6508edb618dc -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.194 | 0.501 | 2.067 | 2.193 | 2.319 | 0.793 | 100.0% | 10 | | keystone_v3.add_role | 0.128 | 0.411 | 1.965 | 2.032 | 2.099 | 0.895 | 100.0% | 10 | | keystone_v3.revoke_role | 0.148 | 0.359 | 0.467 | 0.487 | 0.508 | 0.338 | 100.0% | 10 | | total | 0.601 | 2.537 | 2.96 | 3.097 | 3.234 | 2.026 | 100.0% | 10 | | -> duration | 0.601 | 2.537 | 2.96 | 3.097 | 3.234 | 2.026 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.487144 Full duration: 45.160872 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.147 | 0.683 | 1.655 | 1.855 | 2.056 | 0.855 | 100.0% | 10 | | keystone_v3.add_role | 0.136 | 0.422 | 0.763 | 1.043 | 1.324 | 0.491 | 100.0% | 10 | | keystone_v3.list_roles | 0.107 | 0.126 | 0.201 | 0.278 | 0.354 | 0.154 | 100.0% | 10 | | total | 0.607 | 1.418 | 2.501 | 2.507 | 2.513 | 1.501 | 100.0% | 10 | | -> duration | 0.607 | 1.418 | 2.501 | 2.507 | 2.513 | 1.501 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.215253 Full duration: 45.244401 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.219 | 1.186 | 2.013 | 2.028 | 2.044 | 1.172 | 100.0% | 10 | | keystone_v3.list_projects | 0.116 | 0.126 | 0.141 | 0.142 | 0.142 | 0.129 | 100.0% | 10 | | total | 0.345 | 1.315 | 2.14 | 2.16 | 2.179 | 1.301 | 100.0% | 10 | | -> duration | 0.345 | 1.315 | 2.14 | 2.16 | 2.179 | 1.301 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.867253 Full duration: 47.857512 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.294 | 1.399 | 3.36 | 3.466 | 3.573 | 1.605 | 100.0% | 10 | | keystone_v3.delete_role | 0.4 | 0.838 | 2.386 | 2.921 | 3.456 | 1.193 | 100.0% | 10 | | total | 0.843 | 2.816 | 4.089 | 5.559 | 7.029 | 2.798 | 100.0% | 10 | | -> duration | 0.843 | 2.816 | 4.089 | 5.559 | 7.029 | 2.798 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.752974 Full duration: 45.190713 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.157 | 0.404 | 1.481 | 1.916 | 2.351 | 0.687 | 100.0% | 10 | | keystone_v3.delete_service | 0.106 | 0.495 | 1.177 | 1.289 | 1.4 | 0.661 | 100.0% | 10 | | total | 0.383 | 0.892 | 2.382 | 2.898 | 3.414 | 1.347 | 100.0% | 10 | | -> duration | 0.383 | 0.892 | 2.382 | 2.898 | 3.414 | 1.347 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.602154 Full duration: 47.72626 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.512 | 0.775 | 1.611 | 2.006 | 2.401 | 1.018 | 100.0% | 10 | | keystone_v3.create_user | 1.04 | 1.667 | 1.918 | 2.423 | 2.929 | 1.645 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.045 | 0.053 | 0.078 | 0.155 | 0.232 | 0.071 | 100.0% | 10 | | -> keystone_v3.add_role | 0.223 | 0.485 | 1.081 | 1.09 | 1.099 | 0.557 | 100.0% | 10 | | keystone_v3.create_role | 0.077 | 0.279 | 0.779 | 0.849 | 0.919 | 0.386 | 100.0% | 10 | | keystone_v3.get_project | 0.032 | 0.042 | 0.138 | 0.157 | 0.177 | 0.071 | 100.0% | 10 | | keystone_v3.get_user | 0.041 | 0.072 | 0.253 | 0.318 | 0.383 | 0.136 | 100.0% | 10 | | keystone_v3.get_role | 0.035 | 0.04 | 0.201 | 0.3 | 0.399 | 0.096 | 100.0% | 10 | | keystone_v3.list_services | 0.041 | 0.112 | 0.512 | 0.571 | 0.63 | 0.193 | 100.0% | 10 | | keystone_v3.get_services | 0.028 | 0.036 | 0.387 | 0.649 | 0.911 | 0.159 | 100.0% | 10 | | total | 2.403 | 4.097 | 4.827 | 5.01 | 5.194 | 3.924 | 100.0% | 10 | | -> duration | 2.403 | 4.097 | 4.827 | 5.01 | 5.194 | 3.924 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.614429 Full duration: 74.733503 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.317 | 2.26 | 5.284 | 7.762 | 10.24 | 2.974 | 100.0% | 10 | | keystone_v3.update_project | 0.173 | 0.645 | 5.338 | 5.772 | 6.205 | 1.632 | 100.0% | 10 | | keystone_v3.delete_project | 0.218 | 0.992 | 3.491 | 4.789 | 6.086 | 1.751 | 100.0% | 10 | | total | 1.522 | 4.665 | 11.819 | 11.835 | 11.852 | 6.358 | 100.0% | 10 | | -> duration | 1.522 | 4.665 | 11.819 | 11.835 | 11.852 | 6.358 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.021908 Full duration: 57.50284 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.245 | 0.952 | 1.515 | 1.587 | 1.658 | 0.925 | 100.0% | 10 | | total | 0.43 | 1.031 | 1.594 | 1.668 | 1.742 | 1.045 | 100.0% | 10 | | -> duration | 0.43 | 1.031 | 1.594 | 1.668 | 1.742 | 1.045 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.811558 Full duration: 38.587249 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.433 | 1.835 | 4.563 | 4.663 | 4.763 | 2.266 | 100.0% | 10 | | total | 0.433 | 1.835 | 4.563 | 4.663 | 4.764 | 2.267 | 100.0% | 10 | | -> duration | 0.433 | 1.835 | 4.563 | 4.663 | 4.764 | 2.267 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.291771 Full duration: 34.443143 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.24 | 0.823 | 3.225 | 3.277 | 3.328 | 1.49 | 100.0% | 10 | | keystone_v3.list_users | 0.07 | 0.079 | 0.118 | 0.261 | 0.405 | 0.11 | 100.0% | 10 | | total | 0.397 | 0.983 | 3.551 | 3.624 | 3.698 | 1.691 | 100.0% | 10 | | -> duration | 0.397 | 0.983 | 3.551 | 3.624 | 3.698 | 1.691 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.46138 Full duration: 38.221112 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4a57079e-9d49-4fcf-8ffd-6508edb618dc has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.294 | 1.023 | 1.344 | 1.468 | 1.593 | 0.929 | 100.0% | 10 | | keystone_v3.create_users | 14.06 | 15.178 | 18.306 | 18.819 | 19.332 | 16.049 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 14.06 | 15.178 | 18.305 | 18.818 | 19.332 | 16.049 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.625 | 0.938 | 1.93 | 2.081 | 2.232 | 1.18 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.493 | 5.769 | 6.793 | 6.919 | 7.045 | 5.846 | 100.0% | 10 | | total | 15.935 | 17.113 | 20.385 | 20.533 | 20.681 | 18.024 | 100.0% | 10 | | -> duration | 15.935 | 17.113 | 20.385 | 20.533 | 20.681 | 18.024 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.50523 Full duration: 172.537479 HINTS: * To plot HTML graphics with this data, run: rally task report 4a57079e-9d49-4fcf-8ffd-6508edb618dc --out output.html * To generate a JUnit report, run: rally task export 4a57079e-9d49-4fcf-8ffd-6508edb618dc --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4a57079e-9d49-4fcf-8ffd-6508edb618dc --json --out output.json 2021-03-10 18:50:06,695 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4a57079e-9d49-4fcf-8ffd-6508edb618dc --out /home/opnfv/functest/results/rally_full/keystone.json 2021-03-10 18:50:06,718 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-03-10 18:50:06,754 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 18:50:07,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-03-10 19:08:38,978 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e 2021-03-10 19:08:40,255 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.589 | 3.592 | 5.087 | 5.124 | 5.16 | 3.588 | 100.0% | 10 | | neutron.update_network | 0.97 | 1.596 | 1.801 | 1.867 | 1.934 | 1.505 | 100.0% | 10 | | total | 3.577 | 5.032 | 6.196 | 6.49 | 6.785 | 5.093 | 100.0% | 10 | | -> duration | 3.577 | 5.032 | 6.196 | 6.49 | 6.785 | 5.093 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.105822 Full duration: 61.564869 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.158 | 4.595 | 6.537 | 6.578 | 6.619 | 4.706 | 100.0% | 10 | | neutron.update_port | 0.771 | 1.856 | 2.316 | 2.354 | 2.393 | 1.692 | 100.0% | 10 | | total | 4.529 | 6.916 | 7.681 | 7.724 | 7.767 | 6.398 | 100.0% | 10 | | -> duration | 4.529 | 6.916 | 7.681 | 7.724 | 7.767 | 6.398 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.687917 Full duration: 98.598705 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.313 | 2.986 | 4.101 | 4.145 | 4.189 | 3.2 | 100.0% | 10 | | neutron.create_subnet | 2.077 | 4.041 | 4.155 | 4.159 | 4.163 | 3.688 | 100.0% | 10 | | neutron.update_subnet | 1.082 | 1.82 | 3.498 | 3.534 | 3.57 | 2.197 | 100.0% | 10 | | total | 6.87 | 9.592 | 10.431 | 10.469 | 10.507 | 9.085 | 100.0% | 10 | | -> duration | 6.87 | 9.592 | 10.431 | 10.469 | 10.507 | 9.085 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.51074 Full duration: 87.243669 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.326 | 4.016 | 6.034 | 6.116 | 6.197 | 4.001 | 100.0% | 10 | | neutron.delete_network | 0.875 | 2.023 | 2.694 | 3.075 | 3.455 | 1.945 | 100.0% | 10 | | total | 2.657 | 6.16 | 8.253 | 8.472 | 8.691 | 5.946 | 100.0% | 10 | | -> duration | 2.657 | 6.16 | 8.253 | 8.472 | 8.691 | 5.946 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.955819 Full duration: 57.847587 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.322 | 4.041 | 5.133 | 5.159 | 5.185 | 3.982 | 100.0% | 10 | | neutron.delete_port | 0.825 | 1.358 | 2.028 | 2.331 | 2.634 | 1.481 | 100.0% | 10 | | total | 4.093 | 5.56 | 6.445 | 6.56 | 6.676 | 5.463 | 100.0% | 10 | | -> duration | 4.093 | 5.56 | 6.445 | 6.56 | 6.676 | 5.463 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.208572 Full duration: 83.161314 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.081 | 4.274 | 6.126 | 6.19 | 6.254 | 4.018 | 100.0% | 10 | | neutron.create_subnet | 2.104 | 2.804 | 3.788 | 4.029 | 4.27 | 2.953 | 100.0% | 10 | | neutron.delete_subnet | 0.71 | 1.317 | 1.504 | 1.562 | 1.62 | 1.245 | 100.0% | 10 | | total | 5.357 | 8.323 | 10.022 | 10.418 | 10.814 | 8.217 | 100.0% | 10 | | -> duration | 5.357 | 8.323 | 10.022 | 10.418 | 10.814 | 8.217 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.112261 Full duration: 84.260234 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.229 | 3.629 | 8.191 | 8.456 | 8.722 | 4.825 | 100.0% | 10 | | neutron.list_networks | 0.154 | 0.39 | 3.039 | 3.179 | 3.319 | 1.166 | 100.0% | 10 | | total | 2.383 | 5.03 | 9.685 | 10.346 | 11.006 | 5.992 | 100.0% | 10 | | -> duration | 2.383 | 5.03 | 9.685 | 10.346 | 11.006 | 5.992 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.288695 Full duration: 64.116084 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.26 | 5.576 | 9.688 | 9.896 | 10.103 | 6.46 | 100.0% | 10 | | neutron.list_ports | 0.114 | 0.374 | 2.105 | 2.234 | 2.363 | 0.943 | 100.0% | 10 | | total | 4.522 | 7.194 | 9.832 | 10.155 | 10.478 | 7.403 | 100.0% | 10 | | -> duration | 4.522 | 7.194 | 9.832 | 10.155 | 10.478 | 7.403 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.544307 Full duration: 90.784133 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.415 | 2.669 | 4.224 | 4.58 | 4.937 | 2.892 | 100.0% | 10 | | neutron.create_subnet | 2.079 | 3.547 | 5.197 | 5.334 | 5.471 | 3.635 | 100.0% | 10 | | neutron.list_subnets | 0.085 | 0.12 | 1.668 | 1.705 | 1.742 | 0.57 | 100.0% | 10 | | total | 4.251 | 6.705 | 9.206 | 9.28 | 9.354 | 7.097 | 100.0% | 10 | | -> duration | 4.251 | 6.705 | 9.206 | 9.28 | 9.354 | 7.097 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.5413 Full duration: 81.191267 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.831 | 2.632 | 3.281 | 3.59 | 3.899 | 2.672 | 100.0% | 10 | | neutron.delete_security_group | 0.219 | 0.553 | 1.014 | 1.064 | 1.113 | 0.617 | 100.0% | 10 | | total | 2.05 | 3.193 | 4.035 | 4.307 | 4.579 | 3.289 | 100.0% | 10 | | -> duration | 2.05 | 3.193 | 4.035 | 4.307 | 4.579 | 3.289 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.248273 Full duration: 49.207577 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.402 | 2.196 | 3.57 | 3.801 | 4.031 | 2.391 | 100.0% | 10 | | neutron.create_security_group_rule | 0.828 | 1.11 | 1.684 | 1.702 | 1.721 | 1.254 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.129 | 0.425 | 0.549 | 0.577 | 0.605 | 0.38 | 100.0% | 10 | | neutron.delete_security_group | 0.232 | 0.466 | 0.714 | 0.772 | 0.829 | 0.474 | 100.0% | 10 | | total | 3.202 | 4.474 | 5.333 | 5.646 | 5.958 | 4.5 | 100.0% | 10 | | -> duration | 3.202 | 4.474 | 5.333 | 5.646 | 5.958 | 4.5 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.668014 Full duration: 53.055408 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.091 | 3.461 | 4.657 | 5.033 | 5.41 | 3.531 | 100.0% | 10 | | neutron.create_security_group_rule | 1.45 | 3.291 | 6.599 | 6.878 | 7.157 | 3.657 | 100.0% | 10 | | neutron.list_security_group_rules | 0.085 | 0.266 | 1.435 | 1.639 | 1.843 | 0.622 | 100.0% | 10 | | total | 4.109 | 7.658 | 11.023 | 11.945 | 12.867 | 7.81 | 100.0% | 10 | | -> duration | 4.109 | 7.658 | 11.023 | 11.945 | 12.867 | 7.81 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.821946 Full duration: 72.827585 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.236 | 4.925 | 5.331 | 5.459 | 5.587 | 4.585 | 100.0% | 10 | | neutron.show_security_group | 0.067 | 0.08 | 0.12 | 0.127 | 0.134 | 0.087 | 100.0% | 10 | | total | 3.355 | 5.004 | 5.408 | 5.533 | 5.658 | 4.672 | 100.0% | 10 | | -> duration | 3.355 | 5.004 | 5.408 | 5.533 | 5.658 | 4.672 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.602474 Full duration: 68.065218 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 23.12816 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 4.354 | 6.172 | 9.134 | 9.407 | 9.68 | 6.735 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.184 | 0.569 | 1.225 | 1.284 | 1.342 | 0.67 | 100.0% | 10 | | total | 5.082 | 6.812 | 10.464 | 10.678 | 10.891 | 7.405 | 100.0% | 10 | | -> duration | 5.082 | 6.812 | 10.464 | 10.678 | 10.891 | 7.405 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.581037 Full duration: 96.971628 HINTS: * To plot HTML graphics with this data, run: rally task report 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e --out output.html * To generate a JUnit report, run: rally task export 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e --json --out output.json At least one workload did not pass SLA criteria. 2021-03-10 19:08:43,369 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5d6baaf9-3ba0-45f5-be3f-b8dc264cde4e --out /home/opnfv/functest/results/rally_full/neutron.json 2021-03-10 19:08:43,391 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-03-10 19:08:43,432 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 19:08:43,887 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-03-10 19:53:15,014 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 71996594-4b63-4aa2-99d3-ce45dbf3ad7e 2021-03-10 19:53:16,308 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 71996594-4b63-4aa2-99d3-ce45dbf3ad7e -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.298 | 1.961 | 2.602 | 3.217 | 3.832 | 2.049 | 100.0% | 10 | | nova.delete_keypair | 0.297 | 0.831 | 3.199 | 3.34 | 3.48 | 1.285 | 100.0% | 10 | | total | 1.6 | 2.796 | 5.025 | 5.329 | 5.633 | 3.333 | 100.0% | 10 | | -> duration | 1.6 | 2.796 | 5.025 | 5.329 | 5.633 | 3.333 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.204799 Full duration: 42.818075 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.963 | 1.503 | 2.725 | 2.756 | 2.788 | 1.738 | 100.0% | 10 | | nova.list_keypairs | 0.032 | 0.041 | 0.073 | 0.12 | 0.167 | 0.055 | 100.0% | 10 | | total | 1.008 | 1.554 | 2.757 | 2.79 | 2.824 | 1.793 | 100.0% | 10 | | -> duration | 1.008 | 1.554 | 2.757 | 2.79 | 2.824 | 1.793 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.130838 Full duration: 50.837826 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 22.097 | 46.919 | 57.672 | 61.866 | 66.059 | 43.978 | 100.0% | 10 | | nova.reboot_server | 8.258 | 21.013 | 36.673 | 37.198 | 37.722 | 23.93 | 100.0% | 10 | | nova.soft_reboot_server | 10.879 | 22.461 | 136.958 | 140.338 | 143.719 | 43.291 | 100.0% | 10 | | nova.stop_and_start_server | 11.606 | 18.632 | 23.365 | 23.891 | 24.416 | 18.805 | 100.0% | 10 | | -> nova.stop_server | 5.772 | 10.08 | 14.263 | 15.931 | 17.599 | 10.175 | 100.0% | 10 | | -> nova.start_server | 4.94 | 8.406 | 12.694 | 13.614 | 14.534 | 8.63 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 13.159 | 20.286 | 27.349 | 27.81 | 28.271 | 20.24 | 100.0% | 10 | | -> nova.rescue_server | 7.643 | 11.4 | 17.293 | 18.629 | 19.965 | 12.36 | 100.0% | 10 | | -> nova.unrescue_server | 4.837 | 8.202 | 10.637 | 10.956 | 11.275 | 7.879 | 100.0% | 10 | | nova.delete_server | 4.212 | 12.694 | 17.714 | 18.821 | 19.927 | 11.774 | 100.0% | 10 | | total | 84.54 | 140.045 | 283.155 | 295.524 | 307.892 | 162.06 | 100.0% | 10 | | -> duration | 75.54 | 131.045 | 274.155 | 286.524 | 298.892 | 153.06 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 417.497061 Full duration: 462.599994 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 29.829 | 39.968 | 47.047 | 48.32 | 49.593 | 40.074 | 100.0% | 10 | | nova.delete_server | 7.832 | 19.286 | 21.503 | 22.299 | 23.094 | 17.702 | 100.0% | 10 | | total | 39.483 | 60.346 | 67.697 | 68.751 | 69.805 | 57.776 | 100.0% | 10 | | -> duration | 38.483 | 59.346 | 66.697 | 67.751 | 68.805 | 56.776 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 162.60687 Full duration: 201.703759 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 34.711 | 41.877 | 46.617 | 48.06 | 49.502 | 41.428 | 100.0% | 10 | | nova.list_servers | 0.379 | 0.43 | 0.762 | 0.867 | 0.972 | 0.511 | 100.0% | 10 | | total | 35.45 | 42.307 | 47.006 | 48.444 | 49.881 | 41.94 | 100.0% | 10 | | -> duration | 34.45 | 41.307 | 46.006 | 47.444 | 48.881 | 40.94 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 119.292866 Full duration: 227.572241 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "from_image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "to_image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 39.7 | 47.454 | 58.505 | 60.459 | 62.412 | 48.832 | 100.0% | 10 | | nova.rebuild_server | 13.781 | 26.362 | 31.255 | 31.473 | 31.691 | 23.664 | 100.0% | 10 | | nova.delete_server | 6.557 | 17.618 | 30.646 | 32.169 | 33.692 | 18.438 | 100.0% | 10 | | total | 73.5 | 88.601 | 109.133 | 111.65 | 114.166 | 90.935 | 100.0% | 10 | | -> duration | 71.5 | 86.601 | 107.133 | 109.65 | 112.166 | 88.935 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 247.934091 Full duration: 284.987942 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 72.922 | 113.396 | 116.461 | 119.776 | 123.091 | 105.757 | 100.0% | 10 | | nova.snapshot_server | 18.063 | 32.033 | 39.458 | 40.143 | 40.827 | 30.736 | 100.0% | 10 | | -> glance_v2.get_image | 0.073 | 0.084 | 0.098 | 0.106 | 0.114 | 0.087 | 100.0% | 10 | | -> glance.wait_for_image | 16.385 | 26.619 | 33.164 | 35.006 | 36.847 | 26.212 | 100.0% | 10 | | --> glance_v2.get_image (x13) | 0.52 | 0.536 | 0.548 | 0.55 | 0.551 | 0.536 | 100.0% | 2 | | --> glance_v2.get_image (x15) | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 0.622 | 100.0% | 1 | | --> glance_v2.get_image (x11) | 0.441 | 0.441 | 0.441 | 0.441 | 0.441 | 0.441 | 100.0% | 1 | | --> glance_v2.get_image (x16) | 0.668 | 0.703 | 0.73 | 0.734 | 0.737 | 0.703 | 100.0% | 2 | | --> glance_v2.get_image (x19) | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | --> glance_v2.get_image (x17) | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 100.0% | 1 | | --> glance_v2.get_image (x9) | 0.366 | 0.373 | 0.379 | 0.38 | 0.38 | 0.373 | 100.0% | 2 | | nova.delete_server (x2) | 20.359 | 48.204 | 57.259 | 57.931 | 58.604 | 44.374 | 100.0% | 10 | | nova.delete_image | 5.8 | 7.98 | 10.64 | 11.118 | 11.596 | 8.331 | 100.0% | 10 | | -> glance_v2.delete_image | 5.761 | 7.926 | 10.55 | 11.05 | 11.55 | 8.281 | 100.0% | 10 | | -> glance.wait_for_delete | 0.031 | 0.045 | 0.062 | 0.078 | 0.093 | 0.048 | 100.0% | 10 | | --> glance_v2.get_image | 0.031 | 0.045 | 0.062 | 0.077 | 0.093 | 0.048 | 0.0% | 10 | | total | 119.595 | 206.216 | 213.79 | 214.088 | 214.386 | 189.198 | 100.0% | 10 | | -> duration | 117.595 | 204.216 | 211.79 | 212.088 | 212.386 | 187.198 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 528.514502 Full duration: 573.503468 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "volume_size": 1, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.016 | 22.172 | 30.561 | 33.915 | 37.27 | 23.191 | 100.0% | 10 | | nova.boot_server | 39.933 | 65.782 | 79.775 | 80.98 | 82.186 | 62.611 | 100.0% | 10 | | total | 65.805 | 86.441 | 101.153 | 102.092 | 103.03 | 85.803 | 100.0% | 10 | | -> duration | 64.805 | 85.441 | 100.153 | 101.092 | 102.03 | 84.803 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 244.675405 Full duration: 366.500833 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 28.624 | 48.697 | 59.206 | 60.337 | 61.468 | 47.362 | 100.0% | 10 | | total | 28.624 | 48.697 | 59.206 | 60.337 | 61.468 | 47.362 | 100.0% | 10 | | -> duration | 27.624 | 47.697 | 58.206 | 59.337 | 60.468 | 46.362 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 126.918171 Full duration: 219.999545 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 30.486139 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "image": { "name": "rally_full-img_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "to_flavor": { "name": "rally_full-flavor_alt_2d78c185-7b4e-485f-b5d1-d4c08da7a4c2" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "2cbc6ff8-0356-428f-b0e9-1453aac9a790" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 71996594-4b63-4aa2-99d3-ce45dbf3ad7e has 5 error(s) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-a3e20c65-7c3a-45b7-aba8-71c786873be6) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-a3e20c65-7c3a-45b7-aba8-71c786873be6) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-3c133159-612e-4288-98ee-3f81e2f07b07) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-3c133159-612e-4288-98ee-3f81e2f07b07) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-f66feb0a-f463-4fe4-a588-18c1a565f77d) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-f66feb0a-f463-4fe4-a588-18c1a565f77d) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-a1f821ca-eb8c-4bf3-98c7-07d8209d6a85) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-a1f821ca-eb8c-4bf3-98c7-07d8209d6a85) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-3c5ddeaa-dbd2-4065-9547-b6089638816b) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-3c5ddeaa-dbd2-4065-9547-b6089638816b) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.964 | 50.515 | 53.91 | 54.501 | 55.091 | 46.581 | 100.0% | 5 | | nova.resize | 7.25 | 16.043 | 18.612 | 18.807 | 19.002 | 14.9 | 0.0% | 5 | | total | 39.214 | 66.558 | 72.327 | 72.723 | 73.119 | 61.481 | 0.0% | 5 | | -> duration | 38.214 | 65.558 | 71.327 | 71.723 | 72.119 | 60.481 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 95.636308 Full duration: 141.942826 HINTS: * To plot HTML graphics with this data, run: rally task report 71996594-4b63-4aa2-99d3-ce45dbf3ad7e --out output.html * To generate a JUnit report, run: rally task export 71996594-4b63-4aa2-99d3-ce45dbf3ad7e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 71996594-4b63-4aa2-99d3-ce45dbf3ad7e --json --out output.json At least one workload did not pass SLA criteria. 2021-03-10 19:53:19,404 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 71996594-4b63-4aa2-99d3-ce45dbf3ad7e --out /home/opnfv/functest/results/rally_full/nova.json 2021-03-10 19:53:19,427 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-03-10 19:53:19,453 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 19:53:19,952 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-03-10 19:55:21,800 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 2021-03-10 19:55:23,036 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 -------------------------------------------------------------------------------- Task 5c492788-3efb-4f51-bc3d-6ccb3bfbf828: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.205 | 1.64 | 2.235 | 2.458 | 2.682 | 1.73 | 100.0% | 10 | | quotas.delete_quotas | 0.162 | 0.336 | 1.637 | 2.262 | 2.887 | 0.847 | 100.0% | 10 | | total | 1.368 | 2.478 | 3.232 | 3.911 | 4.59 | 2.577 | 100.0% | 10 | | -> duration | 1.368 | 2.478 | 3.232 | 3.911 | 4.59 | 2.577 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.088652 Full duration: 34.233546 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.934 | 1.841 | 2.175 | 2.224 | 2.273 | 1.693 | 100.0% | 10 | | total | 0.935 | 1.841 | 2.175 | 2.224 | 2.273 | 1.693 | 100.0% | 10 | | -> duration | 0.935 | 1.841 | 2.175 | 2.224 | 2.273 | 1.693 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.262792 Full duration: 28.879418 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.694 | 4.048 | 8.712 | 9.038 | 9.365 | 5.219 | 100.0% | 10 | | total | 2.694 | 4.048 | 8.712 | 9.039 | 9.365 | 5.219 | 100.0% | 10 | | -> duration | 2.694 | 4.048 | 8.712 | 9.039 | 9.365 | 5.219 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.603406 Full duration: 37.497045 HINTS: * To plot HTML graphics with this data, run: rally task report 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 --out output.html * To generate a JUnit report, run: rally task export 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 --json --out output.json 2021-03-10 19:55:26,010 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5c492788-3efb-4f51-bc3d-6ccb3bfbf828 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-03-10 19:55:26,016 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-03-10 19:55:26,046 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-10 19:55:26,208 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-03-10 20:04:26,408 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 6900002b-2cc2-4942-8604-9b8f4786bed6 2021-03-10 20:04:27,654 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6900002b-2cc2-4942-8604-9b8f4786bed6 -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.001 | 1.137 | 1.372 | 1.567 | 1.763 | 1.191 | 100.0% | 10 | | swift.upload_object (x2) | 0.984 | 1.043 | 1.197 | 1.216 | 1.235 | 1.073 | 100.0% | 10 | | swift.list_objects | 0.874 | 1.002 | 1.034 | 1.035 | 1.036 | 0.991 | 100.0% | 10 | | total | 2.894 | 3.213 | 3.476 | 3.577 | 3.679 | 3.256 | 100.0% | 10 | | -> duration | 2.894 | 3.213 | 3.476 | 3.577 | 3.679 | 3.256 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.618585 Full duration: 93.837107 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.408 | 1.468 | 1.587 | 1.598 | 1.609 | 1.49 | 100.0% | 10 | | swift.list_objects | 0.948 | 1.034 | 1.057 | 1.061 | 1.064 | 1.017 | 100.0% | 10 | | total | 2.403 | 2.509 | 2.606 | 2.613 | 2.62 | 2.507 | 100.0% | 10 | | -> duration | 2.403 | 2.509 | 2.606 | 2.613 | 2.62 | 2.507 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.125708 Full duration: 74.696437 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.926 | 1.11 | 1.249 | 1.28 | 1.312 | 1.121 | 100.0% | 10 | | swift.upload_object (x5) | 2.509 | 2.734 | 2.825 | 2.854 | 2.884 | 2.726 | 100.0% | 10 | | swift.download_object (x5) | 2.382 | 2.448 | 2.543 | 2.574 | 2.606 | 2.468 | 100.0% | 10 | | total | 5.969 | 6.354 | 6.483 | 6.575 | 6.667 | 6.317 | 100.0% | 10 | | -> duration | 5.969 | 6.354 | 6.483 | 6.575 | 6.667 | 6.317 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.225845 Full duration: 136.584661 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.993 | 1.185 | 1.235 | 1.283 | 1.331 | 1.157 | 100.0% | 10 | | swift.upload_object (x5) | 2.658 | 2.88 | 3.045 | 3.057 | 3.068 | 2.877 | 100.0% | 10 | | swift.delete_object (x5) | 2.524 | 2.744 | 2.851 | 2.863 | 2.875 | 2.746 | 100.0% | 10 | | swift.delete_container | 0.549 | 0.628 | 0.663 | 0.676 | 0.689 | 0.621 | 100.0% | 10 | | total | 6.851 | 7.425 | 7.694 | 7.762 | 7.83 | 7.404 | 100.0% | 10 | | -> duration | 6.851 | 7.425 | 7.694 | 7.762 | 7.83 | 7.404 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.096112 Full duration: 118.128454 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6900002b-2cc2-4942-8604-9b8f4786bed6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.238 | 1.443 | 1.514 | 1.567 | 1.619 | 1.439 | 100.0% | 10 | | swift.list_objects | 0.821 | 1.015 | 1.033 | 1.036 | 1.039 | 0.986 | 100.0% | 10 | | swift.download_object (x5) | 2.441 | 2.508 | 2.56 | 2.561 | 2.562 | 2.508 | 100.0% | 10 | | total | 4.671 | 4.943 | 5.054 | 5.076 | 5.099 | 4.934 | 100.0% | 10 | | -> duration | 4.671 | 4.943 | 5.054 | 5.076 | 5.099 | 4.934 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.393858 Full duration: 94.906504 HINTS: * To plot HTML graphics with this data, run: rally task report 6900002b-2cc2-4942-8604-9b8f4786bed6 --out output.html * To generate a JUnit report, run: rally task export 6900002b-2cc2-4942-8604-9b8f4786bed6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6900002b-2cc2-4942-8604-9b8f4786bed6 --json --out output.json 2021-03-10 20:04:30,655 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6900002b-2cc2-4942-8604-9b8f4786bed6 --out /home/opnfv/functest/results/rally_full/swift.json 2021-03-10 20:04:30,671 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-03-10 20:04:30,675 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:36 | 60 | 100.00% | | glance | 00:03:24 | 35 | 85.71% | | cinder | 00:42:53 | 240 | 100.00% | | heat | 00:52:31 | 100 | 100.00% | | keystone | 00:10:47 | 110 | 100.00% | | neutron | 00:17:52 | 140 | 100.00% | | nova | 00:43:22 | 95 | 94.74% | | quotas | 00:01:40 | 30 | 100.00% | | swift | 00:08:38 | 50 | 100.00% | | | | | | | TOTAL: | 03:03:46 | 860 | 98.84% | +----------------+------------+----------------+-----------+ 2021-03-10 20:04:30,675 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.84% in 6/9 modules 2021-03-10 20:04:34,628 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-03-10 20:04:38,065 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-03-10 20:04:38,066 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 191:02 | FAIL | +--------------------+------------------+------------------+----------------+