2021-02-06 16:31:11,490 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | CYVELMK8POLF | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/CYVELMK8POLF/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-195 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/CYVELMK8POLF/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-195 | +-------------------------+------------------------------------------------------------+ 2021-02-06 16:31:11,509 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-02-06 16:31:14,754 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-02-06 16:31:19,644 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-02-06 16:31:26,083 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | c72cade7-5aa3-4aa2-bfcd-d615191717f9 | 2021-02-06T16:31:25.807799 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: c72cade7-5aa3-4aa2-bfcd-d615191717f9 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-02-06 16:31:31,076 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-02-06 16:31:33,063 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 16:31:33,207 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-02-06 16:34:51,765 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: e99d4453-ac54-42e7-a01c-23b8234727ad 2021-02-06 16:34:52,972 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e99d4453-ac54-42e7-a01c-23b8234727ad -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.08 | 1.387 | 1.86 | 1.871 | 1.883 | 1.43 | 100.0% | 10 | | total | 1.08 | 1.387 | 1.86 | 1.871 | 1.883 | 1.43 | 100.0% | 10 | | -> duration | 1.08 | 1.387 | 1.86 | 1.871 | 1.883 | 1.43 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.930275 Full duration: 24.996718 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.154 | 0.262 | 0.506 | 0.554 | 0.603 | 0.321 | 100.0% | 10 | | total | 0.596 | 1.144 | 1.288 | 1.321 | 1.355 | 1.003 | 100.0% | 10 | | -> duration | 0.596 | 1.144 | 1.288 | 1.321 | 1.355 | 1.003 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.651258 Full duration: 29.394504 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.21 | 0.296 | 0.625 | 0.666 | 0.707 | 0.372 | 100.0% | 10 | | total | 0.776 | 1.074 | 1.339 | 1.429 | 1.52 | 1.073 | 100.0% | 10 | | -> duration | 0.776 | 1.074 | 1.339 | 1.429 | 1.52 | 1.073 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.849998 Full duration: 35.585181 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.157 | 0.261 | 0.383 | 0.405 | 0.427 | 0.274 | 100.0% | 10 | | total | 0.578 | 0.821 | 1.022 | 1.051 | 1.081 | 0.848 | 100.0% | 10 | | -> duration | 0.578 | 0.821 | 1.022 | 1.051 | 1.081 | 0.848 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.440106 Full duration: 30.391786 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.383 | 0.593 | 0.756 | 0.861 | 0.966 | 0.619 | 100.0% | 10 | | total | 0.846 | 1.081 | 1.656 | 1.683 | 1.71 | 1.201 | 100.0% | 10 | | -> duration | 0.846 | 1.081 | 1.656 | 1.683 | 1.71 | 1.201 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.42048 Full duration: 26.903888 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99d4453-ac54-42e7-a01c-23b8234727ad has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.157 | 0.231 | 0.505 | 0.56 | 0.616 | 0.279 | 100.0% | 10 | | total | 0.552 | 1.0 | 1.386 | 1.419 | 1.453 | 0.965 | 100.0% | 10 | | -> duration | 0.552 | 1.0 | 1.386 | 1.419 | 1.453 | 0.965 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.54687 Full duration: 28.419747 HINTS: * To plot HTML graphics with this data, run: rally task report e99d4453-ac54-42e7-a01c-23b8234727ad --out output.html * To generate a JUnit report, run: rally task export e99d4453-ac54-42e7-a01c-23b8234727ad --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e99d4453-ac54-42e7-a01c-23b8234727ad --json --out output.json 2021-02-06 16:34:56,051 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e99d4453-ac54-42e7-a01c-23b8234727ad --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-02-06 16:34:56,062 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-02-06 16:34:56,094 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 16:34:56,256 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-02-06 16:43:43,940 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: f4ba4e1e-5e33-4f97-b6b5-1a103058c587 2021-02-06 16:43:45,219 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f4ba4e1e-5e33-4f97-b6b5-1a103058c587 -------------------------------------------------------------------------------- Task f4ba4e1e-5e33-4f97-b6b5-1a103058c587: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ba4e1e-5e33-4f97-b6b5-1a103058c587 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.699 | 7.381 | 8.19 | 8.378 | 8.565 | 7.203 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.095 | 0.105 | 0.129 | 0.159 | 0.189 | 0.114 | 100.0% | 10 | | -> glance_v2.upload_data | 2.647 | 3.643 | 4.517 | 4.601 | 4.685 | 3.622 | 100.0% | 10 | | glance_v2.delete_image | 2.484 | 3.34 | 5.173 | 5.277 | 5.382 | 3.714 | 100.0% | 10 | | total | 8.183 | 11.553 | 12.127 | 12.566 | 13.004 | 10.918 | 100.0% | 10 | | -> duration | 8.183 | 11.553 | 12.127 | 12.566 | 13.004 | 10.918 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.126164 Full duration: 67.802989 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ba4e1e-5e33-4f97-b6b5-1a103058c587 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.61 | 7.341 | 13.025 | 13.028 | 13.032 | 9.107 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.089 | 0.126 | 0.342 | 0.356 | 0.371 | 0.167 | 100.0% | 10 | | -> glance_v2.upload_data | 2.521 | 3.61 | 9.81 | 9.919 | 10.029 | 5.801 | 100.0% | 10 | | glance_v2.list_images | 0.049 | 0.063 | 0.082 | 0.088 | 0.094 | 0.068 | 100.0% | 10 | | total | 5.669 | 7.419 | 13.087 | 13.096 | 13.104 | 9.177 | 100.0% | 10 | | -> duration | 5.669 | 7.419 | 13.087 | 13.096 | 13.104 | 9.177 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.839035 Full duration: 68.244232 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ba4e1e-5e33-4f97-b6b5-1a103058c587 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.153 | 0.209 | 0.391 | 0.445 | 0.499 | 0.256 | 100.0% | 10 | | total | 0.153 | 0.209 | 0.391 | 0.445 | 0.499 | 0.256 | 100.0% | 10 | | -> duration | 0.153 | 0.209 | 0.391 | 0.445 | 0.499 | 0.256 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.18607 Full duration: 27.098788 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ba4e1e-5e33-4f97-b6b5-1a103058c587 has 3 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 7.85 | 9.346 | 12.213 | 13.99 | 15.768 | 10.117 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.095 | 0.109 | 0.117 | 0.118 | 0.119 | 0.108 | 100.0% | 9 | | -> glance_v2.upload_data | 4.067 | 6.391 | 7.962 | 10.027 | 12.092 | 6.509 | 100.0% | 9 | | nova.boot_servers | 16.131 | 84.854 | 104.356 | 104.784 | 105.213 | 78.961 | 66.7% | 9 | | total | 23.981 | 96.179 | 113.666 | 114.132 | 114.597 | 89.079 | 66.7% | 9 | | -> duration | 22.981 | 95.179 | 112.666 | 113.132 | 113.597 | 88.079 | 66.7% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 66.7% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 234.342169 Full duration: 338.058265 HINTS: * To plot HTML graphics with this data, run: rally task report f4ba4e1e-5e33-4f97-b6b5-1a103058c587 --out output.html * To generate a JUnit report, run: rally task export f4ba4e1e-5e33-4f97-b6b5-1a103058c587 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f4ba4e1e-5e33-4f97-b6b5-1a103058c587 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-06 16:43:48,178 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f4ba4e1e-5e33-4f97-b6b5-1a103058c587 --out /home/opnfv/functest/results/rally_full/glance.json 2021-02-06 16:43:48,195 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-02-06 16:43:48,242 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 16:43:48,974 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-02-06 17:33:26,873 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 9acd9bcb-4ae1-4216-8890-d2e82643cf12 2021-02-06 17:33:28,177 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 9acd9bcb-4ae1-4216-8890-d2e82643cf12 -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "size": 1, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 26.789 | 45.471 | 66.118 | 67.291 | 68.465 | 47.005 | 100.0% | 10 | | cinder_v3.create_volume | 4.014 | 8.464 | 16.811 | 19.52 | 22.23 | 10.296 | 100.0% | 10 | | nova.attach_volume | 8.339 | 15.627 | 28.255 | 29.976 | 31.697 | 18.124 | 100.0% | 10 | | nova.detach_volume | 1.569 | 5.359 | 8.836 | 10.244 | 11.652 | 6.022 | 100.0% | 10 | | cinder_v3.delete_volume | 2.324 | 6.589 | 11.587 | 13.242 | 14.898 | 7.204 | 100.0% | 10 | | nova.delete_server | 4.546 | 20.2 | 22.47 | 22.959 | 23.448 | 17.026 | 100.0% | 10 | | total | 66.154 | 114.442 | 124.601 | 129.303 | 134.005 | 105.678 | 100.0% | 10 | | -> duration | 65.154 | 113.442 | 123.601 | 128.303 | 133.005 | 104.678 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 286.079511 Full duration: 324.368017 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.671 | 7.307 | 11.542 | 11.98 | 12.418 | 8.21 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.035 | 0.041 | 0.049 | 0.05 | 0.051 | 0.041 | 100.0% | 10 | | total | 4.715 | 7.346 | 11.584 | 12.019 | 12.454 | 8.251 | 100.0% | 10 | | -> duration | 4.715 | 7.346 | 11.584 | 12.019 | 12.454 | 8.251 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.481832 Full duration: 111.526883 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 16.665 | 24.114 | 27.021 | 28.619 | 30.216 | 23.596 | 100.0% | 10 | | cinder_v3.list_volumes | 0.065 | 0.071 | 0.097 | 0.135 | 0.173 | 0.082 | 100.0% | 10 | | total | 16.735 | 24.235 | 27.086 | 28.685 | 30.284 | 23.678 | 100.0% | 10 | | -> duration | 16.735 | 24.235 | 27.086 | 28.685 | 30.284 | 23.678 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 67.241078 Full duration: 125.565736 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.804 | 10.595 | 13.265 | 13.862 | 14.458 | 10.759 | 100.0% | 10 | | cinder_v3.list_volumes | 0.06 | 0.074 | 0.109 | 0.181 | 0.254 | 0.091 | 100.0% | 10 | | total | 5.873 | 10.769 | 13.326 | 13.923 | 14.519 | 10.85 | 100.0% | 10 | | -> duration | 5.873 | 10.769 | 13.326 | 13.923 | 14.519 | 10.85 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.60188 Full duration: 83.666507 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.983 | 8.437 | 9.15 | 9.306 | 9.461 | 7.42 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 26.353 | 66.194 | 78.404 | 78.539 | 78.674 | 61.429 | 100.0% | 10 | | cinder_v3.delete_volume | 3.451 | 6.944 | 7.343 | 7.48 | 7.617 | 6.492 | 100.0% | 10 | | glance_v2.delete_image | 6.278 | 9.379 | 11.545 | 12.941 | 14.337 | 9.362 | 100.0% | 10 | | total | 40.065 | 91.406 | 105.503 | 105.667 | 105.83 | 84.703 | 100.0% | 10 | | -> duration | 40.065 | 91.406 | 105.503 | 105.667 | 105.83 | 84.703 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 237.717289 Full duration: 274.482986 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 37.579 | 54.647 | 79.032 | 80.127 | 81.223 | 59.156 | 100.0% | 10 | | cinder_v3.create_volume | 5.622 | 6.9 | 11.273 | 11.422 | 11.572 | 7.782 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.378 | 7.376 | 11.03 | 11.73 | 12.43 | 7.849 | 100.0% | 10 | | nova.attach_volume | 10.105 | 12.425 | 26.947 | 27.261 | 27.575 | 14.992 | 100.0% | 10 | | nova.detach_volume | 3.821 | 5.601 | 7.174 | 8.905 | 10.637 | 5.834 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.696 | 7.538 | 11.286 | 11.453 | 11.621 | 7.327 | 100.0% | 10 | | cinder_v3.delete_volume | 3.877 | 5.733 | 7.28 | 9.689 | 12.098 | 6.051 | 100.0% | 10 | | nova.delete_server | 12.655 | 24.317 | 30.13 | 31.622 | 33.115 | 23.273 | 100.0% | 10 | | total | 85.706 | 140.514 | 151.363 | 154.839 | 158.316 | 132.264 | 100.0% | 10 | | -> duration | 84.706 | 139.514 | 150.363 | 153.839 | 157.316 | 131.264 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 374.904971 Full duration: 420.626683 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.75 | 11.739 | 17.954 | 18.114 | 18.273 | 13.178 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.248 | 7.822 | 10.462 | 10.489 | 10.515 | 7.805 | 100.0% | 10 | | nova.boot_server | 32.846 | 50.173 | 54.01 | 56.014 | 58.017 | 47.072 | 100.0% | 10 | | nova.attach_volume | 8.242 | 17.572 | 24.217 | 24.583 | 24.949 | 17.855 | 100.0% | 10 | | nova.detach_volume | 3.675 | 7.84 | 13.732 | 13.94 | 14.148 | 8.574 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.775 | 4.959 | 11.992 | 12.839 | 13.687 | 6.625 | 100.0% | 10 | | cinder_v3.delete_volume | 3.611 | 6.097 | 10.382 | 10.393 | 10.404 | 6.81 | 100.0% | 10 | | nova.delete_server | 8.741 | 17.211 | 20.087 | 20.821 | 21.554 | 16.254 | 100.0% | 10 | | total | 87.576 | 133.281 | 140.196 | 140.332 | 140.468 | 124.175 | 100.0% | 10 | | -> duration | 86.576 | 132.281 | 139.196 | 139.332 | 139.468 | 123.175 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 349.989151 Full duration: 390.038877 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.979 | 8.972 | 12.327 | 12.334 | 12.341 | 8.822 | 100.0% | 10 | | total | 3.98 | 8.972 | 12.327 | 12.334 | 12.341 | 8.823 | 100.0% | 10 | | -> duration | 3.98 | 8.972 | 12.327 | 12.334 | 12.341 | 8.823 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.678769 Full duration: 70.745219 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.411 | 5.687 | 12.987 | 13.104 | 13.222 | 7.81 | 100.0% | 10 | | total | 3.411 | 5.687 | 12.987 | 13.104 | 13.222 | 7.81 | 100.0% | 10 | | -> duration | 3.411 | 5.687 | 12.987 | 13.104 | 13.222 | 7.81 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.289727 Full duration: 65.740136 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.668 | 1.0 | 1.287 | 1.476 | 1.666 | 1.0 | 100.0% | 10 | | total | 0.668 | 1.0 | 1.287 | 1.476 | 1.666 | 1.0 | 100.0% | 10 | | -> duration | 0.668 | 1.0 | 1.287 | 1.476 | 1.666 | 1.0 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.719227 Full duration: 143.821992 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.48 | 10.471 | 23.462 | 23.664 | 23.867 | 14.243 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.573 | 5.251 | 7.416 | 7.74 | 8.065 | 5.274 | 100.0% | 10 | | total | 6.13 | 16.495 | 31.238 | 31.36 | 31.481 | 19.518 | 100.0% | 10 | | -> duration | 6.13 | 16.495 | 31.238 | 31.36 | 31.481 | 19.518 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.865638 Full duration: 117.092585 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.143 | 11.147 | 14.116 | 15.177 | 16.238 | 11.203 | 100.0% | 10 | | cinder_v3.delete_volume | 2.361 | 5.608 | 8.723 | 10.045 | 11.367 | 5.868 | 100.0% | 10 | | total | 13.494 | 16.997 | 19.985 | 20.734 | 21.483 | 17.071 | 100.0% | 10 | | -> duration | 13.494 | 16.997 | 19.985 | 20.734 | 21.483 | 17.071 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.922292 Full duration: 82.214955 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 16.77 | 20.921 | 24.745 | 24.756 | 24.767 | 20.814 | 100.0% | 10 | | cinder_v3.delete_volume | 2.293 | 4.761 | 5.396 | 5.609 | 5.823 | 4.317 | 100.0% | 10 | | total | 19.063 | 26.25 | 28.287 | 28.384 | 28.482 | 25.131 | 100.0% | 10 | | -> duration | 19.063 | 26.25 | 28.287 | 28.384 | 28.482 | 25.131 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.713641 Full duration: 107.414615 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.552 | 10.778 | 14.095 | 14.839 | 15.584 | 10.695 | 100.0% | 10 | | cinder_v3.delete_volume | 2.465 | 6.408 | 10.909 | 12.617 | 14.324 | 7.307 | 100.0% | 10 | | total | 10.017 | 18.845 | 22.312 | 23.836 | 25.361 | 18.003 | 100.0% | 10 | | -> duration | 10.017 | 18.845 | 22.312 | 23.836 | 25.361 | 18.003 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.262352 Full duration: 84.553417 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.259 | 8.615 | 9.951 | 10.102 | 10.253 | 8.768 | 100.0% | 10 | | cinder_v3.extend_volume | 2.845 | 5.596 | 11.545 | 11.682 | 11.819 | 5.955 | 100.0% | 10 | | cinder_v3.delete_volume | 2.676 | 5.939 | 9.943 | 10.236 | 10.528 | 6.226 | 100.0% | 10 | | total | 12.974 | 22.165 | 26.387 | 26.414 | 26.44 | 20.952 | 100.0% | 10 | | -> duration | 12.974 | 22.165 | 26.387 | 26.414 | 26.44 | 20.952 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.269421 Full duration: 92.589399 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.81 | 11.919 | 12.79 | 12.932 | 13.074 | 11.741 | 100.0% | 10 | | cinder_v3.delete_volume | 4.963 | 7.327 | 11.384 | 11.883 | 12.382 | 8.284 | 100.0% | 10 | | total | 17.098 | 19.159 | 23.796 | 24.468 | 25.14 | 20.026 | 100.0% | 10 | | -> duration | 17.098 | 19.159 | 23.796 | 24.468 | 25.14 | 20.026 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.644157 Full duration: 115.329772 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.623 | 1.589 | 2.197 | 2.27 | 2.343 | 1.498 | 100.0% | 10 | | cinder_v3.get_qos | 0.028 | 0.034 | 0.039 | 0.039 | 0.039 | 0.034 | 100.0% | 10 | | total | 0.657 | 1.623 | 2.23 | 2.302 | 2.374 | 1.532 | 100.0% | 10 | | -> duration | 0.657 | 1.623 | 2.23 | 2.302 | 2.374 | 1.532 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.655901 Full duration: 34.032188 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.702 | 1.229 | 1.583 | 1.763 | 1.944 | 1.169 | 100.0% | 10 | | cinder_v3.list_qos | 0.032 | 0.041 | 0.046 | 0.048 | 0.05 | 0.041 | 100.0% | 10 | | total | 0.749 | 1.273 | 1.622 | 1.801 | 1.98 | 1.211 | 100.0% | 10 | | -> duration | 0.749 | 1.273 | 1.622 | 1.801 | 1.98 | 1.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.635609 Full duration: 35.220413 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.895 | 1.192 | 10.368 | 10.384 | 10.401 | 3.007 | 100.0% | 10 | | cinder_v3.set_qos | 0.162 | 0.943 | 6.915 | 8.391 | 9.866 | 2.415 | 100.0% | 10 | | total | 1.282 | 2.08 | 12.547 | 12.666 | 12.784 | 5.422 | 100.0% | 10 | | -> duration | 1.282 | 2.08 | 12.547 | 12.666 | 12.784 | 5.422 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.188907 Full duration: 41.753907 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.618 | 1.381 | 2.104 | 2.108 | 2.111 | 1.31 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.028 | 0.036 | 0.041 | 0.045 | 0.049 | 0.037 | 100.0% | 10 | | total | 0.653 | 1.415 | 2.14 | 2.144 | 2.148 | 1.347 | 100.0% | 10 | | -> duration | 0.653 | 1.415 | 2.14 | 2.144 | 2.148 | 1.347 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.716734 Full duration: 35.767215 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.708 | 1.55 | 2.087 | 2.212 | 2.338 | 1.481 | 100.0% | 10 | | cinder_v3.list_types | 0.035 | 0.045 | 0.051 | 0.053 | 0.054 | 0.044 | 100.0% | 10 | | total | 0.754 | 1.59 | 2.14 | 2.265 | 2.389 | 1.525 | 100.0% | 10 | | -> duration | 0.754 | 1.59 | 2.14 | 2.265 | 2.389 | 1.525 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.082449 Full duration: 35.847708 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.755 | 1.069 | 2.009 | 2.055 | 2.102 | 1.257 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.123 | 0.591 | 0.976 | 1.186 | 1.396 | 0.589 | 100.0% | 10 | | total | 0.909 | 1.708 | 2.725 | 2.878 | 3.032 | 1.846 | 100.0% | 10 | | -> duration | 0.909 | 1.708 | 2.725 | 2.878 | 3.032 | 1.846 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.11911 Full duration: 38.692964 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.819 | 1.348 | 3.337 | 3.341 | 3.345 | 1.881 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.454 | 0.615 | 1.198 | 1.257 | 1.315 | 0.761 | 100.0% | 10 | | total | 1.329 | 1.918 | 4.258 | 4.271 | 4.284 | 2.642 | 100.0% | 10 | | -> duration | 1.329 | 1.918 | 4.258 | 4.271 | 4.284 | 2.642 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.066336 Full duration: 41.463544 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 9acd9bcb-4ae1-4216-8890-d2e82643cf12 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.603 | 1.036 | 1.329 | 1.647 | 1.965 | 1.066 | 100.0% | 10 | | cinder_v2.add_type_access | 0.24 | 0.379 | 0.555 | 0.614 | 0.674 | 0.413 | 100.0% | 10 | | cinder_v2.list_type_access | 0.034 | 0.037 | 0.04 | 0.043 | 0.047 | 0.037 | 100.0% | 10 | | total | 0.996 | 1.384 | 1.909 | 2.222 | 2.534 | 1.516 | 100.0% | 10 | | -> duration | 0.996 | 1.384 | 1.909 | 2.222 | 2.534 | 1.516 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.099172 Full duration: 42.245369 HINTS: * To plot HTML graphics with this data, run: rally task report 9acd9bcb-4ae1-4216-8890-d2e82643cf12 --out output.html * To generate a JUnit report, run: rally task export 9acd9bcb-4ae1-4216-8890-d2e82643cf12 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 9acd9bcb-4ae1-4216-8890-d2e82643cf12 --json --out output.json 2021-02-06 17:33:31,334 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 9acd9bcb-4ae1-4216-8890-d2e82643cf12 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-02-06 17:33:31,407 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-02-06 17:33:31,437 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 17:33:31,860 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-02-06 18:25:07,082 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 5330c296-d3fd-4285-9f43-afa16e89a910 2021-02-06 18:25:08,342 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5330c296-d3fd-4285-9f43-afa16e89a910 -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.727 | 14.931 | 21.045 | 21.405 | 21.765 | 15.195 | 100.0% | 10 | | heat.list_stacks | 0.058 | 0.071 | 0.098 | 0.103 | 0.107 | 0.074 | 100.0% | 10 | | total | 8.8 | 14.99 | 21.152 | 21.507 | 21.862 | 15.269 | 100.0% | 10 | | -> duration | 6.8 | 12.99 | 19.152 | 19.507 | 19.862 | 13.269 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.007443 Full duration: 126.687843 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 39.742 | 46.322 | 53.283 | 53.401 | 53.52 | 46.586 | 100.0% | 10 | | heat.update_stack | 7.859 | 24.873 | 33.234 | 34.215 | 35.195 | 24.419 | 100.0% | 10 | | heat.delete_stack | 9.696 | 36.853 | 53.282 | 55.174 | 57.066 | 34.606 | 100.0% | 10 | | total | 62.146 | 103.006 | 140.01 | 142.764 | 145.518 | 105.611 | 100.0% | 10 | | -> duration | 58.146 | 99.006 | 136.01 | 138.764 | 141.518 | 101.611 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 284.475455 Full duration: 333.239131 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 34.876 | 40.951 | 51.969 | 52.158 | 52.347 | 43.057 | 100.0% | 10 | | heat.update_stack | 10.715 | 21.166 | 25.196 | 25.334 | 25.471 | 20.271 | 100.0% | 10 | | heat.delete_stack | 4.945 | 17.249 | 21.861 | 23.451 | 25.041 | 16.466 | 100.0% | 10 | | total | 52.356 | 78.034 | 97.986 | 98.503 | 99.021 | 79.794 | 100.0% | 10 | | -> duration | 48.356 | 74.034 | 93.986 | 94.503 | 95.021 | 75.794 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 220.043511 Full duration: 267.280014 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 40.35 | 44.416 | 72.091 | 73.583 | 75.075 | 54.558 | 100.0% | 10 | | heat.update_stack | 21.556 | 44.714 | 60.25 | 61.303 | 62.356 | 46.364 | 100.0% | 10 | | heat.delete_stack | 22.763 | 42.487 | 46.918 | 47.442 | 47.967 | 40.492 | 100.0% | 10 | | total | 89.544 | 134.575 | 173.956 | 174.616 | 175.277 | 141.415 | 100.0% | 10 | | -> duration | 85.544 | 130.575 | 169.956 | 170.616 | 171.277 | 137.415 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 397.268553 Full duration: 449.937986 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 45.596 | 54.675 | 82.65 | 83.231 | 83.812 | 62.439 | 100.0% | 10 | | heat.update_stack | 16.621 | 49.133 | 51.962 | 53.406 | 54.849 | 43.84 | 100.0% | 10 | | heat.delete_stack | 19.286 | 35.403 | 40.89 | 41.876 | 42.863 | 33.238 | 100.0% | 10 | | total | 82.479 | 142.637 | 165.48 | 168.436 | 171.392 | 139.517 | 100.0% | 10 | | -> duration | 78.479 | 138.637 | 161.48 | 164.436 | 167.392 | 135.517 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 385.563096 Full duration: 431.353347 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 59.011 | 67.246 | 87.338 | 87.352 | 87.366 | 72.015 | 100.0% | 10 | | heat.update_stack | 29.143 | 37.987 | 49.322 | 49.836 | 50.35 | 40.321 | 100.0% | 10 | | heat.delete_stack | 16.358 | 31.902 | 34.893 | 35.82 | 36.748 | 29.111 | 100.0% | 10 | | total | 104.512 | 144.541 | 157.984 | 158.945 | 159.907 | 141.448 | 100.0% | 10 | | -> duration | 100.512 | 140.541 | 153.984 | 154.945 | 155.907 | 137.448 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 400.465854 Full duration: 449.189708 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 36.911 | 47.392 | 54.865 | 56.007 | 57.149 | 47.602 | 100.0% | 10 | | heat.update_stack | 20.425 | 35.31 | 51.901 | 51.915 | 51.928 | 38.153 | 100.0% | 10 | | heat.delete_stack | 10.875 | 18.893 | 24.907 | 32.352 | 39.796 | 20.926 | 100.0% | 10 | | total | 90.616 | 99.975 | 122.623 | 132.436 | 142.249 | 106.682 | 100.0% | 10 | | -> duration | 86.616 | 95.975 | 118.623 | 128.436 | 138.249 | 102.682 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 299.696258 Full duration: 342.999342 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 28.241 | 36.702 | 40.51 | 41.558 | 42.606 | 36.019 | 100.0% | 10 | | heat.check_stack | 7.208 | 10.584 | 16.615 | 16.923 | 17.232 | 11.826 | 100.0% | 10 | | heat.delete_stack | 12.204 | 22.246 | 22.945 | 23.327 | 23.71 | 20.001 | 100.0% | 10 | | total | 50.971 | 70.754 | 72.022 | 72.118 | 72.214 | 67.846 | 100.0% | 10 | | -> duration | 48.971 | 68.754 | 70.022 | 70.118 | 70.214 | 65.846 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 198.721531 Full duration: 248.987064 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 28.743 | 42.951 | 60.043 | 60.693 | 61.343 | 45.034 | 100.0% | 10 | | heat.suspend_stack | 3.992 | 16.348 | 21.128 | 21.629 | 22.13 | 15.004 | 100.0% | 10 | | heat.resume_stack | 5.491 | 11.918 | 18.979 | 20.272 | 21.566 | 12.706 | 100.0% | 10 | | heat.delete_stack | 9.449 | 21.107 | 28.683 | 30.092 | 31.501 | 19.751 | 100.0% | 10 | | total | 69.424 | 90.592 | 108.45 | 110.757 | 113.064 | 92.496 | 100.0% | 10 | | -> duration | 67.424 | 88.592 | 106.45 | 108.757 | 111.064 | 90.496 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 263.167422 Full duration: 321.279945 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5330c296-d3fd-4285-9f43-afa16e89a910 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.618 | 0.773 | 1.214 | 1.219 | 1.224 | 0.837 | 100.0% | 10 | | total | 0.618 | 0.773 | 1.214 | 1.219 | 1.224 | 0.837 | 100.0% | 10 | | -> duration | 0.618 | 0.773 | 1.214 | 1.219 | 1.224 | 0.837 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.434719 Full duration: 47.379472 HINTS: * To plot HTML graphics with this data, run: rally task report 5330c296-d3fd-4285-9f43-afa16e89a910 --out output.html * To generate a JUnit report, run: rally task export 5330c296-d3fd-4285-9f43-afa16e89a910 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5330c296-d3fd-4285-9f43-afa16e89a910 --json --out output.json 2021-02-06 18:25:11,505 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5330c296-d3fd-4285-9f43-afa16e89a910 --out /home/opnfv/functest/results/rally_full/heat.json 2021-02-06 18:25:11,522 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-02-06 18:25:11,551 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 18:25:12,014 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-02-06 18:37:31,391 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 779697c9-92e9-4a12-91ab-fb237c35e543 2021-02-06 18:37:32,670 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 779697c9-92e9-4a12-91ab-fb237c35e543 -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.127 | 0.623 | 2.1 | 3.505 | 4.91 | 1.183 | 100.0% | 10 | | keystone_v3.add_role | 0.144 | 0.533 | 1.212 | 1.413 | 1.614 | 0.669 | 100.0% | 10 | | keystone_v3.revoke_role | 0.241 | 0.65 | 2.153 | 3.551 | 4.948 | 1.169 | 100.0% | 10 | | total | 1.06 | 2.38 | 6.356 | 6.523 | 6.69 | 3.022 | 100.0% | 10 | | -> duration | 1.06 | 2.38 | 6.356 | 6.523 | 6.69 | 3.022 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.063728 Full duration: 56.098177 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.127 | 1.284 | 3.411 | 3.532 | 3.652 | 1.487 | 100.0% | 10 | | keystone_v3.add_role | 0.082 | 0.686 | 1.04 | 1.428 | 1.816 | 0.694 | 100.0% | 10 | | keystone_v3.list_roles | 0.112 | 0.133 | 0.203 | 0.282 | 0.36 | 0.16 | 100.0% | 10 | | total | 0.364 | 2.443 | 4.249 | 4.369 | 4.489 | 2.342 | 100.0% | 10 | | -> duration | 0.364 | 2.443 | 4.249 | 4.369 | 4.489 | 2.342 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.183768 Full duration: 51.48754 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.305 | 0.659 | 1.093 | 1.622 | 2.152 | 0.786 | 100.0% | 10 | | keystone_v3.list_projects | 0.12 | 0.138 | 0.248 | 0.727 | 1.205 | 0.24 | 100.0% | 10 | | total | 0.448 | 0.816 | 1.705 | 1.998 | 2.291 | 1.026 | 100.0% | 10 | | -> duration | 0.448 | 0.816 | 1.705 | 1.998 | 2.291 | 1.026 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.942359 Full duration: 54.482715 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.438 | 0.544 | 1.019 | 1.443 | 1.867 | 0.698 | 100.0% | 10 | | keystone_v3.delete_role | 0.101 | 0.583 | 1.274 | 1.723 | 2.172 | 0.728 | 100.0% | 10 | | total | 0.704 | 1.026 | 2.497 | 2.598 | 2.7 | 1.426 | 100.0% | 10 | | -> duration | 0.704 | 1.026 | 2.497 | 2.598 | 2.7 | 1.426 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.570895 Full duration: 50.576972 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.204 | 1.012 | 1.291 | 1.316 | 1.341 | 0.871 | 100.0% | 10 | | keystone_v3.delete_service | 0.096 | 0.355 | 0.812 | 1.357 | 1.902 | 0.511 | 100.0% | 10 | | total | 0.494 | 1.313 | 1.891 | 2.491 | 3.091 | 1.382 | 100.0% | 10 | | -> duration | 0.494 | 1.313 | 1.891 | 2.491 | 3.091 | 1.382 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.209349 Full duration: 40.758392 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.267 | 0.804 | 2.991 | 3.134 | 3.278 | 1.28 | 100.0% | 10 | | keystone_v3.create_user | 0.702 | 1.785 | 3.41 | 3.76 | 4.109 | 1.97 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.039 | 0.056 | 0.143 | 0.174 | 0.205 | 0.082 | 100.0% | 10 | | -> keystone_v3.add_role | 0.207 | 0.64 | 1.065 | 1.139 | 1.212 | 0.692 | 100.0% | 10 | | keystone_v3.create_role | 0.106 | 0.469 | 0.682 | 0.782 | 0.881 | 0.451 | 100.0% | 10 | | keystone_v3.get_project | 0.035 | 0.042 | 0.235 | 0.252 | 0.268 | 0.082 | 100.0% | 10 | | keystone_v3.get_user | 0.033 | 0.042 | 0.462 | 0.813 | 1.164 | 0.195 | 100.0% | 10 | | keystone_v3.get_role | 0.033 | 0.038 | 0.366 | 0.487 | 0.609 | 0.125 | 100.0% | 10 | | keystone_v3.list_services | 0.038 | 0.042 | 0.121 | 0.172 | 0.223 | 0.067 | 100.0% | 10 | | keystone_v3.get_services | 0.033 | 0.039 | 0.326 | 0.348 | 0.37 | 0.102 | 100.0% | 10 | | total | 1.998 | 4.187 | 6.389 | 6.563 | 6.736 | 4.405 | 100.0% | 10 | | -> duration | 1.998 | 4.187 | 6.389 | 6.563 | 6.736 | 4.405 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.959963 Full duration: 75.921077 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.391 | 1.36 | 2.57 | 3.345 | 4.121 | 1.595 | 100.0% | 10 | | keystone_v3.update_project | 0.703 | 0.91 | 1.767 | 1.8 | 1.833 | 1.113 | 100.0% | 10 | | keystone_v3.delete_project | 0.365 | 1.359 | 2.953 | 3.185 | 3.417 | 1.502 | 100.0% | 10 | | total | 1.936 | 4.44 | 5.73 | 5.813 | 5.897 | 4.211 | 100.0% | 10 | | -> duration | 1.936 | 4.44 | 5.73 | 5.813 | 5.897 | 4.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.065027 Full duration: 49.525111 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.206 | 1.856 | 8.721 | 9.055 | 9.389 | 3.213 | 100.0% | 10 | | total | 0.663 | 1.928 | 8.797 | 9.136 | 9.476 | 3.38 | 100.0% | 10 | | -> duration | 0.663 | 1.928 | 8.797 | 9.136 | 9.476 | 3.38 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.868111 Full duration: 40.811746 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.372 | 0.673 | 1.441 | 1.502 | 1.564 | 0.839 | 100.0% | 10 | | total | 0.372 | 0.673 | 1.441 | 1.502 | 1.564 | 0.839 | 100.0% | 10 | | -> duration | 0.372 | 0.673 | 1.441 | 1.502 | 1.564 | 0.839 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.046029 Full duration: 39.233869 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.487 | 1.002 | 2.224 | 2.27 | 2.316 | 1.248 | 100.0% | 10 | | keystone_v3.list_users | 0.062 | 0.073 | 0.097 | 0.168 | 0.238 | 0.089 | 100.0% | 10 | | total | 0.666 | 1.23 | 2.376 | 2.42 | 2.465 | 1.414 | 100.0% | 10 | | -> duration | 0.666 | 1.23 | 2.376 | 2.42 | 2.465 | 1.414 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.106501 Full duration: 44.75044 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 779697c9-92e9-4a12-91ab-fb237c35e543 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.697 | 2.16 | 4.565 | 4.884 | 5.203 | 2.437 | 100.0% | 10 | | keystone_v3.create_users | 11.571 | 20.535 | 25.418 | 27.148 | 28.878 | 20.503 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 11.571 | 20.534 | 25.418 | 27.148 | 28.877 | 20.502 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.631 | 1.2 | 2.739 | 2.822 | 2.906 | 1.457 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.187 | 8.429 | 9.818 | 9.928 | 10.037 | 7.763 | 100.0% | 10 | | total | 14.424 | 22.691 | 30.816 | 32.315 | 33.815 | 24.014 | 100.0% | 10 | | -> duration | 14.424 | 22.691 | 30.816 | 32.315 | 33.815 | 24.014 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.969267 Full duration: 205.675884 HINTS: * To plot HTML graphics with this data, run: rally task report 779697c9-92e9-4a12-91ab-fb237c35e543 --out output.html * To generate a JUnit report, run: rally task export 779697c9-92e9-4a12-91ab-fb237c35e543 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 779697c9-92e9-4a12-91ab-fb237c35e543 --json --out output.json 2021-02-06 18:37:35,777 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 779697c9-92e9-4a12-91ab-fb237c35e543 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-02-06 18:37:35,799 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-02-06 18:37:35,836 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 18:37:36,301 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-02-06 18:59:01,095 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 2021-02-06 18:59:02,396 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.648 | 4.231 | 6.073 | 6.17 | 6.267 | 4.108 | 100.0% | 10 | | neutron.update_network | 1.172 | 1.583 | 2.367 | 2.553 | 2.74 | 1.694 | 100.0% | 10 | | total | 3.296 | 5.607 | 8.613 | 8.702 | 8.791 | 5.803 | 100.0% | 10 | | -> duration | 3.296 | 5.607 | 8.613 | 8.702 | 8.791 | 5.803 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.810985 Full duration: 69.668465 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.301 | 3.728 | 4.707 | 4.855 | 5.002 | 3.783 | 100.0% | 10 | | neutron.update_port | 1.138 | 1.545 | 1.908 | 1.974 | 2.04 | 1.556 | 100.0% | 10 | | total | 3.662 | 5.373 | 6.66 | 6.671 | 6.681 | 5.339 | 100.0% | 10 | | -> duration | 3.662 | 5.373 | 6.66 | 6.671 | 6.681 | 5.339 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.878154 Full duration: 92.553261 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.91 | 5.759 | 10.765 | 10.897 | 11.029 | 6.63 | 100.0% | 10 | | neutron.create_subnet | 3.909 | 5.105 | 6.445 | 8.613 | 10.78 | 5.643 | 100.0% | 10 | | neutron.update_subnet | 1.015 | 2.786 | 7.133 | 7.306 | 7.48 | 3.849 | 100.0% | 10 | | total | 9.132 | 16.65 | 19.314 | 20.441 | 21.567 | 16.122 | 100.0% | 10 | | -> duration | 9.132 | 16.65 | 19.314 | 20.441 | 21.567 | 16.122 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.697386 Full duration: 110.119837 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.3 | 3.413 | 4.744 | 4.875 | 5.006 | 3.555 | 100.0% | 10 | | neutron.delete_network | 1.281 | 2.315 | 3.204 | 3.365 | 3.526 | 2.375 | 100.0% | 10 | | total | 4.147 | 5.575 | 7.623 | 7.724 | 7.826 | 5.93 | 100.0% | 10 | | -> duration | 4.147 | 5.575 | 7.623 | 7.724 | 7.826 | 5.93 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.731601 Full duration: 72.591348 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.913 | 4.275 | 6.312 | 6.356 | 6.4 | 4.503 | 100.0% | 10 | | neutron.delete_port | 0.987 | 1.542 | 1.835 | 2.13 | 2.424 | 1.545 | 100.0% | 10 | | total | 4.346 | 5.825 | 7.871 | 7.874 | 7.877 | 6.049 | 100.0% | 10 | | -> duration | 4.346 | 5.825 | 7.871 | 7.874 | 7.877 | 6.049 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.00934 Full duration: 95.321352 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.876 | 4.383 | 6.598 | 7.22 | 7.842 | 4.679 | 100.0% | 10 | | neutron.create_subnet | 2.84 | 3.273 | 4.003 | 4.058 | 4.114 | 3.41 | 100.0% | 10 | | neutron.delete_subnet | 0.766 | 1.544 | 1.845 | 1.856 | 1.868 | 1.455 | 100.0% | 10 | | total | 7.417 | 9.587 | 11.201 | 11.863 | 12.526 | 9.545 | 100.0% | 10 | | -> duration | 7.417 | 9.587 | 11.201 | 11.863 | 12.526 | 9.545 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.46261 Full duration: 84.466562 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.409 | 3.004 | 7.273 | 7.409 | 7.545 | 3.938 | 100.0% | 10 | | neutron.list_networks | 0.159 | 0.403 | 1.168 | 1.418 | 1.668 | 0.594 | 100.0% | 10 | | total | 1.576 | 3.3 | 8.124 | 8.355 | 8.586 | 4.532 | 100.0% | 10 | | -> duration | 1.576 | 3.3 | 8.124 | 8.355 | 8.586 | 4.532 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.196804 Full duration: 80.013929 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.269 | 6.691 | 7.885 | 8.097 | 8.308 | 6.26 | 100.0% | 10 | | neutron.list_ports | 0.117 | 0.192 | 0.85 | 1.717 | 2.583 | 0.501 | 100.0% | 10 | | total | 4.215 | 6.825 | 8.117 | 8.43 | 8.743 | 6.761 | 100.0% | 10 | | -> duration | 4.215 | 6.825 | 8.117 | 8.43 | 8.743 | 6.761 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.955915 Full duration: 126.059047 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.705 | 4.653 | 7.542 | 7.814 | 8.085 | 5.072 | 100.0% | 10 | | neutron.create_subnet | 2.663 | 3.51 | 5.286 | 5.289 | 5.292 | 3.808 | 100.0% | 10 | | neutron.list_subnets | 0.086 | 0.105 | 0.716 | 1.486 | 2.256 | 0.425 | 100.0% | 10 | | total | 7.509 | 8.893 | 11.26 | 11.992 | 12.724 | 9.306 | 100.0% | 10 | | -> duration | 7.509 | 8.893 | 11.26 | 11.992 | 12.724 | 9.306 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.896761 Full duration: 85.835942 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.485 | 4.955 | 5.808 | 5.861 | 5.915 | 4.813 | 100.0% | 10 | | neutron.delete_security_group | 0.234 | 0.606 | 0.877 | 0.893 | 0.91 | 0.59 | 100.0% | 10 | | total | 3.093 | 5.582 | 6.058 | 6.187 | 6.315 | 5.403 | 100.0% | 10 | | -> duration | 3.093 | 5.582 | 6.058 | 6.187 | 6.315 | 5.403 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.180123 Full duration: 69.349042 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.999 | 2.649 | 3.344 | 3.476 | 3.608 | 2.732 | 100.0% | 10 | | neutron.create_security_group_rule | 0.674 | 1.811 | 4.392 | 4.618 | 4.844 | 2.122 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.222 | 0.811 | 2.136 | 2.384 | 2.632 | 1.026 | 100.0% | 10 | | neutron.delete_security_group | 0.68 | 1.062 | 1.692 | 1.855 | 2.018 | 1.158 | 100.0% | 10 | | total | 4.68 | 6.581 | 9.005 | 9.307 | 9.61 | 7.038 | 100.0% | 10 | | -> duration | 4.68 | 6.581 | 9.005 | 9.307 | 9.61 | 7.038 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.234524 Full duration: 74.609623 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.953 | 5.278 | 6.482 | 6.653 | 6.825 | 4.86 | 100.0% | 10 | | neutron.create_security_group_rule | 1.451 | 2.449 | 3.078 | 3.673 | 4.269 | 2.522 | 100.0% | 10 | | neutron.list_security_group_rules | 0.066 | 0.623 | 0.902 | 0.975 | 1.047 | 0.555 | 100.0% | 10 | | total | 4.585 | 8.675 | 9.032 | 9.61 | 10.188 | 7.936 | 100.0% | 10 | | -> duration | 4.585 | 8.675 | 9.032 | 9.61 | 10.188 | 7.936 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.758949 Full duration: 74.943581 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.662 | 4.331 | 5.205 | 5.386 | 5.567 | 3.993 | 100.0% | 10 | | neutron.show_security_group | 0.072 | 0.085 | 0.097 | 0.1 | 0.104 | 0.087 | 100.0% | 10 | | total | 1.756 | 4.415 | 5.297 | 5.469 | 5.64 | 4.08 | 100.0% | 10 | | -> duration | 1.756 | 4.415 | 5.297 | 5.469 | 5.64 | 4.08 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.852361 Full duration: 62.88788 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 23.150744 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 5.935 | 7.294 | 10.213 | 10.417 | 10.622 | 7.944 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.173 | 0.932 | 1.323 | 1.499 | 1.676 | 0.87 | 100.0% | 10 | | total | 6.995 | 8.209 | 11.846 | 11.857 | 11.869 | 8.815 | 100.0% | 10 | | -> duration | 6.995 | 8.209 | 11.846 | 11.857 | 11.869 | 8.815 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.11687 Full duration: 116.615026 HINTS: * To plot HTML graphics with this data, run: rally task report 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 --out output.html * To generate a JUnit report, run: rally task export 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-06 18:59:05,523 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4b0b6689-cb4d-4445-9a4b-3444c5be5df9 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-02-06 18:59:05,545 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-02-06 18:59:05,586 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 18:59:06,080 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-02-06 19:43:22,901 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 2021-02-06 19:43:24,176 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.059 | 2.29 | 3.852 | 4.078 | 4.304 | 2.576 | 100.0% | 10 | | nova.delete_keypair | 0.273 | 1.75 | 2.735 | 2.744 | 2.754 | 1.654 | 100.0% | 10 | | total | 1.331 | 4.75 | 5.89 | 5.971 | 6.051 | 4.23 | 100.0% | 10 | | -> duration | 1.331 | 4.75 | 5.89 | 5.971 | 6.051 | 4.23 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.815822 Full duration: 78.901756 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.767 | 1.45 | 2.025 | 2.254 | 2.484 | 1.513 | 100.0% | 10 | | nova.list_keypairs | 0.034 | 0.041 | 0.071 | 0.126 | 0.182 | 0.057 | 100.0% | 10 | | total | 0.808 | 1.49 | 2.192 | 2.355 | 2.518 | 1.57 | 100.0% | 10 | | -> duration | 0.808 | 1.49 | 2.192 | 2.355 | 2.518 | 1.57 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.144105 Full duration: 45.623907 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 32.794 | 51.601 | 56.186 | 59.291 | 62.396 | 48.573 | 100.0% | 10 | | nova.reboot_server | 8.419 | 17.234 | 24.438 | 25.668 | 26.897 | 18.06 | 100.0% | 10 | | nova.soft_reboot_server | 11.659 | 14.26 | 35.353 | 89.257 | 143.162 | 27.703 | 100.0% | 10 | | nova.stop_and_start_server | 11.826 | 18.226 | 25.956 | 27.907 | 29.858 | 19.455 | 100.0% | 10 | | -> nova.stop_server | 5.431 | 8.808 | 17.378 | 17.702 | 18.026 | 10.43 | 100.0% | 10 | | -> nova.start_server | 6.394 | 8.355 | 11.9 | 12.212 | 12.523 | 9.025 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 14.896 | 23.374 | 29.196 | 30.005 | 30.814 | 22.995 | 100.0% | 10 | | -> nova.rescue_server | 9.68 | 15.023 | 21.185 | 21.222 | 21.26 | 15.15 | 100.0% | 10 | | -> nova.unrescue_server | 5.097 | 7.892 | 10.235 | 10.319 | 10.402 | 7.845 | 100.0% | 10 | | nova.delete_server | 5.826 | 10.719 | 20.122 | 21.085 | 22.048 | 13.531 | 100.0% | 10 | | total | 98.561 | 150.093 | 167.631 | 199.575 | 231.52 | 150.384 | 100.0% | 10 | | -> duration | 89.561 | 141.093 | 158.631 | 190.575 | 222.52 | 141.384 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 477.826916 Full duration: 532.694937 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 29.405 | 53.107 | 64.063 | 68.953 | 73.843 | 53.787 | 100.0% | 10 | | nova.delete_server | 14.861 | 27.64 | 35.421 | 36.116 | 36.81 | 26.368 | 100.0% | 10 | | total | 44.87 | 80.346 | 99.969 | 102.858 | 105.747 | 80.155 | 100.0% | 10 | | -> duration | 43.87 | 79.346 | 98.969 | 101.858 | 104.747 | 79.155 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 222.248232 Full duration: 278.613975 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.701 | 41.32 | 45.623 | 47.206 | 48.789 | 40.157 | 100.0% | 10 | | nova.list_servers | 0.392 | 0.417 | 0.446 | 0.446 | 0.447 | 0.419 | 100.0% | 10 | | total | 28.148 | 41.753 | 46.021 | 47.627 | 49.233 | 40.576 | 100.0% | 10 | | -> duration | 27.148 | 40.753 | 45.021 | 46.627 | 48.233 | 39.576 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 110.017782 Full duration: 207.596684 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "from_image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "to_image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 36.134 | 58.87 | 77.257 | 78.51 | 79.764 | 58.736 | 100.0% | 10 | | nova.rebuild_server | 19.245 | 38.171 | 48.649 | 52.218 | 55.786 | 37.536 | 100.0% | 10 | | nova.delete_server | 14.308 | 21.377 | 39.656 | 39.847 | 40.039 | 24.776 | 100.0% | 10 | | total | 71.801 | 126.902 | 148.967 | 155.47 | 161.974 | 121.048 | 100.0% | 10 | | -> duration | 69.801 | 124.902 | 146.967 | 153.47 | 159.974 | 119.048 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 337.722611 Full duration: 385.753227 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 75.016 | 83.216 | 141.139 | 141.275 | 141.412 | 100.617 | 100.0% | 10 | | nova.snapshot_server | 18.643 | 26.93 | 35.938 | 37.796 | 39.655 | 26.545 | 100.0% | 10 | | -> glance_v2.get_image | 0.064 | 0.087 | 0.1 | 0.103 | 0.106 | 0.088 | 100.0% | 10 | | -> glance.wait_for_image | 16.384 | 22.498 | 24.832 | 25.725 | 26.618 | 21.718 | 100.0% | 10 | | --> glance_v2.get_image (x11) | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 100.0% | 1 | | --> glance_v2.get_image (x13) | 0.544 | 0.557 | 0.592 | 0.597 | 0.601 | 0.567 | 100.0% | 3 | | --> glance_v2.get_image (x10) | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 100.0% | 1 | | --> glance_v2.get_image (x14) | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 100.0% | 1 | | --> glance_v2.get_image (x12) | 0.471 | 0.473 | 0.475 | 0.475 | 0.475 | 0.473 | 100.0% | 2 | | --> glance_v2.get_image (x9) | 0.365 | 0.37 | 0.374 | 0.375 | 0.375 | 0.37 | 100.0% | 2 | | nova.delete_server (x2) | 18.666 | 30.389 | 44.769 | 53.377 | 61.986 | 33.616 | 100.0% | 10 | | nova.delete_image | 4.116 | 6.537 | 8.841 | 9.421 | 10.001 | 6.524 | 100.0% | 10 | | -> glance_v2.delete_image | 4.071 | 6.499 | 8.8 | 9.381 | 9.962 | 6.481 | 100.0% | 10 | | -> glance.wait_for_delete | 0.034 | 0.04 | 0.046 | 0.053 | 0.061 | 0.041 | 100.0% | 10 | | --> glance_v2.get_image | 0.033 | 0.039 | 0.046 | 0.053 | 0.061 | 0.041 | 0.0% | 10 | | total | 126.959 | 152.341 | 214.745 | 216.262 | 217.778 | 167.303 | 100.0% | 10 | | -> duration | 124.959 | 150.341 | 212.745 | 214.262 | 215.778 | 165.303 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 473.243708 Full duration: 517.955944 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "volume_size": 1, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 23.714 | 27.636 | 32.203 | 38.752 | 45.302 | 29.227 | 100.0% | 10 | | nova.boot_server | 35.258 | 57.063 | 68.236 | 69.539 | 70.841 | 54.935 | 100.0% | 10 | | total | 62.853 | 85.053 | 96.584 | 96.82 | 97.055 | 84.162 | 100.0% | 10 | | -> duration | 61.853 | 84.053 | 95.584 | 95.82 | 96.055 | 83.162 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 235.543336 Full duration: 344.698834 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "image": { "name": "rally_full-img_8c820d1e-6a1e-44e4-8f17-520d55a9bacc" }, "nics": [ { "net-id": "5c3b4d5e-404d-4d09-acb1-dd358d059a23" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 has 1 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 327, in run auto_assign_nic=auto_assign_nic, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 16.915 | 42.602 | 57.108 | 58.366 | 59.624 | 43.19 | 90.0% | 10 | | total | 16.915 | 42.602 | 57.108 | 58.366 | 59.624 | 43.19 | 90.0% | 10 | | -> duration | 15.915 | 41.602 | 56.108 | 57.366 | 58.624 | 42.19 | 90.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 90.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 129.209747 Full duration: 197.676874 HINTS: * To plot HTML graphics with this data, run: rally task report 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 --out output.html * To generate a JUnit report, run: rally task export 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-06 19:43:27,281 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7f2c677c-9a0d-40d4-857c-ce7b51eeb301 --out /home/opnfv/functest/results/rally_full/nova.json 2021-02-06 19:43:27,301 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-02-06 19:43:27,327 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 19:43:27,885 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-02-06 19:45:43,947 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 2971eb3c-bec4-4227-b68c-b68608d3f621 2021-02-06 19:45:45,194 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2971eb3c-bec4-4227-b68c-b68608d3f621 -------------------------------------------------------------------------------- Task 2971eb3c-bec4-4227-b68c-b68608d3f621: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2971eb3c-bec4-4227-b68c-b68608d3f621 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.295 | 1.83 | 2.078 | 2.1 | 2.123 | 1.749 | 100.0% | 10 | | quotas.delete_quotas | 0.029 | 0.532 | 0.79 | 1.095 | 1.399 | 0.48 | 100.0% | 10 | | total | 1.453 | 2.344 | 2.735 | 3.005 | 3.275 | 2.228 | 100.0% | 10 | | -> duration | 1.453 | 2.344 | 2.735 | 3.005 | 3.275 | 2.228 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.422827 Full duration: 35.222091 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2971eb3c-bec4-4227-b68c-b68608d3f621 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.813 | 2.609 | 4.218 | 4.245 | 4.272 | 2.732 | 100.0% | 10 | | total | 0.813 | 2.609 | 4.218 | 4.245 | 4.273 | 2.732 | 100.0% | 10 | | -> duration | 0.813 | 2.609 | 4.218 | 4.245 | 4.273 | 2.732 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.141608 Full duration: 34.278185 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2971eb3c-bec4-4227-b68c-b68608d3f621 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 6.232 | 8.739 | 10.96 | 11.034 | 11.107 | 8.665 | 100.0% | 10 | | total | 6.232 | 8.739 | 10.96 | 11.034 | 11.107 | 8.665 | 100.0% | 10 | | -> duration | 6.232 | 8.739 | 10.96 | 11.034 | 11.107 | 8.665 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.109557 Full duration: 45.115997 HINTS: * To plot HTML graphics with this data, run: rally task report 2971eb3c-bec4-4227-b68c-b68608d3f621 --out output.html * To generate a JUnit report, run: rally task export 2971eb3c-bec4-4227-b68c-b68608d3f621 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2971eb3c-bec4-4227-b68c-b68608d3f621 --json --out output.json 2021-02-06 19:45:48,161 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2971eb3c-bec4-4227-b68c-b68608d3f621 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-02-06 19:45:48,167 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-02-06 19:45:48,199 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-06 19:45:48,384 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-02-06 19:54:50,104 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 794bc7ea-81f1-46f4-af15-2b3857b5204e 2021-02-06 19:54:51,364 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 794bc7ea-81f1-46f4-af15-2b3857b5204e -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.986 | 1.1 | 1.273 | 1.276 | 1.279 | 1.129 | 100.0% | 10 | | swift.upload_object (x2) | 1.009 | 1.086 | 1.201 | 1.204 | 1.208 | 1.094 | 100.0% | 10 | | swift.list_objects | 0.879 | 0.949 | 0.982 | 1.007 | 1.031 | 0.945 | 100.0% | 10 | | total | 2.913 | 3.161 | 3.419 | 3.442 | 3.465 | 3.169 | 100.0% | 10 | | -> duration | 2.913 | 3.161 | 3.419 | 3.442 | 3.465 | 3.169 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.743194 Full duration: 97.822252 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.313 | 1.397 | 1.523 | 1.534 | 1.546 | 1.417 | 100.0% | 10 | | swift.list_objects | 0.91 | 0.954 | 0.992 | 1.0 | 1.008 | 0.954 | 100.0% | 10 | | total | 2.234 | 2.338 | 2.478 | 2.516 | 2.554 | 2.371 | 100.0% | 10 | | -> duration | 2.234 | 2.338 | 2.478 | 2.516 | 2.554 | 2.371 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.768972 Full duration: 74.466722 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.004 | 1.18 | 1.327 | 1.357 | 1.387 | 1.183 | 100.0% | 10 | | swift.upload_object (x5) | 2.693 | 2.834 | 2.917 | 2.92 | 2.924 | 2.83 | 100.0% | 10 | | swift.download_object (x5) | 2.471 | 2.565 | 2.602 | 2.607 | 2.612 | 2.559 | 100.0% | 10 | | total | 6.402 | 6.588 | 6.705 | 6.717 | 6.73 | 6.574 | 100.0% | 10 | | -> duration | 6.402 | 6.588 | 6.705 | 6.717 | 6.73 | 6.574 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.795361 Full duration: 134.95805 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.004 | 1.221 | 1.303 | 1.316 | 1.328 | 1.189 | 100.0% | 10 | | swift.upload_object (x5) | 2.785 | 2.98 | 3.195 | 3.23 | 3.265 | 3.004 | 100.0% | 10 | | swift.delete_object (x5) | 2.499 | 2.754 | 2.894 | 2.907 | 2.92 | 2.734 | 100.0% | 10 | | swift.delete_container | 0.637 | 0.699 | 0.814 | 0.957 | 1.101 | 0.732 | 100.0% | 10 | | total | 7.308 | 7.55 | 8.154 | 8.271 | 8.388 | 7.66 | 100.0% | 10 | | -> duration | 7.308 | 7.55 | 8.154 | 8.271 | 8.388 | 7.66 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.661503 Full duration: 112.389964 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 794bc7ea-81f1-46f4-af15-2b3857b5204e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.381 | 1.509 | 1.62 | 1.647 | 1.674 | 1.497 | 100.0% | 10 | | swift.list_objects | 0.886 | 0.972 | 1.02 | 1.049 | 1.078 | 0.959 | 100.0% | 10 | | swift.download_object (x5) | 2.305 | 2.364 | 2.482 | 2.49 | 2.497 | 2.378 | 100.0% | 10 | | total | 4.599 | 4.832 | 5.018 | 5.056 | 5.093 | 4.835 | 100.0% | 10 | | -> duration | 4.599 | 4.832 | 5.018 | 5.056 | 5.093 | 4.835 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.40434 Full duration: 96.342356 HINTS: * To plot HTML graphics with this data, run: rally task report 794bc7ea-81f1-46f4-af15-2b3857b5204e --out output.html * To generate a JUnit report, run: rally task export 794bc7ea-81f1-46f4-af15-2b3857b5204e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 794bc7ea-81f1-46f4-af15-2b3857b5204e --json --out output.json 2021-02-06 19:54:54,325 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 794bc7ea-81f1-46f4-af15-2b3857b5204e --out /home/opnfv/functest/results/rally_full/swift.json 2021-02-06 19:54:54,340 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-02-06 19:54:54,343 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:55 | 60 | 100.00% | | glance | 00:08:21 | 39 | 92.31% | | cinder | 00:48:34 | 240 | 100.00% | | heat | 00:50:18 | 100 | 100.00% | | keystone | 00:11:49 | 110 | 100.00% | | neutron | 00:20:38 | 140 | 100.00% | | nova | 00:43:09 | 90 | 98.89% | | quotas | 00:01:54 | 30 | 100.00% | | swift | 00:08:35 | 50 | 100.00% | | | | | | | TOTAL: | 03:16:17 | 859 | 99.53% | +----------------+------------+----------------+-----------+ 2021-02-06 19:54:54,343 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.53% in 6/9 modules 2021-02-06 19:54:58,005 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-02-06 19:55:01,622 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-02-06 19:55:01,622 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 203:46 | FAIL | +--------------------+------------------+------------------+----------------+