2021-03-13 15:42:10,778 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | JRQ35C03GWNW | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/JRQ35C03GWNW/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-202 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/JRQ35C03GWNW/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-202 | +-------------------------+------------------------------------------------------------+ 2021-03-13 15:42:10,796 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-03-13 15:42:14,507 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-03-13 15:42:20,473 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-03-13 15:42:26,932 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 3743ba9b-a556-41cf-b568-227e5f77ee47 | 2021-03-13T15:42:26.660710 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 3743ba9b-a556-41cf-b568-227e5f77ee47 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-03-13 15:42:31,645 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-03-13 15:42:33,416 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 15:42:33,575 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-03-13 15:45:20,355 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: c5d10e32-fcd4-4a4c-afde-6ef17881a17f 2021-03-13 15:45:21,575 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c5d10e32-fcd4-4a4c-afde-6ef17881a17f -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.945 | 1.355 | 1.696 | 1.79 | 1.885 | 1.361 | 100.0% | 10 | | total | 0.945 | 1.355 | 1.696 | 1.79 | 1.885 | 1.361 | 100.0% | 10 | | -> duration | 0.945 | 1.355 | 1.696 | 1.79 | 1.885 | 1.361 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.196918 Full duration: 24.876896 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.137 | 0.177 | 0.376 | 0.481 | 0.586 | 0.234 | 100.0% | 10 | | total | 0.582 | 0.873 | 1.237 | 1.255 | 1.274 | 0.899 | 100.0% | 10 | | -> duration | 0.582 | 0.873 | 1.237 | 1.255 | 1.274 | 0.899 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.695507 Full duration: 20.631755 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.278 | 0.392 | 0.726 | 0.791 | 0.857 | 0.467 | 100.0% | 10 | | total | 0.754 | 1.017 | 1.284 | 1.33 | 1.376 | 1.07 | 100.0% | 10 | | -> duration | 0.754 | 1.017 | 1.284 | 1.33 | 1.376 | 1.07 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.169373 Full duration: 23.367741 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.144 | 0.172 | 0.368 | 0.396 | 0.424 | 0.231 | 100.0% | 10 | | total | 0.607 | 0.832 | 1.396 | 1.658 | 1.921 | 0.957 | 100.0% | 10 | | -> duration | 0.607 | 0.832 | 1.396 | 1.658 | 1.921 | 0.957 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.545711 Full duration: 22.959134 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.346 | 0.559 | 0.901 | 1.047 | 1.193 | 0.641 | 100.0% | 10 | | total | 0.853 | 1.222 | 1.831 | 1.875 | 1.92 | 1.323 | 100.0% | 10 | | -> duration | 0.853 | 1.222 | 1.831 | 1.875 | 1.92 | 1.323 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.718675 Full duration: 26.835774 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c5d10e32-fcd4-4a4c-afde-6ef17881a17f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.154 | 0.237 | 0.623 | 0.706 | 0.789 | 0.329 | 100.0% | 10 | | total | 0.633 | 1.019 | 1.393 | 1.423 | 1.453 | 1.023 | 100.0% | 10 | | -> duration | 0.633 | 1.019 | 1.393 | 1.423 | 1.453 | 1.023 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.721647 Full duration: 22.532434 HINTS: * To plot HTML graphics with this data, run: rally task report c5d10e32-fcd4-4a4c-afde-6ef17881a17f --out output.html * To generate a JUnit report, run: rally task export c5d10e32-fcd4-4a4c-afde-6ef17881a17f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c5d10e32-fcd4-4a4c-afde-6ef17881a17f --json --out output.json 2021-03-13 15:45:24,551 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c5d10e32-fcd4-4a4c-afde-6ef17881a17f --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-03-13 15:45:24,560 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-03-13 15:45:24,592 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 15:45:24,768 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-03-13 15:52:57,028 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 2021-03-13 15:52:58,276 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 -------------------------------------------------------------------------------- Task 36a8d892-06ab-4a4c-a1f8-92075c4e6d34: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.189 | 6.352 | 6.934 | 7.104 | 7.274 | 6.328 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.092 | 0.098 | 0.104 | 0.111 | 0.118 | 0.099 | 100.0% | 10 | | -> glance_v2.upload_data | 2.688 | 3.148 | 4.095 | 4.325 | 4.555 | 3.351 | 100.0% | 10 | | glance_v2.delete_image | 1.916 | 2.979 | 3.611 | 3.951 | 4.292 | 2.926 | 100.0% | 10 | | total | 8.187 | 9.331 | 10.146 | 10.179 | 10.212 | 9.255 | 100.0% | 10 | | -> duration | 8.187 | 9.331 | 10.146 | 10.179 | 10.212 | 9.255 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.707709 Full duration: 52.31896 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.038 | 5.714 | 5.957 | 6.01 | 6.063 | 5.643 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.086 | 0.109 | 0.192 | 0.197 | 0.201 | 0.123 | 100.0% | 10 | | -> glance_v2.upload_data | 2.463 | 2.999 | 3.234 | 3.31 | 3.387 | 2.993 | 100.0% | 10 | | glance_v2.list_images | 0.053 | 0.061 | 0.088 | 0.091 | 0.094 | 0.066 | 100.0% | 10 | | total | 5.099 | 5.804 | 6.011 | 6.069 | 6.128 | 5.709 | 100.0% | 10 | | -> duration | 5.099 | 5.804 | 6.011 | 6.069 | 6.128 | 5.709 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.382843 Full duration: 52.94969 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.16 | 0.17 | 0.601 | 0.649 | 0.698 | 0.276 | 100.0% | 10 | | total | 0.16 | 0.17 | 0.601 | 0.649 | 0.698 | 0.276 | 100.0% | 10 | | -> duration | 0.16 | 0.17 | 0.601 | 0.649 | 0.698 | 0.276 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.420332 Full duration: 26.389933 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 has 3 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.448 | 8.011 | 9.767 | 10.274 | 10.781 | 7.948 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.085 | 0.095 | 0.121 | 0.157 | 0.192 | 0.105 | 100.0% | 9 | | -> glance_v2.upload_data | 2.789 | 3.878 | 5.69 | 6.34 | 6.991 | 4.432 | 100.0% | 9 | | nova.boot_servers | 14.512 | 67.361 | 83.776 | 87.348 | 90.921 | 65.56 | 66.7% | 9 | | total | 23.022 | 73.99 | 90.858 | 95.02 | 99.183 | 73.509 | 66.7% | 9 | | -> duration | 22.022 | 72.99 | 89.858 | 94.02 | 98.183 | 72.509 | 66.7% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 66.7% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 195.751992 Full duration: 293.609987 HINTS: * To plot HTML graphics with this data, run: rally task report 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 --out output.html * To generate a JUnit report, run: rally task export 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 --json --out output.json At least one workload did not pass SLA criteria. 2021-03-13 15:53:01,249 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 36a8d892-06ab-4a4c-a1f8-92075c4e6d34 --out /home/opnfv/functest/results/rally_full/glance.json 2021-03-13 15:53:01,260 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-03-13 15:53:01,305 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 15:53:02,008 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-03-13 16:37:25,042 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 26ee7269-23c4-40db-bff0-805fb84e3fe3 2021-03-13 16:37:26,419 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 26ee7269-23c4-40db-bff0-805fb84e3fe3 -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "size": 1, "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 26.393 | 38.135 | 45.146 | 46.368 | 47.59 | 38.1 | 100.0% | 10 | | cinder_v3.create_volume | 4.366 | 10.429 | 14.61 | 14.903 | 15.197 | 10.46 | 100.0% | 10 | | nova.attach_volume | 9.387 | 14.574 | 22.541 | 25.346 | 28.151 | 16.035 | 100.0% | 10 | | nova.detach_volume | 3.694 | 5.735 | 6.66 | 6.693 | 6.726 | 5.469 | 100.0% | 10 | | cinder_v3.delete_volume | 2.583 | 6.574 | 10.607 | 11.26 | 11.913 | 6.542 | 100.0% | 10 | | nova.delete_server | 8.435 | 12.822 | 18.116 | 18.26 | 18.404 | 13.252 | 100.0% | 10 | | total | 68.108 | 91.836 | 107.837 | 109.173 | 110.51 | 89.859 | 100.0% | 10 | | -> duration | 67.108 | 90.836 | 106.837 | 108.173 | 109.51 | 88.859 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 250.84683 Full duration: 294.455132 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.964 | 8.318 | 11.312 | 11.473 | 11.634 | 8.782 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.033 | 0.045 | 0.051 | 0.055 | 0.06 | 0.044 | 100.0% | 10 | | total | 6.002 | 8.373 | 11.355 | 11.519 | 11.684 | 8.826 | 100.0% | 10 | | -> duration | 6.002 | 8.373 | 11.355 | 11.519 | 11.684 | 8.826 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.982323 Full duration: 94.275362 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.292 | 19.012 | 21.657 | 22.415 | 23.173 | 18.716 | 100.0% | 10 | | cinder_v3.list_volumes | 0.062 | 0.074 | 0.089 | 0.094 | 0.098 | 0.075 | 100.0% | 10 | | total | 14.366 | 19.078 | 21.743 | 22.489 | 23.235 | 18.791 | 100.0% | 10 | | -> duration | 14.366 | 19.078 | 21.743 | 22.489 | 23.235 | 18.791 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 55.32529 Full duration: 106.047044 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.415 | 8.309 | 9.203 | 9.464 | 9.726 | 8.24 | 100.0% | 10 | | cinder_v3.list_volumes | 0.056 | 0.074 | 0.088 | 0.098 | 0.107 | 0.076 | 100.0% | 10 | | total | 6.48 | 8.403 | 9.28 | 9.546 | 9.813 | 8.316 | 100.0% | 10 | | -> duration | 6.48 | 8.403 | 9.28 | 9.546 | 9.813 | 8.316 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.924283 Full duration: 65.297509 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.393 | 7.084 | 8.561 | 8.784 | 9.007 | 6.793 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 40.771 | 62.394 | 66.384 | 66.536 | 66.688 | 59.259 | 100.0% | 10 | | cinder_v3.delete_volume | 2.323 | 3.937 | 5.015 | 5.816 | 6.617 | 4.131 | 100.0% | 10 | | glance_v2.delete_image | 5.218 | 7.725 | 11.29 | 11.296 | 11.302 | 8.292 | 100.0% | 10 | | total | 58.828 | 82.22 | 86.405 | 87.521 | 88.638 | 78.476 | 100.0% | 10 | | -> duration | 58.828 | 82.22 | 86.405 | 87.521 | 88.638 | 78.476 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 225.870908 Full duration: 259.258793 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 29.294 | 45.862 | 51.3 | 52.676 | 54.052 | 45.417 | 100.0% | 10 | | cinder_v3.create_volume | 5.683 | 7.631 | 8.76 | 8.848 | 8.937 | 7.496 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.841 | 6.922 | 7.984 | 8.692 | 9.399 | 6.922 | 100.0% | 10 | | nova.attach_volume | 5.848 | 14.131 | 23.321 | 24.838 | 26.354 | 14.934 | 100.0% | 10 | | nova.detach_volume | 3.941 | 5.488 | 8.29 | 9.358 | 10.426 | 5.947 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.264 | 4.386 | 6.13 | 6.791 | 7.452 | 4.21 | 100.0% | 10 | | cinder_v3.delete_volume | 2.317 | 4.025 | 9.744 | 10.059 | 10.374 | 5.287 | 100.0% | 10 | | nova.delete_server | 8.467 | 18.842 | 22.472 | 22.868 | 23.265 | 17.302 | 100.0% | 10 | | total | 71.153 | 108.163 | 128.831 | 130.349 | 131.867 | 107.516 | 100.0% | 10 | | -> duration | 70.153 | 107.163 | 127.831 | 129.349 | 130.867 | 106.516 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 294.971945 Full duration: 343.475052 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.872 | 11.734 | 15.743 | 20.721 | 25.699 | 13.001 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.026 | 6.488 | 8.139 | 8.696 | 9.253 | 6.848 | 100.0% | 10 | | nova.boot_server | 27.064 | 41.091 | 44.666 | 44.94 | 45.214 | 38.821 | 100.0% | 10 | | nova.attach_volume | 9.71 | 13.423 | 28.162 | 28.384 | 28.607 | 16.807 | 100.0% | 10 | | nova.detach_volume | 3.481 | 4.746 | 8.225 | 8.402 | 8.579 | 5.255 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.287 | 5.814 | 7.941 | 8.006 | 8.071 | 5.545 | 100.0% | 10 | | cinder_v3.delete_volume | 2.425 | 7.865 | 9.407 | 10.103 | 10.8 | 7.237 | 100.0% | 10 | | nova.delete_server | 6.528 | 18.639 | 30.022 | 30.678 | 31.335 | 19.071 | 100.0% | 10 | | total | 70.368 | 119.217 | 133.116 | 135.414 | 137.711 | 112.586 | 100.0% | 10 | | -> duration | 69.368 | 118.217 | 132.116 | 134.414 | 136.711 | 111.586 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 315.158403 Full duration: 353.754083 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.336 | 8.147 | 12.35 | 12.431 | 12.512 | 8.775 | 100.0% | 10 | | total | 4.336 | 8.147 | 12.35 | 12.431 | 12.512 | 8.776 | 100.0% | 10 | | -> duration | 4.336 | 8.147 | 12.35 | 12.431 | 12.512 | 8.776 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.721625 Full duration: 74.039907 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.971 | 8.454 | 9.579 | 9.709 | 9.84 | 8.089 | 100.0% | 10 | | total | 4.971 | 8.454 | 9.579 | 9.709 | 9.84 | 8.089 | 100.0% | 10 | | -> duration | 4.971 | 8.454 | 9.579 | 9.709 | 9.84 | 8.089 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.773879 Full duration: 79.010997 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.626 | 1.012 | 1.501 | 1.797 | 2.093 | 1.107 | 100.0% | 10 | | total | 0.626 | 1.013 | 1.501 | 1.797 | 2.093 | 1.107 | 100.0% | 10 | | -> duration | 0.626 | 1.013 | 1.501 | 1.797 | 2.093 | 1.107 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.841179 Full duration: 110.502009 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.747 | 6.318 | 9.619 | 10.103 | 10.586 | 6.896 | 100.0% | 10 | | cinder_v3.delete_snapshot | 3.035 | 4.688 | 5.486 | 6.971 | 8.455 | 4.676 | 100.0% | 10 | | total | 8.338 | 11.136 | 15.243 | 16.053 | 16.863 | 11.572 | 100.0% | 10 | | -> duration | 8.338 | 11.136 | 15.243 | 16.053 | 16.863 | 11.572 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.631404 Full duration: 88.463467 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.051 | 8.903 | 10.377 | 11.377 | 12.378 | 8.833 | 100.0% | 10 | | cinder_v3.delete_volume | 3.393 | 7.257 | 8.632 | 10.46 | 12.288 | 6.775 | 100.0% | 10 | | total | 10.712 | 15.518 | 19.416 | 19.472 | 19.528 | 15.609 | 100.0% | 10 | | -> duration | 10.712 | 15.518 | 19.416 | 19.472 | 19.528 | 15.609 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.301826 Full duration: 74.594407 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 20.968 | 23.033 | 25.618 | 25.758 | 25.898 | 23.086 | 100.0% | 10 | | cinder_v3.delete_volume | 2.806 | 5.588 | 9.79 | 9.861 | 9.932 | 5.749 | 100.0% | 10 | | total | 24.793 | 28.242 | 35.534 | 35.603 | 35.672 | 28.835 | 100.0% | 10 | | -> duration | 24.793 | 28.242 | 35.534 | 35.603 | 35.672 | 28.835 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.484312 Full duration: 117.228281 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.598 | 10.174 | 13.466 | 13.576 | 13.686 | 10.368 | 100.0% | 10 | | cinder_v3.delete_volume | 2.855 | 6.608 | 8.503 | 9.355 | 10.206 | 6.25 | 100.0% | 10 | | total | 10.453 | 17.161 | 20.313 | 20.451 | 20.589 | 16.618 | 100.0% | 10 | | -> duration | 10.453 | 17.161 | 20.313 | 20.451 | 20.589 | 16.618 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.525153 Full duration: 81.673676 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.021 | 9.861 | 10.633 | 10.992 | 11.352 | 9.257 | 100.0% | 10 | | cinder_v3.extend_volume | 3.085 | 4.296 | 6.507 | 6.622 | 6.737 | 4.573 | 100.0% | 10 | | cinder_v3.delete_volume | 2.717 | 4.433 | 5.901 | 6.657 | 7.414 | 4.583 | 100.0% | 10 | | total | 13.635 | 17.933 | 21.31 | 23.007 | 24.703 | 18.413 | 100.0% | 10 | | -> duration | 13.635 | 17.933 | 21.31 | 23.007 | 24.703 | 18.413 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.990507 Full duration: 85.450322 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.963 | 9.375 | 10.79 | 11.63 | 12.469 | 9.291 | 100.0% | 10 | | cinder_v3.delete_volume | 4.749 | 6.765 | 8.044 | 8.308 | 8.572 | 6.874 | 100.0% | 10 | | total | 13.476 | 16.818 | 18.024 | 18.6 | 19.176 | 16.165 | 100.0% | 10 | | -> duration | 13.476 | 16.818 | 18.024 | 18.6 | 19.176 | 16.165 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.44737 Full duration: 100.279056 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.713 | 1.115 | 1.738 | 1.746 | 1.754 | 1.161 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.033 | 0.039 | 0.04 | 0.04 | 0.034 | 100.0% | 10 | | total | 0.745 | 1.147 | 1.772 | 1.783 | 1.794 | 1.196 | 100.0% | 10 | | -> duration | 0.745 | 1.147 | 1.772 | 1.783 | 1.794 | 1.196 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.47083 Full duration: 31.326812 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.845 | 1.004 | 1.689 | 1.708 | 1.728 | 1.203 | 100.0% | 10 | | cinder_v3.list_qos | 0.034 | 0.039 | 0.045 | 0.051 | 0.057 | 0.04 | 100.0% | 10 | | total | 0.885 | 1.043 | 1.744 | 1.758 | 1.772 | 1.244 | 100.0% | 10 | | -> duration | 0.885 | 1.043 | 1.744 | 1.758 | 1.772 | 1.244 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.706549 Full duration: 33.534605 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.736 | 0.946 | 1.174 | 1.185 | 1.195 | 0.959 | 100.0% | 10 | | cinder_v3.set_qos | 0.073 | 0.363 | 0.619 | 0.682 | 0.745 | 0.385 | 100.0% | 10 | | total | 0.852 | 1.375 | 1.561 | 1.67 | 1.779 | 1.344 | 100.0% | 10 | | -> duration | 0.852 | 1.375 | 1.561 | 1.67 | 1.779 | 1.344 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.174735 Full duration: 32.403739 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.732 | 1.101 | 1.266 | 1.354 | 1.442 | 1.057 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.026 | 0.033 | 0.059 | 0.065 | 0.07 | 0.038 | 100.0% | 10 | | total | 0.766 | 1.137 | 1.297 | 1.388 | 1.479 | 1.095 | 100.0% | 10 | | -> duration | 0.766 | 1.137 | 1.297 | 1.388 | 1.479 | 1.095 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.172954 Full duration: 32.597924 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.827 | 1.713 | 2.355 | 2.397 | 2.438 | 1.707 | 100.0% | 10 | | cinder_v3.list_types | 0.035 | 0.044 | 0.052 | 0.06 | 0.068 | 0.045 | 100.0% | 10 | | total | 0.878 | 1.753 | 2.396 | 2.44 | 2.484 | 1.752 | 100.0% | 10 | | -> duration | 0.878 | 1.753 | 2.396 | 2.44 | 2.484 | 1.752 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.801445 Full duration: 39.26483 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.639 | 1.267 | 1.945 | 2.049 | 2.153 | 1.376 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.063 | 0.309 | 1.472 | 1.76 | 2.047 | 0.614 | 100.0% | 10 | | total | 0.702 | 1.913 | 3.014 | 3.076 | 3.138 | 1.99 | 100.0% | 10 | | -> duration | 0.702 | 1.913 | 3.014 | 3.076 | 3.138 | 1.99 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.468224 Full duration: 36.220186 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.71 | 1.156 | 1.391 | 1.701 | 2.011 | 1.146 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.228 | 0.463 | 1.249 | 1.272 | 1.295 | 0.602 | 100.0% | 10 | | total | 1.172 | 1.706 | 2.148 | 2.312 | 2.475 | 1.748 | 100.0% | 10 | | -> duration | 1.172 | 1.706 | 2.148 | 2.312 | 2.475 | 1.748 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.14351 Full duration: 32.926599 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26ee7269-23c4-40db-bff0-805fb84e3fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.635 | 1.061 | 1.557 | 1.571 | 1.585 | 1.023 | 100.0% | 10 | | cinder_v2.add_type_access | 0.079 | 0.296 | 0.517 | 0.599 | 0.68 | 0.31 | 100.0% | 10 | | cinder_v2.list_type_access | 0.034 | 0.039 | 0.046 | 0.048 | 0.049 | 0.04 | 100.0% | 10 | | total | 0.758 | 1.229 | 2.054 | 2.055 | 2.056 | 1.372 | 100.0% | 10 | | -> duration | 0.758 | 1.229 | 2.054 | 2.055 | 2.056 | 1.372 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.887472 Full duration: 31.126025 HINTS: * To plot HTML graphics with this data, run: rally task report 26ee7269-23c4-40db-bff0-805fb84e3fe3 --out output.html * To generate a JUnit report, run: rally task export 26ee7269-23c4-40db-bff0-805fb84e3fe3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 26ee7269-23c4-40db-bff0-805fb84e3fe3 --json --out output.json 2021-03-13 16:37:29,639 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 26ee7269-23c4-40db-bff0-805fb84e3fe3 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-03-13 16:37:29,703 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-03-13 16:37:29,733 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 16:37:30,112 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-03-13 17:19:39,238 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: a9c0df1c-059c-42bb-90b6-00168fac5918 2021-03-13 17:19:40,511 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a9c0df1c-059c-42bb-90b6-00168fac5918 -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.838 | 10.033 | 13.414 | 13.697 | 13.981 | 10.472 | 100.0% | 10 | | heat.list_stacks | 0.048 | 0.064 | 0.079 | 0.08 | 0.081 | 0.064 | 100.0% | 10 | | total | 6.893 | 10.085 | 13.482 | 13.761 | 14.04 | 10.537 | 100.0% | 10 | | -> duration | 4.893 | 8.085 | 11.482 | 11.761 | 12.04 | 8.537 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.614666 Full duration: 95.92658 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 14.865 | 30.376 | 34.725 | 36.273 | 37.82 | 28.573 | 100.0% | 10 | | heat.update_stack | 8.439 | 20.586 | 23.473 | 23.844 | 24.214 | 18.457 | 100.0% | 10 | | heat.delete_stack | 13.766 | 19.264 | 21.576 | 22.669 | 23.762 | 19.043 | 100.0% | 10 | | total | 39.673 | 71.67 | 75.058 | 75.625 | 76.191 | 66.073 | 100.0% | 10 | | -> duration | 35.673 | 67.67 | 71.058 | 71.625 | 72.191 | 62.073 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 179.788765 Full duration: 224.092539 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.315 | 36.045 | 41.667 | 42.301 | 42.934 | 34.013 | 100.0% | 10 | | heat.update_stack | 10.229 | 15.204 | 18.726 | 22.236 | 25.746 | 15.66 | 100.0% | 10 | | heat.delete_stack | 7.433 | 17.036 | 26.67 | 26.892 | 27.114 | 17.949 | 100.0% | 10 | | total | 54.509 | 58.75 | 84.125 | 85.527 | 86.929 | 67.622 | 100.0% | 10 | | -> duration | 50.509 | 54.75 | 80.125 | 81.527 | 82.929 | 63.622 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 191.165727 Full duration: 236.493071 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 31.81 | 48.77 | 60.587 | 61.255 | 61.923 | 48.03 | 100.0% | 10 | | heat.update_stack | 20.171 | 47.92 | 56.731 | 57.147 | 57.562 | 44.834 | 100.0% | 10 | | heat.delete_stack | 19.334 | 39.772 | 46.153 | 47.055 | 47.957 | 37.656 | 100.0% | 10 | | total | 71.315 | 139.849 | 154.823 | 154.94 | 155.058 | 130.52 | 100.0% | 10 | | -> duration | 67.315 | 135.849 | 150.823 | 150.94 | 151.058 | 126.52 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 357.462909 Full duration: 403.063155 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 23.273 | 33.923 | 61.08 | 61.477 | 61.874 | 40.93 | 100.0% | 10 | | heat.update_stack | 17.442 | 27.064 | 31.942 | 32.191 | 32.44 | 26.069 | 100.0% | 10 | | heat.delete_stack | 12.927 | 37.442 | 42.236 | 44.549 | 46.863 | 33.741 | 100.0% | 10 | | total | 59.991 | 97.657 | 128.777 | 131.591 | 134.404 | 100.74 | 100.0% | 10 | | -> duration | 55.991 | 93.657 | 124.777 | 127.591 | 130.404 | 96.74 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 279.048419 Full duration: 327.287863 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 39.94 | 55.356 | 59.587 | 59.76 | 59.933 | 53.791 | 100.0% | 10 | | heat.update_stack | 11.15 | 34.364 | 40.441 | 40.739 | 41.037 | 31.707 | 100.0% | 10 | | heat.delete_stack | 13.52 | 26.209 | 33.029 | 33.279 | 33.528 | 25.995 | 100.0% | 10 | | total | 64.61 | 114.808 | 132.878 | 133.411 | 133.944 | 111.494 | 100.0% | 10 | | -> duration | 60.61 | 110.808 | 128.878 | 129.411 | 129.944 | 107.494 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 305.871589 Full duration: 360.475567 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 28.701 | 40.52 | 44.187 | 46.64 | 49.094 | 38.693 | 100.0% | 10 | | heat.update_stack | 14.712 | 41.684 | 43.294 | 43.464 | 43.635 | 36.379 | 100.0% | 10 | | heat.delete_stack | 11.102 | 20.766 | 25.358 | 26.735 | 28.112 | 20.373 | 100.0% | 10 | | total | 65.449 | 98.593 | 112.386 | 114.884 | 117.382 | 95.445 | 100.0% | 10 | | -> duration | 61.449 | 94.593 | 108.386 | 110.884 | 113.382 | 91.445 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 262.584913 Full duration: 312.676569 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 15.131 | 30.27 | 38.697 | 39.025 | 39.352 | 27.394 | 100.0% | 10 | | heat.check_stack | 2.837 | 13.336 | 14.013 | 14.284 | 14.555 | 11.276 | 100.0% | 10 | | heat.delete_stack | 11.463 | 18.944 | 20.155 | 21.146 | 22.136 | 17.997 | 100.0% | 10 | | total | 45.831 | 51.278 | 70.694 | 71.93 | 73.166 | 56.667 | 100.0% | 10 | | -> duration | 43.831 | 49.278 | 68.694 | 69.93 | 71.166 | 54.667 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 161.341611 Full duration: 203.09039 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.585 | 32.065 | 39.334 | 40.445 | 41.556 | 34.227 | 100.0% | 10 | | heat.suspend_stack | 8.842 | 10.198 | 17.667 | 17.85 | 18.033 | 12.842 | 100.0% | 10 | | heat.resume_stack | 6.558 | 11.587 | 15.814 | 16.309 | 16.805 | 12.151 | 100.0% | 10 | | heat.delete_stack | 5.853 | 16.368 | 23.59 | 23.65 | 23.711 | 16.537 | 100.0% | 10 | | total | 52.717 | 77.145 | 86.195 | 89.242 | 92.288 | 75.757 | 100.0% | 10 | | -> duration | 50.717 | 75.145 | 84.195 | 87.242 | 90.288 | 73.757 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 212.090665 Full duration: 255.950862 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a9c0df1c-059c-42bb-90b6-00168fac5918 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.557 | 0.836 | 1.1 | 1.197 | 1.294 | 0.861 | 100.0% | 10 | | total | 0.557 | 0.836 | 1.1 | 1.197 | 1.294 | 0.861 | 100.0% | 10 | | -> duration | 0.557 | 0.836 | 1.1 | 1.197 | 1.294 | 0.861 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.668494 Full duration: 38.943533 HINTS: * To plot HTML graphics with this data, run: rally task report a9c0df1c-059c-42bb-90b6-00168fac5918 --out output.html * To generate a JUnit report, run: rally task export a9c0df1c-059c-42bb-90b6-00168fac5918 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a9c0df1c-059c-42bb-90b6-00168fac5918 --json --out output.json 2021-03-13 17:19:43,619 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a9c0df1c-059c-42bb-90b6-00168fac5918 --out /home/opnfv/functest/results/rally_full/heat.json 2021-03-13 17:19:43,637 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-03-13 17:19:43,667 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 17:19:44,124 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-03-13 17:30:33,105 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 0c68f281-8c07-4102-9ebf-95d957acc987 2021-03-13 17:30:34,379 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0c68f281-8c07-4102-9ebf-95d957acc987 -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.241 | 0.783 | 1.239 | 1.373 | 1.506 | 0.813 | 100.0% | 10 | | keystone_v3.add_role | 0.127 | 0.468 | 0.897 | 1.118 | 1.34 | 0.579 | 100.0% | 10 | | keystone_v3.revoke_role | 0.4 | 0.699 | 0.999 | 1.209 | 1.42 | 0.743 | 100.0% | 10 | | total | 1.219 | 2.154 | 3.23 | 3.256 | 3.282 | 2.136 | 100.0% | 10 | | -> duration | 1.219 | 2.154 | 3.23 | 3.256 | 3.282 | 2.136 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.308717 Full duration: 51.345556 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.17 | 0.445 | 0.649 | 0.791 | 0.934 | 0.473 | 100.0% | 10 | | keystone_v3.add_role | 0.087 | 0.253 | 0.429 | 0.503 | 0.577 | 0.253 | 100.0% | 10 | | keystone_v3.list_roles | 0.085 | 0.125 | 0.135 | 0.161 | 0.186 | 0.125 | 100.0% | 10 | | total | 0.373 | 0.85 | 1.111 | 1.24 | 1.368 | 0.851 | 100.0% | 10 | | -> duration | 0.373 | 0.85 | 1.111 | 1.24 | 1.368 | 0.851 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.593807 Full duration: 43.537256 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.34 | 0.718 | 0.854 | 0.855 | 0.857 | 0.687 | 100.0% | 10 | | keystone_v3.list_projects | 0.113 | 0.128 | 0.157 | 0.221 | 0.284 | 0.143 | 100.0% | 10 | | total | 0.471 | 0.86 | 0.988 | 1.024 | 1.061 | 0.83 | 100.0% | 10 | | -> duration | 0.471 | 0.86 | 0.988 | 1.024 | 1.061 | 0.83 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.062903 Full duration: 45.216612 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.11 | 0.546 | 1.073 | 1.296 | 1.519 | 0.587 | 100.0% | 10 | | keystone_v3.delete_role | 0.11 | 0.614 | 1.014 | 1.1 | 1.187 | 0.625 | 100.0% | 10 | | total | 0.22 | 1.273 | 1.694 | 1.794 | 1.895 | 1.212 | 100.0% | 10 | | -> duration | 0.22 | 1.273 | 1.694 | 1.794 | 1.895 | 1.212 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.440867 Full duration: 34.854791 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.157 | 0.918 | 1.508 | 1.582 | 1.656 | 0.836 | 100.0% | 10 | | keystone_v3.delete_service | 0.1 | 0.295 | 0.613 | 0.633 | 0.654 | 0.337 | 100.0% | 10 | | total | 0.381 | 1.273 | 1.846 | 1.918 | 1.99 | 1.174 | 100.0% | 10 | | -> duration | 0.381 | 1.273 | 1.846 | 1.918 | 1.99 | 1.174 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.290529 Full duration: 36.955253 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.268 | 0.735 | 1.381 | 1.471 | 1.561 | 0.802 | 100.0% | 10 | | keystone_v3.create_user | 0.64 | 2.103 | 3.259 | 3.572 | 3.885 | 1.995 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.042 | 0.055 | 0.074 | 0.106 | 0.138 | 0.063 | 100.0% | 10 | | -> keystone_v3.add_role | 0.114 | 0.592 | 1.54 | 1.911 | 2.282 | 0.866 | 100.0% | 10 | | keystone_v3.create_role | 0.13 | 0.608 | 1.592 | 1.969 | 2.347 | 0.829 | 100.0% | 10 | | keystone_v3.get_project | 0.03 | 0.037 | 0.531 | 0.792 | 1.053 | 0.187 | 100.0% | 10 | | keystone_v3.get_user | 0.035 | 0.037 | 0.069 | 0.192 | 0.314 | 0.066 | 100.0% | 10 | | keystone_v3.get_role | 0.033 | 0.039 | 0.154 | 0.318 | 0.482 | 0.091 | 100.0% | 10 | | keystone_v3.list_services | 0.036 | 0.144 | 0.551 | 0.941 | 1.33 | 0.28 | 100.0% | 10 | | keystone_v3.get_services | 0.037 | 0.046 | 0.143 | 0.251 | 0.358 | 0.083 | 100.0% | 10 | | total | 1.949 | 4.288 | 6.791 | 6.948 | 7.105 | 4.477 | 100.0% | 10 | | -> duration | 1.949 | 4.288 | 6.791 | 6.948 | 7.105 | 4.477 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.445671 Full duration: 74.015466 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.598 | 1.425 | 3.827 | 4.107 | 4.388 | 1.815 | 100.0% | 10 | | keystone_v3.update_project | 0.306 | 0.429 | 1.099 | 1.154 | 1.208 | 0.563 | 100.0% | 10 | | keystone_v3.delete_project | 0.151 | 0.692 | 3.097 | 3.118 | 3.139 | 1.2 | 100.0% | 10 | | total | 1.305 | 3.66 | 5.884 | 5.957 | 6.03 | 3.579 | 100.0% | 10 | | -> duration | 1.305 | 3.66 | 5.884 | 5.957 | 6.03 | 3.579 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.801921 Full duration: 45.323675 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.25 | 1.242 | 1.515 | 1.56 | 1.606 | 1.02 | 100.0% | 10 | | total | 0.326 | 1.433 | 1.693 | 1.711 | 1.73 | 1.224 | 100.0% | 10 | | -> duration | 0.326 | 1.433 | 1.693 | 1.711 | 1.73 | 1.224 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.505447 Full duration: 35.152624 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.542 | 0.897 | 1.332 | 1.379 | 1.426 | 0.96 | 100.0% | 10 | | total | 0.542 | 0.897 | 1.332 | 1.379 | 1.426 | 0.96 | 100.0% | 10 | | -> duration | 0.542 | 0.897 | 1.332 | 1.379 | 1.426 | 0.96 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.3647 Full duration: 30.514949 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.742 | 1.185 | 1.562 | 1.633 | 1.704 | 1.124 | 100.0% | 10 | | keystone_v3.list_users | 0.072 | 0.079 | 0.365 | 0.653 | 0.94 | 0.187 | 100.0% | 10 | | total | 0.888 | 1.508 | 1.813 | 1.838 | 1.863 | 1.424 | 100.0% | 10 | | -> duration | 0.888 | 1.508 | 1.813 | 1.838 | 1.863 | 1.424 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.805412 Full duration: 40.692822 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0c68f281-8c07-4102-9ebf-95d957acc987 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.343 | 0.899 | 1.111 | 1.414 | 1.718 | 0.881 | 100.0% | 10 | | keystone_v3.create_users | 11.331 | 22.431 | 23.125 | 23.132 | 23.139 | 20.375 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 11.331 | 22.431 | 23.125 | 23.132 | 23.138 | 20.375 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.519 | 0.81 | 1.883 | 2.383 | 2.882 | 1.125 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.481 | 8.535 | 11.338 | 11.868 | 12.397 | 8.167 | 100.0% | 10 | | total | 13.824 | 24.323 | 25.227 | 25.396 | 25.564 | 22.577 | 100.0% | 10 | | -> duration | 13.824 | 24.323 | 25.227 | 25.396 | 25.564 | 22.577 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 68.100364 Full duration: 181.473525 HINTS: * To plot HTML graphics with this data, run: rally task report 0c68f281-8c07-4102-9ebf-95d957acc987 --out output.html * To generate a JUnit report, run: rally task export 0c68f281-8c07-4102-9ebf-95d957acc987 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0c68f281-8c07-4102-9ebf-95d957acc987 --json --out output.json 2021-03-13 17:30:37,512 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0c68f281-8c07-4102-9ebf-95d957acc987 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-03-13 17:30:37,535 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-03-13 17:30:37,574 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 17:30:38,298 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-03-13 17:49:24,034 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 90d463e9-54a6-4190-94ec-fd59784a915b 2021-03-13 17:49:25,350 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 90d463e9-54a6-4190-94ec-fd59784a915b -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.82 | 3.808 | 5.067 | 5.103 | 5.139 | 3.892 | 100.0% | 10 | | neutron.update_network | 0.716 | 1.386 | 2.241 | 2.511 | 2.781 | 1.503 | 100.0% | 10 | | total | 3.963 | 5.461 | 6.49 | 6.52 | 6.55 | 5.395 | 100.0% | 10 | | -> duration | 3.963 | 5.461 | 6.49 | 6.52 | 6.55 | 5.395 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.594233 Full duration: 69.822314 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.876 | 4.806 | 10.208 | 11.459 | 12.711 | 6.267 | 100.0% | 10 | | neutron.update_port | 0.866 | 1.418 | 5.662 | 5.735 | 5.808 | 2.487 | 100.0% | 10 | | total | 3.742 | 5.951 | 14.216 | 14.228 | 14.24 | 8.754 | 100.0% | 10 | | -> duration | 3.742 | 5.951 | 14.216 | 14.228 | 14.24 | 8.754 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.171025 Full duration: 101.947025 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.851 | 2.716 | 3.642 | 3.768 | 3.893 | 2.85 | 100.0% | 10 | | neutron.create_subnet | 2.427 | 3.073 | 4.749 | 4.943 | 5.137 | 3.445 | 100.0% | 10 | | neutron.update_subnet | 0.834 | 1.665 | 2.357 | 2.365 | 2.372 | 1.626 | 100.0% | 10 | | total | 5.744 | 8.357 | 9.995 | 9.997 | 10.0 | 7.92 | 100.0% | 10 | | -> duration | 5.744 | 8.357 | 9.995 | 9.997 | 10.0 | 7.92 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.406897 Full duration: 81.874413 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.869 | 4.139 | 6.338 | 6.496 | 6.654 | 4.008 | 100.0% | 10 | | neutron.delete_network | 1.42 | 3.244 | 4.246 | 4.345 | 4.444 | 2.967 | 100.0% | 10 | | total | 4.615 | 6.192 | 9.314 | 9.773 | 10.233 | 6.975 | 100.0% | 10 | | -> duration | 4.615 | 6.192 | 9.314 | 9.773 | 10.233 | 6.975 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.412076 Full duration: 64.880363 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.155 | 5.348 | 6.768 | 6.939 | 7.11 | 5.515 | 100.0% | 10 | | neutron.delete_port | 0.746 | 1.336 | 1.842 | 2.167 | 2.492 | 1.453 | 100.0% | 10 | | total | 5.416 | 6.993 | 7.721 | 8.289 | 8.858 | 6.968 | 100.0% | 10 | | -> duration | 5.416 | 6.993 | 7.721 | 8.289 | 8.858 | 6.968 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.190681 Full duration: 93.021297 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.07 | 2.975 | 4.239 | 4.581 | 4.923 | 3.003 | 100.0% | 10 | | neutron.create_subnet | 2.732 | 4.142 | 4.798 | 4.816 | 4.835 | 4.073 | 100.0% | 10 | | neutron.delete_subnet | 0.768 | 1.896 | 2.413 | 2.468 | 2.523 | 1.798 | 100.0% | 10 | | total | 5.772 | 8.508 | 10.984 | 11.11 | 11.235 | 8.879 | 100.0% | 10 | | -> duration | 5.772 | 8.508 | 10.984 | 11.11 | 11.235 | 8.879 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.429215 Full duration: 79.158931 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.486 | 2.931 | 5.182 | 5.183 | 5.183 | 3.368 | 100.0% | 10 | | neutron.list_networks | 0.146 | 0.252 | 1.057 | 1.255 | 1.452 | 0.47 | 100.0% | 10 | | total | 1.653 | 3.872 | 5.384 | 5.635 | 5.885 | 3.839 | 100.0% | 10 | | -> duration | 1.653 | 3.872 | 5.384 | 5.635 | 5.885 | 3.839 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.913837 Full duration: 62.746004 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.413 | 3.515 | 4.36 | 4.523 | 4.686 | 3.508 | 100.0% | 10 | | neutron.list_ports | 0.096 | 0.217 | 0.398 | 0.401 | 0.404 | 0.247 | 100.0% | 10 | | total | 2.553 | 3.761 | 4.712 | 4.88 | 5.048 | 3.755 | 100.0% | 10 | | -> duration | 2.553 | 3.761 | 4.712 | 4.88 | 5.048 | 3.755 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.432763 Full duration: 76.245451 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.321 | 2.711 | 3.48 | 4.138 | 4.797 | 2.92 | 100.0% | 10 | | neutron.create_subnet | 3.181 | 3.63 | 4.593 | 4.662 | 4.73 | 3.811 | 100.0% | 10 | | neutron.list_subnets | 0.085 | 0.129 | 0.838 | 1.201 | 1.564 | 0.325 | 100.0% | 10 | | total | 5.762 | 7.367 | 7.766 | 7.995 | 8.224 | 7.056 | 100.0% | 10 | | -> duration | 5.762 | 7.367 | 7.766 | 7.995 | 8.224 | 7.056 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.683284 Full duration: 78.073176 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.802 | 3.462 | 5.378 | 5.634 | 5.89 | 3.801 | 100.0% | 10 | | neutron.delete_security_group | 0.581 | 1.196 | 1.641 | 1.715 | 1.788 | 1.181 | 100.0% | 10 | | total | 3.417 | 4.928 | 6.617 | 6.902 | 7.188 | 4.982 | 100.0% | 10 | | -> duration | 3.417 | 4.928 | 6.617 | 6.902 | 7.188 | 4.982 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.505673 Full duration: 58.332854 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.87 | 3.483 | 4.069 | 4.442 | 4.815 | 3.102 | 100.0% | 10 | | neutron.create_security_group_rule | 0.659 | 3.797 | 4.563 | 5.066 | 5.568 | 3.332 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.134 | 1.202 | 1.608 | 1.656 | 1.704 | 1.03 | 100.0% | 10 | | neutron.delete_security_group | 0.271 | 0.983 | 2.127 | 2.373 | 2.618 | 1.203 | 100.0% | 10 | | total | 3.444 | 9.789 | 10.841 | 11.006 | 11.171 | 8.667 | 100.0% | 10 | | -> duration | 3.444 | 9.789 | 10.841 | 11.006 | 11.171 | 8.667 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.711549 Full duration: 69.518859 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.505 | 4.387 | 5.887 | 6.869 | 7.852 | 4.352 | 100.0% | 10 | | neutron.create_security_group_rule | 1.184 | 1.929 | 8.31 | 8.963 | 9.616 | 3.999 | 100.0% | 10 | | neutron.list_security_group_rules | 0.073 | 0.103 | 0.964 | 1.907 | 2.85 | 0.469 | 100.0% | 10 | | total | 3.875 | 7.247 | 13.503 | 13.706 | 13.909 | 8.82 | 100.0% | 10 | | -> duration | 3.875 | 7.247 | 13.503 | 13.706 | 13.909 | 8.82 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.259875 Full duration: 71.159331 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.766 | 2.595 | 2.925 | 2.982 | 3.039 | 2.525 | 100.0% | 10 | | neutron.show_security_group | 0.062 | 0.076 | 0.108 | 0.114 | 0.119 | 0.083 | 100.0% | 10 | | total | 1.872 | 2.69 | 2.992 | 3.054 | 3.115 | 2.607 | 100.0% | 10 | | -> duration | 1.872 | 2.69 | 2.992 | 3.054 | 3.115 | 2.607 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.444719 Full duration: 59.452137 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 20.442528 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 90d463e9-54a6-4190-94ec-fd59784a915b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 6.216 | 7.595 | 9.071 | 9.097 | 9.124 | 7.665 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.233 | 0.515 | 0.969 | 1.165 | 1.362 | 0.576 | 100.0% | 10 | | total | 6.49 | 8.125 | 9.388 | 9.484 | 9.58 | 8.241 | 100.0% | 10 | | -> duration | 6.49 | 8.125 | 9.388 | 9.484 | 9.58 | 8.241 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.973678 Full duration: 99.236 HINTS: * To plot HTML graphics with this data, run: rally task report 90d463e9-54a6-4190-94ec-fd59784a915b --out output.html * To generate a JUnit report, run: rally task export 90d463e9-54a6-4190-94ec-fd59784a915b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 90d463e9-54a6-4190-94ec-fd59784a915b --json --out output.json At least one workload did not pass SLA criteria. 2021-03-13 17:49:28,472 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 90d463e9-54a6-4190-94ec-fd59784a915b --out /home/opnfv/functest/results/rally_full/neutron.json 2021-03-13 17:49:28,495 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-03-13 17:49:28,537 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 17:49:28,950 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-03-13 18:05:11,495 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 0a6a72e0-7e35-45e8-9a72-ade212a05e0f 2021-03-13 18:05:12,793 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0a6a72e0-7e35-45e8-9a72-ade212a05e0f -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.023 | 1.531 | 2.253 | 2.284 | 2.316 | 1.553 | 100.0% | 10 | | nova.delete_keypair | 0.119 | 0.479 | 0.778 | 0.812 | 0.846 | 0.47 | 100.0% | 10 | | total | 1.245 | 1.848 | 2.818 | 2.952 | 3.086 | 2.023 | 100.0% | 10 | | -> duration | 1.245 | 1.848 | 2.818 | 2.952 | 3.086 | 2.023 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.54819 Full duration: 40.142079 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.899 | 1.324 | 1.997 | 2.022 | 2.047 | 1.377 | 100.0% | 10 | | nova.list_keypairs | 0.03 | 0.037 | 0.047 | 0.07 | 0.092 | 0.042 | 100.0% | 10 | | total | 0.936 | 1.36 | 2.084 | 2.087 | 2.089 | 1.419 | 100.0% | 10 | | -> duration | 0.936 | 1.36 | 2.084 | 2.087 | 2.089 | 1.419 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.231514 Full duration: 49.458999 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.673 | 44.533 | 48.646 | 50.82 | 52.994 | 43.611 | 100.0% | 10 | | nova.reboot_server | 8.226 | 13.373 | 18.407 | 18.46 | 18.514 | 13.821 | 100.0% | 10 | | nova.soft_reboot_server | 9.979 | 14.815 | 16.435 | 17.41 | 18.385 | 14.109 | 100.0% | 10 | | nova.stop_and_start_server | 13.269 | 23.379 | 28.136 | 28.403 | 28.67 | 22.835 | 100.0% | 10 | | -> nova.stop_server | 8.318 | 16.712 | 17.305 | 17.381 | 17.457 | 14.927 | 100.0% | 10 | | -> nova.start_server | 4.952 | 7.747 | 11.213 | 11.215 | 11.217 | 7.909 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 17.506 | 24.653 | 33.317 | 34.233 | 35.149 | 25.801 | 100.0% | 10 | | -> nova.rescue_server | 9.853 | 14.135 | 23.884 | 24.164 | 24.444 | 16.172 | 100.0% | 10 | | -> nova.unrescue_server | 7.654 | 9.228 | 11.447 | 11.991 | 12.535 | 9.63 | 100.0% | 10 | | nova.delete_server | 8.314 | 13.028 | 17.289 | 18.685 | 20.081 | 12.897 | 100.0% | 10 | | total | 108.725 | 133.517 | 149.069 | 149.486 | 149.903 | 133.121 | 100.0% | 10 | | -> duration | 99.725 | 124.517 | 140.069 | 140.486 | 140.903 | 124.121 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 373.795229 Full duration: 422.235854 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 33.904 | 44.278 | 47.415 | 48.246 | 49.077 | 43.035 | 100.0% | 10 | | nova.delete_server | 5.964 | 16.365 | 20.202 | 20.32 | 20.438 | 14.392 | 100.0% | 10 | | total | 39.869 | 61.384 | 65.836 | 66.437 | 67.037 | 57.427 | 100.0% | 10 | | -> duration | 38.869 | 60.384 | 64.836 | 65.437 | 66.037 | 56.427 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 160.012928 Full duration: 202.111639 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "image": { "name": "rally_full-img_ed3d4e83-25e1-43ff-8dc8-521646d74918" }, "nics": [ { "net-id": "aa700a70-8fd9-4f7f-9907-491526834907" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a6a72e0-7e35-45e8-9a72-ade212a05e0f has 2 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.997 | 41.161 | 47.583 | 47.872 | 48.161 | 36.492 | 80.0% | 10 | | nova.list_servers | 0.374 | 0.414 | 0.605 | 0.68 | 0.755 | 0.468 | 100.0% | 8 | | total | 8.998 | 41.626 | 48.037 | 48.287 | 48.536 | 36.867 | 80.0% | 10 | | -> duration | 7.998 | 40.626 | 47.037 | 47.287 | 47.536 | 35.867 | 80.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 80.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 92.700269 Full duration: 169.16996 HINTS: * To plot HTML graphics with this data, run: rally task report 0a6a72e0-7e35-45e8-9a72-ade212a05e0f --out output.html * To generate a JUnit report, run: rally task export 0a6a72e0-7e35-45e8-9a72-ade212a05e0f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0a6a72e0-7e35-45e8-9a72-ade212a05e0f --json --out output.json At least one workload did not pass SLA criteria. 2021-03-13 18:05:15,889 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0a6a72e0-7e35-45e8-9a72-ade212a05e0f --out /home/opnfv/functest/results/rally_full/nova.json 2021-03-13 18:05:15,903 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-03-13 18:05:15,931 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 18:05:16,636 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-03-13 18:07:31,778 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb 2021-03-13 18:07:32,993 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb -------------------------------------------------------------------------------- Task 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.311 | 3.251 | 4.194 | 4.242 | 4.291 | 2.941 | 100.0% | 10 | | quotas.delete_quotas | 0.327 | 1.246 | 2.062 | 2.404 | 2.746 | 1.257 | 100.0% | 10 | | total | 2.107 | 4.393 | 6.068 | 6.312 | 6.556 | 4.198 | 100.0% | 10 | | -> duration | 2.107 | 4.393 | 6.068 | 6.312 | 6.556 | 4.198 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.367419 Full duration: 36.933016 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.335 | 2.327 | 3.839 | 3.937 | 4.034 | 2.55 | 100.0% | 10 | | total | 1.335 | 2.327 | 3.839 | 3.937 | 4.034 | 2.55 | 100.0% | 10 | | -> duration | 1.335 | 2.327 | 3.839 | 3.937 | 4.034 | 2.55 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.104356 Full duration: 31.533526 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 5.29 | 8.226 | 8.94 | 9.009 | 9.077 | 7.824 | 100.0% | 10 | | total | 5.29 | 8.226 | 8.94 | 9.009 | 9.077 | 7.824 | 100.0% | 10 | | -> duration | 5.29 | 8.226 | 8.94 | 9.009 | 9.077 | 7.824 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.181888 Full duration: 44.985955 HINTS: * To plot HTML graphics with this data, run: rally task report 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb --out output.html * To generate a JUnit report, run: rally task export 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb --json --out output.json 2021-03-13 18:07:35,987 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2c3fb2b8-327b-4f93-9d56-0fb6ebda74fb --out /home/opnfv/functest/results/rally_full/quotas.json 2021-03-13 18:07:35,993 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-03-13 18:07:36,025 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-13 18:07:36,215 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-03-13 18:16:38,252 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 10b37913-d3b2-465a-b2cd-8dca8d9d0288 2021-03-13 18:16:39,515 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 10b37913-d3b2-465a-b2cd-8dca8d9d0288 -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.055 | 1.132 | 1.278 | 1.365 | 1.452 | 1.171 | 100.0% | 10 | | swift.upload_object (x2) | 1.022 | 1.12 | 1.179 | 1.189 | 1.2 | 1.118 | 100.0% | 10 | | swift.list_objects | 1.024 | 1.046 | 1.068 | 1.071 | 1.073 | 1.045 | 100.0% | 10 | | total | 3.217 | 3.281 | 3.433 | 3.569 | 3.705 | 3.335 | 100.0% | 10 | | -> duration | 3.217 | 3.281 | 3.433 | 3.569 | 3.705 | 3.335 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.407823 Full duration: 97.927337 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.343 | 1.48 | 1.574 | 1.576 | 1.578 | 1.468 | 100.0% | 10 | | swift.list_objects | 0.912 | 0.988 | 1.052 | 1.065 | 1.078 | 0.99 | 100.0% | 10 | | total | 2.26 | 2.475 | 2.565 | 2.565 | 2.566 | 2.458 | 100.0% | 10 | | -> duration | 2.26 | 2.475 | 2.565 | 2.565 | 2.566 | 2.458 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.635247 Full duration: 72.492897 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.964 | 1.103 | 1.286 | 1.306 | 1.325 | 1.12 | 100.0% | 10 | | swift.upload_object (x5) | 2.591 | 2.729 | 2.778 | 2.793 | 2.809 | 2.7 | 100.0% | 10 | | swift.download_object (x5) | 2.376 | 2.491 | 2.54 | 2.568 | 2.597 | 2.491 | 100.0% | 10 | | total | 6.08 | 6.32 | 6.406 | 6.514 | 6.623 | 6.313 | 100.0% | 10 | | -> duration | 6.08 | 6.32 | 6.406 | 6.514 | 6.623 | 6.313 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.186835 Full duration: 134.728798 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.986 | 1.113 | 1.253 | 1.261 | 1.269 | 1.121 | 100.0% | 10 | | swift.upload_object (x5) | 2.726 | 2.9 | 2.994 | 3.004 | 3.015 | 2.883 | 100.0% | 10 | | swift.delete_object (x5) | 2.615 | 2.729 | 2.816 | 2.82 | 2.823 | 2.737 | 100.0% | 10 | | swift.delete_container | 0.623 | 0.64 | 0.658 | 0.661 | 0.665 | 0.639 | 100.0% | 10 | | total | 7.109 | 7.375 | 7.537 | 7.56 | 7.584 | 7.382 | 100.0% | 10 | | -> duration | 7.109 | 7.375 | 7.537 | 7.56 | 7.584 | 7.382 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.8887 Full duration: 118.889271 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b37913-d3b2-465a-b2cd-8dca8d9d0288 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.245 | 1.411 | 1.499 | 1.502 | 1.505 | 1.391 | 100.0% | 10 | | swift.list_objects | 0.954 | 0.992 | 1.028 | 1.046 | 1.063 | 1.001 | 100.0% | 10 | | swift.download_object (x5) | 2.366 | 2.455 | 2.495 | 2.516 | 2.537 | 2.446 | 100.0% | 10 | | total | 4.632 | 4.83 | 4.979 | 5.004 | 5.029 | 4.838 | 100.0% | 10 | | -> duration | 4.632 | 4.83 | 4.979 | 5.004 | 5.029 | 4.838 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.436999 Full duration: 89.031957 HINTS: * To plot HTML graphics with this data, run: rally task report 10b37913-d3b2-465a-b2cd-8dca8d9d0288 --out output.html * To generate a JUnit report, run: rally task export 10b37913-d3b2-465a-b2cd-8dca8d9d0288 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 10b37913-d3b2-465a-b2cd-8dca8d9d0288 --json --out output.json 2021-03-13 18:16:42,657 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 10b37913-d3b2-465a-b2cd-8dca8d9d0288 --out /home/opnfv/functest/results/rally_full/swift.json 2021-03-13 18:16:42,672 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-03-13 18:16:42,676 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:21 | 60 | 100.00% | | glance | 00:07:05 | 39 | 92.31% | | cinder | 00:43:17 | 240 | 100.00% | | heat | 00:40:58 | 100 | 100.00% | | keystone | 00:10:19 | 110 | 100.00% | | neutron | 00:18:05 | 140 | 100.00% | | nova | 00:14:43 | 50 | 96.00% | | quotas | 00:01:53 | 30 | 100.00% | | swift | 00:08:33 | 50 | 100.00% | | | | | | | TOTAL: | 02:27:16 | 819 | 99.39% | +----------------+------------+----------------+-----------+ 2021-03-13 18:16:42,676 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.39% in 6/9 modules 2021-03-13 18:16:46,381 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-03-13 18:16:49,889 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-03-13 18:16:49,889 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 154:35 | FAIL | +--------------------+------------------+------------------+----------------+