2021-01-23 16:30:46,613 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | 8H6AXNY9PK6K | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/8H6AXNY9PK6K/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-191 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/8H6AXNY9PK6K/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-191 | +-------------------------+------------------------------------------------------------+ 2021-01-23 16:30:46,632 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-01-23 16:30:50,012 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-01-23 16:30:55,418 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-01-23 16:31:01,878 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 29f60f9c-3e65-407f-9604-b9dddb3b8d98 | 2021-01-23T16:31:01.576992 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 29f60f9c-3e65-407f-9604-b9dddb3b8d98 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-01-23 16:31:06,565 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-01-23 16:31:08,355 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 16:31:08,532 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-01-23 16:35:21,838 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 40fbda36-6aa8-443a-a8ad-18ec48c91a91 2021-01-23 16:35:23,053 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 40fbda36-6aa8-443a-a8ad-18ec48c91a91 -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.005 | 1.696 | 2.696 | 2.878 | 3.061 | 1.815 | 100.0% | 10 | | total | 1.005 | 1.696 | 2.696 | 2.878 | 3.061 | 1.815 | 100.0% | 10 | | -> duration | 1.005 | 1.696 | 2.696 | 2.878 | 3.061 | 1.815 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.196797 Full duration: 42.591131 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.159 | 0.192 | 0.646 | 0.648 | 0.649 | 0.299 | 100.0% | 10 | | total | 0.598 | 0.829 | 1.343 | 1.361 | 1.38 | 0.935 | 100.0% | 10 | | -> duration | 0.598 | 0.829 | 1.343 | 1.361 | 1.38 | 0.935 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.600756 Full duration: 27.294612 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.196 | 0.24 | 0.467 | 0.49 | 0.514 | 0.315 | 100.0% | 10 | | total | 0.597 | 1.141 | 1.598 | 1.736 | 1.874 | 1.182 | 100.0% | 10 | | -> duration | 0.597 | 1.141 | 1.598 | 1.736 | 1.874 | 1.182 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.581748 Full duration: 40.972223 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.148 | 0.192 | 0.589 | 0.617 | 0.645 | 0.309 | 100.0% | 10 | | total | 0.552 | 0.892 | 1.233 | 1.26 | 1.286 | 0.91 | 100.0% | 10 | | -> duration | 0.552 | 0.892 | 1.233 | 1.26 | 1.286 | 0.91 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.529528 Full duration: 45.456783 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.369 | 0.662 | 1.022 | 1.387 | 1.752 | 0.719 | 100.0% | 10 | | total | 0.816 | 1.346 | 1.948 | 2.108 | 2.269 | 1.401 | 100.0% | 10 | | -> duration | 0.816 | 1.346 | 1.948 | 2.108 | 2.269 | 1.401 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.727773 Full duration: 32.759523 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 40fbda36-6aa8-443a-a8ad-18ec48c91a91 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.164 | 0.222 | 0.305 | 0.465 | 0.624 | 0.255 | 100.0% | 10 | | total | 0.631 | 0.979 | 1.764 | 1.775 | 1.785 | 1.13 | 100.0% | 10 | | -> duration | 0.631 | 0.979 | 1.764 | 1.775 | 1.785 | 1.13 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.313967 Full duration: 34.801293 HINTS: * To plot HTML graphics with this data, run: rally task report 40fbda36-6aa8-443a-a8ad-18ec48c91a91 --out output.html * To generate a JUnit report, run: rally task export 40fbda36-6aa8-443a-a8ad-18ec48c91a91 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 40fbda36-6aa8-443a-a8ad-18ec48c91a91 --json --out output.json 2021-01-23 16:35:26,092 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 40fbda36-6aa8-443a-a8ad-18ec48c91a91 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-01-23 16:35:26,105 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-01-23 16:35:26,140 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 16:35:26,300 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-01-23 16:46:29,221 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 74a41268-086b-4b79-9c81-171c1b04a754 2021-01-23 16:46:30,500 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 74a41268-086b-4b79-9c81-171c1b04a754 -------------------------------------------------------------------------------- Task 74a41268-086b-4b79-9c81-171c1b04a754: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 74a41268-086b-4b79-9c81-171c1b04a754 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.584 | 8.706 | 10.832 | 10.938 | 11.044 | 9.01 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.107 | 0.11 | 0.111 | 0.111 | 0.107 | 100.0% | 10 | | -> glance_v2.upload_data | 2.985 | 5.75 | 7.602 | 8.039 | 8.476 | 5.709 | 100.0% | 10 | | glance_v2.delete_image | 2.395 | 3.531 | 6.859 | 7.082 | 7.305 | 4.01 | 100.0% | 10 | | total | 10.36 | 13.21 | 15.168 | 15.389 | 15.609 | 13.02 | 100.0% | 10 | | -> duration | 10.36 | 13.21 | 15.168 | 15.389 | 15.609 | 13.02 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.838515 Full duration: 71.889125 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 74a41268-086b-4b79-9c81-171c1b04a754 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.997 | 6.492 | 6.899 | 7.048 | 7.197 | 6.514 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.09 | 0.105 | 0.111 | 0.112 | 0.114 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 3.027 | 3.567 | 4.34 | 4.572 | 4.803 | 3.749 | 100.0% | 10 | | glance_v2.list_images | 0.056 | 0.062 | 0.08 | 0.142 | 0.203 | 0.076 | 100.0% | 10 | | total | 6.053 | 6.552 | 6.974 | 7.188 | 7.401 | 6.59 | 100.0% | 10 | | -> duration | 6.053 | 6.552 | 6.974 | 7.188 | 7.401 | 6.59 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.783375 Full duration: 58.724082 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 74a41268-086b-4b79-9c81-171c1b04a754 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.154 | 0.164 | 0.194 | 0.222 | 0.251 | 0.173 | 100.0% | 10 | | total | 0.154 | 0.164 | 0.194 | 0.222 | 0.251 | 0.174 | 100.0% | 10 | | -> duration | 0.154 | 0.164 | 0.194 | 0.222 | 0.251 | 0.174 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.557887 Full duration: 32.412121 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 74a41268-086b-4b79-9c81-171c1b04a754 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 7.056 | 8.433 | 13.369 | 14.278 | 15.188 | 10.103 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.108 | 0.13 | 0.157 | 0.183 | 0.116 | 100.0% | 10 | | -> glance_v2.upload_data | 3.325 | 5.429 | 8.46 | 8.923 | 9.386 | 6.174 | 100.0% | 10 | | nova.boot_servers | 21.104 | 101.082 | 145.204 | 149.885 | 154.567 | 99.948 | 60.0% | 10 | | total | 33.216 | 108.862 | 160.148 | 163.732 | 167.317 | 110.052 | 60.0% | 10 | | -> duration | 32.216 | 107.862 | 159.148 | 162.732 | 166.317 | 109.052 | 60.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 60.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 331.733685 Full duration: 464.765556 HINTS: * To plot HTML graphics with this data, run: rally task report 74a41268-086b-4b79-9c81-171c1b04a754 --out output.html * To generate a JUnit report, run: rally task export 74a41268-086b-4b79-9c81-171c1b04a754 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 74a41268-086b-4b79-9c81-171c1b04a754 --json --out output.json At least one workload did not pass SLA criteria. 2021-01-23 16:46:33,685 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 74a41268-086b-4b79-9c81-171c1b04a754 --out /home/opnfv/functest/results/rally_full/glance.json 2021-01-23 16:46:33,765 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-01-23 16:46:33,808 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 16:46:34,272 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-01-23 17:47:09,293 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: b3171da3-db9f-44ac-94b7-2dd71efad4ed 2021-01-23 17:47:10,706 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b3171da3-db9f-44ac-94b7-2dd71efad4ed -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "size": 1, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 35.651 | 73.832 | 93.141 | 94.779 | 96.417 | 72.892 | 100.0% | 10 | | cinder_v3.create_volume | 9.074 | 16.74 | 21.693 | 23.328 | 24.963 | 16.844 | 100.0% | 10 | | nova.attach_volume | 9.061 | 18.695 | 31.765 | 33.01 | 34.255 | 21.238 | 100.0% | 10 | | nova.detach_volume | 4.038 | 6.742 | 8.788 | 10.699 | 12.61 | 6.999 | 100.0% | 10 | | cinder_v3.delete_volume | 4.295 | 6.869 | 18.49 | 21.259 | 24.029 | 9.736 | 100.0% | 10 | | nova.delete_server | 10.341 | 23.942 | 35.818 | 38.554 | 41.291 | 24.33 | 100.0% | 10 | | total | 80.55 | 160.982 | 186.656 | 190.03 | 193.404 | 152.039 | 100.0% | 10 | | -> duration | 79.55 | 159.982 | 185.656 | 189.03 | 192.404 | 151.039 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 410.674189 Full duration: 475.94557 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.224 | 8.483 | 11.446 | 12.569 | 13.692 | 8.179 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.038 | 0.041 | 0.051 | 0.051 | 0.051 | 0.043 | 100.0% | 10 | | total | 3.276 | 8.523 | 11.486 | 12.615 | 13.743 | 8.223 | 100.0% | 10 | | -> duration | 3.276 | 8.523 | 11.486 | 12.615 | 13.743 | 8.223 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.397226 Full duration: 99.694041 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 18.711 | 22.098 | 24.684 | 25.047 | 25.409 | 22.112 | 100.0% | 10 | | cinder_v3.list_volumes | 0.07 | 0.082 | 0.092 | 0.092 | 0.093 | 0.083 | 100.0% | 10 | | total | 18.795 | 22.173 | 24.777 | 25.138 | 25.499 | 22.195 | 100.0% | 10 | | -> duration | 18.795 | 22.173 | 24.777 | 25.138 | 25.499 | 22.195 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.89174 Full duration: 129.02926 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 13.087 | 19.446 | 28.808 | 28.822 | 28.836 | 21.44 | 100.0% | 10 | | cinder_v3.list_volumes | 0.061 | 0.071 | 0.092 | 0.129 | 0.166 | 0.08 | 100.0% | 10 | | total | 13.158 | 19.516 | 28.891 | 28.9 | 28.908 | 21.52 | 100.0% | 10 | | -> duration | 13.158 | 19.516 | 28.891 | 28.9 | 28.908 | 21.52 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.595605 Full duration: 135.322793 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.748 | 8.47 | 12.991 | 13.354 | 13.716 | 8.881 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 44.516 | 66.168 | 69.748 | 70.378 | 71.008 | 62.491 | 100.0% | 10 | | cinder_v3.delete_volume | 2.889 | 5.399 | 10.809 | 11.351 | 11.892 | 6.594 | 100.0% | 10 | | glance_v2.delete_image | 6.022 | 7.949 | 9.914 | 9.989 | 10.064 | 7.97 | 100.0% | 10 | | total | 64.096 | 88.939 | 95.25 | 97.394 | 99.538 | 85.936 | 100.0% | 10 | | -> duration | 64.096 | 88.939 | 95.25 | 97.394 | 99.538 | 85.936 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 247.449069 Full duration: 288.374622 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 50.759 | 69.261 | 72.929 | 72.929 | 72.93 | 64.998 | 100.0% | 10 | | cinder_v3.create_volume | 10.988 | 16.078 | 24.02 | 25.179 | 26.338 | 17.145 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.186 | 10.918 | 17.042 | 18.808 | 20.574 | 11.665 | 100.0% | 10 | | nova.attach_volume | 10.491 | 21.271 | 31.465 | 31.931 | 32.397 | 22.782 | 100.0% | 10 | | nova.detach_volume | 4.261 | 5.616 | 7.939 | 7.952 | 7.966 | 5.993 | 100.0% | 10 | | cinder_v3.delete_snapshot | 3.246 | 5.372 | 7.81 | 7.966 | 8.121 | 5.343 | 100.0% | 10 | | cinder_v3.delete_volume | 3.34 | 5.888 | 8.247 | 8.287 | 8.326 | 5.944 | 100.0% | 10 | | nova.delete_server | 11.227 | 20.582 | 26.444 | 29.524 | 32.604 | 20.622 | 100.0% | 10 | | total | 103.789 | 156.588 | 186.993 | 191.116 | 195.239 | 154.494 | 100.0% | 10 | | -> duration | 102.789 | 155.588 | 185.993 | 190.116 | 194.239 | 153.494 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 434.105285 Full duration: 484.078055 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.552 | 15.096 | 21.742 | 23.988 | 26.234 | 14.171 | 100.0% | 10 | | cinder_v3.create_snapshot | 6.622 | 9.559 | 11.072 | 11.331 | 11.591 | 9.321 | 100.0% | 10 | | nova.boot_server | 47.293 | 53.327 | 62.628 | 62.743 | 62.859 | 54.145 | 100.0% | 10 | | nova.attach_volume | 8.743 | 12.979 | 23.653 | 23.96 | 24.267 | 16.389 | 100.0% | 10 | | nova.detach_volume | 3.797 | 8.036 | 9.726 | 10.554 | 11.381 | 7.418 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.787 | 6.35 | 9.065 | 11.3 | 13.535 | 6.415 | 100.0% | 10 | | cinder_v3.delete_volume | 3.825 | 11.007 | 13.63 | 13.891 | 14.153 | 10.189 | 100.0% | 10 | | nova.delete_server | 17.303 | 25.479 | 29.224 | 30.454 | 31.684 | 24.459 | 100.0% | 10 | | total | 117.28 | 133.163 | 168.332 | 169.42 | 170.509 | 142.509 | 100.0% | 10 | | -> duration | 116.28 | 132.163 | 167.332 | 168.42 | 169.509 | 141.509 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 413.599966 Full duration: 461.876072 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 10.912 | 11.808 | 13.483 | 14.251 | 15.019 | 12.264 | 100.0% | 10 | | total | 10.912 | 11.808 | 13.483 | 14.251 | 15.019 | 12.264 | 100.0% | 10 | | -> duration | 10.912 | 11.808 | 13.483 | 14.251 | 15.019 | 12.264 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.110966 Full duration: 79.099305 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.139 | 7.86 | 9.707 | 10.261 | 10.815 | 7.711 | 100.0% | 10 | | total | 4.139 | 7.86 | 9.707 | 10.261 | 10.815 | 7.711 | 100.0% | 10 | | -> duration | 4.139 | 7.86 | 9.707 | 10.261 | 10.815 | 7.711 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.688643 Full duration: 102.414791 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.632 | 0.77 | 1.064 | 1.166 | 1.268 | 0.833 | 100.0% | 10 | | total | 0.633 | 0.77 | 1.064 | 1.166 | 1.268 | 0.833 | 100.0% | 10 | | -> duration | 0.633 | 0.77 | 1.064 | 1.166 | 1.268 | 0.833 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.27724 Full duration: 158.106134 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 6.921 | 13.09 | 14.998 | 15.964 | 16.93 | 12.645 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.691 | 5.569 | 7.607 | 8.529 | 9.451 | 5.643 | 100.0% | 10 | | total | 12.41 | 18.43 | 22.342 | 23.337 | 24.332 | 18.289 | 100.0% | 10 | | -> duration | 12.41 | 18.43 | 22.342 | 23.337 | 24.332 | 18.289 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 52.333685 Full duration: 117.92073 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 8.957 | 12.695 | 17.198 | 18.071 | 18.944 | 13.059 | 100.0% | 10 | | cinder_v3.delete_volume | 8.891 | 10.841 | 15.812 | 17.489 | 19.167 | 12.061 | 100.0% | 10 | | total | 19.681 | 25.413 | 29.557 | 30.432 | 31.307 | 25.121 | 100.0% | 10 | | -> duration | 19.681 | 25.413 | 29.557 | 30.432 | 31.307 | 25.121 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 68.809201 Full duration: 103.847875 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 24.439 | 32.054 | 39.043 | 40.78 | 42.517 | 31.363 | 100.0% | 10 | | cinder_v3.delete_volume | 3.017 | 8.967 | 12.327 | 13.045 | 13.763 | 8.123 | 100.0% | 10 | | total | 31.548 | 37.666 | 48.797 | 49.848 | 50.898 | 39.486 | 100.0% | 10 | | -> duration | 31.548 | 37.666 | 48.797 | 49.848 | 50.898 | 39.486 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 111.371445 Full duration: 151.938112 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 11.943 | 15.068 | 21.617 | 22.543 | 23.47 | 16.007 | 100.0% | 10 | | cinder_v3.delete_volume | 4.407 | 6.127 | 13.986 | 14.159 | 14.331 | 7.644 | 100.0% | 10 | | total | 17.065 | 23.388 | 29.59 | 29.632 | 29.674 | 23.651 | 100.0% | 10 | | -> duration | 17.065 | 23.388 | 29.59 | 29.632 | 29.674 | 23.651 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.882058 Full duration: 99.125867 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 10.039 | 13.831 | 19.736 | 20.768 | 21.799 | 14.572 | 100.0% | 10 | | cinder_v3.extend_volume | 3.574 | 5.687 | 7.994 | 8.525 | 9.057 | 6.224 | 100.0% | 10 | | cinder_v3.delete_volume | 4.177 | 9.164 | 15.557 | 15.8 | 16.043 | 9.876 | 100.0% | 10 | | total | 22.113 | 30.015 | 39.677 | 41.031 | 42.385 | 30.672 | 100.0% | 10 | | -> duration | 22.113 | 30.015 | 39.677 | 41.031 | 42.385 | 30.672 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 91.537861 Full duration: 132.620041 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.522 | 20.05 | 27.608 | 28.209 | 28.81 | 21.823 | 100.0% | 10 | | cinder_v3.delete_volume | 2.779 | 10.324 | 15.269 | 15.987 | 16.704 | 9.923 | 100.0% | 10 | | total | 20.35 | 30.537 | 40.904 | 42.541 | 44.179 | 31.746 | 100.0% | 10 | | -> duration | 20.35 | 30.537 | 40.904 | 42.541 | 44.179 | 31.746 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 88.899462 Full duration: 176.751209 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.81 | 1.675 | 2.047 | 2.073 | 2.099 | 1.551 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.036 | 0.039 | 0.039 | 0.039 | 0.036 | 100.0% | 10 | | total | 0.845 | 1.711 | 2.081 | 2.109 | 2.136 | 1.587 | 100.0% | 10 | | -> duration | 0.845 | 1.711 | 2.081 | 2.109 | 2.136 | 1.587 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.648576 Full duration: 45.365551 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.878 | 1.451 | 1.642 | 2.074 | 2.505 | 1.435 | 100.0% | 10 | | cinder_v3.list_qos | 0.033 | 0.039 | 0.046 | 0.046 | 0.047 | 0.04 | 100.0% | 10 | | total | 0.914 | 1.493 | 1.683 | 2.113 | 2.543 | 1.475 | 100.0% | 10 | | -> duration | 0.914 | 1.493 | 1.683 | 2.113 | 2.543 | 1.475 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.300594 Full duration: 46.89837 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.697 | 1.434 | 2.051 | 2.707 | 3.363 | 1.584 | 100.0% | 10 | | cinder_v3.set_qos | 0.331 | 0.779 | 2.416 | 2.528 | 2.641 | 1.201 | 100.0% | 10 | | total | 1.028 | 2.389 | 4.082 | 4.301 | 4.519 | 2.785 | 100.0% | 10 | | -> duration | 1.028 | 2.389 | 4.082 | 4.301 | 4.519 | 2.785 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.298867 Full duration: 43.958406 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.836 | 1.086 | 1.206 | 1.215 | 1.223 | 1.068 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.03 | 0.038 | 0.049 | 0.05 | 0.052 | 0.039 | 100.0% | 10 | | total | 0.876 | 1.123 | 1.25 | 1.263 | 1.276 | 1.107 | 100.0% | 10 | | -> duration | 0.876 | 1.123 | 1.25 | 1.263 | 1.276 | 1.107 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.437768 Full duration: 46.619743 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.132 | 1.643 | 2.507 | 2.534 | 2.561 | 1.834 | 100.0% | 10 | | cinder_v3.list_types | 0.042 | 0.047 | 0.05 | 0.05 | 0.05 | 0.046 | 100.0% | 10 | | total | 1.175 | 1.685 | 2.557 | 2.583 | 2.609 | 1.881 | 100.0% | 10 | | -> duration | 1.175 | 1.685 | 2.557 | 2.583 | 2.609 | 1.881 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.309611 Full duration: 43.544868 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.886 | 1.821 | 3.267 | 3.295 | 3.323 | 2.065 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.289 | 0.8 | 1.199 | 1.247 | 1.295 | 0.835 | 100.0% | 10 | | total | 1.513 | 2.433 | 4.451 | 4.462 | 4.472 | 2.9 | 100.0% | 10 | | -> duration | 1.513 | 2.433 | 4.451 | 4.462 | 4.472 | 2.9 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.283463 Full duration: 50.598557 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.127 | 2.029 | 2.9 | 3.436 | 3.971 | 2.121 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.335 | 1.667 | 2.13 | 2.271 | 2.412 | 1.606 | 100.0% | 10 | | total | 2.094 | 3.767 | 4.856 | 5.291 | 5.727 | 3.728 | 100.0% | 10 | | -> duration | 2.094 | 3.767 | 4.856 | 5.291 | 5.727 | 3.728 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.279717 Full duration: 59.826212 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b3171da3-db9f-44ac-94b7-2dd71efad4ed has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.886 | 1.189 | 3.425 | 3.45 | 3.474 | 1.994 | 100.0% | 10 | | cinder_v2.add_type_access | 0.3 | 0.69 | 1.339 | 1.367 | 1.395 | 0.803 | 100.0% | 10 | | cinder_v2.list_type_access | 0.033 | 0.039 | 0.055 | 0.085 | 0.115 | 0.047 | 100.0% | 10 | | total | 1.301 | 1.904 | 4.842 | 4.85 | 4.857 | 2.844 | 100.0% | 10 | | -> duration | 1.301 | 1.904 | 4.842 | 4.85 | 4.857 | 2.844 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.039902 Full duration: 42.467709 HINTS: * To plot HTML graphics with this data, run: rally task report b3171da3-db9f-44ac-94b7-2dd71efad4ed --out output.html * To generate a JUnit report, run: rally task export b3171da3-db9f-44ac-94b7-2dd71efad4ed --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b3171da3-db9f-44ac-94b7-2dd71efad4ed --json --out output.json 2021-01-23 17:47:13,907 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b3171da3-db9f-44ac-94b7-2dd71efad4ed --out /home/opnfv/functest/results/rally_full/cinder.json 2021-01-23 17:47:13,942 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-01-23 17:47:13,973 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 17:47:14,408 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-01-23 19:08:29,427 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 040f54aa-fd0b-4161-add0-3895080c80e8 2021-01-23 19:08:30,680 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 040f54aa-fd0b-4161-add0-3895080c80e8 -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 15.057 | 33.818 | 35.134 | 35.289 | 35.444 | 30.2 | 100.0% | 10 | | heat.list_stacks | 0.061 | 0.077 | 0.093 | 0.095 | 0.096 | 0.077 | 100.0% | 10 | | total | 15.137 | 33.906 | 35.224 | 35.365 | 35.505 | 30.277 | 100.0% | 10 | | -> duration | 13.137 | 31.906 | 33.224 | 33.365 | 33.505 | 28.277 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.643579 Full duration: 215.565591 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 66.435 | 76.814 | 89.731 | 95.388 | 101.045 | 79.883 | 100.0% | 10 | | heat.update_stack | 34.527 | 53.15 | 58.601 | 60.002 | 61.402 | 51.074 | 100.0% | 10 | | heat.delete_stack | 29.171 | 49.219 | 72.377 | 73.027 | 73.678 | 51.505 | 100.0% | 10 | | total | 146.698 | 171.283 | 219.381 | 225.151 | 230.922 | 182.462 | 100.0% | 10 | | -> duration | 142.698 | 167.283 | 215.381 | 221.151 | 226.922 | 178.462 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 520.372391 Full duration: 575.500529 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 75.648 | 77.885 | 84.828 | 89.237 | 93.645 | 79.822 | 100.0% | 10 | | heat.update_stack | 20.393 | 42.391 | 46.299 | 46.645 | 46.991 | 38.351 | 100.0% | 10 | | heat.delete_stack | 26.424 | 37.888 | 47.623 | 50.919 | 54.216 | 38.789 | 100.0% | 10 | | total | 127.38 | 160.475 | 167.256 | 181.054 | 194.852 | 156.962 | 100.0% | 10 | | -> duration | 123.38 | 156.475 | 163.256 | 177.054 | 190.852 | 152.962 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 440.369402 Full duration: 500.011717 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 58.131 | 108.391 | 130.205 | 130.24 | 130.276 | 105.477 | 100.0% | 10 | | heat.update_stack | 35.548 | 78.756 | 110.839 | 112.087 | 113.335 | 81.7 | 100.0% | 10 | | heat.delete_stack | 36.375 | 85.36 | 89.475 | 89.709 | 89.943 | 76.865 | 100.0% | 10 | | total | 130.054 | 289.084 | 305.022 | 305.255 | 305.488 | 264.042 | 100.0% | 10 | | -> duration | 126.054 | 285.084 | 301.022 | 301.255 | 301.488 | 260.042 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 726.795315 Full duration: 784.917027 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 63.692 | 89.761 | 108.761 | 111.32 | 113.879 | 88.983 | 100.0% | 10 | | heat.update_stack | 54.789 | 69.759 | 77.153 | 79.087 | 81.022 | 69.702 | 100.0% | 10 | | heat.delete_stack | 31.293 | 60.531 | 66.851 | 72.317 | 77.784 | 57.379 | 100.0% | 10 | | total | 174.762 | 217.299 | 244.272 | 245.349 | 246.426 | 216.065 | 100.0% | 10 | | -> duration | 170.762 | 213.299 | 240.272 | 241.349 | 242.426 | 212.065 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 622.796586 Full duration: 690.030324 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 67.304 | 85.311 | 107.791 | 108.319 | 108.847 | 89.974 | 100.0% | 10 | | heat.update_stack | 31.943 | 74.511 | 82.512 | 85.008 | 87.503 | 68.481 | 100.0% | 10 | | heat.delete_stack | 29.214 | 61.011 | 64.895 | 66.006 | 67.116 | 55.327 | 100.0% | 10 | | total | 129.981 | 223.498 | 250.933 | 251.468 | 252.004 | 213.782 | 100.0% | 10 | | -> duration | 125.981 | 219.498 | 246.933 | 247.468 | 248.004 | 209.782 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 590.425407 Full duration: 650.184068 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 52.619 | 60.375 | 85.323 | 87.281 | 89.24 | 67.145 | 100.0% | 10 | | heat.update_stack | 40.386 | 58.216 | 62.015 | 63.326 | 64.636 | 56.247 | 100.0% | 10 | | heat.delete_stack | 15.693 | 41.851 | 44.292 | 44.89 | 45.489 | 36.885 | 100.0% | 10 | | total | 114.832 | 155.31 | 190.582 | 194.973 | 199.365 | 160.278 | 100.0% | 10 | | -> duration | 110.832 | 151.31 | 186.582 | 190.973 | 195.365 | 156.278 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 448.400985 Full duration: 505.785485 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 39.327 | 54.037 | 69.971 | 71.599 | 73.226 | 55.105 | 100.0% | 10 | | heat.check_stack | 6.396 | 11.917 | 14.567 | 15.054 | 15.541 | 11.272 | 100.0% | 10 | | heat.delete_stack | 7.69 | 27.579 | 30.863 | 31.038 | 31.213 | 24.732 | 100.0% | 10 | | total | 68.01 | 84.252 | 111.193 | 111.494 | 111.795 | 91.11 | 100.0% | 10 | | -> duration | 66.01 | 82.252 | 109.193 | 109.494 | 109.795 | 89.11 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 260.414394 Full duration: 318.559525 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 63.427 | 67.762 | 74.16 | 76.857 | 79.555 | 69.506 | 100.0% | 10 | | heat.suspend_stack | 21.044 | 26.044 | 26.78 | 26.861 | 26.943 | 25.227 | 100.0% | 10 | | heat.resume_stack | 8.464 | 22.994 | 24.736 | 27.093 | 29.45 | 21.167 | 100.0% | 10 | | heat.delete_stack | 13.427 | 33.018 | 40.846 | 42.957 | 45.068 | 32.33 | 100.0% | 10 | | total | 115.439 | 149.381 | 165.501 | 172.814 | 180.127 | 148.231 | 100.0% | 10 | | -> duration | 113.439 | 147.381 | 163.501 | 170.814 | 178.127 | 146.231 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 421.193288 Full duration: 487.023555 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 040f54aa-fd0b-4161-add0-3895080c80e8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.641 | 0.921 | 1.162 | 1.166 | 1.169 | 0.921 | 100.0% | 10 | | total | 0.641 | 0.921 | 1.162 | 1.166 | 1.169 | 0.921 | 100.0% | 10 | | -> duration | 0.641 | 0.921 | 1.162 | 1.166 | 1.169 | 0.921 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.791257 Full duration: 61.390763 HINTS: * To plot HTML graphics with this data, run: rally task report 040f54aa-fd0b-4161-add0-3895080c80e8 --out output.html * To generate a JUnit report, run: rally task export 040f54aa-fd0b-4161-add0-3895080c80e8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 040f54aa-fd0b-4161-add0-3895080c80e8 --json --out output.json 2021-01-23 19:08:33,756 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 040f54aa-fd0b-4161-add0-3895080c80e8 --out /home/opnfv/functest/results/rally_full/heat.json 2021-01-23 19:08:33,773 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-01-23 19:08:33,803 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 19:08:34,293 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-01-23 19:23:43,013 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 2021-01-23 19:23:44,314 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.237 | 1.623 | 2.727 | 2.934 | 3.141 | 1.658 | 100.0% | 10 | | keystone_v3.add_role | 0.122 | 0.74 | 1.206 | 1.638 | 2.07 | 0.812 | 100.0% | 10 | | keystone_v3.revoke_role | 0.203 | 0.806 | 0.993 | 1.155 | 1.318 | 0.707 | 100.0% | 10 | | total | 1.256 | 3.078 | 4.783 | 4.977 | 5.172 | 3.177 | 100.0% | 10 | | -> duration | 1.256 | 3.078 | 4.783 | 4.977 | 5.172 | 3.177 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.504386 Full duration: 62.170968 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.113 | 0.479 | 1.343 | 1.544 | 1.745 | 0.663 | 100.0% | 10 | | keystone_v3.add_role | 0.204 | 0.66 | 0.972 | 1.003 | 1.035 | 0.628 | 100.0% | 10 | | keystone_v3.list_roles | 0.103 | 0.123 | 0.231 | 0.288 | 0.345 | 0.152 | 100.0% | 10 | | total | 0.541 | 1.474 | 2.328 | 2.401 | 2.473 | 1.443 | 100.0% | 10 | | -> duration | 0.541 | 1.474 | 2.328 | 2.401 | 2.473 | 1.443 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.673478 Full duration: 68.570333 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.63 | 0.989 | 1.538 | 2.013 | 2.488 | 1.15 | 100.0% | 10 | | keystone_v3.list_projects | 0.105 | 0.13 | 0.141 | 0.143 | 0.145 | 0.128 | 100.0% | 10 | | total | 0.77 | 1.116 | 1.649 | 2.133 | 2.616 | 1.278 | 100.0% | 10 | | -> duration | 0.77 | 1.116 | 1.649 | 2.133 | 2.616 | 1.278 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.131196 Full duration: 64.007713 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.445 | 0.939 | 1.526 | 1.818 | 2.11 | 1.052 | 100.0% | 10 | | keystone_v3.delete_role | 0.324 | 1.048 | 2.422 | 2.592 | 2.761 | 1.209 | 100.0% | 10 | | total | 0.769 | 1.99 | 4.186 | 4.34 | 4.494 | 2.261 | 100.0% | 10 | | -> duration | 0.769 | 1.99 | 4.186 | 4.34 | 4.494 | 2.261 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.150586 Full duration: 61.887324 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.472 | 2.382 | 3.509 | 3.655 | 3.8 | 2.126 | 100.0% | 10 | | keystone_v3.delete_service | 0.336 | 0.871 | 2.413 | 2.439 | 2.466 | 1.267 | 100.0% | 10 | | total | 1.129 | 3.78 | 4.745 | 5.505 | 6.266 | 3.394 | 100.0% | 10 | | -> duration | 1.129 | 3.78 | 4.745 | 5.505 | 6.266 | 3.394 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.60051 Full duration: 57.96545 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.575 | 2.686 | 4.548 | 5.286 | 6.025 | 3.117 | 100.0% | 10 | | keystone_v3.create_user | 0.854 | 3.249 | 4.717 | 4.772 | 4.827 | 3.111 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.049 | 0.055 | 0.177 | 0.353 | 0.528 | 0.109 | 100.0% | 10 | | -> keystone_v3.add_role | 0.232 | 1.116 | 1.652 | 2.252 | 2.853 | 1.18 | 100.0% | 10 | | keystone_v3.create_role | 0.303 | 1.414 | 1.814 | 1.842 | 1.87 | 1.301 | 100.0% | 10 | | keystone_v3.get_project | 0.032 | 0.052 | 0.242 | 0.337 | 0.432 | 0.124 | 100.0% | 10 | | keystone_v3.get_user | 0.029 | 0.044 | 0.314 | 0.805 | 1.295 | 0.184 | 100.0% | 10 | | keystone_v3.get_role | 0.034 | 0.05 | 0.535 | 1.103 | 1.672 | 0.28 | 100.0% | 10 | | keystone_v3.list_services | 0.034 | 0.047 | 0.32 | 0.339 | 0.358 | 0.103 | 100.0% | 10 | | keystone_v3.get_services | 0.03 | 0.044 | 1.025 | 1.381 | 1.736 | 0.345 | 100.0% | 10 | | total | 5.053 | 9.338 | 10.676 | 10.98 | 11.283 | 8.76 | 100.0% | 10 | | -> duration | 5.053 | 9.338 | 10.676 | 10.98 | 11.283 | 8.76 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.034808 Full duration: 96.795433 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.686 | 2.014 | 3.982 | 4.178 | 4.374 | 2.248 | 100.0% | 10 | | keystone_v3.update_project | 0.715 | 1.315 | 2.724 | 2.902 | 3.081 | 1.646 | 100.0% | 10 | | keystone_v3.delete_project | 0.716 | 1.622 | 2.565 | 2.755 | 2.945 | 1.65 | 100.0% | 10 | | total | 2.164 | 5.535 | 7.765 | 7.908 | 8.051 | 5.545 | 100.0% | 10 | | -> duration | 2.164 | 5.535 | 7.765 | 7.908 | 8.051 | 5.545 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.473564 Full duration: 67.841932 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.238 | 0.802 | 1.116 | 1.252 | 1.388 | 0.77 | 100.0% | 10 | | total | 0.304 | 0.876 | 1.528 | 1.576 | 1.623 | 0.901 | 100.0% | 10 | | -> duration | 0.304 | 0.876 | 1.528 | 1.576 | 1.623 | 0.901 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.501261 Full duration: 35.651422 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.451 | 0.811 | 2.026 | 2.223 | 2.42 | 1.003 | 100.0% | 10 | | total | 0.451 | 0.811 | 2.026 | 2.223 | 2.42 | 1.003 | 100.0% | 10 | | -> duration | 0.451 | 0.811 | 2.026 | 2.223 | 2.42 | 1.003 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.735205 Full duration: 34.746065 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.324 | 1.452 | 4.033 | 5.217 | 6.401 | 2.116 | 100.0% | 10 | | keystone_v3.list_users | 0.051 | 0.071 | 0.153 | 0.215 | 0.276 | 0.097 | 100.0% | 10 | | total | 0.688 | 1.597 | 4.173 | 5.355 | 6.538 | 2.364 | 100.0% | 10 | | -> duration | 0.688 | 1.597 | 4.173 | 5.355 | 6.538 | 2.364 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.173717 Full duration: 48.240174 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.535 | 1.185 | 2.694 | 4.438 | 6.181 | 1.726 | 100.0% | 10 | | keystone_v3.create_users | 13.64 | 26.18 | 30.85 | 30.883 | 30.915 | 25.249 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 13.64 | 26.179 | 30.85 | 30.882 | 30.914 | 25.249 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.494 | 0.731 | 1.188 | 2.694 | 4.2 | 1.046 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.465 | 10.33 | 12.508 | 12.814 | 13.119 | 9.818 | 100.0% | 10 | | total | 15.22 | 28.316 | 34.399 | 34.586 | 34.773 | 28.297 | 100.0% | 10 | | -> duration | 15.22 | 28.316 | 34.399 | 34.586 | 34.773 | 28.297 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.449697 Full duration: 276.684651 HINTS: * To plot HTML graphics with this data, run: rally task report 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 --out output.html * To generate a JUnit report, run: rally task export 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 --json --out output.json 2021-01-23 19:23:47,456 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8407e1e4-7fab-4580-8dc4-6e95f5f52ce9 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-01-23 19:23:47,476 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-01-23 19:23:47,513 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 19:23:48,201 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-01-23 19:47:32,093 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 2021-01-23 19:47:33,316 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.585 | 4.202 | 6.165 | 6.54 | 6.914 | 4.317 | 100.0% | 10 | | neutron.update_network | 0.845 | 1.816 | 2.313 | 2.354 | 2.394 | 1.763 | 100.0% | 10 | | total | 3.459 | 5.865 | 7.987 | 8.648 | 9.309 | 6.08 | 100.0% | 10 | | -> duration | 3.459 | 5.865 | 7.987 | 8.648 | 9.309 | 6.08 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.83451 Full duration: 80.613282 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.11 | 5.349 | 6.054 | 6.065 | 6.076 | 5.092 | 100.0% | 10 | | neutron.update_port | 1.03 | 1.573 | 2.437 | 2.635 | 2.834 | 1.733 | 100.0% | 10 | | total | 5.446 | 6.897 | 7.65 | 8.059 | 8.469 | 6.825 | 100.0% | 10 | | -> duration | 5.446 | 6.897 | 7.65 | 8.059 | 8.469 | 6.825 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.120622 Full duration: 109.979859 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.397 | 4.541 | 5.247 | 5.898 | 6.548 | 4.333 | 100.0% | 10 | | neutron.create_subnet | 3.992 | 5.076 | 6.708 | 6.894 | 7.081 | 5.348 | 100.0% | 10 | | neutron.update_subnet | 1.472 | 2.033 | 2.743 | 2.868 | 2.993 | 2.142 | 100.0% | 10 | | total | 7.862 | 12.108 | 13.225 | 14.097 | 14.969 | 11.823 | 100.0% | 10 | | -> duration | 7.862 | 12.108 | 13.225 | 14.097 | 14.969 | 11.823 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.463211 Full duration: 109.459124 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.673 | 4.526 | 5.53 | 5.827 | 6.124 | 4.546 | 100.0% | 10 | | neutron.delete_network | 1.554 | 2.655 | 3.674 | 3.795 | 3.916 | 2.609 | 100.0% | 10 | | total | 4.704 | 7.392 | 8.758 | 8.764 | 8.769 | 7.155 | 100.0% | 10 | | -> duration | 4.704 | 7.392 | 8.758 | 8.764 | 8.769 | 7.155 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.086367 Full duration: 78.059188 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 6.044 | 7.448 | 12.072 | 12.562 | 13.052 | 8.77 | 100.0% | 10 | | neutron.delete_port | 0.8 | 1.829 | 2.901 | 3.444 | 3.987 | 2.063 | 100.0% | 10 | | total | 8.613 | 9.806 | 13.679 | 13.766 | 13.852 | 10.834 | 100.0% | 10 | | -> duration | 8.613 | 9.806 | 13.679 | 13.766 | 13.852 | 10.834 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.91357 Full duration: 129.079404 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.01 | 7.028 | 10.116 | 10.89 | 11.665 | 7.459 | 100.0% | 10 | | neutron.create_subnet | 2.491 | 5.827 | 12.373 | 13.933 | 15.494 | 7.473 | 100.0% | 10 | | neutron.delete_subnet | 1.153 | 2.837 | 5.247 | 6.663 | 8.078 | 3.514 | 100.0% | 10 | | total | 10.431 | 16.235 | 27.602 | 28.113 | 28.625 | 18.451 | 100.0% | 10 | | -> duration | 10.431 | 16.235 | 27.602 | 28.113 | 28.625 | 18.451 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 52.197316 Full duration: 117.32574 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.618 | 4.598 | 5.441 | 5.561 | 5.681 | 4.327 | 100.0% | 10 | | neutron.list_networks | 0.162 | 0.191 | 0.773 | 1.265 | 1.758 | 0.447 | 100.0% | 10 | | total | 2.78 | 5.453 | 5.858 | 5.876 | 5.894 | 4.774 | 100.0% | 10 | | -> duration | 2.78 | 5.453 | 5.858 | 5.876 | 5.894 | 4.774 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.864884 Full duration: 76.485991 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.3 | 5.312 | 7.12 | 7.215 | 7.311 | 5.388 | 100.0% | 10 | | neutron.list_ports | 0.104 | 0.285 | 1.174 | 1.533 | 1.892 | 0.582 | 100.0% | 10 | | total | 4.106 | 5.823 | 7.314 | 7.803 | 8.291 | 5.97 | 100.0% | 10 | | -> duration | 4.106 | 5.823 | 7.314 | 7.803 | 8.291 | 5.97 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.557729 Full duration: 102.111225 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.017 | 3.982 | 5.486 | 5.608 | 5.73 | 4.19 | 100.0% | 10 | | neutron.create_subnet | 2.208 | 6.073 | 6.994 | 7.239 | 7.485 | 5.481 | 100.0% | 10 | | neutron.list_subnets | 0.091 | 0.1 | 0.194 | 0.588 | 0.982 | 0.187 | 100.0% | 10 | | total | 5.394 | 10.583 | 12.174 | 12.342 | 12.509 | 9.858 | 100.0% | 10 | | -> duration | 5.394 | 10.583 | 12.174 | 12.342 | 12.509 | 9.858 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.343316 Full duration: 98.233382 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.329 | 4.268 | 4.838 | 4.962 | 5.086 | 3.87 | 100.0% | 10 | | neutron.delete_security_group | 0.864 | 1.237 | 2.062 | 2.275 | 2.488 | 1.391 | 100.0% | 10 | | total | 3.47 | 5.486 | 6.41 | 6.992 | 7.575 | 5.261 | 100.0% | 10 | | -> duration | 3.47 | 5.486 | 6.41 | 6.992 | 7.575 | 5.261 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.265619 Full duration: 65.189652 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.946 | 3.758 | 6.127 | 6.177 | 6.227 | 4.319 | 100.0% | 10 | | neutron.create_security_group_rule | 1.731 | 2.97 | 5.813 | 5.853 | 5.894 | 3.637 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.486 | 1.536 | 2.114 | 2.192 | 2.27 | 1.503 | 100.0% | 10 | | neutron.delete_security_group | 0.72 | 1.763 | 2.79 | 2.834 | 2.878 | 1.796 | 100.0% | 10 | | total | 6.996 | 11.624 | 14.466 | 14.578 | 14.689 | 11.255 | 100.0% | 10 | | -> duration | 6.996 | 11.624 | 14.466 | 14.578 | 14.689 | 11.255 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.173472 Full duration: 76.321412 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.722 | 5.01 | 9.896 | 9.916 | 9.937 | 6.531 | 100.0% | 10 | | neutron.create_security_group_rule | 2.22 | 4.16 | 4.714 | 4.763 | 4.811 | 3.847 | 100.0% | 10 | | neutron.list_security_group_rules | 0.076 | 0.665 | 1.618 | 1.898 | 2.179 | 0.765 | 100.0% | 10 | | total | 6.601 | 9.844 | 15.509 | 15.688 | 15.868 | 11.143 | 100.0% | 10 | | -> duration | 6.601 | 9.844 | 15.509 | 15.688 | 15.868 | 11.143 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.869554 Full duration: 88.662411 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.356 | 6.253 | 9.023 | 9.716 | 10.409 | 6.707 | 100.0% | 10 | | neutron.show_security_group | 0.063 | 0.078 | 0.091 | 0.091 | 0.091 | 0.078 | 100.0% | 10 | | total | 3.429 | 6.336 | 9.088 | 9.789 | 10.49 | 6.786 | 100.0% | 10 | | -> duration | 3.429 | 6.336 | 9.088 | 9.789 | 10.49 | 6.786 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.492767 Full duration: 74.945021 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 35.48505 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 5.135 | 13.626 | 14.915 | 15.109 | 15.303 | 12.073 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.158 | 0.634 | 1.875 | 2.895 | 3.916 | 1.025 | 100.0% | 10 | | total | 5.9 | 14.66 | 15.336 | 15.407 | 15.478 | 13.098 | 100.0% | 10 | | -> duration | 5.9 | 14.66 | 15.336 | 15.407 | 15.478 | 13.098 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.733027 Full duration: 142.562649 HINTS: * To plot HTML graphics with this data, run: rally task report 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 --out output.html * To generate a JUnit report, run: rally task export 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 --json --out output.json At least one workload did not pass SLA criteria. 2021-01-23 19:47:36,401 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 81f2c9c5-5cea-4e15-8aa4-8906e3d0e9f0 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-01-23 19:47:36,423 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-01-23 19:47:36,464 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 19:47:36,919 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-01-23 20:55:09,631 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: b052dea7-24d4-4e21-829b-b636a02b3e5c 2021-01-23 20:55:10,999 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b052dea7-24d4-4e21-829b-b636a02b3e5c -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.439 | 1.9 | 4.778 | 4.805 | 4.832 | 2.394 | 100.0% | 10 | | nova.delete_keypair | 0.916 | 1.979 | 2.237 | 2.362 | 2.488 | 1.726 | 100.0% | 10 | | total | 2.815 | 3.604 | 6.672 | 6.795 | 6.919 | 4.121 | 100.0% | 10 | | -> duration | 2.815 | 3.604 | 6.672 | 6.795 | 6.919 | 4.121 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.765468 Full duration: 71.439041 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.076 | 1.573 | 1.978 | 1.985 | 1.992 | 1.593 | 100.0% | 10 | | nova.list_keypairs | 0.033 | 0.038 | 0.22 | 0.278 | 0.336 | 0.097 | 100.0% | 10 | | total | 1.328 | 1.611 | 2.031 | 2.055 | 2.079 | 1.69 | 100.0% | 10 | | -> duration | 1.328 | 1.611 | 2.031 | 2.055 | 2.079 | 1.69 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.997622 Full duration: 73.878825 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 50.963 | 62.469 | 90.005 | 90.308 | 90.612 | 68.251 | 100.0% | 10 | | nova.reboot_server | 16.902 | 25.593 | 28.263 | 30.088 | 31.912 | 24.73 | 100.0% | 10 | | nova.soft_reboot_server | 13.978 | 23.422 | 138.562 | 139.545 | 140.528 | 56.3 | 100.0% | 10 | | nova.stop_and_start_server | 16.444 | 21.922 | 26.937 | 29.038 | 31.138 | 22.152 | 100.0% | 10 | | -> nova.stop_server | 7.991 | 10.453 | 17.605 | 17.966 | 18.327 | 11.763 | 100.0% | 10 | | -> nova.start_server | 7.095 | 10.067 | 12.821 | 12.868 | 12.914 | 10.389 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 18.722 | 26.603 | 35.265 | 36.314 | 37.363 | 27.892 | 100.0% | 10 | | -> nova.rescue_server | 10.02 | 15.555 | 20.057 | 20.247 | 20.437 | 15.388 | 100.0% | 10 | | -> nova.unrescue_server | 7.903 | 11.597 | 15.616 | 18.307 | 20.999 | 12.504 | 100.0% | 10 | | nova.delete_server | 10.099 | 23.542 | 33.315 | 40.318 | 47.321 | 23.572 | 100.0% | 10 | | total | 164.09 | 190.234 | 314.069 | 317.37 | 320.67 | 222.956 | 100.0% | 10 | | -> duration | 155.09 | 181.234 | 305.069 | 308.37 | 311.67 | 213.956 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 662.092988 Full duration: 719.385078 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 58.288 | 83.357 | 104.218 | 104.483 | 104.748 | 82.803 | 100.0% | 10 | | nova.delete_server | 14.203 | 28.101 | 43.36 | 46.795 | 50.229 | 30.283 | 100.0% | 10 | | total | 73.44 | 126.473 | 130.761 | 131.046 | 131.332 | 113.087 | 100.0% | 10 | | -> duration | 72.44 | 125.473 | 129.761 | 130.046 | 130.332 | 112.087 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 309.761363 Full duration: 369.414226 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 41.804 | 67.537 | 73.968 | 75.178 | 76.389 | 63.812 | 100.0% | 10 | | nova.list_servers | 0.38 | 0.402 | 0.667 | 0.768 | 0.869 | 0.473 | 100.0% | 10 | | total | 42.184 | 67.95 | 74.79 | 75.784 | 76.779 | 64.285 | 100.0% | 10 | | -> duration | 41.184 | 66.95 | 73.79 | 74.784 | 75.779 | 63.285 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 180.506695 Full duration: 306.942159 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "from_image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "to_image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 56.929 | 71.985 | 82.323 | 83.502 | 84.68 | 72.179 | 100.0% | 10 | | nova.rebuild_server | 20.041 | 56.118 | 73.527 | 76.943 | 80.358 | 54.943 | 100.0% | 10 | | nova.delete_server | 21.657 | 40.208 | 44.996 | 46.037 | 47.078 | 36.006 | 100.0% | 10 | | total | 112.328 | 170.659 | 197.763 | 198.845 | 199.928 | 163.129 | 100.0% | 10 | | -> duration | 110.328 | 168.659 | 195.763 | 196.845 | 197.928 | 161.129 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 454.906176 Full duration: 505.012045 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 99.218 | 128.912 | 195.634 | 196.209 | 196.784 | 149.686 | 100.0% | 10 | | nova.snapshot_server | 20.533 | 40.118 | 73.146 | 75.416 | 77.686 | 49.084 | 100.0% | 10 | | -> glance_v2.get_image | 0.079 | 0.089 | 0.097 | 0.102 | 0.106 | 0.09 | 100.0% | 10 | | -> glance.wait_for_image | 14.383 | 36.817 | 56.264 | 60.866 | 65.469 | 38.675 | 100.0% | 10 | | --> glance_v2.get_image (x14) | 0.563 | 0.563 | 0.563 | 0.563 | 0.563 | 0.563 | 100.0% | 1 | | --> glance_v2.get_image (x19) | 0.758 | 0.765 | 0.781 | 0.782 | 0.784 | 0.769 | 100.0% | 3 | | --> glance_v2.get_image (x33) | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 1.395 | 100.0% | 1 | | --> glance_v2.get_image (x28) | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 100.0% | 1 | | --> glance_v2.get_image (x24) | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | --> glance_v2.get_image (x25) | 1.056 | 1.056 | 1.056 | 1.056 | 1.056 | 1.056 | 100.0% | 1 | | --> glance_v2.get_image (x10) | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 100.0% | 1 | | --> glance_v2.get_image (x8) | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 100.0% | 1 | | nova.delete_server (x2) | 30.65 | 69.021 | 98.595 | 101.455 | 104.315 | 67.02 | 100.0% | 10 | | nova.delete_image | 4.141 | 12.476 | 17.604 | 17.62 | 17.636 | 12.04 | 100.0% | 10 | | -> glance_v2.delete_image | 4.096 | 12.435 | 17.569 | 17.575 | 17.582 | 11.997 | 100.0% | 10 | | -> glance.wait_for_delete | 0.032 | 0.041 | 0.053 | 0.054 | 0.055 | 0.042 | 100.0% | 10 | | --> glance_v2.get_image | 0.032 | 0.041 | 0.053 | 0.054 | 0.055 | 0.042 | 0.0% | 10 | | total | 159.269 | 250.799 | 377.819 | 378.053 | 378.287 | 277.831 | 100.0% | 10 | | -> duration | 157.269 | 248.799 | 375.819 | 376.053 | 376.287 | 275.831 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 768.833632 Full duration: 828.262317 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "volume_size": 1, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 28.506 | 36.703 | 38.367 | 38.808 | 39.248 | 35.803 | 100.0% | 10 | | nova.boot_server | 36.232 | 82.55 | 90.482 | 93.859 | 97.235 | 76.116 | 100.0% | 10 | | total | 73.729 | 117.101 | 128.498 | 132.001 | 135.504 | 111.919 | 100.0% | 10 | | -> duration | 72.729 | 116.101 | 127.498 | 131.001 | 134.504 | 110.919 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 317.451667 Full duration: 478.33062 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 48.134 | 60.672 | 87.117 | 87.316 | 87.516 | 65.971 | 100.0% | 10 | | total | 48.134 | 60.673 | 87.117 | 87.316 | 87.516 | 65.971 | 100.0% | 10 | | -> duration | 47.134 | 59.673 | 86.117 | 86.316 | 86.516 | 64.971 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 184.143789 Full duration: 305.245712 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "servers": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "servers_per_tenant": 2, "auto_assign_nic": true }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 34.748383 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "image": { "name": "rally_full-img_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "to_flavor": { "name": "rally_full-flavor_alt_a72baac6-0fba-40b3-ac1d-b0d2607e669b" }, "confirm": true, "force_delete": false, "nics": [ { "net-id": "d47680b7-85ba-4c95-b736-165da25bdd95" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b052dea7-24d4-4e21-829b-b636a02b3e5c has 5 error(s) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-4384e8f3-ceeb-4ce5-81cf-1ac912512d81) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-4384e8f3-ceeb-4ce5-81cf-1ac912512d81) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-2642f2dd-f0f3-46e4-a303-92fba5806164) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-2642f2dd-f0f3-46e4-a303-92fba5806164) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-807c0da3-d20c-4391-905b-eea767020ca5) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-807c0da3-d20c-4391-905b-eea767020ca5) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-aeaaf063-b38b-45c6-a806-14e083a9891a) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-aeaaf063-b38b-45c6-a806-14e083a9891a) -------------------------------------------------------------------------------- BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-7392c260-6cc4-49a8-8567-83695f1ce69b) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 687, in _resize server.resize(flavor) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 360, in resize return self.manager.resize(self, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1599, in resize return self._action('resize', server, info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-7392c260-6cc4-49a8-8567-83695f1ce69b) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 61.582 | 77.134 | 93.23 | 96.54 | 99.849 | 77.081 | 100.0% | 5 | | nova.resize | 11.224 | 46.515 | 50.244 | 50.922 | 51.6 | 37.928 | 0.0% | 5 | | total | 72.806 | 125.344 | 131.097 | 131.523 | 131.949 | 115.012 | 0.0% | 5 | | -> duration | 71.806 | 124.344 | 130.097 | 130.523 | 130.949 | 114.012 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 186.961213 Full duration: 293.377495 HINTS: * To plot HTML graphics with this data, run: rally task report b052dea7-24d4-4e21-829b-b636a02b3e5c --out output.html * To generate a JUnit report, run: rally task export b052dea7-24d4-4e21-829b-b636a02b3e5c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b052dea7-24d4-4e21-829b-b636a02b3e5c --json --out output.json At least one workload did not pass SLA criteria. 2021-01-23 20:55:14,099 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b052dea7-24d4-4e21-829b-b636a02b3e5c --out /home/opnfv/functest/results/rally_full/nova.json 2021-01-23 20:55:14,125 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-01-23 20:55:14,156 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 20:55:14,653 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-01-23 20:58:10,610 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 2021-01-23 20:58:11,905 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 -------------------------------------------------------------------------------- Task 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.268 | 4.583 | 4.677 | 4.845 | 5.013 | 4.113 | 100.0% | 10 | | quotas.delete_quotas | 0.237 | 0.344 | 0.852 | 0.965 | 1.078 | 0.491 | 100.0% | 10 | | total | 2.505 | 4.951 | 5.39 | 5.408 | 5.425 | 4.605 | 100.0% | 10 | | -> duration | 2.505 | 4.951 | 5.39 | 5.408 | 5.425 | 4.605 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.747921 Full duration: 36.244683 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.392 | 2.984 | 3.712 | 3.894 | 4.075 | 2.894 | 100.0% | 10 | | total | 1.392 | 2.984 | 3.712 | 3.894 | 4.075 | 2.894 | 100.0% | 10 | | -> duration | 1.392 | 2.984 | 3.712 | 3.894 | 4.075 | 2.894 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.079429 Full duration: 47.816135 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 6.232 | 10.388 | 14.518 | 14.526 | 14.534 | 10.907 | 100.0% | 10 | | total | 6.232 | 10.388 | 14.518 | 14.526 | 14.534 | 10.908 | 100.0% | 10 | | -> duration | 6.232 | 10.388 | 14.518 | 14.526 | 14.534 | 10.908 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.655821 Full duration: 64.809867 HINTS: * To plot HTML graphics with this data, run: rally task report 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 --out output.html * To generate a JUnit report, run: rally task export 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 --json --out output.json 2021-01-23 20:58:14,875 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 862f3e01-3f7d-470c-ac98-7c9b6f8a8b19 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-01-23 20:58:14,881 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-01-23 20:58:14,913 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-23 20:58:15,345 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-01-23 21:08:38,034 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: bfbf354c-a4fc-4280-9ce5-e68517d48862 2021-01-23 21:08:39,313 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid bfbf354c-a4fc-4280-9ce5-e68517d48862 -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.887 | 1.097 | 1.245 | 1.374 | 1.503 | 1.125 | 100.0% | 10 | | swift.upload_object (x2) | 1.017 | 1.127 | 1.186 | 1.209 | 1.232 | 1.126 | 100.0% | 10 | | swift.list_objects | 0.894 | 0.972 | 1.027 | 1.048 | 1.069 | 0.976 | 100.0% | 10 | | total | 3.021 | 3.138 | 3.411 | 3.566 | 3.721 | 3.228 | 100.0% | 10 | | -> duration | 3.021 | 3.138 | 3.411 | 3.566 | 3.721 | 3.228 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.335503 Full duration: 129.978271 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.304 | 1.427 | 1.567 | 1.604 | 1.641 | 1.451 | 100.0% | 10 | | swift.list_objects | 0.846 | 0.91 | 0.93 | 0.935 | 0.941 | 0.901 | 100.0% | 10 | | total | 2.236 | 2.343 | 2.461 | 2.506 | 2.55 | 2.352 | 100.0% | 10 | | -> duration | 2.236 | 2.343 | 2.461 | 2.506 | 2.55 | 2.352 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.581234 Full duration: 93.162389 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.978 | 1.103 | 1.26 | 1.285 | 1.309 | 1.129 | 100.0% | 10 | | swift.upload_object (x5) | 2.65 | 2.797 | 2.955 | 2.968 | 2.98 | 2.809 | 100.0% | 10 | | swift.download_object (x5) | 2.365 | 2.516 | 2.613 | 2.618 | 2.623 | 2.509 | 100.0% | 10 | | total | 6.144 | 6.46 | 6.675 | 6.677 | 6.679 | 6.449 | 100.0% | 10 | | -> duration | 6.144 | 6.46 | 6.675 | 6.677 | 6.679 | 6.449 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.548357 Full duration: 138.160881 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.98 | 1.08 | 1.215 | 1.225 | 1.235 | 1.088 | 100.0% | 10 | | swift.upload_object (x5) | 2.697 | 2.794 | 2.854 | 2.884 | 2.914 | 2.787 | 100.0% | 10 | | swift.delete_object (x5) | 2.474 | 2.611 | 2.71 | 2.737 | 2.764 | 2.614 | 100.0% | 10 | | swift.delete_container | 0.536 | 0.592 | 0.651 | 0.705 | 0.76 | 0.605 | 100.0% | 10 | | total | 6.822 | 7.076 | 7.256 | 7.278 | 7.3 | 7.097 | 100.0% | 10 | | -> duration | 6.822 | 7.076 | 7.256 | 7.278 | 7.3 | 7.097 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.028859 Full duration: 128.878618 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bfbf354c-a4fc-4280-9ce5-e68517d48862 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.335 | 1.423 | 1.539 | 1.557 | 1.575 | 1.439 | 100.0% | 10 | | swift.list_objects | 0.879 | 0.946 | 0.979 | 1.0 | 1.021 | 0.94 | 100.0% | 10 | | swift.download_object (x5) | 2.242 | 2.357 | 2.412 | 2.425 | 2.439 | 2.348 | 100.0% | 10 | | total | 4.552 | 4.743 | 4.835 | 4.845 | 4.855 | 4.726 | 100.0% | 10 | | -> duration | 4.552 | 4.743 | 4.835 | 4.845 | 4.855 | 4.726 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.322397 Full duration: 101.994913 HINTS: * To plot HTML graphics with this data, run: rally task report bfbf354c-a4fc-4280-9ce5-e68517d48862 --out output.html * To generate a JUnit report, run: rally task export bfbf354c-a4fc-4280-9ce5-e68517d48862 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report bfbf354c-a4fc-4280-9ce5-e68517d48862 --json --out output.json 2021-01-23 21:08:42,335 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid bfbf354c-a4fc-4280-9ce5-e68517d48862 --out /home/opnfv/functest/results/rally_full/swift.json 2021-01-23 21:08:42,351 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-01-23 21:08:42,355 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:03:43 | 60 | 100.00% | | glance | 00:10:27 | 40 | 90.00% | | cinder | 00:59:35 | 240 | 100.00% | | heat | 01:19:48 | 100 | 100.00% | | keystone | 00:14:34 | 110 | 100.00% | | neutron | 00:23:04 | 140 | 100.00% | | nova | 01:06:26 | 95 | 94.74% | | quotas | 00:02:28 | 30 | 100.00% | | swift | 00:09:52 | 50 | 100.00% | | | | | | | TOTAL: | 04:30:02 | 865 | 98.96% | +----------------+------------+----------------+-----------+ 2021-01-23 21:08:42,355 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.96% in 6/9 modules 2021-01-23 21:08:46,167 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-01-23 21:08:49,701 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-01-23 21:08:49,702 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 277:59 | FAIL | +--------------------+------------------+------------------+----------------+