2021-02-10 16:25:16,550 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | IPLV2G95SU3M | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/IPLV2G95SU3M/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-196 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/IPLV2G95SU3M/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-196 | +-------------------------+------------------------------------------------------------+ 2021-02-10 16:25:16,568 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-02-10 16:25:19,916 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-02-10 16:25:26,023 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-02-10 16:25:32,349 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 6c8429f6-d19e-412f-9720-73110f57aefd | 2021-02-10T16:25:32.081274 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 6c8429f6-d19e-412f-9720-73110f57aefd ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-02-10 16:25:37,247 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-02-10 16:25:38,944 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 16:25:39,105 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-02-10 16:28:57,052 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 05c349a6-a50c-4e59-9954-46c26e4a3bf2 2021-02-10 16:28:58,330 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 05c349a6-a50c-4e59-9954-46c26e4a3bf2 -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.925 | 1.243 | 1.907 | 2.024 | 2.141 | 1.366 | 100.0% | 10 | | total | 0.925 | 1.243 | 1.907 | 2.024 | 2.141 | 1.366 | 100.0% | 10 | | -> duration | 0.925 | 1.243 | 1.907 | 2.024 | 2.141 | 1.366 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.746258 Full duration: 28.177175 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.153 | 0.29 | 0.442 | 0.633 | 0.824 | 0.325 | 100.0% | 10 | | total | 0.696 | 1.086 | 1.485 | 1.612 | 1.739 | 1.083 | 100.0% | 10 | | -> duration | 0.696 | 1.086 | 1.485 | 1.612 | 1.739 | 1.083 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.910975 Full duration: 31.305998 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.206 | 0.29 | 0.553 | 0.565 | 0.578 | 0.327 | 100.0% | 10 | | total | 0.752 | 0.962 | 1.398 | 1.447 | 1.496 | 1.034 | 100.0% | 10 | | -> duration | 0.752 | 0.962 | 1.398 | 1.447 | 1.496 | 1.034 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.366711 Full duration: 28.425709 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.162 | 0.379 | 0.712 | 0.735 | 0.758 | 0.381 | 100.0% | 10 | | total | 0.61 | 1.045 | 1.232 | 1.271 | 1.31 | 1.019 | 100.0% | 10 | | -> duration | 0.61 | 1.045 | 1.232 | 1.271 | 1.31 | 1.019 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.871357 Full duration: 27.966654 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.386 | 0.516 | 0.843 | 1.002 | 1.16 | 0.609 | 100.0% | 10 | | total | 0.861 | 1.309 | 1.527 | 1.649 | 1.77 | 1.268 | 100.0% | 10 | | -> duration | 0.861 | 1.309 | 1.527 | 1.649 | 1.77 | 1.268 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.604867 Full duration: 30.62379 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 05c349a6-a50c-4e59-9954-46c26e4a3bf2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.171 | 0.193 | 0.331 | 0.515 | 0.7 | 0.256 | 100.0% | 10 | | total | 0.63 | 0.899 | 1.429 | 1.44 | 1.451 | 0.955 | 100.0% | 10 | | -> duration | 0.63 | 0.899 | 1.429 | 1.44 | 1.451 | 0.955 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.640582 Full duration: 28.136739 HINTS: * To plot HTML graphics with this data, run: rally task report 05c349a6-a50c-4e59-9954-46c26e4a3bf2 --out output.html * To generate a JUnit report, run: rally task export 05c349a6-a50c-4e59-9954-46c26e4a3bf2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 05c349a6-a50c-4e59-9954-46c26e4a3bf2 --json --out output.json 2021-02-10 16:29:01,475 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 05c349a6-a50c-4e59-9954-46c26e4a3bf2 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-02-10 16:29:01,485 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-02-10 16:29:01,516 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 16:29:01,905 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-02-10 16:40:13,848 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 2021-02-10 16:40:15,114 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 -------------------------------------------------------------------------------- Task d424faa0-7c07-4cf1-a9c9-37a96f2c68f1: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.718 | 7.057 | 8.03 | 8.185 | 8.339 | 6.962 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.092 | 0.102 | 0.117 | 0.143 | 0.169 | 0.109 | 100.0% | 10 | | -> glance_v2.upload_data | 2.96 | 3.716 | 5.034 | 5.043 | 5.053 | 4.022 | 100.0% | 10 | | glance_v2.delete_image | 1.779 | 2.678 | 4.645 | 4.986 | 5.328 | 3.071 | 100.0% | 10 | | total | 8.694 | 10.165 | 10.877 | 10.971 | 11.065 | 10.033 | 100.0% | 10 | | -> duration | 8.694 | 10.165 | 10.877 | 10.971 | 11.065 | 10.033 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.552666 Full duration: 64.633422 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.02 | 7.707 | 8.618 | 8.878 | 9.138 | 7.088 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.096 | 0.106 | 0.117 | 0.118 | 0.12 | 0.106 | 100.0% | 10 | | -> glance_v2.upload_data | 2.473 | 4.495 | 5.432 | 5.45 | 5.467 | 4.112 | 100.0% | 10 | | glance_v2.list_images | 0.055 | 0.063 | 0.074 | 0.078 | 0.082 | 0.064 | 100.0% | 10 | | total | 5.089 | 7.774 | 8.698 | 8.95 | 9.202 | 7.153 | 100.0% | 10 | | -> duration | 5.089 | 7.774 | 8.698 | 8.95 | 9.202 | 7.153 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.194377 Full duration: 68.834235 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.146 | 0.206 | 0.379 | 0.432 | 0.485 | 0.24 | 100.0% | 10 | | total | 0.146 | 0.206 | 0.379 | 0.432 | 0.486 | 0.24 | 100.0% | 10 | | -> duration | 0.146 | 0.206 | 0.379 | 0.432 | 0.486 | 0.24 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.383279 Full duration: 28.577023 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 7.266 | 9.679 | 12.322 | 12.975 | 13.627 | 10.038 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.096 | 0.103 | 0.108 | 0.109 | 0.11 | 0.103 | 100.0% | 10 | | -> glance_v2.upload_data | 4.109 | 5.936 | 7.813 | 7.92 | 8.027 | 5.932 | 100.0% | 10 | | nova.boot_servers | 91.284 | 115.493 | 149.465 | 149.483 | 149.501 | 119.329 | 60.0% | 10 | | total | 101.007 | 124.114 | 157.363 | 159.349 | 161.336 | 129.367 | 60.0% | 10 | | -> duration | 100.007 | 123.114 | 156.363 | 158.349 | 160.336 | 128.367 | 60.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 60.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 347.707041 Full duration: 477.098854 HINTS: * To plot HTML graphics with this data, run: rally task report d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 --out output.html * To generate a JUnit report, run: rally task export d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-10 16:40:18,249 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d424faa0-7c07-4cf1-a9c9-37a96f2c68f1 --out /home/opnfv/functest/results/rally_full/glance.json 2021-02-10 16:40:18,305 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-02-10 16:40:18,348 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 16:40:19,024 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-02-10 17:30:37,796 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 78ea5b38-18ce-4800-ba8e-adbf4cf2261e 2021-02-10 17:30:39,130 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 78ea5b38-18ce-4800-ba8e-adbf4cf2261e -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "size": 1, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 34.579 | 49.87 | 59.49 | 60.163 | 60.836 | 49.725 | 100.0% | 10 | | cinder_v3.create_volume | 5.839 | 10.689 | 13.827 | 15.207 | 16.587 | 10.514 | 100.0% | 10 | | nova.attach_volume | 8.457 | 16.783 | 29.605 | 30.382 | 31.159 | 19.138 | 100.0% | 10 | | nova.detach_volume | 3.975 | 6.604 | 12.062 | 12.197 | 12.332 | 7.342 | 100.0% | 10 | | cinder_v3.delete_volume | 2.686 | 8.931 | 12.305 | 13.324 | 14.343 | 8.265 | 100.0% | 10 | | nova.delete_server | 5.885 | 17.684 | 24.95 | 26.58 | 28.209 | 17.87 | 100.0% | 10 | | total | 66.116 | 120.31 | 129.83 | 132.387 | 134.944 | 112.855 | 100.0% | 10 | | -> duration | 65.116 | 119.31 | 128.83 | 131.387 | 133.944 | 111.855 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 314.392108 Full duration: 362.174505 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.393 | 8.16 | 14.881 | 14.989 | 15.096 | 9.626 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.035 | 0.04 | 0.046 | 0.06 | 0.074 | 0.043 | 100.0% | 10 | | total | 4.468 | 8.2 | 14.922 | 15.03 | 15.137 | 9.669 | 100.0% | 10 | | -> duration | 4.468 | 8.2 | 14.922 | 15.03 | 15.137 | 9.669 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.681672 Full duration: 95.822968 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 19.415 | 24.214 | 27.883 | 28.612 | 29.34 | 23.748 | 100.0% | 10 | | cinder_v3.list_volumes | 0.069 | 0.076 | 0.079 | 0.08 | 0.08 | 0.076 | 100.0% | 10 | | total | 19.494 | 24.291 | 27.961 | 28.688 | 29.416 | 23.824 | 100.0% | 10 | | -> duration | 19.494 | 24.291 | 27.961 | 28.688 | 29.416 | 23.824 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 68.219922 Full duration: 121.431607 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.278 | 9.041 | 13.907 | 16.219 | 18.532 | 10.369 | 100.0% | 10 | | cinder_v3.list_volumes | 0.064 | 0.073 | 0.218 | 0.229 | 0.239 | 0.102 | 100.0% | 10 | | total | 6.352 | 9.185 | 13.971 | 16.284 | 18.597 | 10.471 | 100.0% | 10 | | -> duration | 6.352 | 9.185 | 13.971 | 16.284 | 18.597 | 10.471 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.457659 Full duration: 83.151609 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.673 | 8.3 | 12.315 | 12.698 | 13.082 | 8.85 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 42.57 | 67.49 | 80.148 | 80.177 | 80.206 | 66.419 | 100.0% | 10 | | cinder_v3.delete_volume | 3.708 | 4.881 | 7.188 | 8.368 | 9.547 | 5.454 | 100.0% | 10 | | glance_v2.delete_image | 6.35 | 7.897 | 10.801 | 10.942 | 11.082 | 8.523 | 100.0% | 10 | | total | 61.999 | 89.616 | 107.637 | 107.854 | 108.07 | 89.246 | 100.0% | 10 | | -> duration | 61.999 | 89.616 | 107.637 | 107.854 | 108.07 | 89.246 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 256.42642 Full duration: 293.654222 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 43.319 | 52.64 | 59.454 | 63.177 | 66.9 | 52.741 | 100.0% | 10 | | cinder_v3.create_volume | 5.914 | 15.144 | 25.418 | 26.959 | 28.499 | 15.907 | 100.0% | 10 | | cinder_v3.create_snapshot | 5.479 | 9.116 | 12.306 | 14.361 | 16.416 | 9.314 | 100.0% | 10 | | nova.attach_volume | 19.264 | 21.191 | 23.251 | 25.861 | 28.471 | 21.641 | 100.0% | 10 | | nova.detach_volume | 3.904 | 7.101 | 8.631 | 8.836 | 9.04 | 6.982 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.466 | 5.81 | 8.924 | 9.229 | 9.534 | 5.945 | 100.0% | 10 | | cinder_v3.delete_volume | 2.706 | 8.538 | 11.469 | 11.936 | 12.402 | 7.817 | 100.0% | 10 | | nova.delete_server | 7.947 | 14.815 | 23.243 | 26.176 | 29.109 | 16.164 | 100.0% | 10 | | total | 107.164 | 136.014 | 158.833 | 164.733 | 170.634 | 136.511 | 100.0% | 10 | | -> duration | 106.164 | 135.014 | 157.833 | 163.733 | 169.634 | 135.511 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 381.958014 Full duration: 426.601125 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.246 | 14.433 | 25.328 | 25.535 | 25.741 | 16.73 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.555 | 11.775 | 18.487 | 18.901 | 19.316 | 12.089 | 100.0% | 10 | | nova.boot_server | 32.308 | 46.823 | 59.23 | 61.771 | 64.313 | 48.38 | 100.0% | 10 | | nova.attach_volume | 11.964 | 19.062 | 25.429 | 27.783 | 30.136 | 19.204 | 100.0% | 10 | | nova.detach_volume | 4.087 | 6.726 | 7.523 | 7.872 | 8.222 | 6.113 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.558 | 5.25 | 9.186 | 9.839 | 10.492 | 5.6 | 100.0% | 10 | | cinder_v3.delete_volume | 3.247 | 7.616 | 9.324 | 10.458 | 11.592 | 7.163 | 100.0% | 10 | | nova.delete_server | 14.592 | 21.885 | 26.036 | 27.022 | 28.008 | 20.797 | 100.0% | 10 | | total | 90.01 | 141.118 | 154.836 | 162.085 | 169.335 | 136.076 | 100.0% | 10 | | -> duration | 89.01 | 140.118 | 153.836 | 161.085 | 168.335 | 135.076 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 381.050594 Full duration: 427.215607 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.902 | 6.981 | 12.274 | 12.63 | 12.987 | 8.307 | 100.0% | 10 | | total | 4.902 | 6.981 | 12.274 | 12.631 | 12.987 | 8.307 | 100.0% | 10 | | -> duration | 4.902 | 6.981 | 12.274 | 12.631 | 12.987 | 8.307 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.000736 Full duration: 70.237551 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.708 | 11.371 | 14.023 | 14.412 | 14.802 | 11.412 | 100.0% | 10 | | total | 7.709 | 11.371 | 14.023 | 14.413 | 14.802 | 11.412 | 100.0% | 10 | | -> duration | 7.709 | 11.371 | 14.023 | 14.413 | 14.802 | 11.412 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.292468 Full duration: 73.713342 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.595 | 0.792 | 1.158 | 1.179 | 1.2 | 0.828 | 100.0% | 10 | | total | 0.595 | 0.792 | 1.158 | 1.179 | 1.2 | 0.828 | 100.0% | 10 | | -> duration | 0.595 | 0.792 | 1.158 | 1.179 | 1.2 | 0.828 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.473623 Full duration: 100.776653 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 5.1 | 6.135 | 8.506 | 8.924 | 9.341 | 6.751 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.473 | 4.573 | 5.459 | 6.155 | 6.85 | 4.392 | 100.0% | 10 | | total | 8.156 | 11.193 | 13.423 | 13.571 | 13.718 | 11.144 | 100.0% | 10 | | -> duration | 8.156 | 11.193 | 13.423 | 13.571 | 13.718 | 11.144 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.861731 Full duration: 94.069001 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 11.64 | 13.314 | 17.132 | 17.193 | 17.255 | 14.06 | 100.0% | 10 | | cinder_v3.delete_volume | 4.422 | 9.097 | 14.536 | 15.016 | 15.495 | 9.101 | 100.0% | 10 | | total | 16.062 | 21.751 | 31.778 | 32.196 | 32.614 | 23.161 | 100.0% | 10 | | -> duration | 16.062 | 21.751 | 31.778 | 32.196 | 32.614 | 23.161 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.595753 Full duration: 102.350939 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.104 | 25.328 | 33.272 | 33.945 | 34.619 | 25.722 | 100.0% | 10 | | cinder_v3.delete_volume | 3.313 | 6.185 | 7.685 | 8.879 | 10.072 | 6.216 | 100.0% | 10 | | total | 20.418 | 31.887 | 39.386 | 40.712 | 42.039 | 31.939 | 100.0% | 10 | | -> duration | 20.418 | 31.887 | 39.386 | 40.712 | 42.039 | 31.939 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 89.411302 Full duration: 123.042565 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.511 | 10.784 | 11.633 | 12.093 | 12.553 | 10.417 | 100.0% | 10 | | cinder_v3.delete_volume | 3.329 | 5.799 | 8.362 | 8.521 | 8.68 | 5.969 | 100.0% | 10 | | total | 11.04 | 16.32 | 19.936 | 20.103 | 20.27 | 16.386 | 100.0% | 10 | | -> duration | 11.04 | 16.32 | 19.936 | 20.103 | 20.27 | 16.386 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.565281 Full duration: 80.486529 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.612 | 9.262 | 13.261 | 13.3 | 13.338 | 9.749 | 100.0% | 10 | | cinder_v3.extend_volume | 2.75 | 6.433 | 7.519 | 7.586 | 7.653 | 5.913 | 100.0% | 10 | | cinder_v3.delete_volume | 2.517 | 6.13 | 7.962 | 8.653 | 9.345 | 5.953 | 100.0% | 10 | | total | 13.805 | 22.375 | 26.687 | 27.055 | 27.423 | 21.616 | 100.0% | 10 | | -> duration | 13.805 | 22.375 | 26.687 | 27.055 | 27.423 | 21.616 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 60.915723 Full duration: 94.722989 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.928 | 10.446 | 14.641 | 15.297 | 15.952 | 10.688 | 100.0% | 10 | | cinder_v3.delete_volume | 4.449 | 7.159 | 10.815 | 10.969 | 11.124 | 7.667 | 100.0% | 10 | | total | 12.748 | 19.061 | 22.219 | 22.52 | 22.82 | 18.355 | 100.0% | 10 | | -> duration | 12.748 | 19.061 | 22.219 | 22.52 | 22.82 | 18.355 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.75196 Full duration: 115.602868 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.712 | 1.384 | 1.608 | 1.622 | 1.637 | 1.279 | 100.0% | 10 | | cinder_v3.get_qos | 0.028 | 0.034 | 0.036 | 0.036 | 0.037 | 0.034 | 100.0% | 10 | | total | 0.744 | 1.418 | 1.644 | 1.658 | 1.673 | 1.313 | 100.0% | 10 | | -> duration | 0.744 | 1.418 | 1.644 | 1.658 | 1.673 | 1.313 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.063259 Full duration: 36.008927 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.69 | 0.827 | 1.118 | 1.137 | 1.156 | 0.903 | 100.0% | 10 | | cinder_v3.list_qos | 0.036 | 0.043 | 0.058 | 0.059 | 0.059 | 0.045 | 100.0% | 10 | | total | 0.733 | 0.875 | 1.159 | 1.187 | 1.215 | 0.949 | 100.0% | 10 | | -> duration | 0.733 | 0.875 | 1.159 | 1.187 | 1.215 | 0.949 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.753525 Full duration: 32.858644 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.644 | 1.241 | 1.472 | 1.832 | 2.192 | 1.173 | 100.0% | 10 | | cinder_v3.set_qos | 0.199 | 0.495 | 1.069 | 1.096 | 1.122 | 0.638 | 100.0% | 10 | | total | 1.204 | 1.739 | 2.437 | 2.555 | 2.674 | 1.811 | 100.0% | 10 | | -> duration | 1.204 | 1.739 | 2.437 | 2.555 | 2.674 | 1.811 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.234823 Full duration: 37.393959 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.799 | 1.09 | 1.364 | 1.365 | 1.366 | 1.062 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.031 | 0.038 | 0.045 | 0.046 | 0.048 | 0.039 | 100.0% | 10 | | total | 0.836 | 1.13 | 1.407 | 1.409 | 1.411 | 1.101 | 100.0% | 10 | | -> duration | 0.836 | 1.13 | 1.407 | 1.409 | 1.411 | 1.101 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.887602 Full duration: 37.949461 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.706 | 0.951 | 1.065 | 1.186 | 1.307 | 0.951 | 100.0% | 10 | | cinder_v3.list_types | 0.039 | 0.048 | 0.055 | 0.055 | 0.055 | 0.048 | 100.0% | 10 | | total | 0.756 | 0.998 | 1.106 | 1.234 | 1.363 | 0.999 | 100.0% | 10 | | -> duration | 0.756 | 0.998 | 1.106 | 1.234 | 1.363 | 0.999 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.841559 Full duration: 35.366458 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.743 | 1.101 | 1.992 | 2.367 | 2.742 | 1.25 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.168 | 0.605 | 0.908 | 1.406 | 1.904 | 0.67 | 100.0% | 10 | | total | 0.911 | 1.683 | 2.988 | 2.999 | 3.01 | 1.921 | 100.0% | 10 | | -> duration | 0.911 | 1.683 | 2.988 | 2.999 | 3.01 | 1.921 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.225747 Full duration: 38.763662 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.835 | 1.434 | 1.941 | 2.072 | 2.204 | 1.44 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.366 | 0.89 | 1.42 | 1.424 | 1.428 | 0.961 | 100.0% | 10 | | total | 1.978 | 2.3 | 2.742 | 2.893 | 3.044 | 2.401 | 100.0% | 10 | | -> duration | 1.978 | 2.3 | 2.742 | 2.893 | 3.044 | 2.401 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.92395 Full duration: 35.421 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 78ea5b38-18ce-4800-ba8e-adbf4cf2261e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.661 | 1.01 | 1.174 | 1.35 | 1.527 | 1.004 | 100.0% | 10 | | cinder_v2.add_type_access | 0.075 | 0.472 | 0.825 | 0.836 | 0.848 | 0.481 | 100.0% | 10 | | cinder_v2.list_type_access | 0.035 | 0.04 | 0.045 | 0.045 | 0.046 | 0.04 | 100.0% | 10 | | total | 0.87 | 1.69 | 1.885 | 1.935 | 1.985 | 1.525 | 100.0% | 10 | | -> duration | 0.87 | 1.69 | 1.885 | 1.935 | 1.985 | 1.525 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.310701 Full duration: 34.624515 HINTS: * To plot HTML graphics with this data, run: rally task report 78ea5b38-18ce-4800-ba8e-adbf4cf2261e --out output.html * To generate a JUnit report, run: rally task export 78ea5b38-18ce-4800-ba8e-adbf4cf2261e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 78ea5b38-18ce-4800-ba8e-adbf4cf2261e --json --out output.json 2021-02-10 17:30:42,307 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 78ea5b38-18ce-4800-ba8e-adbf4cf2261e --out /home/opnfv/functest/results/rally_full/cinder.json 2021-02-10 17:30:42,343 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-02-10 17:30:42,378 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 17:30:42,795 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-02-10 17:54:43,756 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 13899e8e-1366-4441-9ce7-83a5858236ec 2021-02-10 17:54:44,998 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 13899e8e-1366-4441-9ce7-83a5858236ec -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec: aborted -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 9.63 | 13.684 | 15.214 | 15.41 | 15.605 | 12.972 | 100.0% | 10 | | heat.list_stacks | 0.06 | 0.066 | 0.077 | 0.08 | 0.082 | 0.068 | 100.0% | 10 | | total | 9.706 | 13.756 | 15.276 | 15.472 | 15.668 | 13.04 | 100.0% | 10 | | -> duration | 7.706 | 11.756 | 13.276 | 13.472 | 13.668 | 11.04 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.295445 Full duration: 130.14008 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 34.053 | 39.655 | 41.734 | 41.802 | 41.87 | 39.057 | 100.0% | 10 | | heat.update_stack | 20.409 | 30.746 | 31.599 | 32.167 | 32.736 | 28.49 | 100.0% | 10 | | heat.delete_stack | 17.05 | 32.206 | 35.645 | 35.849 | 36.052 | 29.605 | 100.0% | 10 | | total | 80.069 | 101.111 | 106.399 | 107.04 | 107.681 | 97.151 | 100.0% | 10 | | -> duration | 76.069 | 97.111 | 102.399 | 103.04 | 103.681 | 93.151 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 278.320783 Full duration: 327.486868 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.876 | 34.526 | 45.155 | 45.553 | 45.95 | 37.058 | 100.0% | 10 | | heat.update_stack | 8.788 | 19.73 | 21.45 | 22.627 | 23.804 | 18.207 | 100.0% | 10 | | heat.delete_stack | 4.168 | 19.719 | 22.616 | 23.024 | 23.433 | 17.728 | 100.0% | 10 | | total | 46.554 | 75.341 | 86.5 | 87.285 | 88.07 | 72.993 | 100.0% | 10 | | -> duration | 42.554 | 71.341 | 82.5 | 83.285 | 84.07 | 68.993 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 198.539282 Full duration: 239.290586 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 42.796 | 53.553 | 65.782 | 66.1 | 66.418 | 55.895 | 100.0% | 10 | | heat.update_stack | 22.496 | 51.906 | 60.519 | 61.395 | 62.271 | 49.867 | 100.0% | 10 | | heat.delete_stack | 30.891 | 50.39 | 52.69 | 52.988 | 53.285 | 47.368 | 100.0% | 10 | | total | 98.699 | 164.956 | 167.935 | 169.268 | 170.6 | 153.13 | 100.0% | 10 | | -> duration | 94.699 | 160.956 | 163.935 | 165.268 | 166.6 | 149.13 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 433.042901 Full duration: 483.304174 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 13899e8e-1366-4441-9ce7-83a5858236ec has 1 error(s) -------------------------------------------------------------------------------- AuthenticationFailed: Failed to authenticate to http://identity-nc.intel-pod17.opnfv.org:80/v3 for user 'c_rally_b2ad33af_h0XQD2fd' in project 'c_rally_b2ad33af_bqDNYeCz': [BadGateway] Bad Gateway (HTTP 502) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 273, in auth_ref self.cache["keystone_auth_ref"] = plugin.get_access(sess) File "/usr/lib/python3.6/site-packages/keystoneauth1/identity/base.py", line 134, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/lib/python3.6/site-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/lib/python3.6/site-packages/keystoneauth1/identity/v3/base.py", line 178, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 1045, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request raise exceptions.from_response(resp, method, url) keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 162, in run files, environment) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] File "/usr/lib/python3.6/site-packages/rally_openstack/scenario.py", line 96, in clients return client(version) if version is not None else client() File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 244, in __call__ self.cache[key] = self.create_client(*args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 506, in create_client endpoint_override=self._get_endpoint(service_type), File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint api_url = self.keystone.service_catalog.url_for(**kw) File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 266, in service_catalog return self.auth_ref.service_catalog File "/usr/lib/python3.6/site-packages/rally_openstack/osclients.py", line 288, in auth_ref raise e rally_openstack.osclients.AuthenticationFailed: Failed to authenticate to http://identity-nc.intel-pod17.opnfv.org:80/v3 for user 'c_rally_b2ad33af_h0XQD2fd' in project 'c_rally_b2ad33af_bqDNYeCz': [BadGateway] Bad Gateway (HTTP 502) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 0.068 | 53.456 | 54.269 | 54.375 | 54.481 | 42.737 | 80.0% | 5 | | heat.update_stack | 40.752 | 41.119 | 41.625 | 41.686 | 41.747 | 41.184 | 100.0% | 4 | | heat.delete_stack | 45.413 | 46.437 | 49.702 | 50.348 | 50.995 | 47.321 | 100.0% | 4 | | total | 0.068 | 140.544 | 144.645 | 145.731 | 146.816 | 113.541 | 80.0% | 5 | | -> duration | 0.068 | 136.544 | 140.645 | 141.731 | 142.816 | 110.341 | 80.0% | 5 | | -> idle_duration | 0.0 | 4.0 | 4.0 | 4.0 | 4.0 | 3.2 | 80.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 142.901809 Full duration: 190.762058 HINTS: * To plot HTML graphics with this data, run: rally task report 13899e8e-1366-4441-9ce7-83a5858236ec --out output.html * To generate a JUnit report, run: rally task export 13899e8e-1366-4441-9ce7-83a5858236ec --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 13899e8e-1366-4441-9ce7-83a5858236ec --json --out output.json At least one workload did not pass SLA criteria. 2021-02-10 17:54:48,014 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 13899e8e-1366-4441-9ce7-83a5858236ec --out /home/opnfv/functest/results/rally_full/heat.json 2021-02-10 17:54:48,024 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed. 2021-02-10 17:54:48,054 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 17:54:48,478 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-02-10 18:07:18,617 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: c12f435f-9717-480d-b3f9-94e26cebedae 2021-02-10 18:07:19,917 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c12f435f-9717-480d-b3f9-94e26cebedae -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.163 | 0.701 | 1.409 | 1.986 | 2.562 | 0.876 | 100.0% | 10 | | keystone_v3.add_role | 0.318 | 0.547 | 0.924 | 1.226 | 1.528 | 0.618 | 100.0% | 10 | | keystone_v3.revoke_role | 0.255 | 0.591 | 0.807 | 0.846 | 0.885 | 0.566 | 100.0% | 10 | | total | 0.83 | 1.841 | 2.944 | 3.297 | 3.649 | 2.06 | 100.0% | 10 | | -> duration | 0.83 | 1.841 | 2.944 | 3.297 | 3.649 | 2.06 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.192998 Full duration: 52.747066 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.14 | 0.754 | 1.102 | 1.215 | 1.327 | 0.705 | 100.0% | 10 | | keystone_v3.add_role | 0.083 | 0.43 | 0.813 | 0.821 | 0.829 | 0.467 | 100.0% | 10 | | keystone_v3.list_roles | 0.107 | 0.128 | 0.143 | 0.175 | 0.208 | 0.133 | 100.0% | 10 | | total | 0.595 | 1.3 | 1.88 | 1.893 | 1.906 | 1.305 | 100.0% | 10 | | -> duration | 0.595 | 1.3 | 1.88 | 1.893 | 1.906 | 1.305 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.703755 Full duration: 55.328165 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.431 | 0.983 | 1.649 | 1.673 | 1.698 | 1.019 | 100.0% | 10 | | keystone_v3.list_projects | 0.117 | 0.144 | 0.212 | 0.216 | 0.221 | 0.152 | 100.0% | 10 | | total | 0.581 | 1.105 | 1.869 | 1.889 | 1.908 | 1.171 | 100.0% | 10 | | -> duration | 0.581 | 1.105 | 1.869 | 1.889 | 1.908 | 1.171 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.689003 Full duration: 50.794024 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.282 | 1.504 | 2.214 | 2.223 | 2.232 | 1.413 | 100.0% | 10 | | keystone_v3.delete_role | 0.163 | 0.402 | 1.215 | 1.47 | 1.726 | 0.696 | 100.0% | 10 | | total | 0.645 | 2.081 | 3.135 | 3.212 | 3.29 | 2.109 | 100.0% | 10 | | -> duration | 0.645 | 2.081 | 3.135 | 3.212 | 3.29 | 2.109 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.240372 Full duration: 42.331728 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.154 | 0.658 | 0.993 | 1.104 | 1.214 | 0.663 | 100.0% | 10 | | keystone_v3.delete_service | 0.095 | 0.547 | 1.511 | 1.584 | 1.656 | 0.702 | 100.0% | 10 | | total | 0.697 | 1.146 | 2.252 | 2.302 | 2.352 | 1.365 | 100.0% | 10 | | -> duration | 0.697 | 1.146 | 2.252 | 2.302 | 2.352 | 1.365 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.280231 Full duration: 50.519094 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.248 | 0.928 | 1.145 | 1.275 | 1.405 | 0.875 | 100.0% | 10 | | keystone_v3.create_user | 1.163 | 1.431 | 1.754 | 1.982 | 2.21 | 1.494 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.053 | 0.07 | 0.29 | 0.3 | 0.309 | 0.133 | 100.0% | 10 | | -> keystone_v3.add_role | 0.294 | 0.491 | 0.632 | 0.694 | 0.756 | 0.489 | 100.0% | 10 | | keystone_v3.create_role | 0.09 | 0.407 | 0.867 | 0.994 | 1.12 | 0.469 | 100.0% | 10 | | keystone_v3.get_project | 0.036 | 0.042 | 0.095 | 0.274 | 0.453 | 0.083 | 100.0% | 10 | | keystone_v3.get_user | 0.034 | 0.039 | 0.215 | 0.481 | 0.747 | 0.127 | 100.0% | 10 | | keystone_v3.get_role | 0.034 | 0.038 | 0.042 | 0.046 | 0.049 | 0.039 | 100.0% | 10 | | keystone_v3.list_services | 0.04 | 0.047 | 0.28 | 0.318 | 0.356 | 0.108 | 100.0% | 10 | | keystone_v3.get_services | 0.034 | 0.204 | 0.712 | 0.806 | 0.901 | 0.312 | 100.0% | 10 | | total | 3.024 | 3.497 | 4.185 | 4.441 | 4.697 | 3.645 | 100.0% | 10 | | -> duration | 3.024 | 3.497 | 4.185 | 4.441 | 4.697 | 3.645 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.197589 Full duration: 76.50773 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.492 | 1.335 | 3.761 | 4.045 | 4.33 | 1.778 | 100.0% | 10 | | keystone_v3.update_project | 0.274 | 1.502 | 2.077 | 2.204 | 2.331 | 1.482 | 100.0% | 10 | | keystone_v3.delete_project | 0.696 | 1.268 | 1.759 | 2.284 | 2.808 | 1.303 | 100.0% | 10 | | total | 1.469 | 4.132 | 6.172 | 6.578 | 6.985 | 4.563 | 100.0% | 10 | | -> duration | 1.469 | 4.132 | 6.172 | 6.578 | 6.985 | 4.563 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.482231 Full duration: 49.755611 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.318 | 0.733 | 1.345 | 1.37 | 1.395 | 0.769 | 100.0% | 10 | | total | 0.386 | 0.868 | 1.424 | 1.449 | 1.474 | 0.867 | 100.0% | 10 | | -> duration | 0.386 | 0.868 | 1.424 | 1.449 | 1.474 | 0.867 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.187801 Full duration: 35.737341 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.375 | 0.621 | 1.201 | 1.493 | 1.786 | 0.79 | 100.0% | 10 | | total | 0.375 | 0.621 | 1.201 | 1.493 | 1.786 | 0.791 | 100.0% | 10 | | -> duration | 0.375 | 0.621 | 1.201 | 1.493 | 1.786 | 0.791 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.644193 Full duration: 40.038244 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.262 | 0.88 | 2.077 | 2.086 | 2.094 | 0.945 | 100.0% | 10 | | keystone_v3.list_users | 0.073 | 0.083 | 0.128 | 0.285 | 0.442 | 0.117 | 100.0% | 10 | | total | 0.614 | 1.099 | 2.237 | 2.245 | 2.253 | 1.245 | 100.0% | 10 | | -> duration | 0.614 | 1.099 | 2.237 | 2.245 | 2.253 | 1.245 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.437564 Full duration: 34.537729 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c12f435f-9717-480d-b3f9-94e26cebedae has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.353 | 1.047 | 1.66 | 1.909 | 2.158 | 1.122 | 100.0% | 10 | | keystone_v3.create_users | 13.007 | 20.542 | 24.32 | 24.366 | 24.412 | 20.279 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 13.006 | 20.542 | 24.32 | 24.366 | 24.412 | 20.278 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.522 | 0.676 | 2.429 | 3.859 | 5.289 | 1.374 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.345 | 8.035 | 9.216 | 9.634 | 10.052 | 7.365 | 100.0% | 10 | | total | 13.862 | 23.619 | 27.558 | 27.608 | 27.658 | 23.027 | 100.0% | 10 | | -> duration | 13.862 | 23.619 | 27.558 | 27.608 | 27.658 | 23.027 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.08171 Full duration: 230.665376 HINTS: * To plot HTML graphics with this data, run: rally task report c12f435f-9717-480d-b3f9-94e26cebedae --out output.html * To generate a JUnit report, run: rally task export c12f435f-9717-480d-b3f9-94e26cebedae --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c12f435f-9717-480d-b3f9-94e26cebedae --json --out output.json 2021-02-10 18:07:22,933 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c12f435f-9717-480d-b3f9-94e26cebedae --out /home/opnfv/functest/results/rally_full/keystone.json 2021-02-10 18:07:22,956 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-02-10 18:07:22,993 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 18:07:23,425 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-02-10 18:27:12,698 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: caee42db-cdf7-41f8-91f5-aee687a7f1a9 2021-02-10 18:27:13,929 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid caee42db-cdf7-41f8-91f5-aee687a7f1a9 -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.736 | 2.92 | 4.191 | 4.335 | 4.479 | 3.039 | 100.0% | 10 | | neutron.update_network | 0.727 | 1.338 | 2.541 | 2.751 | 2.962 | 1.567 | 100.0% | 10 | | total | 3.313 | 5.013 | 5.676 | 5.713 | 5.749 | 4.606 | 100.0% | 10 | | -> duration | 3.313 | 5.013 | 5.676 | 5.713 | 5.749 | 4.606 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.706517 Full duration: 69.539447 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.862 | 4.418 | 5.169 | 5.194 | 5.219 | 4.535 | 100.0% | 10 | | neutron.update_port | 0.835 | 1.843 | 2.384 | 2.791 | 3.198 | 1.873 | 100.0% | 10 | | total | 5.247 | 6.433 | 7.211 | 7.337 | 7.462 | 6.408 | 100.0% | 10 | | -> duration | 5.247 | 6.433 | 7.211 | 7.337 | 7.462 | 6.408 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.176542 Full duration: 95.681211 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.055 | 4.92 | 5.843 | 6.136 | 6.428 | 4.305 | 100.0% | 10 | | neutron.create_subnet | 2.63 | 3.449 | 6.767 | 7.776 | 8.785 | 4.375 | 100.0% | 10 | | neutron.update_subnet | 0.785 | 1.352 | 2.024 | 2.337 | 2.649 | 1.444 | 100.0% | 10 | | total | 6.944 | 9.894 | 12.323 | 12.352 | 12.38 | 10.124 | 100.0% | 10 | | -> duration | 6.944 | 9.894 | 12.323 | 12.352 | 12.38 | 10.124 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.391415 Full duration: 86.312186 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.101 | 3.08 | 3.706 | 3.834 | 3.961 | 3.141 | 100.0% | 10 | | neutron.delete_network | 1.435 | 1.86 | 2.711 | 2.741 | 2.771 | 2.016 | 100.0% | 10 | | total | 3.901 | 5.154 | 5.805 | 5.977 | 6.149 | 5.157 | 100.0% | 10 | | -> duration | 3.901 | 5.154 | 5.805 | 5.977 | 6.149 | 5.157 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.263832 Full duration: 67.232311 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.501 | 7.459 | 11.396 | 11.827 | 12.258 | 7.405 | 100.0% | 10 | | neutron.delete_port | 1.231 | 2.487 | 3.476 | 3.561 | 3.646 | 2.361 | 100.0% | 10 | | total | 6.016 | 9.693 | 12.697 | 13.093 | 13.489 | 9.765 | 100.0% | 10 | | -> duration | 6.016 | 9.693 | 12.697 | 13.093 | 13.489 | 9.765 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.407135 Full duration: 129.785009 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.001 | 4.713 | 7.227 | 7.44 | 7.653 | 4.584 | 100.0% | 10 | | neutron.create_subnet | 2.107 | 3.52 | 6.231 | 7.19 | 8.15 | 3.947 | 100.0% | 10 | | neutron.delete_subnet | 0.774 | 1.779 | 1.963 | 2.0 | 2.037 | 1.657 | 100.0% | 10 | | total | 5.844 | 8.953 | 14.303 | 14.334 | 14.365 | 10.193 | 100.0% | 10 | | -> duration | 5.844 | 8.953 | 14.303 | 14.334 | 14.365 | 10.193 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.147794 Full duration: 87.86194 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.567 | 3.928 | 5.215 | 5.588 | 5.961 | 3.806 | 100.0% | 10 | | neutron.list_networks | 0.166 | 0.518 | 1.438 | 1.542 | 1.647 | 0.702 | 100.0% | 10 | | total | 2.63 | 4.183 | 6.173 | 6.36 | 6.546 | 4.508 | 100.0% | 10 | | -> duration | 2.63 | 4.183 | 6.173 | 6.36 | 6.546 | 4.508 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.58069 Full duration: 60.167953 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.622 | 4.629 | 5.152 | 5.177 | 5.202 | 4.396 | 100.0% | 10 | | neutron.list_ports | 0.106 | 0.156 | 1.774 | 2.067 | 2.36 | 0.601 | 100.0% | 10 | | total | 2.765 | 5.081 | 6.751 | 7.086 | 7.421 | 4.997 | 100.0% | 10 | | -> duration | 2.765 | 5.081 | 6.751 | 7.086 | 7.421 | 4.997 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.308512 Full duration: 88.737639 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.658 | 2.874 | 8.111 | 8.564 | 9.016 | 4.7 | 100.0% | 10 | | neutron.create_subnet | 1.388 | 3.665 | 4.497 | 4.747 | 4.996 | 3.584 | 100.0% | 10 | | neutron.list_subnets | 0.084 | 0.242 | 0.644 | 0.814 | 0.985 | 0.348 | 100.0% | 10 | | total | 3.593 | 8.088 | 12.369 | 12.633 | 12.897 | 8.632 | 100.0% | 10 | | -> duration | 3.593 | 8.088 | 12.369 | 12.633 | 12.897 | 8.632 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.361 Full duration: 79.816011 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.038 | 2.429 | 2.885 | 3.084 | 3.283 | 2.219 | 100.0% | 10 | | neutron.delete_security_group | 0.249 | 0.405 | 0.693 | 1.094 | 1.494 | 0.536 | 100.0% | 10 | | total | 1.429 | 2.928 | 3.285 | 3.461 | 3.636 | 2.756 | 100.0% | 10 | | -> duration | 1.429 | 2.928 | 3.285 | 3.461 | 3.636 | 2.756 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.551155 Full duration: 49.730245 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.357 | 3.165 | 4.732 | 5.272 | 5.813 | 3.473 | 100.0% | 10 | | neutron.create_security_group_rule | 0.74 | 2.942 | 4.667 | 4.943 | 5.218 | 2.99 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.301 | 0.666 | 1.193 | 1.897 | 2.601 | 0.854 | 100.0% | 10 | | neutron.delete_security_group | 0.221 | 1.497 | 2.802 | 2.841 | 2.88 | 1.516 | 100.0% | 10 | | total | 5.091 | 8.428 | 11.551 | 12.295 | 13.039 | 8.833 | 100.0% | 10 | | -> duration | 5.091 | 8.428 | 11.551 | 12.295 | 13.039 | 8.833 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.987747 Full duration: 67.860949 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.253 | 3.151 | 3.824 | 3.931 | 4.038 | 3.14 | 100.0% | 10 | | neutron.create_security_group_rule | 2.442 | 2.87 | 3.775 | 4.034 | 4.294 | 3.096 | 100.0% | 10 | | neutron.list_security_group_rules | 0.064 | 0.093 | 0.371 | 0.816 | 1.261 | 0.233 | 100.0% | 10 | | total | 5.258 | 6.232 | 7.911 | 8.193 | 8.475 | 6.47 | 100.0% | 10 | | -> duration | 5.258 | 6.232 | 7.911 | 8.193 | 8.475 | 6.47 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.333259 Full duration: 68.885282 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.919 | 3.545 | 4.554 | 4.599 | 4.644 | 3.536 | 100.0% | 10 | | neutron.show_security_group | 0.063 | 0.069 | 0.072 | 0.075 | 0.078 | 0.069 | 100.0% | 10 | | total | 1.985 | 3.613 | 4.626 | 4.674 | 4.722 | 3.605 | 100.0% | 10 | | -> duration | 1.985 | 3.613 | 4.626 | 4.674 | 4.722 | 3.605 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.892787 Full duration: 68.320721 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 26.242153 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task caee42db-cdf7-41f8-91f5-aee687a7f1a9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 4.514 | 9.979 | 13.352 | 13.59 | 13.829 | 9.919 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.231 | 0.81 | 1.481 | 1.99 | 2.498 | 0.845 | 100.0% | 10 | | total | 5.475 | 10.644 | 14.735 | 15.032 | 15.329 | 10.764 | 100.0% | 10 | | -> duration | 5.475 | 10.644 | 14.735 | 15.032 | 15.329 | 10.764 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.515582 Full duration: 105.656947 HINTS: * To plot HTML graphics with this data, run: rally task report caee42db-cdf7-41f8-91f5-aee687a7f1a9 --out output.html * To generate a JUnit report, run: rally task export caee42db-cdf7-41f8-91f5-aee687a7f1a9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report caee42db-cdf7-41f8-91f5-aee687a7f1a9 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-10 18:27:17,241 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid caee42db-cdf7-41f8-91f5-aee687a7f1a9 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-02-10 18:27:17,263 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-02-10 18:27:17,305 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 18:27:17,938 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-02-10 19:14:21,327 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: b664390c-6210-47ee-b5ba-50a98a080d42 2021-02-10 19:14:22,592 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b664390c-6210-47ee-b5ba-50a98a080d42 -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.855 | 1.436 | 1.643 | 1.71 | 1.777 | 1.4 | 100.0% | 10 | | nova.delete_keypair | 0.082 | 0.518 | 1.413 | 1.495 | 1.578 | 0.688 | 100.0% | 10 | | total | 1.296 | 1.887 | 3.03 | 3.102 | 3.173 | 2.088 | 100.0% | 10 | | -> duration | 1.296 | 1.887 | 3.03 | 3.102 | 3.173 | 2.088 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.096472 Full duration: 52.407867 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.215 | 1.708 | 2.261 | 2.33 | 2.398 | 1.808 | 100.0% | 10 | | nova.list_keypairs | 0.034 | 0.042 | 0.076 | 0.146 | 0.216 | 0.06 | 100.0% | 10 | | total | 1.251 | 1.751 | 2.44 | 2.451 | 2.462 | 1.868 | 100.0% | 10 | | -> duration | 1.251 | 1.751 | 2.44 | 2.451 | 2.462 | 1.868 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.004395 Full duration: 53.092779 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.561 | 65.067 | 72.549 | 74.946 | 77.344 | 59.888 | 100.0% | 10 | | nova.reboot_server | 14.708 | 20.43 | 27.291 | 29.992 | 32.693 | 21.489 | 100.0% | 10 | | nova.soft_reboot_server | 10.242 | 19.311 | 147.265 | 147.482 | 147.699 | 67.237 | 100.0% | 10 | | nova.stop_and_start_server | 12.689 | 23.343 | 32.278 | 55.457 | 78.635 | 27.31 | 100.0% | 10 | | -> nova.stop_server | 5.465 | 15.029 | 22.724 | 44.525 | 66.326 | 17.874 | 100.0% | 10 | | -> nova.start_server | 6.133 | 8.56 | 12.539 | 13.571 | 14.603 | 9.435 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 15.396 | 21.858 | 73.003 | 81.194 | 89.386 | 32.545 | 100.0% | 10 | | -> nova.rescue_server | 9.615 | 11.385 | 66.703 | 70.318 | 73.933 | 22.969 | 100.0% | 10 | | -> nova.unrescue_server | 5.282 | 8.91 | 13.783 | 14.618 | 15.453 | 9.576 | 100.0% | 10 | | nova.delete_server | 5.244 | 12.283 | 32.942 | 35.355 | 37.769 | 17.154 | 100.0% | 10 | | total | 98.109 | 184.109 | 368.396 | 384.135 | 399.875 | 225.682 | 100.0% | 10 | | -> duration | 89.109 | 175.109 | 359.396 | 375.135 | 390.875 | 216.682 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 581.487635 Full duration: 632.58901 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 49.252 | 70.138 | 82.964 | 84.487 | 86.01 | 69.6 | 100.0% | 10 | | nova.delete_server | 16.381 | 20.764 | 24.058 | 25.553 | 27.047 | 20.941 | 100.0% | 10 | | total | 72.106 | 92.152 | 99.772 | 103.222 | 106.672 | 90.541 | 100.0% | 10 | | -> duration | 71.106 | 91.152 | 98.772 | 102.222 | 105.672 | 89.541 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 257.547339 Full duration: 301.446459 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 38.225 | 52.981 | 64.19 | 66.437 | 68.684 | 53.536 | 100.0% | 10 | | nova.list_servers | 0.395 | 0.416 | 0.748 | 1.004 | 1.26 | 0.55 | 100.0% | 10 | | total | 38.631 | 53.409 | 64.586 | 66.84 | 69.093 | 54.087 | 100.0% | 10 | | -> duration | 37.631 | 52.409 | 63.586 | 65.84 | 68.093 | 53.087 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 151.198236 Full duration: 271.058442 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "from_image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "to_image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 35.02 | 66.67 | 73.665 | 75.324 | 76.982 | 62.159 | 100.0% | 10 | | nova.rebuild_server | 14.098 | 22.463 | 28.223 | 28.823 | 29.423 | 22.523 | 100.0% | 10 | | nova.delete_server | 15.473 | 17.674 | 25.015 | 25.37 | 25.726 | 19.137 | 100.0% | 10 | | total | 65.69 | 110.329 | 121.369 | 124.678 | 127.986 | 103.819 | 100.0% | 10 | | -> duration | 63.69 | 108.329 | 119.369 | 122.678 | 125.986 | 101.819 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 286.276533 Full duration: 340.188654 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 79.744 | 116.393 | 163.42 | 164.975 | 166.531 | 124.715 | 100.0% | 10 | | nova.snapshot_server | 14.214 | 27.383 | 41.449 | 55.779 | 70.11 | 31.027 | 100.0% | 10 | | -> glance_v2.get_image | 0.073 | 0.083 | 0.107 | 0.158 | 0.21 | 0.096 | 100.0% | 10 | | -> glance.wait_for_image | 12.31 | 25.595 | 32.991 | 43.143 | 53.295 | 26.26 | 100.0% | 10 | | --> glance_v2.get_image (x13) | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 100.0% | 1 | | --> glance_v2.get_image (x12) | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 100.0% | 1 | | --> glance_v2.get_image (x16) | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 100.0% | 1 | | --> glance_v2.get_image (x15) | 0.628 | 0.679 | 0.719 | 0.724 | 0.729 | 0.679 | 100.0% | 2 | | --> glance_v2.get_image (x27) | 1.234 | 1.234 | 1.234 | 1.234 | 1.234 | 1.234 | 100.0% | 1 | | --> glance_v2.get_image (x10) | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 100.0% | 1 | | --> glance_v2.get_image (x14) | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 100.0% | 1 | | --> glance_v2.get_image (x7) | 0.295 | 0.295 | 0.295 | 0.295 | 0.295 | 0.295 | 100.0% | 1 | | --> glance_v2.get_image (x9) | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 100.0% | 1 | | nova.delete_server (x2) | 24.439 | 42.593 | 51.786 | 52.641 | 53.495 | 39.794 | 100.0% | 10 | | nova.delete_image | 3.832 | 9.195 | 10.807 | 11.324 | 11.84 | 8.281 | 100.0% | 10 | | -> glance_v2.delete_image | 3.761 | 9.146 | 10.766 | 11.28 | 11.795 | 8.23 | 100.0% | 10 | | -> glance.wait_for_delete | 0.034 | 0.043 | 0.069 | 0.069 | 0.07 | 0.049 | 100.0% | 10 | | --> glance_v2.get_image | 0.033 | 0.043 | 0.069 | 0.069 | 0.069 | 0.049 | 0.0% | 10 | | total | 125.687 | 202.786 | 253.292 | 256.659 | 260.027 | 203.818 | 100.0% | 10 | | -> duration | 123.687 | 200.786 | 251.292 | 254.659 | 258.027 | 201.818 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 566.327074 Full duration: 609.779866 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "volume_size": 1, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 19.969 | 29.418 | 47.181 | 47.773 | 48.364 | 31.449 | 100.0% | 10 | | nova.boot_server | 26.839 | 56.038 | 83.512 | 92.381 | 101.25 | 61.8 | 100.0% | 10 | | total | 52.813 | 101.594 | 110.018 | 117.553 | 125.087 | 93.249 | 100.0% | 10 | | -> duration | 51.813 | 100.594 | 109.018 | 116.553 | 124.087 | 92.249 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 259.617167 Full duration: 362.786473 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_d0f2bd92-985f-473f-8c69-a6277327b730" }, "image": { "name": "rally_full-img_d0f2bd92-985f-473f-8c69-a6277327b730" }, "nics": [ { "net-id": "befffb8f-5f9b-4ef0-9259-f4f117cc0526" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b664390c-6210-47ee-b5ba-50a98a080d42 has 2 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 327, in run auto_assign_nic=auto_assign_nic, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 327, in run auto_assign_nic=auto_assign_nic, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 4.906 | 35.338 | 37.856 | 39.284 | 40.712 | 30.198 | 80.0% | 10 | | total | 4.907 | 35.338 | 37.856 | 39.284 | 40.712 | 30.198 | 80.0% | 10 | | -> duration | 3.907 | 34.338 | 36.856 | 38.284 | 39.712 | 29.198 | 80.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 80.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 77.539706 Full duration: 135.374396 HINTS: * To plot HTML graphics with this data, run: rally task report b664390c-6210-47ee-b5ba-50a98a080d42 --out output.html * To generate a JUnit report, run: rally task export b664390c-6210-47ee-b5ba-50a98a080d42 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b664390c-6210-47ee-b5ba-50a98a080d42 --json --out output.json At least one workload did not pass SLA criteria. 2021-02-10 19:14:25,578 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b664390c-6210-47ee-b5ba-50a98a080d42 --out /home/opnfv/functest/results/rally_full/nova.json 2021-02-10 19:14:25,598 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-02-10 19:14:25,625 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 19:14:26,055 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-02-10 19:16:43,436 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 7b936fcc-857c-4c3d-82de-1a486d27488d 2021-02-10 19:16:44,733 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7b936fcc-857c-4c3d-82de-1a486d27488d -------------------------------------------------------------------------------- Task 7b936fcc-857c-4c3d-82de-1a486d27488d: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b936fcc-857c-4c3d-82de-1a486d27488d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.892 | 4.097 | 6.585 | 6.937 | 7.288 | 4.355 | 100.0% | 10 | | quotas.delete_quotas | 0.034 | 1.252 | 2.538 | 2.888 | 3.238 | 1.379 | 100.0% | 10 | | total | 2.933 | 5.582 | 7.395 | 7.726 | 8.058 | 5.733 | 100.0% | 10 | | -> duration | 2.933 | 5.582 | 7.395 | 7.726 | 8.058 | 5.733 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.918663 Full duration: 41.799043 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b936fcc-857c-4c3d-82de-1a486d27488d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.087 | 1.714 | 2.54 | 2.564 | 2.588 | 1.78 | 100.0% | 10 | | total | 1.087 | 1.714 | 2.54 | 2.564 | 2.588 | 1.78 | 100.0% | 10 | | -> duration | 1.087 | 1.714 | 2.54 | 2.564 | 2.588 | 1.78 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.907645 Full duration: 25.208173 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b936fcc-857c-4c3d-82de-1a486d27488d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.155 | 5.715 | 8.788 | 8.837 | 8.886 | 6.531 | 100.0% | 10 | | total | 4.155 | 5.715 | 8.788 | 8.837 | 8.886 | 6.532 | 100.0% | 10 | | -> duration | 4.155 | 5.715 | 8.788 | 8.837 | 8.886 | 6.532 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.547512 Full duration: 48.635553 HINTS: * To plot HTML graphics with this data, run: rally task report 7b936fcc-857c-4c3d-82de-1a486d27488d --out output.html * To generate a JUnit report, run: rally task export 7b936fcc-857c-4c3d-82de-1a486d27488d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7b936fcc-857c-4c3d-82de-1a486d27488d --json --out output.json 2021-02-10 19:16:47,699 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7b936fcc-857c-4c3d-82de-1a486d27488d --out /home/opnfv/functest/results/rally_full/quotas.json 2021-02-10 19:16:47,705 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-02-10 19:16:47,737 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-02-10 19:16:47,893 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-02-10 19:26:36,248 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 12680105-af02-4b6f-96c6-fbec4b6f4dea 2021-02-10 19:26:37,501 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 12680105-af02-4b6f-96c6-fbec4b6f4dea -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.999 | 1.11 | 1.294 | 1.334 | 1.373 | 1.152 | 100.0% | 10 | | swift.upload_object (x2) | 1.001 | 1.143 | 1.271 | 1.274 | 1.277 | 1.155 | 100.0% | 10 | | swift.list_objects | 0.92 | 1.031 | 1.076 | 1.082 | 1.087 | 1.025 | 100.0% | 10 | | total | 3.022 | 3.333 | 3.573 | 3.574 | 3.575 | 3.333 | 100.0% | 10 | | -> duration | 3.022 | 3.333 | 3.573 | 3.574 | 3.575 | 3.333 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.38709 Full duration: 104.86844 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.243 | 1.482 | 1.618 | 1.63 | 1.641 | 1.447 | 100.0% | 10 | | swift.list_objects | 0.908 | 0.993 | 1.072 | 1.075 | 1.079 | 0.982 | 100.0% | 10 | | total | 2.191 | 2.446 | 2.598 | 2.621 | 2.644 | 2.429 | 100.0% | 10 | | -> duration | 2.191 | 2.446 | 2.598 | 2.621 | 2.644 | 2.429 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.344708 Full duration: 80.198511 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.983 | 1.183 | 1.345 | 1.374 | 1.402 | 1.189 | 100.0% | 10 | | swift.upload_object (x5) | 2.509 | 2.707 | 2.974 | 3.006 | 3.038 | 2.742 | 100.0% | 10 | | swift.download_object (x5) | 2.352 | 2.409 | 2.578 | 2.59 | 2.601 | 2.437 | 100.0% | 10 | | total | 6.097 | 6.326 | 6.708 | 6.719 | 6.73 | 6.369 | 100.0% | 10 | | -> duration | 6.097 | 6.326 | 6.708 | 6.719 | 6.73 | 6.369 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.751626 Full duration: 152.667509 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.092 | 1.217 | 1.336 | 1.339 | 1.342 | 1.219 | 100.0% | 10 | | swift.upload_object (x5) | 2.985 | 3.196 | 3.314 | 3.336 | 3.358 | 3.195 | 100.0% | 10 | | swift.delete_object (x5) | 2.898 | 2.983 | 3.106 | 3.106 | 3.107 | 3.004 | 100.0% | 10 | | swift.delete_container | 0.632 | 0.716 | 0.819 | 0.909 | 0.999 | 0.737 | 100.0% | 10 | | total | 7.715 | 8.196 | 8.498 | 8.503 | 8.508 | 8.156 | 100.0% | 10 | | -> duration | 7.715 | 8.196 | 8.498 | 8.503 | 8.508 | 8.156 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 81.628653 Full duration: 120.978876 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 12680105-af02-4b6f-96c6-fbec4b6f4dea has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.32 | 1.497 | 1.585 | 1.591 | 1.597 | 1.48 | 100.0% | 10 | | swift.list_objects | 0.942 | 1.015 | 1.105 | 1.11 | 1.115 | 1.036 | 100.0% | 10 | | swift.download_object (x5) | 2.397 | 2.545 | 2.651 | 2.66 | 2.67 | 2.554 | 100.0% | 10 | | total | 4.89 | 5.055 | 5.242 | 5.258 | 5.274 | 5.071 | 100.0% | 10 | | -> duration | 4.89 | 5.055 | 5.242 | 5.258 | 5.274 | 5.071 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.765333 Full duration: 98.773432 HINTS: * To plot HTML graphics with this data, run: rally task report 12680105-af02-4b6f-96c6-fbec4b6f4dea --out output.html * To generate a JUnit report, run: rally task export 12680105-af02-4b6f-96c6-fbec4b6f4dea --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 12680105-af02-4b6f-96c6-fbec4b6f4dea --json --out output.json 2021-02-10 19:26:40,462 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 12680105-af02-4b6f-96c6-fbec4b6f4dea --out /home/opnfv/functest/results/rally_full/swift.json 2021-02-10 19:26:40,478 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-02-10 19:26:40,483 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:54 | 60 | 100.00% | | glance | 00:10:39 | 40 | 90.00% | | cinder | 00:49:13 | 240 | 100.00% | | heat | 00:22:50 | 45 | 97.78% | | keystone | 00:11:58 | 110 | 100.00% | | neutron | 00:19:11 | 140 | 100.00% | | nova | 00:45:58 | 90 | 97.78% | | quotas | 00:01:55 | 30 | 100.00% | | swift | 00:09:17 | 50 | 100.00% | | | | | | | TOTAL: | 02:54:00 | 805 | 99.13% | +----------------+------------+----------------+-----------+ 2021-02-10 19:26:40,483 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.13% in 5/9 modules 2021-02-10 19:26:44,196 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-02-10 19:26:47,586 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-02-10 19:26:47,587 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 181:27 | FAIL | +--------------------+------------------+------------------+----------------+