2021-04-07 15:17:36,522 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | RTA6RZRM83D1 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/RTA6RZRM83D1/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-208 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/RTA6RZRM83D1/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-208 | +-------------------------+------------------------------------------------------------+ 2021-04-07 15:17:36,541 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-04-07 15:17:40,011 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-04-07 15:17:46,082 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-04-07 15:17:52,396 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 83ecf7b3-eabe-4325-9eb4-32c2c5b9574c | 2021-04-07T15:17:52.127950 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 83ecf7b3-eabe-4325-9eb4-32c2c5b9574c ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-04-07 15:17:57,332 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-04-07 15:17:59,943 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 15:18:00,126 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-04-07 15:20:47,225 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 077fede7-364a-4563-b4c9-034c3fcbcb38 2021-04-07 15:20:48,449 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 077fede7-364a-4563-b4c9-034c3fcbcb38 -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.859 | 1.384 | 1.65 | 1.84 | 2.031 | 1.368 | 100.0% | 10 | | total | 0.859 | 1.384 | 1.65 | 1.84 | 2.031 | 1.368 | 100.0% | 10 | | -> duration | 0.859 | 1.384 | 1.65 | 1.84 | 2.031 | 1.368 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.981805 Full duration: 25.07666 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.147 | 0.242 | 0.427 | 0.461 | 0.495 | 0.281 | 100.0% | 10 | | total | 0.639 | 0.954 | 1.123 | 1.123 | 1.123 | 0.968 | 100.0% | 10 | | -> duration | 0.639 | 0.954 | 1.123 | 1.123 | 1.123 | 0.968 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.999504 Full duration: 26.267691 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.186 | 0.289 | 0.524 | 0.539 | 0.554 | 0.342 | 100.0% | 10 | | total | 0.607 | 1.033 | 1.207 | 1.297 | 1.387 | 0.988 | 100.0% | 10 | | -> duration | 0.607 | 1.033 | 1.207 | 1.297 | 1.387 | 0.988 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.71344 Full duration: 20.849759 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.161 | 0.174 | 0.503 | 0.727 | 0.95 | 0.304 | 100.0% | 10 | | total | 0.592 | 0.849 | 1.656 | 1.847 | 2.037 | 1.039 | 100.0% | 10 | | -> duration | 0.592 | 0.849 | 1.656 | 1.847 | 2.037 | 1.039 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.945834 Full duration: 23.448794 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.393 | 0.542 | 0.849 | 0.856 | 0.864 | 0.566 | 100.0% | 10 | | total | 0.844 | 1.218 | 1.606 | 1.617 | 1.627 | 1.211 | 100.0% | 10 | | -> duration | 0.844 | 1.218 | 1.606 | 1.617 | 1.627 | 1.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.35479 Full duration: 22.042871 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 077fede7-364a-4563-b4c9-034c3fcbcb38 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.155 | 0.287 | 0.579 | 0.637 | 0.695 | 0.346 | 100.0% | 10 | | total | 0.647 | 0.989 | 1.608 | 1.677 | 1.747 | 1.073 | 100.0% | 10 | | -> duration | 0.647 | 0.989 | 1.608 | 1.677 | 1.747 | 1.073 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.72907 Full duration: 24.512332 HINTS: * To plot HTML graphics with this data, run: rally task report 077fede7-364a-4563-b4c9-034c3fcbcb38 --out output.html * To generate a JUnit report, run: rally task export 077fede7-364a-4563-b4c9-034c3fcbcb38 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 077fede7-364a-4563-b4c9-034c3fcbcb38 --json --out output.json 2021-04-07 15:20:51,434 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 077fede7-364a-4563-b4c9-034c3fcbcb38 --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-04-07 15:20:51,445 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-04-07 15:20:51,481 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 15:20:51,652 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-04-07 15:28:21,246 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 50b9df09-6064-4295-8384-34c1e51ba3b7 2021-04-07 15:28:22,487 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 50b9df09-6064-4295-8384-34c1e51ba3b7 -------------------------------------------------------------------------------- Task 50b9df09-6064-4295-8384-34c1e51ba3b7: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 50b9df09-6064-4295-8384-34c1e51ba3b7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.948 | 6.439 | 7.036 | 7.069 | 7.103 | 6.286 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.086 | 0.103 | 0.111 | 0.123 | 0.135 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 2.409 | 3.605 | 4.206 | 4.35 | 4.495 | 3.553 | 100.0% | 10 | | glance_v2.delete_image | 1.782 | 2.479 | 2.684 | 2.799 | 2.914 | 2.411 | 100.0% | 10 | | total | 7.449 | 8.814 | 9.481 | 9.532 | 9.584 | 8.698 | 100.0% | 10 | | -> duration | 7.449 | 8.814 | 9.481 | 9.532 | 9.584 | 8.698 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.190505 Full duration: 55.982945 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 50b9df09-6064-4295-8384-34c1e51ba3b7 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.639 | 6.238 | 7.366 | 7.628 | 7.89 | 6.327 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.097 | 0.104 | 0.109 | 0.11 | 0.111 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 2.246 | 3.763 | 4.792 | 4.881 | 4.97 | 3.698 | 100.0% | 10 | | glance_v2.list_images | 0.056 | 0.061 | 0.072 | 0.077 | 0.082 | 0.063 | 100.0% | 10 | | total | 4.704 | 6.309 | 7.437 | 7.692 | 7.947 | 6.39 | 100.0% | 10 | | -> duration | 4.704 | 6.309 | 7.437 | 7.692 | 7.947 | 6.39 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.977832 Full duration: 66.34985 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 50b9df09-6064-4295-8384-34c1e51ba3b7 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.156 | 0.195 | 0.418 | 0.7 | 0.981 | 0.285 | 100.0% | 10 | | total | 0.156 | 0.195 | 0.418 | 0.7 | 0.981 | 0.285 | 100.0% | 10 | | -> duration | 0.156 | 0.195 | 0.418 | 0.7 | 0.981 | 0.285 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.223952 Full duration: 25.602545 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 50b9df09-6064-4295-8384-34c1e51ba3b7 has 4 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-07T15:25:11Z', 'message': 'No valid host was found. There are not enough hosts available.'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-07T15:25:11Z', 'message': 'No valid host was found. There are not enough hosts available.'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.038 | 6.171 | 7.03 | 7.606 | 8.182 | 6.217 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.088 | 0.102 | 0.131 | 0.177 | 0.223 | 0.113 | 100.0% | 9 | | -> glance_v2.upload_data | 2.568 | 3.279 | 4.069 | 4.101 | 4.133 | 3.291 | 100.0% | 9 | | nova.boot_servers | 9.498 | 60.654 | 79.75 | 80.444 | 81.139 | 57.674 | 55.6% | 9 | | total | 16.24 | 66.826 | 86.565 | 87.943 | 89.321 | 63.891 | 55.6% | 9 | | -> duration | 15.24 | 65.826 | 85.565 | 86.943 | 88.321 | 62.891 | 55.6% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 55.6% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 167.582785 Full duration: 277.405921 HINTS: * To plot HTML graphics with this data, run: rally task report 50b9df09-6064-4295-8384-34c1e51ba3b7 --out output.html * To generate a JUnit report, run: rally task export 50b9df09-6064-4295-8384-34c1e51ba3b7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 50b9df09-6064-4295-8384-34c1e51ba3b7 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-07 15:28:25,583 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 50b9df09-6064-4295-8384-34c1e51ba3b7 --out /home/opnfv/functest/results/rally_full/glance.json 2021-04-07 15:28:25,598 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-04-07 15:28:25,641 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 15:28:26,353 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-04-07 16:10:12,701 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 4001bf69-7ae3-45f7-8a82-0861a4d7df30 2021-04-07 16:10:14,040 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4001bf69-7ae3-45f7-8a82-0861a4d7df30 -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "size": 1, "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.383 | 38.434 | 48.173 | 49.107 | 50.042 | 38.313 | 100.0% | 10 | | cinder_v3.create_volume | 3.875 | 8.666 | 10.823 | 11.068 | 11.313 | 8.521 | 100.0% | 10 | | nova.attach_volume | 8.398 | 14.24 | 17.01 | 17.185 | 17.36 | 13.795 | 100.0% | 10 | | nova.detach_volume | 4.246 | 5.374 | 7.262 | 9.748 | 12.234 | 5.987 | 100.0% | 10 | | cinder_v3.delete_volume | 2.693 | 6.209 | 12.548 | 12.686 | 12.824 | 7.066 | 100.0% | 10 | | nova.delete_server | 7.609 | 11.222 | 17.829 | 19.647 | 21.465 | 13.048 | 100.0% | 10 | | total | 59.693 | 82.515 | 109.616 | 110.538 | 111.46 | 86.731 | 100.0% | 10 | | -> duration | 58.693 | 81.515 | 108.616 | 109.538 | 110.46 | 85.731 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 243.824534 Full duration: 285.413316 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.226 | 6.396 | 7.655 | 7.676 | 7.696 | 6.166 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.038 | 0.041 | 0.047 | 0.048 | 0.048 | 0.042 | 100.0% | 10 | | total | 4.27 | 6.44 | 7.696 | 7.717 | 7.739 | 6.209 | 100.0% | 10 | | -> duration | 4.27 | 6.44 | 7.696 | 7.717 | 7.739 | 6.209 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.85999 Full duration: 83.289847 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.722 | 20.564 | 24.843 | 24.902 | 24.961 | 19.959 | 100.0% | 10 | | cinder_v3.list_volumes | 0.065 | 0.076 | 0.106 | 0.178 | 0.25 | 0.093 | 100.0% | 10 | | total | 14.794 | 20.638 | 24.92 | 24.981 | 25.043 | 20.052 | 100.0% | 10 | | -> duration | 14.794 | 20.638 | 24.92 | 24.981 | 25.043 | 20.052 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 58.417704 Full duration: 101.799087 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.895 | 7.085 | 9.33 | 9.363 | 9.396 | 6.875 | 100.0% | 10 | | cinder_v3.list_volumes | 0.068 | 0.084 | 0.094 | 0.095 | 0.095 | 0.083 | 100.0% | 10 | | total | 3.976 | 7.165 | 9.414 | 9.447 | 9.481 | 6.959 | 100.0% | 10 | | -> duration | 3.976 | 7.165 | 9.414 | 9.447 | 9.481 | 6.959 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.942099 Full duration: 64.158476 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.958 | 3.363 | 8.093 | 8.234 | 8.374 | 4.687 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 30.322 | 54.905 | 62.17 | 62.174 | 62.177 | 52.155 | 100.0% | 10 | | cinder_v3.delete_volume | 2.285 | 3.857 | 5.915 | 6.375 | 6.836 | 4.112 | 100.0% | 10 | | glance_v2.delete_image | 5.283 | 7.482 | 10.795 | 10.994 | 11.192 | 7.757 | 100.0% | 10 | | total | 41.957 | 74.535 | 78.187 | 78.529 | 78.87 | 68.712 | 100.0% | 10 | | -> duration | 41.957 | 74.535 | 78.187 | 78.529 | 78.87 | 68.712 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 195.980347 Full duration: 237.483409 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 30.953 | 39.206 | 55.896 | 58.343 | 60.79 | 40.982 | 100.0% | 10 | | cinder_v3.create_volume | 3.952 | 9.126 | 25.654 | 26.706 | 27.758 | 11.909 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.48 | 8.342 | 10.16 | 11.021 | 11.882 | 8.098 | 100.0% | 10 | | nova.attach_volume | 9.679 | 13.775 | 16.413 | 16.603 | 16.793 | 13.995 | 100.0% | 10 | | nova.detach_volume | 4.016 | 4.954 | 7.974 | 8.08 | 8.185 | 5.751 | 100.0% | 10 | | cinder_v3.delete_snapshot | 3.176 | 6.57 | 7.264 | 7.96 | 8.657 | 5.926 | 100.0% | 10 | | cinder_v3.delete_volume | 2.814 | 10.045 | 11.182 | 11.318 | 11.453 | 8.913 | 100.0% | 10 | | nova.delete_server | 6.603 | 19.312 | 21.206 | 21.253 | 21.299 | 17.18 | 100.0% | 10 | | total | 71.638 | 120.072 | 130.684 | 130.766 | 130.848 | 112.755 | 100.0% | 10 | | -> duration | 70.638 | 119.072 | 129.684 | 129.766 | 129.848 | 111.755 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 314.613679 Full duration: 352.919899 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.662 | 9.087 | 19.555 | 20.477 | 21.399 | 10.88 | 100.0% | 10 | | cinder_v3.create_snapshot | 4.176 | 6.133 | 8.066 | 11.414 | 14.762 | 6.617 | 100.0% | 10 | | nova.boot_server | 21.287 | 38.687 | 43.521 | 43.809 | 44.097 | 35.589 | 100.0% | 10 | | nova.attach_volume | 8.386 | 13.062 | 23.244 | 24.609 | 25.975 | 15.084 | 100.0% | 10 | | nova.detach_volume | 4.078 | 5.095 | 7.572 | 8.006 | 8.44 | 5.493 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.426 | 5.041 | 5.74 | 7.292 | 8.844 | 4.675 | 100.0% | 10 | | cinder_v3.delete_volume | 2.405 | 4.323 | 6.353 | 8.573 | 10.792 | 4.712 | 100.0% | 10 | | nova.delete_server | 6.647 | 13.957 | 18.965 | 19.384 | 19.803 | 13.477 | 100.0% | 10 | | total | 70.939 | 98.956 | 113.846 | 117.435 | 121.024 | 96.527 | 100.0% | 10 | | -> duration | 69.939 | 97.956 | 112.846 | 116.435 | 120.024 | 95.527 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 286.618657 Full duration: 338.916883 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.772 | 8.448 | 9.674 | 10.195 | 10.715 | 7.824 | 100.0% | 10 | | total | 4.772 | 8.448 | 9.675 | 10.195 | 10.715 | 7.825 | 100.0% | 10 | | -> duration | 4.772 | 8.448 | 9.675 | 10.195 | 10.715 | 7.825 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.426865 Full duration: 56.717625 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.674 | 7.508 | 8.433 | 8.755 | 9.077 | 7.27 | 100.0% | 10 | | total | 4.674 | 7.509 | 8.433 | 8.755 | 9.077 | 7.27 | 100.0% | 10 | | -> duration | 4.674 | 7.509 | 8.433 | 8.755 | 9.077 | 7.27 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.499869 Full duration: 65.548745 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.66 | 0.868 | 1.116 | 1.13 | 1.145 | 0.895 | 100.0% | 10 | | total | 0.66 | 0.868 | 1.116 | 1.131 | 1.145 | 0.895 | 100.0% | 10 | | -> duration | 0.66 | 0.868 | 1.116 | 1.131 | 1.145 | 0.895 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.593113 Full duration: 88.374827 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.559 | 5.405 | 7.137 | 7.388 | 7.639 | 5.44 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.251 | 2.785 | 4.608 | 4.876 | 5.145 | 3.094 | 100.0% | 10 | | total | 6.484 | 8.898 | 9.63 | 9.877 | 10.123 | 8.535 | 100.0% | 10 | | -> duration | 6.484 | 8.898 | 9.63 | 9.877 | 10.123 | 8.535 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.385367 Full duration: 75.549548 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.787 | 7.773 | 9.059 | 9.557 | 10.054 | 7.734 | 100.0% | 10 | | cinder_v3.delete_volume | 4.228 | 6.269 | 7.516 | 7.542 | 7.567 | 6.249 | 100.0% | 10 | | total | 11.609 | 13.785 | 16.576 | 17.099 | 17.621 | 13.983 | 100.0% | 10 | | -> duration | 11.609 | 13.785 | 16.576 | 17.099 | 17.621 | 13.983 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.01368 Full duration: 69.654817 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 16.264 | 19.87 | 22.129 | 22.132 | 22.135 | 19.696 | 100.0% | 10 | | cinder_v3.delete_volume | 2.819 | 4.836 | 7.044 | 7.216 | 7.388 | 5.021 | 100.0% | 10 | | total | 22.628 | 24.992 | 25.887 | 26.016 | 26.144 | 24.717 | 100.0% | 10 | | -> duration | 22.628 | 24.992 | 25.887 | 26.016 | 26.144 | 24.717 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.144952 Full duration: 106.283173 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.801 | 6.763 | 8.068 | 9.225 | 10.383 | 7.103 | 100.0% | 10 | | cinder_v3.delete_volume | 2.812 | 3.478 | 8.536 | 8.686 | 8.837 | 4.957 | 100.0% | 10 | | total | 8.807 | 11.616 | 14.997 | 15.007 | 15.017 | 12.06 | 100.0% | 10 | | -> duration | 8.807 | 11.616 | 14.997 | 15.007 | 15.017 | 12.06 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.979625 Full duration: 67.698802 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.769 | 9.39 | 18.825 | 20.325 | 21.825 | 11.726 | 100.0% | 10 | | cinder_v3.extend_volume | 2.78 | 3.909 | 6.558 | 8.152 | 9.747 | 4.832 | 100.0% | 10 | | cinder_v3.delete_volume | 2.539 | 4.406 | 5.429 | 5.758 | 6.086 | 4.242 | 100.0% | 10 | | total | 10.902 | 17.344 | 30.152 | 31.7 | 33.248 | 20.801 | 100.0% | 10 | | -> duration | 10.902 | 17.344 | 30.152 | 31.7 | 33.248 | 20.801 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.778816 Full duration: 91.606227 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.404 | 7.7 | 10.303 | 10.688 | 11.074 | 7.941 | 100.0% | 10 | | cinder_v3.delete_volume | 2.848 | 5.156 | 7.2 | 7.717 | 8.233 | 5.323 | 100.0% | 10 | | total | 8.73 | 12.372 | 17.791 | 17.975 | 18.159 | 13.265 | 100.0% | 10 | | -> duration | 8.73 | 12.372 | 17.791 | 17.975 | 18.159 | 13.265 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.131351 Full duration: 85.052041 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.598 | 0.994 | 1.657 | 1.726 | 1.795 | 1.097 | 100.0% | 10 | | cinder_v3.get_qos | 0.03 | 0.034 | 0.042 | 0.047 | 0.051 | 0.036 | 100.0% | 10 | | total | 0.63 | 1.026 | 1.706 | 1.767 | 1.827 | 1.134 | 100.0% | 10 | | -> duration | 0.63 | 1.026 | 1.706 | 1.767 | 1.827 | 1.134 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.207886 Full duration: 29.485319 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.649 | 1.174 | 1.678 | 1.7 | 1.723 | 1.167 | 100.0% | 10 | | cinder_v3.list_qos | 0.034 | 0.042 | 0.049 | 0.049 | 0.05 | 0.043 | 100.0% | 10 | | total | 0.698 | 1.216 | 1.719 | 1.739 | 1.76 | 1.21 | 100.0% | 10 | | -> duration | 0.698 | 1.216 | 1.719 | 1.739 | 1.76 | 1.21 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.402802 Full duration: 30.257326 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.685 | 1.133 | 1.728 | 2.105 | 2.482 | 1.242 | 100.0% | 10 | | cinder_v3.set_qos | 0.309 | 0.679 | 1.601 | 1.662 | 1.723 | 0.915 | 100.0% | 10 | | total | 1.139 | 1.777 | 3.23 | 3.347 | 3.464 | 2.157 | 100.0% | 10 | | -> duration | 1.139 | 1.777 | 3.23 | 3.347 | 3.464 | 2.157 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.00915 Full duration: 32.606139 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.663 | 0.881 | 1.615 | 2.454 | 3.292 | 1.135 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.033 | 0.039 | 0.043 | 0.044 | 0.044 | 0.04 | 100.0% | 10 | | total | 0.7 | 0.922 | 1.654 | 2.493 | 3.331 | 1.175 | 100.0% | 10 | | -> duration | 0.7 | 0.922 | 1.654 | 2.493 | 3.331 | 1.175 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.15204 Full duration: 42.706939 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.687 | 1.352 | 2.162 | 2.284 | 2.407 | 1.438 | 100.0% | 10 | | cinder_v3.list_types | 0.045 | 0.055 | 0.058 | 0.062 | 0.066 | 0.053 | 100.0% | 10 | | total | 0.736 | 1.409 | 2.208 | 2.336 | 2.463 | 1.491 | 100.0% | 10 | | -> duration | 0.736 | 1.409 | 2.208 | 2.336 | 2.463 | 1.491 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.36702 Full duration: 32.649858 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.695 | 1.247 | 2.277 | 2.673 | 3.069 | 1.425 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.083 | 0.508 | 2.169 | 2.793 | 3.417 | 0.984 | 100.0% | 10 | | total | 0.954 | 2.399 | 3.557 | 4.172 | 4.787 | 2.409 | 100.0% | 10 | | -> duration | 0.954 | 2.399 | 3.557 | 4.172 | 4.787 | 2.409 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.49065 Full duration: 38.900694 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.633 | 1.191 | 1.639 | 1.727 | 1.815 | 1.127 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.099 | 0.294 | 0.638 | 0.808 | 0.978 | 0.352 | 100.0% | 10 | | total | 0.758 | 1.497 | 1.873 | 1.997 | 2.121 | 1.48 | 100.0% | 10 | | -> duration | 0.758 | 1.497 | 1.873 | 1.997 | 2.121 | 1.48 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.013524 Full duration: 31.956195 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4001bf69-7ae3-45f7-8a82-0861a4d7df30 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.639 | 1.185 | 3.168 | 3.227 | 3.286 | 1.609 | 100.0% | 10 | | cinder_v2.add_type_access | 0.087 | 0.762 | 1.553 | 1.92 | 2.287 | 0.853 | 100.0% | 10 | | cinder_v2.list_type_access | 0.035 | 0.04 | 0.059 | 0.125 | 0.191 | 0.055 | 100.0% | 10 | | total | 1.269 | 1.551 | 4.427 | 4.457 | 4.487 | 2.517 | 100.0% | 10 | | -> duration | 1.269 | 1.551 | 4.427 | 4.457 | 4.487 | 2.517 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.084726 Full duration: 33.551099 HINTS: * To plot HTML graphics with this data, run: rally task report 4001bf69-7ae3-45f7-8a82-0861a4d7df30 --out output.html * To generate a JUnit report, run: rally task export 4001bf69-7ae3-45f7-8a82-0861a4d7df30 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4001bf69-7ae3-45f7-8a82-0861a4d7df30 --json --out output.json 2021-04-07 16:10:17,283 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4001bf69-7ae3-45f7-8a82-0861a4d7df30 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-04-07 16:10:17,384 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-04-07 16:10:17,414 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 16:10:17,784 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-04-07 16:48:11,095 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 27a81375-ffe7-4dd2-8c03-9afba8708c75 2021-04-07 16:48:12,296 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 27a81375-ffe7-4dd2-8c03-9afba8708c75 -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.53 | 9.12 | 10.096 | 10.741 | 11.386 | 9.112 | 100.0% | 10 | | heat.list_stacks | 0.058 | 0.063 | 0.073 | 0.083 | 0.092 | 0.066 | 100.0% | 10 | | total | 6.593 | 9.186 | 10.166 | 10.823 | 11.479 | 9.178 | 100.0% | 10 | | -> duration | 4.593 | 7.186 | 8.166 | 8.823 | 9.479 | 7.178 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.405853 Full duration: 96.686774 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.358 | 21.267 | 53.487 | 55.353 | 57.219 | 33.085 | 100.0% | 10 | | heat.update_stack | 8.959 | 18.667 | 29.862 | 29.864 | 29.866 | 20.681 | 100.0% | 10 | | heat.delete_stack | 15.04 | 20.612 | 32.095 | 33.382 | 34.668 | 23.874 | 100.0% | 10 | | total | 44.97 | 81.206 | 91.443 | 91.494 | 91.545 | 77.64 | 100.0% | 10 | | -> duration | 40.97 | 77.206 | 87.443 | 87.494 | 87.545 | 73.64 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 212.166192 Full duration: 261.193122 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.016 | 28.858 | 43.044 | 45.346 | 47.647 | 31.506 | 100.0% | 10 | | heat.update_stack | 5.986 | 19.529 | 23.036 | 23.489 | 23.942 | 17.904 | 100.0% | 10 | | heat.delete_stack | 5.173 | 14.071 | 15.075 | 15.886 | 16.697 | 12.406 | 100.0% | 10 | | total | 39.204 | 58.743 | 77.621 | 78.119 | 78.617 | 61.816 | 100.0% | 10 | | -> duration | 35.204 | 54.743 | 73.621 | 74.119 | 74.617 | 57.816 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 168.67225 Full duration: 218.197017 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 26.745 | 34.088 | 54.315 | 54.339 | 54.362 | 40.342 | 100.0% | 10 | | heat.update_stack | 22.615 | 36.868 | 40.626 | 40.716 | 40.805 | 35.205 | 100.0% | 10 | | heat.delete_stack | 22.16 | 37.734 | 44.889 | 45.087 | 45.284 | 36.487 | 100.0% | 10 | | total | 72.159 | 112.797 | 135.381 | 135.881 | 136.381 | 112.034 | 100.0% | 10 | | -> duration | 68.159 | 108.797 | 131.381 | 131.881 | 132.381 | 108.034 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 311.533327 Full duration: 355.964636 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 23.988 | 34.994 | 41.929 | 42.896 | 43.863 | 34.271 | 100.0% | 10 | | heat.update_stack | 11.724 | 21.557 | 25.605 | 26.164 | 26.724 | 20.535 | 100.0% | 10 | | heat.delete_stack | 14.504 | 21.174 | 30.849 | 32.909 | 34.969 | 23.866 | 100.0% | 10 | | total | 62.386 | 77.195 | 92.111 | 93.814 | 95.517 | 78.672 | 100.0% | 10 | | -> duration | 58.386 | 73.195 | 88.111 | 89.814 | 91.517 | 74.672 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 225.317484 Full duration: 269.039846 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 31.792 | 37.656 | 88.01 | 88.555 | 89.1 | 55.0 | 100.0% | 10 | | heat.update_stack | 15.365 | 27.691 | 44.692 | 45.103 | 45.514 | 30.65 | 100.0% | 10 | | heat.delete_stack | 14.269 | 30.138 | 32.108 | 33.348 | 34.589 | 27.678 | 100.0% | 10 | | total | 61.427 | 94.924 | 162.425 | 162.583 | 162.741 | 113.328 | 100.0% | 10 | | -> duration | 57.427 | 90.924 | 158.425 | 158.583 | 158.741 | 109.328 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 316.262874 Full duration: 358.210634 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 15.109 | 25.296 | 41.334 | 41.483 | 41.632 | 28.476 | 100.0% | 10 | | heat.update_stack | 17.215 | 23.967 | 29.014 | 29.453 | 29.892 | 23.563 | 100.0% | 10 | | heat.delete_stack | 9.075 | 14.536 | 20.152 | 20.361 | 20.569 | 15.023 | 100.0% | 10 | | total | 42.292 | 60.555 | 88.172 | 88.382 | 88.592 | 67.062 | 100.0% | 10 | | -> duration | 38.292 | 56.555 | 84.172 | 84.382 | 84.592 | 63.062 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 182.817422 Full duration: 225.098041 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 16.049 | 28.608 | 37.795 | 39.417 | 41.04 | 27.688 | 100.0% | 10 | | heat.check_stack | 3.083 | 4.342 | 9.877 | 10.75 | 11.622 | 6.212 | 100.0% | 10 | | heat.delete_stack | 5.306 | 10.922 | 19.621 | 20.319 | 21.017 | 12.159 | 100.0% | 10 | | total | 26.286 | 38.615 | 68.169 | 68.557 | 68.946 | 46.059 | 100.0% | 10 | | -> duration | 24.286 | 36.615 | 66.169 | 66.557 | 66.946 | 44.059 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 129.573676 Full duration: 169.922233 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 17.067 | 22.561 | 36.104 | 36.903 | 37.702 | 26.507 | 100.0% | 10 | | heat.suspend_stack | 5.874 | 11.678 | 14.519 | 15.395 | 16.27 | 11.534 | 100.0% | 10 | | heat.resume_stack | 5.528 | 9.353 | 12.448 | 12.551 | 12.654 | 9.489 | 100.0% | 10 | | heat.delete_stack | 4.177 | 14.864 | 18.342 | 18.806 | 19.27 | 13.287 | 100.0% | 10 | | total | 40.187 | 59.271 | 74.917 | 75.288 | 75.659 | 60.818 | 100.0% | 10 | | -> duration | 38.187 | 57.271 | 72.917 | 73.288 | 73.659 | 58.818 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 170.17214 Full duration: 211.730497 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 27a81375-ffe7-4dd2-8c03-9afba8708c75 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.551 | 0.858 | 1.216 | 1.243 | 1.269 | 0.899 | 100.0% | 10 | | total | 0.551 | 0.858 | 1.216 | 1.243 | 1.269 | 0.899 | 100.0% | 10 | | -> duration | 0.551 | 0.858 | 1.216 | 1.243 | 1.269 | 0.899 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.3843 Full duration: 34.778633 HINTS: * To plot HTML graphics with this data, run: rally task report 27a81375-ffe7-4dd2-8c03-9afba8708c75 --out output.html * To generate a JUnit report, run: rally task export 27a81375-ffe7-4dd2-8c03-9afba8708c75 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 27a81375-ffe7-4dd2-8c03-9afba8708c75 --json --out output.json 2021-04-07 16:48:15,272 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 27a81375-ffe7-4dd2-8c03-9afba8708c75 --out /home/opnfv/functest/results/rally_full/heat.json 2021-04-07 16:48:15,290 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-04-07 16:48:15,320 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 16:48:15,756 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-04-07 16:57:59,166 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: d17f4d13-6feb-401e-b256-26d81a43ca32 2021-04-07 16:58:00,452 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d17f4d13-6feb-401e-b256-26d81a43ca32 -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.15 | 0.499 | 0.955 | 1.223 | 1.49 | 0.578 | 100.0% | 10 | | keystone_v3.add_role | 0.109 | 0.335 | 0.91 | 0.978 | 1.045 | 0.435 | 100.0% | 10 | | keystone_v3.revoke_role | 0.267 | 0.548 | 0.825 | 1.141 | 1.457 | 0.591 | 100.0% | 10 | | total | 0.881 | 1.585 | 2.179 | 2.19 | 2.201 | 1.604 | 100.0% | 10 | | -> duration | 0.881 | 1.585 | 2.179 | 2.19 | 2.201 | 1.604 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.352705 Full duration: 40.873229 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.182 | 1.097 | 2.268 | 2.653 | 3.039 | 1.195 | 100.0% | 10 | | keystone_v3.add_role | 0.074 | 0.889 | 2.653 | 2.769 | 2.886 | 1.142 | 100.0% | 10 | | keystone_v3.list_roles | 0.113 | 0.129 | 0.287 | 0.88 | 1.474 | 0.264 | 100.0% | 10 | | total | 0.474 | 2.266 | 4.642 | 4.671 | 4.699 | 2.601 | 100.0% | 10 | | -> duration | 0.474 | 2.266 | 4.642 | 4.671 | 4.699 | 2.601 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.584515 Full duration: 47.075054 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.462 | 0.695 | 1.259 | 1.271 | 1.283 | 0.782 | 100.0% | 10 | | keystone_v3.list_projects | 0.102 | 0.134 | 0.143 | 0.148 | 0.152 | 0.13 | 100.0% | 10 | | total | 0.598 | 0.833 | 1.386 | 1.389 | 1.391 | 0.912 | 100.0% | 10 | | -> duration | 0.598 | 0.833 | 1.386 | 1.389 | 1.391 | 0.912 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.663177 Full duration: 39.710222 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.188 | 0.384 | 1.248 | 1.553 | 1.858 | 0.666 | 100.0% | 10 | | keystone_v3.delete_role | 0.101 | 0.349 | 1.054 | 1.14 | 1.227 | 0.524 | 100.0% | 10 | | total | 0.361 | 1.013 | 1.902 | 2.493 | 3.085 | 1.19 | 100.0% | 10 | | -> duration | 0.361 | 1.013 | 1.902 | 2.493 | 3.085 | 1.19 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.176625 Full duration: 35.982646 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.128 | 0.651 | 1.114 | 1.136 | 1.158 | 0.66 | 100.0% | 10 | | keystone_v3.delete_service | 0.124 | 0.327 | 0.36 | 0.387 | 0.414 | 0.286 | 100.0% | 10 | | total | 0.443 | 0.942 | 1.453 | 1.477 | 1.5 | 0.946 | 100.0% | 10 | | -> duration | 0.443 | 0.942 | 1.453 | 1.477 | 1.5 | 0.946 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.665549 Full duration: 31.11354 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.273 | 0.541 | 0.928 | 0.952 | 0.976 | 0.599 | 100.0% | 10 | | keystone_v3.create_user | 0.796 | 1.826 | 2.227 | 2.25 | 2.274 | 1.659 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.051 | 0.073 | 0.219 | 0.318 | 0.417 | 0.124 | 100.0% | 10 | | -> keystone_v3.add_role | 0.308 | 0.578 | 0.833 | 0.962 | 1.091 | 0.604 | 100.0% | 10 | | keystone_v3.create_role | 0.223 | 0.709 | 1.62 | 1.743 | 1.866 | 0.937 | 100.0% | 10 | | keystone_v3.get_project | 0.036 | 0.043 | 0.085 | 0.22 | 0.354 | 0.074 | 100.0% | 10 | | keystone_v3.get_user | 0.029 | 0.046 | 0.459 | 0.88 | 1.301 | 0.201 | 100.0% | 10 | | keystone_v3.get_role | 0.037 | 0.041 | 0.084 | 0.25 | 0.416 | 0.079 | 100.0% | 10 | | keystone_v3.list_services | 0.044 | 0.053 | 0.371 | 0.422 | 0.474 | 0.149 | 100.0% | 10 | | keystone_v3.get_services | 0.034 | 0.042 | 0.936 | 1.236 | 1.535 | 0.273 | 100.0% | 10 | | total | 3.511 | 4.11 | 4.747 | 4.776 | 4.806 | 4.109 | 100.0% | 10 | | -> duration | 3.511 | 4.11 | 4.747 | 4.776 | 4.806 | 4.109 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.707057 Full duration: 64.791179 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.359 | 0.804 | 1.505 | 2.154 | 2.803 | 1.02 | 100.0% | 10 | | keystone_v3.update_project | 0.18 | 0.57 | 1.029 | 1.295 | 1.562 | 0.624 | 100.0% | 10 | | keystone_v3.delete_project | 0.426 | 0.832 | 1.525 | 1.764 | 2.004 | 0.943 | 100.0% | 10 | | total | 1.359 | 2.822 | 3.545 | 3.731 | 3.918 | 2.588 | 100.0% | 10 | | -> duration | 1.359 | 2.822 | 3.545 | 3.731 | 3.918 | 2.588 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.953723 Full duration: 38.957195 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.349 | 0.678 | 1.104 | 1.196 | 1.288 | 0.707 | 100.0% | 10 | | total | 0.433 | 0.76 | 1.196 | 1.353 | 1.51 | 0.818 | 100.0% | 10 | | -> duration | 0.433 | 0.76 | 1.196 | 1.353 | 1.51 | 0.818 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.407896 Full duration: 33.490929 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.556 | 0.735 | 1.464 | 2.086 | 2.708 | 0.962 | 100.0% | 10 | | total | 0.556 | 0.735 | 1.464 | 2.086 | 2.708 | 0.962 | 100.0% | 10 | | -> duration | 0.556 | 0.735 | 1.464 | 2.086 | 2.708 | 0.962 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.806122 Full duration: 33.438746 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.371 | 0.913 | 1.447 | 1.476 | 1.506 | 0.953 | 100.0% | 10 | | keystone_v3.list_users | 0.071 | 0.078 | 0.187 | 0.34 | 0.492 | 0.128 | 100.0% | 10 | | total | 0.531 | 1.244 | 1.612 | 1.639 | 1.665 | 1.198 | 100.0% | 10 | | -> duration | 0.531 | 1.244 | 1.612 | 1.639 | 1.665 | 1.198 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.020928 Full duration: 35.061943 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d17f4d13-6feb-401e-b256-26d81a43ca32 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.22 | 0.734 | 0.959 | 1.138 | 1.317 | 0.694 | 100.0% | 10 | | keystone_v3.create_users | 13.664 | 17.192 | 19.051 | 19.209 | 19.366 | 16.953 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 13.664 | 17.192 | 19.051 | 19.208 | 19.366 | 16.952 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.687 | 0.914 | 2.031 | 2.067 | 2.104 | 1.238 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 4.44 | 6.831 | 7.702 | 7.802 | 7.902 | 6.391 | 100.0% | 10 | | total | 15.189 | 19.027 | 21.197 | 21.509 | 21.821 | 18.88 | 100.0% | 10 | | -> duration | 15.189 | 19.027 | 21.197 | 21.509 | 21.821 | 18.88 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 58.93785 Full duration: 155.040347 HINTS: * To plot HTML graphics with this data, run: rally task report d17f4d13-6feb-401e-b256-26d81a43ca32 --out output.html * To generate a JUnit report, run: rally task export d17f4d13-6feb-401e-b256-26d81a43ca32 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d17f4d13-6feb-401e-b256-26d81a43ca32 --json --out output.json 2021-04-07 16:58:03,550 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d17f4d13-6feb-401e-b256-26d81a43ca32 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-04-07 16:58:03,574 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-04-07 16:58:03,612 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 16:58:04,044 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-04-07 17:15:49,346 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 2d451da4-c9fb-4898-8ac0-2f72214d2c68 2021-04-07 17:15:50,624 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2d451da4-c9fb-4898-8ac0-2f72214d2c68 -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.462 | 3.2 | 3.854 | 3.925 | 3.996 | 3.02 | 100.0% | 10 | | neutron.update_network | 0.93 | 1.347 | 1.949 | 2.067 | 2.186 | 1.388 | 100.0% | 10 | | total | 2.985 | 4.564 | 5.113 | 5.132 | 5.15 | 4.408 | 100.0% | 10 | | -> duration | 2.985 | 4.564 | 5.113 | 5.132 | 5.15 | 4.408 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.632937 Full duration: 65.176271 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.245 | 5.962 | 13.817 | 14.512 | 15.206 | 7.213 | 100.0% | 10 | | neutron.update_port | 1.677 | 2.65 | 6.587 | 6.89 | 7.193 | 3.441 | 100.0% | 10 | | total | 5.293 | 10.936 | 16.545 | 17.288 | 18.03 | 10.654 | 100.0% | 10 | | -> duration | 5.293 | 10.936 | 16.545 | 17.288 | 18.03 | 10.654 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.929427 Full duration: 109.390265 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.138 | 2.791 | 4.055 | 4.255 | 4.456 | 2.733 | 100.0% | 10 | | neutron.create_subnet | 2.112 | 3.713 | 4.301 | 4.666 | 5.031 | 3.564 | 100.0% | 10 | | neutron.update_subnet | 1.199 | 1.425 | 1.679 | 1.685 | 1.691 | 1.455 | 100.0% | 10 | | total | 4.505 | 7.958 | 9.856 | 9.858 | 9.861 | 7.752 | 100.0% | 10 | | -> duration | 4.505 | 7.958 | 9.856 | 9.858 | 9.861 | 7.752 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.703971 Full duration: 76.708068 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.577 | 3.528 | 5.576 | 5.797 | 6.018 | 3.964 | 100.0% | 10 | | neutron.delete_network | 1.27 | 1.621 | 2.019 | 2.167 | 2.316 | 1.651 | 100.0% | 10 | | total | 4.026 | 5.515 | 6.987 | 7.447 | 7.907 | 5.615 | 100.0% | 10 | | -> duration | 4.026 | 5.515 | 6.987 | 7.447 | 7.907 | 5.615 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.006543 Full duration: 57.736462 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.234 | 3.165 | 3.894 | 3.924 | 3.954 | 3.185 | 100.0% | 10 | | neutron.delete_port | 0.94 | 1.135 | 1.748 | 1.953 | 2.158 | 1.318 | 100.0% | 10 | | total | 3.173 | 4.827 | 5.029 | 5.033 | 5.038 | 4.502 | 100.0% | 10 | | -> duration | 3.173 | 4.827 | 5.029 | 5.033 | 5.038 | 4.502 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.770587 Full duration: 77.523926 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.025 | 1.756 | 2.494 | 2.722 | 2.951 | 1.858 | 100.0% | 10 | | neutron.create_subnet | 1.734 | 2.633 | 3.064 | 3.257 | 3.451 | 2.519 | 100.0% | 10 | | neutron.delete_subnet | 0.778 | 1.146 | 1.58 | 1.68 | 1.781 | 1.229 | 100.0% | 10 | | total | 4.071 | 5.989 | 6.517 | 6.849 | 7.18 | 5.607 | 100.0% | 10 | | -> duration | 4.071 | 5.989 | 6.517 | 6.849 | 7.18 | 5.607 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.921327 Full duration: 64.447884 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.29 | 2.183 | 2.802 | 3.062 | 3.322 | 2.171 | 100.0% | 10 | | neutron.list_networks | 0.173 | 0.189 | 0.504 | 0.608 | 0.712 | 0.296 | 100.0% | 10 | | total | 1.575 | 2.52 | 3.278 | 3.391 | 3.503 | 2.466 | 100.0% | 10 | | -> duration | 1.575 | 2.52 | 3.278 | 3.391 | 3.503 | 2.466 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.865069 Full duration: 60.911877 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.797 | 3.823 | 6.799 | 6.985 | 7.171 | 4.474 | 100.0% | 10 | | neutron.list_ports | 0.099 | 0.143 | 0.429 | 0.576 | 0.724 | 0.218 | 100.0% | 10 | | total | 2.953 | 4.117 | 6.945 | 7.118 | 7.29 | 4.692 | 100.0% | 10 | | -> duration | 2.953 | 4.117 | 6.945 | 7.118 | 7.29 | 4.692 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.561373 Full duration: 82.763202 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.97 | 2.889 | 4.668 | 5.08 | 5.491 | 3.305 | 100.0% | 10 | | neutron.create_subnet | 2.953 | 4.409 | 5.503 | 5.601 | 5.698 | 4.374 | 100.0% | 10 | | neutron.list_subnets | 0.085 | 0.252 | 1.006 | 1.128 | 1.251 | 0.431 | 100.0% | 10 | | total | 6.344 | 8.375 | 9.156 | 9.398 | 9.64 | 8.11 | 100.0% | 10 | | -> duration | 6.344 | 8.375 | 9.156 | 9.398 | 9.64 | 8.11 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.440867 Full duration: 77.399347 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.397 | 3.568 | 6.738 | 7.086 | 7.435 | 4.136 | 100.0% | 10 | | neutron.delete_security_group | 0.382 | 0.589 | 0.895 | 1.089 | 1.283 | 0.658 | 100.0% | 10 | | total | 3.249 | 4.188 | 7.953 | 7.996 | 8.039 | 4.793 | 100.0% | 10 | | -> duration | 3.249 | 4.188 | 7.953 | 7.996 | 8.039 | 4.793 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.087642 Full duration: 54.626966 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.025 | 2.098 | 3.41 | 3.846 | 4.281 | 2.329 | 100.0% | 10 | | neutron.create_security_group_rule | 0.7 | 1.365 | 2.126 | 2.459 | 2.791 | 1.526 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.166 | 0.526 | 0.772 | 0.789 | 0.806 | 0.504 | 100.0% | 10 | | neutron.delete_security_group | 0.186 | 0.438 | 1.19 | 1.255 | 1.32 | 0.583 | 100.0% | 10 | | total | 3.52 | 4.498 | 6.806 | 6.977 | 7.148 | 4.941 | 100.0% | 10 | | -> duration | 3.52 | 4.498 | 6.806 | 6.977 | 7.148 | 4.941 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.326943 Full duration: 53.409634 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.723 | 2.379 | 4.071 | 4.294 | 4.516 | 2.661 | 100.0% | 10 | | neutron.create_security_group_rule | 0.718 | 1.917 | 2.509 | 2.535 | 2.561 | 1.852 | 100.0% | 10 | | neutron.list_security_group_rules | 0.074 | 0.349 | 0.825 | 0.948 | 1.07 | 0.434 | 100.0% | 10 | | total | 3.512 | 4.429 | 7.089 | 7.326 | 7.563 | 4.948 | 100.0% | 10 | | -> duration | 3.512 | 4.429 | 7.089 | 7.326 | 7.563 | 4.948 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.534165 Full duration: 61.689872 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.479 | 2.44 | 5.128 | 5.271 | 5.415 | 3.094 | 100.0% | 10 | | neutron.show_security_group | 0.071 | 0.084 | 0.1 | 0.101 | 0.102 | 0.084 | 100.0% | 10 | | total | 1.565 | 2.532 | 5.204 | 5.347 | 5.49 | 3.178 | 100.0% | 10 | | -> duration | 1.565 | 2.532 | 5.204 | 5.347 | 5.49 | 3.178 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.463143 Full duration: 50.959195 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 22.965866 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2d451da4-c9fb-4898-8ac0-2f72214d2c68 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 4.153 | 5.756 | 12.233 | 12.6 | 12.967 | 7.929 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.254 | 0.722 | 1.099 | 1.297 | 1.495 | 0.745 | 100.0% | 10 | | total | 4.755 | 6.77 | 13.007 | 13.114 | 13.221 | 8.675 | 100.0% | 10 | | -> duration | 4.755 | 6.77 | 13.007 | 13.114 | 13.221 | 8.675 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.022737 Full duration: 106.259056 HINTS: * To plot HTML graphics with this data, run: rally task report 2d451da4-c9fb-4898-8ac0-2f72214d2c68 --out output.html * To generate a JUnit report, run: rally task export 2d451da4-c9fb-4898-8ac0-2f72214d2c68 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2d451da4-c9fb-4898-8ac0-2f72214d2c68 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-07 17:15:53,781 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2d451da4-c9fb-4898-8ac0-2f72214d2c68 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-04-07 17:15:53,803 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-04-07 17:15:53,843 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 17:15:54,324 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-04-07 17:31:43,263 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: a7a15411-6974-41dd-a46b-85571d8adc64 2021-04-07 17:31:44,573 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a7a15411-6974-41dd-a46b-85571d8adc64 -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.095 | 1.712 | 2.163 | 2.174 | 2.185 | 1.704 | 100.0% | 10 | | nova.delete_keypair | 0.181 | 0.388 | 0.662 | 0.786 | 0.909 | 0.437 | 100.0% | 10 | | total | 1.379 | 2.083 | 2.825 | 2.96 | 3.094 | 2.141 | 100.0% | 10 | | -> duration | 1.379 | 2.083 | 2.825 | 2.96 | 3.094 | 2.141 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.239591 Full duration: 42.726269 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.974 | 1.533 | 2.314 | 2.435 | 2.557 | 1.613 | 100.0% | 10 | | nova.list_keypairs | 0.031 | 0.04 | 0.061 | 0.061 | 0.061 | 0.044 | 100.0% | 10 | | total | 1.007 | 1.565 | 2.355 | 2.486 | 2.618 | 1.657 | 100.0% | 10 | | -> duration | 1.007 | 1.565 | 2.355 | 2.486 | 2.618 | 1.657 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.813082 Full duration: 40.75646 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 25.921 | 38.425 | 49.802 | 51.545 | 53.287 | 39.166 | 100.0% | 10 | | nova.reboot_server | 10.231 | 14.548 | 18.463 | 18.92 | 19.377 | 14.675 | 100.0% | 10 | | nova.soft_reboot_server | 8.029 | 14.148 | 27.738 | 79.264 | 130.791 | 24.968 | 100.0% | 10 | | nova.stop_and_start_server | 13.231 | 16.147 | 23.839 | 25.275 | 26.71 | 17.662 | 100.0% | 10 | | -> nova.stop_server | 5.655 | 8.32 | 17.594 | 17.837 | 18.08 | 9.518 | 100.0% | 10 | | -> nova.start_server | 5.98 | 7.636 | 10.454 | 10.968 | 11.483 | 8.144 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 16.748 | 27.739 | 35.172 | 38.242 | 41.312 | 27.489 | 100.0% | 10 | | -> nova.rescue_server | 10.01 | 20.326 | 25.761 | 29.419 | 33.077 | 19.639 | 100.0% | 10 | | -> nova.unrescue_server | 5.866 | 7.938 | 9.597 | 9.85 | 10.102 | 7.85 | 100.0% | 10 | | nova.delete_server | 6.466 | 10.68 | 20.46 | 20.752 | 21.043 | 12.897 | 100.0% | 10 | | total | 96.681 | 128.749 | 152.864 | 196.362 | 239.861 | 136.895 | 100.0% | 10 | | -> duration | 87.681 | 119.749 | 143.864 | 187.362 | 230.861 | 127.895 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 360.892596 Full duration: 412.555067 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 37.789 | 50.363 | 55.36 | 55.832 | 56.304 | 48.75 | 100.0% | 10 | | nova.delete_server | 10.993 | 15.61 | 21.067 | 22.917 | 24.767 | 16.657 | 100.0% | 10 | | total | 55.24 | 64.551 | 73.9 | 76.961 | 80.022 | 65.407 | 100.0% | 10 | | -> duration | 54.24 | 63.551 | 72.9 | 75.961 | 79.022 | 64.407 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 186.181776 Full duration: 228.033187 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "image": { "name": "rally_full-img_b69298dc-179c-48ed-a2b1-18ed512aa708" }, "nics": [ { "net-id": "149cc726-e997-4894-b2f1-92969437d6cd" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a7a15411-6974-41dd-a46b-85571d8adc64 has 2 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 10.464 | 40.283 | 45.516 | 46.481 | 47.446 | 35.614 | 80.0% | 10 | | nova.list_servers | 0.387 | 0.409 | 0.469 | 0.504 | 0.539 | 0.425 | 100.0% | 8 | | total | 10.464 | 40.686 | 45.927 | 46.89 | 47.853 | 35.954 | 80.0% | 10 | | -> duration | 9.464 | 39.686 | 44.927 | 45.89 | 46.853 | 34.954 | 80.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 80.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 92.416397 Full duration: 163.07462 HINTS: * To plot HTML graphics with this data, run: rally task report a7a15411-6974-41dd-a46b-85571d8adc64 --out output.html * To generate a JUnit report, run: rally task export a7a15411-6974-41dd-a46b-85571d8adc64 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a7a15411-6974-41dd-a46b-85571d8adc64 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-07 17:31:47,578 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a7a15411-6974-41dd-a46b-85571d8adc64 --out /home/opnfv/functest/results/rally_full/nova.json 2021-04-07 17:31:47,591 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-04-07 17:31:47,617 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 17:31:48,057 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-04-07 17:34:38,715 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 3068a2d9-c248-47e0-8e49-ef92dfd8d237 2021-04-07 17:34:39,941 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3068a2d9-c248-47e0-8e49-ef92dfd8d237 -------------------------------------------------------------------------------- Task 3068a2d9-c248-47e0-8e49-ef92dfd8d237: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3068a2d9-c248-47e0-8e49-ef92dfd8d237 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.61 | 2.953 | 4.213 | 4.285 | 4.357 | 3.099 | 100.0% | 10 | | quotas.delete_quotas | 0.242 | 0.419 | 0.814 | 0.841 | 0.868 | 0.494 | 100.0% | 10 | | total | 1.985 | 3.626 | 4.515 | 4.557 | 4.599 | 3.593 | 100.0% | 10 | | -> duration | 1.985 | 3.626 | 4.515 | 4.557 | 4.599 | 3.593 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.017035 Full duration: 36.654758 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3068a2d9-c248-47e0-8e49-ef92dfd8d237 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 5.378 | 7.265 | 10.62 | 10.737 | 10.855 | 8.038 | 100.0% | 10 | | total | 5.378 | 7.265 | 10.62 | 10.737 | 10.855 | 8.038 | 100.0% | 10 | | -> duration | 5.378 | 7.265 | 10.62 | 10.737 | 10.855 | 8.038 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.413096 Full duration: 48.926001 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3068a2d9-c248-47e0-8e49-ef92dfd8d237 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 7.327 | 10.584 | 17.641 | 18.175 | 18.709 | 11.66 | 100.0% | 10 | | total | 7.327 | 10.584 | 17.641 | 18.175 | 18.709 | 11.66 | 100.0% | 10 | | -> duration | 7.327 | 10.584 | 17.641 | 18.175 | 18.709 | 11.66 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.524023 Full duration: 65.706804 HINTS: * To plot HTML graphics with this data, run: rally task report 3068a2d9-c248-47e0-8e49-ef92dfd8d237 --out output.html * To generate a JUnit report, run: rally task export 3068a2d9-c248-47e0-8e49-ef92dfd8d237 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3068a2d9-c248-47e0-8e49-ef92dfd8d237 --json --out output.json 2021-04-07 17:34:43,022 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3068a2d9-c248-47e0-8e49-ef92dfd8d237 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-04-07 17:34:43,028 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-04-07 17:34:43,059 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-07 17:34:43,221 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-04-07 17:43:37,617 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: fdc4088d-727b-4fde-a645-b32f3155c956 2021-04-07 17:43:38,853 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fdc4088d-727b-4fde-a645-b32f3155c956 -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.876 | 1.087 | 1.309 | 1.575 | 1.842 | 1.15 | 100.0% | 10 | | swift.upload_object (x2) | 0.989 | 1.157 | 1.182 | 1.183 | 1.185 | 1.131 | 100.0% | 10 | | swift.list_objects | 0.993 | 1.028 | 1.057 | 1.062 | 1.067 | 1.028 | 100.0% | 10 | | total | 3.021 | 3.28 | 3.463 | 3.766 | 4.069 | 3.31 | 100.0% | 10 | | -> duration | 3.021 | 3.28 | 3.463 | 3.766 | 4.069 | 3.31 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.155939 Full duration: 98.759331 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.339 | 1.498 | 1.6 | 1.617 | 1.634 | 1.493 | 100.0% | 10 | | swift.list_objects | 0.985 | 1.022 | 1.049 | 1.05 | 1.051 | 1.022 | 100.0% | 10 | | total | 2.372 | 2.505 | 2.615 | 2.617 | 2.618 | 2.514 | 100.0% | 10 | | -> duration | 2.372 | 2.505 | 2.615 | 2.617 | 2.618 | 2.514 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.200373 Full duration: 70.640751 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.931 | 1.047 | 1.168 | 1.18 | 1.193 | 1.053 | 100.0% | 10 | | swift.upload_object (x5) | 2.371 | 2.439 | 2.485 | 2.509 | 2.534 | 2.44 | 100.0% | 10 | | swift.download_object (x5) | 2.169 | 2.204 | 2.237 | 2.268 | 2.299 | 2.211 | 100.0% | 10 | | total | 5.533 | 5.681 | 5.857 | 5.915 | 5.974 | 5.705 | 100.0% | 10 | | -> duration | 5.533 | 5.681 | 5.857 | 5.915 | 5.974 | 5.705 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.107627 Full duration: 130.793284 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.025 | 1.082 | 1.194 | 1.237 | 1.28 | 1.106 | 100.0% | 10 | | swift.upload_object (x5) | 2.876 | 2.945 | 3.016 | 3.025 | 3.034 | 2.944 | 100.0% | 10 | | swift.delete_object (x5) | 2.615 | 2.674 | 2.75 | 2.768 | 2.785 | 2.679 | 100.0% | 10 | | swift.delete_container | 0.573 | 0.655 | 0.68 | 0.681 | 0.682 | 0.644 | 100.0% | 10 | | total | 7.274 | 7.357 | 7.447 | 7.584 | 7.721 | 7.375 | 100.0% | 10 | | -> duration | 7.274 | 7.357 | 7.447 | 7.584 | 7.721 | 7.375 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.809604 Full duration: 108.308122 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdc4088d-727b-4fde-a645-b32f3155c956 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.349 | 1.456 | 1.653 | 1.787 | 1.921 | 1.509 | 100.0% | 10 | | swift.list_objects | 0.956 | 0.98 | 1.026 | 1.05 | 1.074 | 0.992 | 100.0% | 10 | | swift.download_object (x5) | 2.384 | 2.466 | 2.528 | 2.539 | 2.55 | 2.462 | 100.0% | 10 | | total | 4.728 | 4.905 | 5.144 | 5.252 | 5.361 | 4.964 | 100.0% | 10 | | -> duration | 4.728 | 4.905 | 5.144 | 5.252 | 5.361 | 4.964 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.69128 Full duration: 100.769688 HINTS: * To plot HTML graphics with this data, run: rally task report fdc4088d-727b-4fde-a645-b32f3155c956 --out output.html * To generate a JUnit report, run: rally task export fdc4088d-727b-4fde-a645-b32f3155c956 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fdc4088d-727b-4fde-a645-b32f3155c956 --json --out output.json 2021-04-07 17:43:41,966 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fdc4088d-727b-4fde-a645-b32f3155c956 --out /home/opnfv/functest/results/rally_full/swift.json 2021-04-07 17:43:41,983 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-04-07 17:43:41,988 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:22 | 60 | 100.00% | | glance | 00:07:05 | 39 | 89.74% | | cinder | 00:40:42 | 240 | 100.00% | | heat | 00:36:40 | 100 | 100.00% | | keystone | 00:09:15 | 110 | 100.00% | | neutron | 00:17:01 | 140 | 100.00% | | nova | 00:14:47 | 50 | 96.00% | | quotas | 00:02:31 | 30 | 100.00% | | swift | 00:08:29 | 50 | 100.00% | | | | | | | TOTAL: | 02:18:56 | 819 | 99.27% | +----------------+------------+----------------+-----------+ 2021-04-07 17:43:41,988 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.27% in 6/9 modules 2021-04-07 17:43:45,703 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-04-07 17:43:49,127 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-04-07 17:43:49,128 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 146:09 | FAIL | +--------------------+------------------+------------------+----------------+