2021-04-17 15:07:07,878 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | T3XR5RZ6B674 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/T3XR5RZ6B674/airs | | | hip-opnfv-functest-benchmarking-latest-rally_full- | | | run-211 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/T3XR5RZ6B674/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_full-run-211 | +-------------------------+------------------------------------------------------------+ 2021-04-17 15:07:07,898 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2021-04-17 15:07:13,621 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2021-04-17 15:07:18,835 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-04-17 15:07:25,122 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 96601ed4-c35f-48b9-9401-7cf0114a7532 | 2021-04-17T15:07:24.866947 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 96601ed4-c35f-48b9-9401-7cf0114a7532 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-04-17 15:07:29,919 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-04-17 15:07:31,888 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 15:07:32,048 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-04-17 15:10:11,979 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: f837f6e7-900a-4408-9143-c391ffbad41c 2021-04-17 15:10:13,314 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f837f6e7-900a-4408-9143-c391ffbad41c -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.812 | 1.024 | 1.522 | 1.735 | 1.949 | 1.161 | 100.0% | 10 | | total | 0.812 | 1.024 | 1.522 | 1.735 | 1.949 | 1.161 | 100.0% | 10 | | -> duration | 0.812 | 1.024 | 1.522 | 1.735 | 1.949 | 1.161 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.25164 Full duration: 24.524509 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.142 | 0.161 | 0.424 | 0.438 | 0.452 | 0.251 | 100.0% | 10 | | total | 0.534 | 0.88 | 1.146 | 1.269 | 1.391 | 0.899 | 100.0% | 10 | | -> duration | 0.534 | 0.88 | 1.146 | 1.269 | 1.391 | 0.899 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.761928 Full duration: 21.61822 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.207 | 0.334 | 0.494 | 0.547 | 0.599 | 0.344 | 100.0% | 10 | | total | 0.743 | 1.074 | 1.403 | 1.557 | 1.712 | 1.104 | 100.0% | 10 | | -> duration | 0.743 | 1.074 | 1.403 | 1.557 | 1.712 | 1.104 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.245529 Full duration: 23.133164 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.167 | 0.196 | 0.358 | 0.38 | 0.402 | 0.248 | 100.0% | 10 | | total | 0.633 | 0.956 | 1.271 | 1.283 | 1.295 | 0.95 | 100.0% | 10 | | -> duration | 0.633 | 0.956 | 1.271 | 1.283 | 1.295 | 0.95 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.586136 Full duration: 24.505678 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.407 | 0.797 | 1.204 | 1.242 | 1.28 | 0.776 | 100.0% | 10 | | total | 0.848 | 1.415 | 1.658 | 1.717 | 1.776 | 1.363 | 100.0% | 10 | | -> duration | 0.848 | 1.415 | 1.658 | 1.717 | 1.776 | 1.363 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.867511 Full duration: 22.17492 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f837f6e7-900a-4408-9143-c391ffbad41c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.179 | 0.272 | 0.404 | 0.519 | 0.635 | 0.312 | 100.0% | 10 | | total | 0.628 | 0.863 | 1.175 | 1.496 | 1.818 | 0.975 | 100.0% | 10 | | -> duration | 0.628 | 0.863 | 1.175 | 1.496 | 1.818 | 0.975 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.710092 Full duration: 21.454712 HINTS: * To plot HTML graphics with this data, run: rally task report f837f6e7-900a-4408-9143-c391ffbad41c --out output.html * To generate a JUnit report, run: rally task export f837f6e7-900a-4408-9143-c391ffbad41c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f837f6e7-900a-4408-9143-c391ffbad41c --json --out output.json 2021-04-17 15:10:16,444 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f837f6e7-900a-4408-9143-c391ffbad41c --out /home/opnfv/functest/results/rally_full/authenticate.json 2021-04-17 15:10:16,454 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-04-17 15:10:16,485 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 15:10:16,640 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-04-17 15:16:28,607 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 964c828e-de5f-4392-8d20-d2bc71e3a76b 2021-04-17 15:16:29,841 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 964c828e-de5f-4392-8d20-d2bc71e3a76b -------------------------------------------------------------------------------- Task 964c828e-de5f-4392-8d20-d2bc71e3a76b: aborted -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 964c828e-de5f-4392-8d20-d2bc71e3a76b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.596 | 5.191 | 6.233 | 6.448 | 6.663 | 5.374 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.085 | 0.108 | 0.119 | 0.127 | 0.134 | 0.109 | 100.0% | 10 | | -> glance_v2.upload_data | 2.128 | 2.405 | 2.787 | 2.926 | 3.065 | 2.471 | 100.0% | 10 | | glance_v2.delete_image | 1.555 | 2.011 | 2.526 | 2.868 | 3.211 | 2.057 | 100.0% | 10 | | total | 6.383 | 7.018 | 8.673 | 8.84 | 9.007 | 7.431 | 100.0% | 10 | | -> duration | 6.383 | 7.018 | 8.673 | 8.84 | 9.007 | 7.431 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.811114 Full duration: 43.307124 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 964c828e-de5f-4392-8d20-d2bc71e3a76b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.853 | 5.303 | 6.799 | 6.857 | 6.915 | 5.729 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.085 | 0.104 | 0.134 | 0.138 | 0.142 | 0.108 | 100.0% | 10 | | -> glance_v2.upload_data | 2.363 | 2.878 | 4.072 | 4.075 | 4.077 | 3.117 | 100.0% | 10 | | glance_v2.list_images | 0.05 | 0.071 | 0.135 | 0.148 | 0.162 | 0.085 | 100.0% | 10 | | total | 4.93 | 5.39 | 6.896 | 6.938 | 6.981 | 5.815 | 100.0% | 10 | | -> duration | 4.93 | 5.39 | 6.896 | 6.938 | 6.981 | 5.815 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.56492 Full duration: 53.329902 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 964c828e-de5f-4392-8d20-d2bc71e3a76b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.13 | 0.186 | 0.364 | 0.513 | 0.662 | 0.249 | 100.0% | 10 | | total | 0.13 | 0.186 | 0.364 | 0.513 | 0.662 | 0.249 | 100.0% | 10 | | -> duration | 0.13 | 0.186 | 0.364 | 0.513 | 0.662 | 0.249 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.407686 Full duration: 21.635866 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 964c828e-de5f-4392-8d20-d2bc71e3a76b has 3 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run **boot_server_kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers ) for server in servers] File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in ) for server in servers] File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.987 | 6.188 | 6.968 | 7.502 | 8.036 | 6.258 | 100.0% | 9 | | -> glance_v2.get_image (x2) | 0.09 | 0.107 | 0.113 | 0.118 | 0.124 | 0.106 | 100.0% | 9 | | -> glance_v2.upload_data | 2.424 | 2.946 | 4.244 | 4.829 | 5.413 | 3.319 | 100.0% | 9 | | nova.boot_servers | 11.204 | 62.06 | 65.861 | 66.062 | 66.264 | 53.747 | 66.7% | 9 | | total | 17.873 | 67.83 | 72.419 | 73.359 | 74.3 | 60.005 | 66.7% | 9 | | -> duration | 16.873 | 66.83 | 71.419 | 72.359 | 73.3 | 59.005 | 66.7% | 9 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 66.7% | 9 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 149.144116 Full duration: 230.284214 HINTS: * To plot HTML graphics with this data, run: rally task report 964c828e-de5f-4392-8d20-d2bc71e3a76b --out output.html * To generate a JUnit report, run: rally task export 964c828e-de5f-4392-8d20-d2bc71e3a76b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 964c828e-de5f-4392-8d20-d2bc71e3a76b --json --out output.json At least one workload did not pass SLA criteria. 2021-04-17 15:16:32,838 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 964c828e-de5f-4392-8d20-d2bc71e3a76b --out /home/opnfv/functest/results/rally_full/glance.json 2021-04-17 15:16:32,851 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2021-04-17 15:16:32,894 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 15:16:33,297 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-04-17 15:52:54,878 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 2021-04-17 15:52:56,254 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "size": 1, "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.296 | 35.864 | 42.988 | 43.166 | 43.344 | 36.072 | 100.0% | 10 | | cinder_v3.create_volume | 3.185 | 4.061 | 7.868 | 9.837 | 11.807 | 5.388 | 100.0% | 10 | | nova.attach_volume | 4.092 | 12.776 | 20.032 | 23.568 | 27.104 | 13.856 | 100.0% | 10 | | nova.detach_volume | 3.595 | 5.322 | 17.745 | 17.809 | 17.873 | 7.524 | 100.0% | 10 | | cinder_v3.delete_volume | 2.424 | 6.13 | 8.178 | 8.597 | 9.017 | 5.794 | 100.0% | 10 | | nova.delete_server | 5.645 | 10.916 | 13.995 | 15.864 | 17.734 | 10.872 | 100.0% | 10 | | total | 48.009 | 82.731 | 90.276 | 91.282 | 92.288 | 79.507 | 100.0% | 10 | | -> duration | 47.009 | 81.731 | 89.276 | 90.282 | 91.288 | 78.507 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 222.355832 Full duration: 261.081568 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "args": { "detailed": true, "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.6 | 6.649 | 8.789 | 8.947 | 9.105 | 6.462 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.035 | 0.04 | 0.046 | 0.049 | 0.052 | 0.042 | 100.0% | 10 | | total | 3.635 | 6.698 | 8.83 | 8.988 | 9.146 | 6.504 | 100.0% | 10 | | -> duration | 3.635 | 6.698 | 8.83 | 8.988 | 9.146 | 6.504 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.101245 Full duration: 68.690001 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "args": { "detailed": true, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 13.743 | 15.046 | 19.68 | 20.425 | 21.17 | 15.875 | 100.0% | 10 | | cinder_v3.list_volumes | 0.068 | 0.073 | 0.08 | 0.092 | 0.104 | 0.076 | 100.0% | 10 | | total | 13.811 | 15.124 | 19.757 | 20.516 | 21.275 | 15.951 | 100.0% | 10 | | -> duration | 13.811 | 15.124 | 19.757 | 20.516 | 21.275 | 15.951 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.211988 Full duration: 87.282795 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "args": { "detailed": true, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.433 | 7.537 | 8.476 | 8.612 | 8.748 | 7.295 | 100.0% | 10 | | cinder_v3.list_volumes | 0.055 | 0.076 | 0.113 | 0.117 | 0.121 | 0.082 | 100.0% | 10 | | total | 5.5 | 7.636 | 8.549 | 8.676 | 8.803 | 7.377 | 100.0% | 10 | | -> duration | 5.5 | 7.636 | 8.549 | 8.676 | 8.803 | 7.377 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.993583 Full duration: 68.302857 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "raw", "do_delete": true, "force": false, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.906 | 6.585 | 9.892 | 10.316 | 10.739 | 6.418 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 30.375 | 57.287 | 64.851 | 66.362 | 67.873 | 54.008 | 100.0% | 10 | | cinder_v3.delete_volume | 2.365 | 2.582 | 4.861 | 5.861 | 6.861 | 3.557 | 100.0% | 10 | | glance_v2.delete_image | 5.104 | 7.195 | 8.149 | 9.212 | 10.275 | 7.07 | 100.0% | 10 | | total | 41.766 | 75.451 | 84.317 | 84.344 | 84.371 | 71.054 | 100.0% | 10 | | -> duration | 41.766 | 75.451 | 84.317 | 84.344 | 84.371 | 71.054 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 200.898846 Full duration: 240.488922 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "nested_level": 1, "size": { "max": 1, "min": 1 }, "create_vm_params": { "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 21.848 | 31.377 | 37.417 | 37.667 | 37.918 | 30.999 | 100.0% | 10 | | cinder_v3.create_volume | 2.785 | 6.506 | 10.699 | 10.992 | 11.285 | 6.51 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.866 | 5.338 | 9.145 | 9.963 | 10.781 | 5.766 | 100.0% | 10 | | nova.attach_volume | 5.884 | 10.337 | 16.172 | 17.736 | 19.301 | 10.909 | 100.0% | 10 | | nova.detach_volume | 3.584 | 4.184 | 4.843 | 5.278 | 5.712 | 4.289 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.222 | 2.79 | 5.553 | 6.045 | 6.536 | 3.552 | 100.0% | 10 | | cinder_v3.delete_volume | 2.304 | 5.011 | 7.99 | 8.14 | 8.289 | 5.259 | 100.0% | 10 | | nova.delete_server | 6.008 | 11.271 | 14.362 | 14.866 | 15.37 | 11.124 | 100.0% | 10 | | total | 56.799 | 81.363 | 95.166 | 98.449 | 101.733 | 78.409 | 100.0% | 10 | | -> duration | 55.799 | 80.363 | 94.166 | 97.449 | 100.733 | 77.409 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 225.059628 Full duration: 268.52723 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "size": { "min": 1, "max": 1 }, "create_vm_params": { "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.955 | 6.867 | 8.875 | 10.11 | 11.346 | 7.345 | 100.0% | 10 | | cinder_v3.create_snapshot | 3.453 | 4.65 | 6.277 | 8.011 | 9.746 | 5.048 | 100.0% | 10 | | nova.boot_server | 18.371 | 32.087 | 36.903 | 38.871 | 40.84 | 30.893 | 100.0% | 10 | | nova.attach_volume | 5.302 | 10.001 | 15.109 | 17.651 | 20.193 | 10.767 | 100.0% | 10 | | nova.detach_volume | 3.717 | 4.302 | 4.849 | 5.213 | 5.576 | 4.361 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.191 | 3.36 | 4.694 | 4.782 | 4.87 | 3.425 | 100.0% | 10 | | cinder_v3.delete_volume | 2.467 | 2.801 | 4.043 | 4.497 | 4.95 | 3.119 | 100.0% | 10 | | nova.delete_server | 5.05 | 6.738 | 11.052 | 11.954 | 12.856 | 7.459 | 100.0% | 10 | | total | 53.108 | 74.012 | 80.186 | 83.205 | 86.223 | 72.42 | 100.0% | 10 | | -> duration | 52.108 | 73.012 | 79.186 | 82.205 | 85.223 | 71.42 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 206.902665 Full duration: 245.234243 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.685 | 6.071 | 7.403 | 7.404 | 7.405 | 5.824 | 100.0% | 10 | | total | 3.686 | 6.071 | 7.403 | 7.404 | 7.405 | 5.824 | 100.0% | 10 | | -> duration | 3.686 | 6.071 | 7.403 | 7.404 | 7.405 | 5.824 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.133558 Full duration: 50.379319 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "args": { "size": { "min": 1, "max": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.395 | 4.417 | 5.041 | 5.051 | 5.061 | 4.334 | 100.0% | 10 | | total | 3.395 | 4.417 | 5.041 | 5.051 | 5.062 | 4.334 | 100.0% | 10 | | -> duration | 3.395 | 4.417 | 5.041 | 5.051 | 5.062 | 4.334 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.46065 Full duration: 45.909333 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "args": { "detailed": true }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 4 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.599 | 0.687 | 0.996 | 1.021 | 1.045 | 0.769 | 100.0% | 10 | | total | 0.599 | 0.687 | 0.996 | 1.021 | 1.045 | 0.769 | 100.0% | 10 | | -> duration | 0.599 | 0.687 | 0.996 | 1.021 | 1.045 | 0.769 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.169319 Full duration: 76.239794 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.457 | 6.436 | 7.967 | 8.084 | 8.2 | 6.009 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.194 | 4.437 | 4.986 | 5.257 | 5.528 | 3.907 | 100.0% | 10 | | total | 6.069 | 10.559 | 12.622 | 12.721 | 12.819 | 9.916 | 100.0% | 10 | | -> duration | 6.069 | 10.559 | 12.622 | 12.721 | 12.819 | 9.916 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.460708 Full duration: 80.929212 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.485 | 6.933 | 9.559 | 9.61 | 9.661 | 7.05 | 100.0% | 10 | | cinder_v3.delete_volume | 2.79 | 3.554 | 5.514 | 5.776 | 6.039 | 3.959 | 100.0% | 10 | | total | 8.54 | 10.187 | 14.556 | 14.836 | 15.117 | 11.009 | 100.0% | 10 | | -> duration | 8.54 | 10.187 | 14.556 | 14.836 | 15.117 | 11.009 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.989741 Full duration: 62.609297 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.935 | 16.709 | 18.434 | 19.234 | 20.035 | 16.796 | 100.0% | 10 | | cinder_v3.delete_volume | 2.52 | 3.443 | 4.496 | 4.607 | 4.719 | 3.398 | 100.0% | 10 | | total | 17.73 | 20.484 | 21.899 | 22.241 | 22.582 | 20.194 | 100.0% | 10 | | -> duration | 17.73 | 20.484 | 21.899 | 22.241 | 22.582 | 20.194 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.791127 Full duration: 88.92738 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.532 | 5.717 | 12.611 | 12.615 | 12.618 | 7.254 | 100.0% | 10 | | cinder_v3.delete_volume | 2.444 | 4.537 | 6.996 | 9.189 | 11.383 | 5.125 | 100.0% | 10 | | total | 6.914 | 11.349 | 18.527 | 18.714 | 18.901 | 12.379 | 100.0% | 10 | | -> duration | 6.914 | 11.349 | 18.527 | 18.714 | 18.901 | 12.379 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.93243 Full duration: 66.988919 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.4 | 5.862 | 7.329 | 8.265 | 9.201 | 6.172 | 100.0% | 10 | | cinder_v3.extend_volume | 2.863 | 3.797 | 4.99 | 5.28 | 5.571 | 3.859 | 100.0% | 10 | | cinder_v3.delete_volume | 2.705 | 4.822 | 5.68 | 6.772 | 7.863 | 4.733 | 100.0% | 10 | | total | 11.918 | 14.922 | 15.758 | 16.792 | 17.825 | 14.765 | 100.0% | 10 | | -> duration | 11.918 | 14.922 | 15.758 | 16.792 | 17.825 | 14.765 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.729354 Full duration: 72.357993 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.671 | 8.208 | 10.164 | 10.286 | 10.409 | 8.161 | 100.0% | 10 | | cinder_v3.delete_volume | 3.233 | 5.295 | 6.679 | 7.06 | 7.44 | 5.498 | 100.0% | 10 | | total | 11.755 | 13.695 | 15.405 | 15.571 | 15.737 | 13.659 | 100.0% | 10 | | -> duration | 11.755 | 13.695 | 15.405 | 15.571 | 15.737 | 13.659 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.790969 Full duration: 87.947868 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.534 | 0.976 | 1.344 | 1.381 | 1.418 | 1.007 | 100.0% | 10 | | cinder_v3.get_qos | 0.031 | 0.036 | 0.168 | 0.204 | 0.24 | 0.068 | 100.0% | 10 | | total | 0.575 | 1.177 | 1.378 | 1.417 | 1.456 | 1.075 | 100.0% | 10 | | -> duration | 0.575 | 1.177 | 1.378 | 1.417 | 1.456 | 1.075 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.086623 Full duration: 26.245663 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.742 | 1.109 | 1.624 | 1.641 | 1.658 | 1.174 | 100.0% | 10 | | cinder_v3.list_qos | 0.031 | 0.043 | 0.048 | 0.052 | 0.055 | 0.043 | 100.0% | 10 | | total | 0.789 | 1.159 | 1.657 | 1.679 | 1.702 | 1.217 | 100.0% | 10 | | -> duration | 0.789 | 1.159 | 1.657 | 1.679 | 1.702 | 1.217 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.628695 Full duration: 29.417223 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.602 | 0.876 | 0.983 | 1.004 | 1.024 | 0.84 | 100.0% | 10 | | cinder_v3.set_qos | 0.076 | 0.14 | 0.35 | 0.365 | 0.38 | 0.192 | 100.0% | 10 | | total | 0.678 | 1.094 | 1.224 | 1.259 | 1.295 | 1.032 | 100.0% | 10 | | -> duration | 0.678 | 1.094 | 1.224 | 1.259 | 1.295 | 1.032 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.263826 Full duration: 28.56757 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.713 | 1.069 | 2.164 | 2.248 | 2.332 | 1.308 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.03 | 0.034 | 0.038 | 0.039 | 0.04 | 0.034 | 100.0% | 10 | | total | 0.749 | 1.106 | 2.197 | 2.28 | 2.363 | 1.343 | 100.0% | 10 | | -> duration | 0.749 | 1.106 | 2.197 | 2.28 | 2.363 | 1.343 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.870493 Full duration: 31.323953 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.673 | 0.885 | 0.92 | 0.938 | 0.956 | 0.828 | 100.0% | 10 | | cinder_v3.list_types | 0.04 | 0.057 | 0.062 | 0.063 | 0.064 | 0.054 | 100.0% | 10 | | total | 0.713 | 0.937 | 0.982 | 0.992 | 1.002 | 0.882 | 100.0% | 10 | | -> duration | 0.713 | 0.937 | 0.982 | 0.992 | 1.002 | 0.882 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.535606 Full duration: 31.808531 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "args": { "description": "test", "update_description": "test update" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.671 | 1.392 | 1.954 | 2.027 | 2.1 | 1.373 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.093 | 0.478 | 0.801 | 0.82 | 0.839 | 0.462 | 100.0% | 10 | | total | 0.777 | 2.029 | 2.632 | 2.786 | 2.94 | 1.836 | 100.0% | 10 | | -> duration | 0.777 | 2.029 | 2.632 | 2.786 | 2.94 | 1.836 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.312369 Full duration: 36.27294 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.676 | 1.139 | 2.117 | 2.151 | 2.186 | 1.365 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.084 | 0.243 | 0.315 | 0.331 | 0.347 | 0.208 | 100.0% | 10 | | total | 0.891 | 1.382 | 2.203 | 2.246 | 2.289 | 1.573 | 100.0% | 10 | | -> duration | 0.891 | 1.382 | 2.203 | 2.246 | 2.289 | 1.573 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.6775 Full duration: 31.137156 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.727 | 0.851 | 1.057 | 1.129 | 1.2 | 0.886 | 100.0% | 10 | | cinder_v2.add_type_access | 0.136 | 0.269 | 1.095 | 1.104 | 1.113 | 0.532 | 100.0% | 10 | | cinder_v2.list_type_access | 0.037 | 0.041 | 0.052 | 0.054 | 0.056 | 0.043 | 100.0% | 10 | | total | 0.94 | 1.41 | 2.017 | 2.018 | 2.018 | 1.461 | 100.0% | 10 | | -> duration | 0.94 | 1.41 | 2.017 | 2.018 | 2.018 | 1.461 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.596032 Full duration: 29.824148 HINTS: * To plot HTML graphics with this data, run: rally task report f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 --out output.html * To generate a JUnit report, run: rally task export f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 --json --out output.json 2021-04-17 15:52:59,487 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f4ecd4b0-03e8-4ece-8ba2-94f18bcd9243 --out /home/opnfv/functest/results/rally_full/cinder.json 2021-04-17 15:52:59,603 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-04-17 15:52:59,632 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 15:53:00,012 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-04-17 16:28:06,273 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 2021-04-17 16:28:07,526 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.609 | 7.486 | 8.447 | 8.683 | 8.919 | 7.48 | 100.0% | 10 | | heat.list_stacks | 0.047 | 0.06 | 0.066 | 0.067 | 0.068 | 0.059 | 100.0% | 10 | | total | 5.675 | 7.544 | 8.5 | 8.733 | 8.966 | 7.54 | 100.0% | 10 | | -> duration | 3.675 | 5.544 | 6.5 | 6.733 | 6.966 | 5.54 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.824695 Full duration: 77.804524 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.887 | 20.35 | 30.366 | 30.584 | 30.802 | 21.423 | 100.0% | 10 | | heat.update_stack | 12.39 | 21.31 | 24.731 | 26.68 | 28.629 | 20.33 | 100.0% | 10 | | heat.delete_stack | 9.95 | 16.783 | 22.545 | 22.789 | 23.033 | 17.465 | 100.0% | 10 | | total | 45.047 | 57.876 | 70.501 | 73.144 | 75.788 | 59.218 | 100.0% | 10 | | -> duration | 41.047 | 53.876 | 66.501 | 69.144 | 71.788 | 55.218 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 167.624257 Full duration: 205.897204 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 17.497 | 24.167 | 33.233 | 33.326 | 33.419 | 26.014 | 100.0% | 10 | | heat.update_stack | 5.921 | 14.332 | 15.492 | 15.654 | 15.817 | 12.745 | 100.0% | 10 | | heat.delete_stack | 4.327 | 12.626 | 15.41 | 16.658 | 17.907 | 11.703 | 100.0% | 10 | | total | 32.687 | 53.404 | 59.238 | 60.493 | 61.748 | 50.462 | 100.0% | 10 | | -> duration | 28.687 | 49.404 | 55.238 | 56.493 | 57.748 | 46.462 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 136.746202 Full duration: 180.124838 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 30.449 | 32.701 | 52.381 | 53.597 | 54.814 | 37.326 | 100.0% | 10 | | heat.update_stack | 10.17 | 24.033 | 42.712 | 44.335 | 45.957 | 28.439 | 100.0% | 10 | | heat.delete_stack | 13.157 | 34.096 | 39.679 | 40.499 | 41.318 | 31.806 | 100.0% | 10 | | total | 75.437 | 90.126 | 116.913 | 121.138 | 125.364 | 97.571 | 100.0% | 10 | | -> duration | 71.437 | 86.126 | 112.913 | 117.138 | 121.364 | 93.571 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 274.16592 Full duration: 317.705899 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 32.417 | 37.39 | 43.535 | 44.762 | 45.99 | 37.626 | 100.0% | 10 | | heat.update_stack | 26.044 | 27.796 | 29.98 | 31.635 | 33.291 | 28.116 | 100.0% | 10 | | heat.delete_stack | 20.538 | 31.796 | 48.943 | 49.864 | 50.785 | 35.012 | 100.0% | 10 | | total | 87.827 | 95.493 | 116.383 | 118.382 | 120.381 | 100.755 | 100.0% | 10 | | -> duration | 83.827 | 91.493 | 112.383 | 114.382 | 116.381 | 96.755 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 292.808796 Full duration: 339.012745 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 33.53 | 38.247 | 65.995 | 66.998 | 68.0 | 47.247 | 100.0% | 10 | | heat.update_stack | 20.112 | 28.479 | 37.413 | 39.919 | 42.424 | 30.108 | 100.0% | 10 | | heat.delete_stack | 12.288 | 33.666 | 37.363 | 38.338 | 39.314 | 30.606 | 100.0% | 10 | | total | 72.0 | 101.652 | 133.891 | 135.679 | 137.467 | 107.961 | 100.0% | 10 | | -> duration | 68.0 | 97.652 | 129.891 | 131.679 | 133.467 | 103.961 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 302.116771 Full duration: 344.618575 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 21.267 | 27.66 | 31.006 | 31.096 | 31.185 | 26.893 | 100.0% | 10 | | heat.update_stack | 9.496 | 23.926 | 24.925 | 25.003 | 25.081 | 20.76 | 100.0% | 10 | | heat.delete_stack | 10.512 | 14.531 | 17.705 | 18.154 | 18.603 | 14.538 | 100.0% | 10 | | total | 42.898 | 66.422 | 69.384 | 70.217 | 71.049 | 62.191 | 100.0% | 10 | | -> duration | 38.898 | 62.422 | 65.384 | 66.217 | 67.049 | 58.191 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 168.827003 Full duration: 215.570207 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 19.136 | 22.141 | 25.106 | 26.399 | 27.692 | 22.119 | 100.0% | 10 | | heat.check_stack | 3.081 | 6.935 | 8.358 | 8.432 | 8.507 | 6.649 | 100.0% | 10 | | heat.delete_stack | 5.604 | 11.921 | 14.701 | 14.934 | 15.167 | 11.197 | 100.0% | 10 | | total | 31.12 | 40.517 | 45.219 | 46.676 | 48.133 | 39.965 | 100.0% | 10 | | -> duration | 29.12 | 38.517 | 43.219 | 44.676 | 46.133 | 37.965 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 111.370914 Full duration: 146.705014 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.95 | 22.149 | 27.274 | 27.524 | 27.774 | 21.129 | 100.0% | 10 | | heat.suspend_stack | 2.847 | 11.327 | 14.019 | 14.101 | 14.182 | 10.445 | 100.0% | 10 | | heat.resume_stack | 5.098 | 8.502 | 10.66 | 12.17 | 13.679 | 8.45 | 100.0% | 10 | | heat.delete_stack | 5.716 | 12.004 | 13.243 | 15.242 | 17.24 | 10.89 | 100.0% | 10 | | total | 34.931 | 47.961 | 62.621 | 65.045 | 67.469 | 50.915 | 100.0% | 10 | | -> duration | 32.931 | 45.961 | 60.621 | 63.045 | 65.469 | 48.915 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 142.212532 Full duration: 176.396505 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.561 | 0.825 | 1.493 | 1.744 | 1.995 | 1.011 | 100.0% | 10 | | total | 0.561 | 0.825 | 1.493 | 1.744 | 1.995 | 1.011 | 100.0% | 10 | | -> duration | 0.561 | 0.825 | 1.493 | 1.744 | 1.995 | 1.011 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.040623 Full duration: 31.363096 HINTS: * To plot HTML graphics with this data, run: rally task report 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 --out output.html * To generate a JUnit report, run: rally task export 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 --json --out output.json 2021-04-17 16:28:10,630 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6c8f62c1-e8ed-424e-b3cc-c30cbd3c5310 --out /home/opnfv/functest/results/rally_full/heat.json 2021-04-17 16:28:10,649 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-04-17 16:28:10,679 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 16:28:11,203 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-04-17 16:36:59,945 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 2021-04-17 16:37:01,202 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.188 | 0.654 | 1.127 | 1.204 | 1.28 | 0.667 | 100.0% | 10 | | keystone_v3.add_role | 0.08 | 0.636 | 0.893 | 1.095 | 1.297 | 0.574 | 100.0% | 10 | | keystone_v3.revoke_role | 0.163 | 0.534 | 0.741 | 0.901 | 1.062 | 0.504 | 100.0% | 10 | | total | 0.6 | 1.901 | 2.383 | 2.5 | 2.617 | 1.746 | 100.0% | 10 | | -> duration | 0.6 | 1.901 | 2.383 | 2.5 | 2.617 | 1.746 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.336829 Full duration: 41.547612 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.101 | 0.471 | 1.29 | 1.691 | 2.093 | 0.677 | 100.0% | 10 | | keystone_v3.add_role | 0.169 | 0.317 | 0.551 | 0.585 | 0.62 | 0.344 | 100.0% | 10 | | keystone_v3.list_roles | 0.098 | 0.128 | 0.147 | 0.168 | 0.189 | 0.129 | 100.0% | 10 | | total | 0.409 | 0.879 | 1.902 | 2.34 | 2.778 | 1.15 | 100.0% | 10 | | -> duration | 0.409 | 0.879 | 1.902 | 2.34 | 2.778 | 1.15 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.470875 Full duration: 39.352253 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.229 | 0.385 | 0.66 | 0.672 | 0.685 | 0.432 | 100.0% | 10 | | keystone_v3.list_projects | 0.122 | 0.132 | 0.204 | 0.21 | 0.215 | 0.151 | 100.0% | 10 | | total | 0.353 | 0.56 | 0.814 | 0.843 | 0.872 | 0.584 | 100.0% | 10 | | -> duration | 0.353 | 0.56 | 0.814 | 0.843 | 0.872 | 0.584 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.937405 Full duration: 35.362604 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.113 | 0.404 | 1.474 | 2.082 | 2.69 | 0.708 | 100.0% | 10 | | keystone_v3.delete_role | 0.1 | 0.28 | 0.405 | 0.506 | 0.608 | 0.286 | 100.0% | 10 | | total | 0.358 | 0.748 | 1.607 | 2.273 | 2.938 | 0.995 | 100.0% | 10 | | -> duration | 0.358 | 0.748 | 1.607 | 2.273 | 2.938 | 0.995 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.426443 Full duration: 31.680866 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.099 | 0.414 | 1.019 | 1.069 | 1.119 | 0.538 | 100.0% | 10 | | keystone_v3.delete_service | 0.129 | 0.348 | 0.716 | 0.862 | 1.008 | 0.407 | 100.0% | 10 | | total | 0.367 | 0.727 | 1.669 | 1.68 | 1.691 | 0.944 | 100.0% | 10 | | -> duration | 0.367 | 0.727 | 1.669 | 1.68 | 1.691 | 0.944 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.130366 Full duration: 30.703444 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.237 | 0.656 | 1.504 | 1.613 | 1.722 | 0.759 | 100.0% | 10 | | keystone_v3.create_user | 0.519 | 1.602 | 3.025 | 3.062 | 3.099 | 1.753 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.045 | 0.053 | 0.069 | 0.107 | 0.144 | 0.062 | 100.0% | 10 | | -> keystone_v3.add_role | 0.1 | 0.489 | 1.086 | 1.628 | 2.171 | 0.649 | 100.0% | 10 | | keystone_v3.create_role | 0.075 | 0.24 | 0.543 | 0.61 | 0.677 | 0.301 | 100.0% | 10 | | keystone_v3.get_project | 0.036 | 0.041 | 0.122 | 0.126 | 0.129 | 0.063 | 100.0% | 10 | | keystone_v3.get_user | 0.037 | 0.04 | 0.079 | 0.189 | 0.3 | 0.067 | 100.0% | 10 | | keystone_v3.get_role | 0.032 | 0.038 | 0.251 | 0.351 | 0.45 | 0.1 | 100.0% | 10 | | keystone_v3.list_services | 0.043 | 0.056 | 0.79 | 0.855 | 0.921 | 0.257 | 100.0% | 10 | | keystone_v3.get_services | 0.031 | 0.038 | 0.144 | 0.259 | 0.373 | 0.079 | 100.0% | 10 | | total | 1.278 | 3.64 | 4.92 | 4.999 | 5.077 | 3.498 | 100.0% | 10 | | -> duration | 1.278 | 3.64 | 4.92 | 4.999 | 5.077 | 3.498 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.030926 Full duration: 59.853655 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.284 | 1.104 | 1.898 | 2.053 | 2.208 | 1.211 | 100.0% | 10 | | keystone_v3.update_project | 0.156 | 0.332 | 0.544 | 0.554 | 0.564 | 0.335 | 100.0% | 10 | | keystone_v3.delete_project | 0.186 | 0.609 | 1.215 | 1.403 | 1.591 | 0.711 | 100.0% | 10 | | total | 1.116 | 2.599 | 2.83 | 2.901 | 2.972 | 2.257 | 100.0% | 10 | | -> duration | 1.116 | 2.599 | 2.83 | 2.901 | 2.972 | 2.257 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.128938 Full duration: 39.413578 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.459 | 0.754 | 1.204 | 1.244 | 1.285 | 0.822 | 100.0% | 10 | | total | 0.532 | 0.832 | 1.285 | 1.327 | 1.368 | 0.937 | 100.0% | 10 | | -> duration | 0.532 | 0.832 | 1.285 | 1.327 | 1.368 | 0.937 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.806451 Full duration: 31.969702 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.298 | 0.571 | 1.06 | 1.253 | 1.447 | 0.697 | 100.0% | 10 | | total | 0.298 | 0.571 | 1.06 | 1.253 | 1.447 | 0.697 | 100.0% | 10 | | -> duration | 0.298 | 0.571 | 1.06 | 1.253 | 1.447 | 0.697 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.359851 Full duration: 30.40729 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.231 | 0.496 | 0.787 | 0.796 | 0.806 | 0.519 | 100.0% | 10 | | keystone_v3.list_users | 0.073 | 0.078 | 0.108 | 0.207 | 0.306 | 0.102 | 100.0% | 10 | | total | 0.395 | 0.649 | 0.976 | 1.021 | 1.067 | 0.698 | 100.0% | 10 | | -> duration | 0.395 | 0.649 | 0.976 | 1.021 | 1.067 | 0.698 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.483176 Full duration: 27.637391 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.491 | 1.608 | 2.287 | 2.453 | 2.62 | 1.492 | 100.0% | 10 | | keystone_v3.create_users | 9.372 | 16.172 | 18.504 | 18.943 | 19.383 | 15.672 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 9.371 | 16.172 | 18.503 | 18.943 | 19.383 | 15.672 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.534 | 0.802 | 3.796 | 3.875 | 3.955 | 1.52 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 3.18 | 5.341 | 8.508 | 9.109 | 9.711 | 6.047 | 100.0% | 10 | | total | 10.569 | 19.055 | 21.673 | 21.929 | 22.184 | 18.258 | 100.0% | 10 | | -> duration | 10.569 | 19.055 | 21.673 | 21.929 | 22.184 | 18.258 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.88563 Full duration: 136.390761 HINTS: * To plot HTML graphics with this data, run: rally task report 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 --out output.html * To generate a JUnit report, run: rally task export 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 --json --out output.json 2021-04-17 16:37:04,324 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8a9008dc-79d1-4d9b-b00f-f0b0fae27270 --out /home/opnfv/functest/results/rally_full/keystone.json 2021-04-17 16:37:04,347 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-04-17 16:37:04,384 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 16:37:04,841 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-04-17 16:53:37,406 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: a8a31f47-9299-4486-9b0c-9f14be1f91d1 2021-04-17 16:53:38,773 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a8a31f47-9299-4486-9b0c-9f14be1f91d1 -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.65 | 2.549 | 3.435 | 4.188 | 4.941 | 2.734 | 100.0% | 10 | | neutron.update_network | 1.015 | 1.52 | 1.817 | 1.932 | 2.047 | 1.476 | 100.0% | 10 | | total | 3.106 | 4.204 | 5.008 | 5.482 | 5.956 | 4.21 | 100.0% | 10 | | -> duration | 3.106 | 4.204 | 5.008 | 5.482 | 5.956 | 4.21 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.333996 Full duration: 61.02571 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.922 | 3.327 | 4.679 | 4.705 | 4.731 | 3.311 | 100.0% | 10 | | neutron.update_port | 0.657 | 1.5 | 1.912 | 1.952 | 1.993 | 1.417 | 100.0% | 10 | | total | 3.297 | 4.34 | 6.354 | 6.383 | 6.412 | 4.729 | 100.0% | 10 | | -> duration | 3.297 | 4.34 | 6.354 | 6.383 | 6.412 | 4.729 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.295706 Full duration: 81.692476 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.977 | 4.052 | 4.875 | 5.097 | 5.32 | 3.725 | 100.0% | 10 | | neutron.create_subnet | 2.211 | 3.33 | 4.346 | 4.357 | 4.369 | 3.334 | 100.0% | 10 | | neutron.update_subnet | 0.672 | 1.49 | 1.842 | 2.089 | 2.336 | 1.432 | 100.0% | 10 | | total | 4.672 | 9.065 | 10.323 | 10.405 | 10.487 | 8.491 | 100.0% | 10 | | -> duration | 4.672 | 9.065 | 10.323 | 10.405 | 10.487 | 8.491 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.906364 Full duration: 76.588716 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.238 | 2.267 | 3.252 | 3.275 | 3.297 | 2.338 | 100.0% | 10 | | neutron.delete_network | 1.141 | 1.551 | 1.746 | 1.799 | 1.851 | 1.523 | 100.0% | 10 | | total | 2.592 | 3.837 | 4.781 | 4.864 | 4.947 | 3.862 | 100.0% | 10 | | -> duration | 2.592 | 3.837 | 4.781 | 4.864 | 4.947 | 3.862 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.689194 Full duration: 45.889565 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.374 | 3.99 | 9.354 | 9.389 | 9.425 | 5.328 | 100.0% | 10 | | neutron.delete_port | 0.725 | 1.58 | 2.061 | 3.063 | 4.065 | 1.615 | 100.0% | 10 | | total | 4.094 | 5.834 | 11.113 | 11.123 | 11.133 | 6.944 | 100.0% | 10 | | -> duration | 4.094 | 5.834 | 11.113 | 11.123 | 11.133 | 6.944 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.464422 Full duration: 81.270577 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.427 | 2.536 | 3.645 | 4.268 | 4.891 | 2.749 | 100.0% | 10 | | neutron.create_subnet | 1.645 | 2.814 | 3.643 | 3.673 | 3.702 | 2.772 | 100.0% | 10 | | neutron.delete_subnet | 0.926 | 1.778 | 2.354 | 2.568 | 2.783 | 1.765 | 100.0% | 10 | | total | 4.229 | 7.644 | 8.399 | 8.611 | 8.823 | 7.288 | 100.0% | 10 | | -> duration | 4.229 | 7.644 | 8.399 | 8.611 | 8.823 | 7.288 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.202207 Full duration: 68.931336 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.148 | 3.595 | 4.835 | 4.866 | 4.897 | 3.67 | 100.0% | 10 | | neutron.list_networks | 0.158 | 0.285 | 0.958 | 1.297 | 1.637 | 0.463 | 100.0% | 10 | | total | 2.582 | 4.55 | 5.103 | 5.154 | 5.204 | 4.133 | 100.0% | 10 | | -> duration | 2.582 | 4.55 | 5.103 | 5.154 | 5.204 | 4.133 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.640425 Full duration: 58.785351 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.224 | 4.339 | 5.943 | 5.949 | 5.955 | 4.273 | 100.0% | 10 | | neutron.list_ports | 0.126 | 0.244 | 0.427 | 0.485 | 0.542 | 0.264 | 100.0% | 10 | | total | 2.35 | 4.757 | 6.166 | 6.179 | 6.192 | 4.537 | 100.0% | 10 | | -> duration | 2.35 | 4.757 | 6.166 | 6.179 | 6.192 | 4.537 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.505797 Full duration: 77.118826 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.541 | 2.494 | 3.188 | 3.73 | 4.272 | 2.593 | 100.0% | 10 | | neutron.create_subnet | 1.164 | 2.416 | 2.813 | 2.933 | 3.053 | 2.253 | 100.0% | 10 | | neutron.list_subnets | 0.084 | 0.115 | 0.274 | 0.588 | 0.901 | 0.204 | 100.0% | 10 | | total | 2.799 | 5.346 | 6.043 | 6.44 | 6.837 | 5.051 | 100.0% | 10 | | -> duration | 2.799 | 5.346 | 6.043 | 6.44 | 6.837 | 5.051 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.597681 Full duration: 68.548456 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.208 | 3.004 | 4.052 | 4.234 | 4.416 | 3.112 | 100.0% | 10 | | neutron.delete_security_group | 0.398 | 0.682 | 1.61 | 1.78 | 1.95 | 0.912 | 100.0% | 10 | | total | 3.142 | 4.052 | 4.83 | 4.86 | 4.889 | 4.024 | 100.0% | 10 | | -> duration | 3.142 | 4.052 | 4.83 | 4.86 | 4.889 | 4.024 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.125905 Full duration: 52.904307 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.571 | 3.462 | 4.482 | 4.942 | 5.402 | 3.365 | 100.0% | 10 | | neutron.create_security_group_rule | 0.509 | 3.5 | 4.865 | 4.942 | 5.019 | 3.217 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.244 | 0.749 | 1.755 | 2.4 | 3.045 | 0.954 | 100.0% | 10 | | neutron.delete_security_group | 0.294 | 0.49 | 0.939 | 1.15 | 1.362 | 0.578 | 100.0% | 10 | | total | 3.201 | 9.189 | 9.877 | 10.222 | 10.567 | 8.114 | 100.0% | 10 | | -> duration | 3.201 | 9.189 | 9.877 | 10.222 | 10.567 | 8.114 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.274827 Full duration: 62.564463 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.145 | 3.074 | 3.654 | 3.862 | 4.071 | 2.745 | 100.0% | 10 | | neutron.create_security_group_rule | 0.724 | 1.669 | 2.749 | 3.177 | 3.605 | 1.792 | 100.0% | 10 | | neutron.list_security_group_rules | 0.073 | 0.104 | 0.494 | 0.766 | 1.038 | 0.241 | 100.0% | 10 | | total | 2.981 | 4.836 | 5.553 | 6.663 | 7.773 | 4.777 | 100.0% | 10 | | -> duration | 2.981 | 4.836 | 5.553 | 6.663 | 7.773 | 4.777 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.26879 Full duration: 54.439205 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.916 | 2.496 | 3.526 | 3.637 | 3.749 | 2.358 | 100.0% | 10 | | neutron.show_security_group | 0.06 | 0.079 | 0.132 | 0.222 | 0.312 | 0.105 | 100.0% | 10 | | total | 1.028 | 2.69 | 3.599 | 3.71 | 3.821 | 2.463 | 100.0% | 10 | | -> duration | 1.028 | 2.69 | 3.599 | 3.71 | 3.821 | 2.463 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.419842 Full duration: 51.976918 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "args": { "ports_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 18.804404 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a8a31f47-9299-4486-9b0c-9f14be1f91d1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 5.013 | 6.6 | 7.642 | 8.033 | 8.425 | 6.474 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.19 | 0.727 | 1.572 | 2.252 | 2.932 | 0.885 | 100.0% | 10 | | total | 6.104 | 7.783 | 8.27 | 8.475 | 8.68 | 7.359 | 100.0% | 10 | | -> duration | 6.104 | 7.783 | 8.27 | 8.475 | 8.68 | 7.359 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.037655 Full duration: 89.4031 HINTS: * To plot HTML graphics with this data, run: rally task report a8a31f47-9299-4486-9b0c-9f14be1f91d1 --out output.html * To generate a JUnit report, run: rally task export a8a31f47-9299-4486-9b0c-9f14be1f91d1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a8a31f47-9299-4486-9b0c-9f14be1f91d1 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-17 16:53:41,925 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a8a31f47-9299-4486-9b0c-9f14be1f91d1 --out /home/opnfv/functest/results/rally_full/neutron.json 2021-04-17 16:53:41,947 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2021-04-17 16:53:41,987 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 16:53:42,420 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-04-17 17:08:34,257 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: ad6d5449-9fee-446e-8419-22eb095ffa21 2021-04-17 17:08:35,554 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ad6d5449-9fee-446e-8419-22eb095ffa21 -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.833 | 1.359 | 1.553 | 1.558 | 1.564 | 1.273 | 100.0% | 10 | | nova.delete_keypair | 0.068 | 0.257 | 0.388 | 0.456 | 0.523 | 0.244 | 100.0% | 10 | | total | 1.108 | 1.522 | 1.907 | 1.916 | 1.925 | 1.517 | 100.0% | 10 | | -> duration | 1.108 | 1.522 | 1.907 | 1.916 | 1.925 | 1.517 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.43726 Full duration: 29.697183 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "args": {}, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.015 | 1.328 | 1.58 | 1.606 | 1.632 | 1.3 | 100.0% | 10 | | nova.list_keypairs | 0.033 | 0.04 | 0.046 | 0.065 | 0.084 | 0.043 | 100.0% | 10 | | total | 1.055 | 1.388 | 1.615 | 1.64 | 1.666 | 1.343 | 100.0% | 10 | | -> duration | 1.055 | 1.388 | 1.615 | 1.64 | 1.666 | 1.343 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.844646 Full duration: 41.300508 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "args": { "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ], "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 22.153 | 28.961 | 31.428 | 31.675 | 31.922 | 27.949 | 100.0% | 10 | | nova.reboot_server | 7.251 | 13.131 | 28.328 | 28.732 | 29.135 | 14.91 | 100.0% | 10 | | nova.soft_reboot_server | 10.551 | 12.748 | 133.488 | 134.331 | 135.174 | 37.56 | 100.0% | 10 | | nova.stop_and_start_server | 11.848 | 19.789 | 25.051 | 27.231 | 29.412 | 19.245 | 100.0% | 10 | | -> nova.stop_server | 5.196 | 6.724 | 17.079 | 17.292 | 17.506 | 10.288 | 100.0% | 10 | | -> nova.start_server | 6.132 | 7.56 | 13.029 | 14.004 | 14.98 | 8.958 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 13.665 | 20.554 | 32.342 | 53.473 | 74.604 | 25.642 | 100.0% | 10 | | -> nova.rescue_server | 7.612 | 11.227 | 24.143 | 45.781 | 67.419 | 18.016 | 100.0% | 10 | | -> nova.unrescue_server | 4.99 | 7.527 | 8.924 | 9.378 | 9.832 | 7.626 | 100.0% | 10 | | nova.delete_server | 5.214 | 7.927 | 14.875 | 16.571 | 18.267 | 9.338 | 100.0% | 10 | | total | 91.843 | 115.161 | 217.22 | 218.417 | 219.614 | 134.705 | 100.0% | 10 | | -> duration | 82.843 | 106.161 | 208.22 | 209.417 | 210.614 | 125.705 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 430.910847 Full duration: 475.29529 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 23.171 | 27.983 | 35.702 | 37.964 | 40.226 | 29.314 | 100.0% | 10 | | nova.delete_server | 4.993 | 9.08 | 14.834 | 15.665 | 16.495 | 9.968 | 100.0% | 10 | | total | 29.535 | 37.304 | 49.679 | 49.764 | 49.849 | 39.282 | 100.0% | 10 | | -> duration | 28.535 | 36.304 | 48.679 | 48.764 | 48.849 | 38.282 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 111.291312 Full duration: 150.075757 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "args": { "detailed": true, "flavor": { "name": "rally_full-flavor_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "image": { "name": "rally_full-img_0410cee5-455d-4631-99a8-ccb71a6a824c" }, "nics": [ { "net-id": "19d26fc0-5852-4c41-ad34-ca849223814d" } ] }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ad6d5449-9fee-446e-8419-22eb095ffa21 has 2 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status fault="Status in failure list %s" % str(failure_statuses)) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: Status in failure list {'ERROR'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-17T17:07:43Z', 'message': 'No valid host was found. There are not enough hosts available.'} Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 64, in run server = self._boot_server(image, flavor, **kwargs) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) rally.exceptions.GetResourceErrorStatus: Resource has ERROR status. Fault: {'code': 500, 'created': '2021-04-17T17:07:43Z', 'message': 'No valid host was found. There are not enough hosts available.'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 2.842 | 32.591 | 42.255 | 43.816 | 45.377 | 30.096 | 80.0% | 10 | | nova.list_servers | 0.374 | 0.473 | 0.616 | 0.646 | 0.676 | 0.49 | 100.0% | 8 | | total | 2.842 | 33.181 | 42.677 | 44.322 | 45.967 | 30.489 | 80.0% | 10 | | -> duration | 1.842 | 32.181 | 41.677 | 43.322 | 44.967 | 29.489 | 80.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 80.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.223054 Full duration: 136.971437 HINTS: * To plot HTML graphics with this data, run: rally task report ad6d5449-9fee-446e-8419-22eb095ffa21 --out output.html * To generate a JUnit report, run: rally task export ad6d5449-9fee-446e-8419-22eb095ffa21 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ad6d5449-9fee-446e-8419-22eb095ffa21 --json --out output.json At least one workload did not pass SLA criteria. 2021-04-17 17:08:38,499 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ad6d5449-9fee-446e-8419-22eb095ffa21 --out /home/opnfv/functest/results/rally_full/nova.json 2021-04-17 17:08:38,512 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-04-17 17:08:38,539 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 17:08:39,008 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-04-17 17:10:22,096 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 3700aef9-6173-4adc-82a0-d893a6cddf46 2021-04-17 17:10:23,331 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3700aef9-6173-4adc-82a0-d893a6cddf46 -------------------------------------------------------------------------------- Task 3700aef9-6173-4adc-82a0-d893a6cddf46: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3700aef9-6173-4adc-82a0-d893a6cddf46 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.345 | 1.648 | 2.471 | 2.687 | 2.902 | 1.916 | 100.0% | 10 | | quotas.delete_quotas | 0.039 | 0.115 | 0.334 | 0.355 | 0.377 | 0.172 | 100.0% | 10 | | total | 1.651 | 1.727 | 2.787 | 2.864 | 2.941 | 2.088 | 100.0% | 10 | | -> duration | 1.651 | 1.727 | 2.787 | 2.864 | 2.941 | 2.088 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.904921 Full duration: 22.586643 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3700aef9-6173-4adc-82a0-d893a6cddf46 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.754 | 1.079 | 1.784 | 1.784 | 1.785 | 1.224 | 100.0% | 10 | | total | 0.755 | 1.079 | 1.784 | 1.785 | 1.785 | 1.224 | 100.0% | 10 | | -> duration | 0.755 | 1.079 | 1.784 | 1.785 | 1.785 | 1.224 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.575229 Full duration: 24.245057 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3700aef9-6173-4adc-82a0-d893a6cddf46 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 3.156 | 5.023 | 6.236 | 6.253 | 6.27 | 5.015 | 100.0% | 10 | | total | 3.156 | 5.023 | 6.236 | 6.253 | 6.27 | 5.016 | 100.0% | 10 | | -> duration | 3.156 | 5.023 | 6.236 | 6.253 | 6.27 | 5.016 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.821618 Full duration: 35.727851 HINTS: * To plot HTML graphics with this data, run: rally task report 3700aef9-6173-4adc-82a0-d893a6cddf46 --out output.html * To generate a JUnit report, run: rally task export 3700aef9-6173-4adc-82a0-d893a6cddf46 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3700aef9-6173-4adc-82a0-d893a6cddf46 --json --out output.json 2021-04-17 17:10:26,308 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3700aef9-6173-4adc-82a0-d893a6cddf46 --out /home/opnfv/functest/results/rally_full/quotas.json 2021-04-17 17:10:26,314 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-04-17 17:10:26,344 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-04-17 17:10:26,516 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-04-17 17:18:46,082 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: f5a3aeb3-fe90-4173-b40e-08132b984681 2021-04-17 17:18:47,302 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f5a3aeb3-fe90-4173-b40e-08132b984681 -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.978 | 1.096 | 1.207 | 1.335 | 1.462 | 1.12 | 100.0% | 10 | | swift.upload_object (x2) | 1.026 | 1.105 | 1.133 | 1.165 | 1.197 | 1.099 | 100.0% | 10 | | swift.list_objects | 0.988 | 1.013 | 1.043 | 1.044 | 1.044 | 1.019 | 100.0% | 10 | | total | 2.996 | 3.251 | 3.351 | 3.478 | 3.606 | 3.24 | 100.0% | 10 | | -> duration | 2.996 | 3.251 | 3.351 | 3.478 | 3.606 | 3.24 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.460659 Full duration: 90.239012 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.373 | 1.437 | 1.616 | 1.625 | 1.634 | 1.482 | 100.0% | 10 | | swift.list_objects | 0.985 | 1.011 | 1.046 | 1.049 | 1.052 | 1.016 | 100.0% | 10 | | total | 2.372 | 2.468 | 2.611 | 2.619 | 2.627 | 2.498 | 100.0% | 10 | | -> duration | 2.372 | 2.468 | 2.611 | 2.619 | 2.627 | 2.498 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.039341 Full duration: 71.850825 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.873 | 1.103 | 1.206 | 1.213 | 1.221 | 1.088 | 100.0% | 10 | | swift.upload_object (x5) | 2.535 | 2.659 | 2.72 | 2.727 | 2.734 | 2.654 | 100.0% | 10 | | swift.download_object (x5) | 2.39 | 2.464 | 2.518 | 2.524 | 2.53 | 2.464 | 100.0% | 10 | | total | 5.799 | 6.243 | 6.343 | 6.359 | 6.375 | 6.208 | 100.0% | 10 | | -> duration | 5.799 | 6.243 | 6.343 | 6.359 | 6.375 | 6.208 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 62.133171 Full duration: 126.46801 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.984 | 1.137 | 1.215 | 1.231 | 1.247 | 1.112 | 100.0% | 10 | | swift.upload_object (x5) | 2.585 | 2.735 | 2.836 | 2.881 | 2.926 | 2.728 | 100.0% | 10 | | swift.delete_object (x5) | 2.382 | 2.502 | 2.617 | 2.625 | 2.632 | 2.51 | 100.0% | 10 | | swift.delete_container | 0.533 | 0.594 | 0.609 | 0.616 | 0.624 | 0.586 | 100.0% | 10 | | total | 6.584 | 6.924 | 7.118 | 7.194 | 7.27 | 6.938 | 100.0% | 10 | | -> duration | 6.584 | 6.924 | 7.118 | 7.194 | 7.27 | 6.938 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.435699 Full duration: 104.25253 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 10 }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5a3aeb3-fe90-4173-b40e-08132b984681 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.397 | 1.473 | 1.632 | 1.645 | 1.658 | 1.504 | 100.0% | 10 | | swift.list_objects | 0.857 | 1.006 | 1.04 | 1.064 | 1.088 | 0.992 | 100.0% | 10 | | swift.download_object (x5) | 2.377 | 2.493 | 2.522 | 2.523 | 2.525 | 2.479 | 100.0% | 10 | | total | 4.786 | 4.939 | 5.149 | 5.183 | 5.218 | 4.975 | 100.0% | 10 | | -> duration | 4.786 | 4.939 | 5.149 | 5.183 | 5.218 | 4.975 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.806185 Full duration: 87.751945 HINTS: * To plot HTML graphics with this data, run: rally task report f5a3aeb3-fe90-4173-b40e-08132b984681 --out output.html * To generate a JUnit report, run: rally task export f5a3aeb3-fe90-4173-b40e-08132b984681 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f5a3aeb3-fe90-4173-b40e-08132b984681 --json --out output.json 2021-04-17 17:18:50,274 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f5a3aeb3-fe90-4173-b40e-08132b984681 --out /home/opnfv/functest/results/rally_full/swift.json 2021-04-17 17:18:50,289 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-04-17 17:18:50,292 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:02:17 | 60 | 100.00% | | glance | 00:05:48 | 39 | 92.31% | | cinder | 00:35:16 | 240 | 100.00% | | heat | 00:33:55 | 100 | 100.00% | | keystone | 00:08:24 | 110 | 100.00% | | neutron | 00:15:49 | 140 | 100.00% | | nova | 00:13:53 | 50 | 96.00% | | quotas | 00:01:22 | 30 | 100.00% | | swift | 00:08:00 | 50 | 100.00% | | | | | | | TOTAL: | 02:04:48 | 819 | 99.39% | +----------------+------------+----------------+-----------+ 2021-04-17 17:18:50,292 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.39% in 6/9 modules 2021-04-17 17:18:54,002 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2021-04-17 17:18:57,492 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2021-04-17 17:18:57,493 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 131:43 | FAIL | +--------------------+------------------+------------------+----------------+