2020-12-08 12:38:33,444 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+------------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+------------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | true |
| DEPLOY_SCENARIO | ovs |
| INSTALLER_TYPE | airship |
| BUILD_TAG | WR7HM1BV0NA2 |
| NODE_NAME | intel-pod17 |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results |
| S3_ENDPOINT_URL | https://storage.googleapis.com |
| S3_DST_URL | s3://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airs |
| | hip-opnfv-functest-benchmarking-latest-rally_full- |
| | run-185 |
| HTTP_DST_URL | http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/ai |
| | rship-opnfv-functest-benchmarking-latest- |
| | rally_full-run-185 |
+-------------------------+------------------------------------------------------------+
2020-12-08 12:38:33,463 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'...
2020-12-08 12:38:38,136 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'...
2020-12-08 12:38:48,551 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-12-08 12:38:55,058 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid | created_at | name | status | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 956d4e29-17bb-4d80-9c39-5c5f977bbaca | 2020-12-08T12:38:54.785505 | opnfv-rally | deploy->finished | |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 956d4e29-17bb-4d80-9c39-5c5f977bbaca
~/.rally/openrc was updated
HINTS:
* To use standard OpenStack clients, set up your env by running:
source ~/.rally/openrc
OpenStack clients are now configured, e.g run:
openstack image list
2020-12-08 12:39:00,040 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------
Available services:
+-------------+----------------+-----------+
| Service | Service Type | Status |
+-------------+----------------+-----------+
| __unknown__ | placement | Available |
| cinder | volume | Available |
| cinder | volumev2 | Available |
| cinder | volumev3 | Available |
| cloud | cloudformation | Available |
| glance | image | Available |
| heat | orchestration | Available |
| keystone | identity | Available |
| neutron | network | Available |
| nova | compute | Available |
| swift | object-store | Available |
+-------------+----------------+-----------+
2020-12-08 12:39:01,927 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 12:39:02,079 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ...
2020-12-08 12:41:57,811 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: a0156202-37d1-4c77-80f0-f9b1a14076e2
2020-12-08 12:41:59,033 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a0156202-37d1-4c77-80f0-f9b1a14076e2
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2: finished
--------------------------------------------------------------------------------
test scenario Authenticate.keystone
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.keystone | 0.831 | 1.385 | 1.903 | 1.972 | 2.041 | 1.402 | 100.0% | 10 |
| total | 0.831 | 1.385 | 1.903 | 1.972 | 2.041 | 1.402 | 100.0% | 10 |
| -> duration | 0.831 | 1.385 | 1.903 | 1.972 | 2.041 | 1.402 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.927333
Full duration: 26.432695
--------------------------------------------------------------------------------
test scenario Authenticate.validate_cinder
args position 0
args values:
{
"args": {
"repetitions": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_cinder | 0.132 | 0.164 | 0.326 | 0.341 | 0.355 | 0.199 | 100.0% | 10 |
| total | 0.649 | 0.929 | 1.292 | 1.535 | 1.778 | 1.0 | 100.0% | 10 |
| -> duration | 0.649 | 0.929 | 1.292 | 1.535 | 1.778 | 1.0 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.018305
Full duration: 23.267578
--------------------------------------------------------------------------------
test scenario Authenticate.validate_glance
args position 0
args values:
{
"args": {
"repetitions": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_glance | 0.222 | 0.323 | 0.415 | 0.454 | 0.494 | 0.324 | 100.0% | 10 |
| total | 0.7 | 0.938 | 1.012 | 1.076 | 1.14 | 0.916 | 100.0% | 10 |
| -> duration | 0.7 | 0.938 | 1.012 | 1.076 | 1.14 | 0.916 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.653157
Full duration: 25.852759
--------------------------------------------------------------------------------
test scenario Authenticate.validate_heat
args position 0
args values:
{
"args": {
"repetitions": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_heat | 0.156 | 0.176 | 0.338 | 0.454 | 0.57 | 0.24 | 100.0% | 10 |
| total | 0.6 | 0.982 | 1.432 | 1.483 | 1.533 | 1.009 | 100.0% | 10 |
| -> duration | 0.6 | 0.982 | 1.432 | 1.483 | 1.533 | 1.009 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.965304
Full duration: 23.467912
--------------------------------------------------------------------------------
test scenario Authenticate.validate_neutron
args position 0
args values:
{
"args": {
"repetitions": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_neutron | 0.433 | 0.588 | 0.992 | 1.009 | 1.026 | 0.693 | 100.0% | 10 |
| total | 1.06 | 1.459 | 1.52 | 1.531 | 1.543 | 1.367 | 100.0% | 10 |
| -> duration | 1.06 | 1.459 | 1.52 | 1.531 | 1.543 | 1.367 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.049765
Full duration: 26.371555
--------------------------------------------------------------------------------
test scenario Authenticate.validate_nova
args position 0
args values:
{
"args": {
"repetitions": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a0156202-37d1-4c77-80f0-f9b1a14076e2 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_nova | 0.166 | 0.19 | 0.272 | 0.298 | 0.323 | 0.215 | 100.0% | 10 |
| total | 0.59 | 0.936 | 1.518 | 1.733 | 1.948 | 1.047 | 100.0% | 10 |
| -> duration | 0.59 | 0.936 | 1.518 | 1.733 | 1.948 | 1.047 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.968155
Full duration: 24.664445
HINTS:
* To plot HTML graphics with this data, run:
rally task report a0156202-37d1-4c77-80f0-f9b1a14076e2 --out output.html
* To generate a JUnit report, run:
rally task export a0156202-37d1-4c77-80f0-f9b1a14076e2 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report a0156202-37d1-4c77-80f0-f9b1a14076e2 --json --out output.json
2020-12-08 12:42:02,024 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a0156202-37d1-4c77-80f0-f9b1a14076e2 --out /home/opnfv/functest/results/rally_full/authenticate.json
2020-12-08 12:42:02,035 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK.
2020-12-08 12:42:02,065 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 12:42:02,212 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ...
2020-12-08 12:52:52,073 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 40dfad99-421b-4df6-bbf5-5372c4736721
2020-12-08 12:52:53,297 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 40dfad99-421b-4df6-bbf5-5372c4736721
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721: aborted
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_delete_image
args position 0
args values:
{
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 5.104 | 6.521 | 12.304 | 12.323 | 12.342 | 7.871 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.093 | 0.102 | 0.108 | 0.11 | 0.111 | 0.102 | 100.0% | 10 |
| -> glance_v2.upload_data | 2.632 | 3.658 | 8.597 | 8.598 | 8.599 | 4.811 | 100.0% | 10 |
| glance_v2.delete_image | 2.05 | 2.376 | 4.223 | 4.652 | 5.082 | 2.825 | 100.0% | 10 |
| total | 7.98 | 9.687 | 14.41 | 14.479 | 14.549 | 10.696 | 100.0% | 10 |
| -> duration | 7.98 | 9.687 | 14.41 | 14.479 | 14.549 | 10.696 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 32.691161
Full duration: 59.71485
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_list_image
args position 0
args values:
{
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 4.926 | 5.312 | 6.296 | 6.338 | 6.38 | 5.495 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.089 | 0.1 | 0.143 | 0.145 | 0.146 | 0.111 | 100.0% | 10 |
| -> glance_v2.upload_data | 2.401 | 2.708 | 3.323 | 3.39 | 3.457 | 2.814 | 100.0% | 10 |
| glance_v2.list_images | 0.053 | 0.063 | 0.076 | 0.08 | 0.084 | 0.066 | 100.0% | 10 |
| total | 4.98 | 5.378 | 6.358 | 6.405 | 6.451 | 5.561 | 100.0% | 10 |
| -> duration | 4.98 | 5.378 | 6.358 | 6.405 | 6.451 | 5.561 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 19.152587
Full duration: 47.169598
--------------------------------------------------------------------------------
test scenario GlanceImages.list_images
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.list_images | 0.126 | 0.205 | 0.422 | 0.496 | 0.57 | 0.251 | 100.0% | 10 |
| total | 0.126 | 0.206 | 0.422 | 0.496 | 0.57 | 0.252 | 100.0% | 10 |
| -> duration | 0.126 | 0.206 | 0.422 | 0.496 | 0.57 | 0.252 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.266374
Full duration: 23.957967
--------------------------------------------------------------------------------
test scenario GlanceImages.create_image_and_boot_instances
args position 0
args values:
{
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img",
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"number_instances": 2,
"boot_server_kwargs": {
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 6.228 | 7.132 | 10.667 | 12.249 | 13.83 | 8.225 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.094 | 0.106 | 0.185 | 0.194 | 0.202 | 0.124 | 100.0% | 10 |
| -> glance_v2.upload_data | 2.948 | 3.774 | 6.392 | 7.363 | 8.334 | 4.414 | 100.0% | 10 |
| nova.boot_servers | 65.031 | 89.503 | 98.884 | 98.918 | 98.953 | 88.222 | 100.0% | 10 |
| total | 74.689 | 96.82 | 105.938 | 107.604 | 109.269 | 96.448 | 100.0% | 10 |
| -> duration | 73.689 | 95.82 | 104.938 | 106.604 | 108.269 | 95.448 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 291.606488
Full duration: 447.635768
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_deactivate_image
args position 0
args values:
{
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 40dfad99-421b-4df6-bbf5-5372c4736721 has 5 error(s)
--------------------------------------------------------------------------------
HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run
service.deactivate_image(image.id)
File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image
self._clients.glance("2").images.deactivate(image_id)
File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate
resp, body = self.http_client.post(url)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
--------------------------------------------------------------------------------
HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run
service.deactivate_image(image.id)
File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image
self._clients.glance("2").images.deactivate(image_id)
File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate
resp, body = self.http_client.post(url)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
--------------------------------------------------------------------------------
HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run
service.deactivate_image(image.id)
File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image
self._clients.glance("2").images.deactivate(image_id)
File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate
resp, body = self.http_client.post(url)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
--------------------------------------------------------------------------------
HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run
service.deactivate_image(image.id)
File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image
self._clients.glance("2").images.deactivate(image_id)
File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate
resp, body = self.http_client.post(url)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
--------------------------------------------------------------------------------
HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 337, in run
service.deactivate_image(image.id)
File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_v2.py", line 157, in deactivate_image
self._clients.glance("2").images.deactivate(image_id)
File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 371, in deactivate
resp, body = self.http_client.post(url)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPForbidden: HTTP 403 Forbidden: You are not authorized to complete deactivate action.
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 5.093 | 5.631 | 6.169 | 6.314 | 6.458 | 5.616 | 100.0% | 5 |
| -> glance_v2.get_image (x2) | 0.097 | 0.101 | 0.171 | 0.194 | 0.217 | 0.123 | 100.0% | 5 |
| -> glance_v2.upload_data | 2.588 | 3.21 | 3.663 | 3.76 | 3.857 | 3.138 | 100.0% | 5 |
| glance_v2.deactivate_image | 0.033 | 0.041 | 0.048 | 0.049 | 0.051 | 0.041 | 0.0% | 5 |
| total | 5.134 | 5.67 | 6.217 | 6.363 | 6.509 | 5.658 | 0.0% | 5 |
| -> duration | 5.134 | 5.67 | 6.217 | 6.363 | 6.509 | 5.658 | 0.0% | 5 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 5 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 11.633873
Full duration: 44.459158
HINTS:
* To plot HTML graphics with this data, run:
rally task report 40dfad99-421b-4df6-bbf5-5372c4736721 --out output.html
* To generate a JUnit report, run:
rally task export 40dfad99-421b-4df6-bbf5-5372c4736721 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 40dfad99-421b-4df6-bbf5-5372c4736721 --json --out output.json
At least one workload did not pass SLA criteria.
2020-12-08 12:52:56,343 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 40dfad99-421b-4df6-bbf5-5372c4736721 --out /home/opnfv/functest/results/rally_full/glance.json
2020-12-08 12:52:56,425 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed.
2020-12-08 12:52:56,458 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 12:52:56,824 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ...
2020-12-08 13:44:03,977 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: a5ca7645-88fd-4631-a6f1-c0a52ae796ad
2020-12-08 13:44:05,247 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a5ca7645-88fd-4631-a6f1-c0a52ae796ad
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad: finished
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_attach_volume
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"size": 1,
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 54.119 | 60.533 | 72.977 | 75.036 | 77.095 | 62.809 | 100.0% | 10 |
| cinder_v3.create_volume | 4.501 | 7.127 | 18.05 | 18.543 | 19.037 | 9.89 | 100.0% | 10 |
| nova.attach_volume | 10.888 | 28.046 | 30.512 | 32.944 | 35.376 | 25.171 | 100.0% | 10 |
| nova.detach_volume | 3.844 | 5.202 | 6.314 | 7.031 | 7.748 | 5.2 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.667 | 6.698 | 9.908 | 13.391 | 16.873 | 7.032 | 100.0% | 10 |
| nova.delete_server | 10.104 | 32.986 | 38.163 | 44.503 | 50.844 | 31.01 | 100.0% | 10 |
| total | 107.324 | 147.429 | 160.107 | 160.242 | 160.376 | 141.114 | 100.0% | 10 |
| -> duration | 106.324 | 146.429 | 159.107 | 159.242 | 159.376 | 140.114 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 430.089896
Full duration: 468.362986
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_snapshots
args position 0
args values:
{
"args": {
"detailed": true,
"force": false
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
},
"volumes": {
"size": 1,
"volumes_per_tenant": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 3.452 | 5.757 | 8.751 | 8.818 | 8.886 | 5.994 | 100.0% | 10 |
| cinder_v3.list_snapshots | 0.039 | 0.043 | 0.046 | 0.046 | 0.047 | 0.043 | 100.0% | 10 |
| total | 3.498 | 5.801 | 8.794 | 8.861 | 8.927 | 6.037 | 100.0% | 10 |
| -> duration | 3.498 | 5.801 | 8.794 | 8.861 | 8.927 | 6.037 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 15.62103
Full duration: 81.017127
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 0
args values:
{
"args": {
"detailed": true,
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 18.761 | 25.151 | 33.791 | 33.982 | 34.174 | 27.258 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.058 | 0.071 | 0.08 | 0.084 | 0.088 | 0.071 | 100.0% | 10 |
| total | 18.821 | 25.222 | 33.859 | 34.056 | 34.253 | 27.33 | 100.0% | 10 |
| -> duration | 18.821 | 25.222 | 33.859 | 34.056 | 34.253 | 27.33 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 77.550331
Full duration: 127.393693
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 1
args values:
{
"args": {
"detailed": true,
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 6.793 | 9.897 | 12.184 | 13.145 | 14.106 | 9.995 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.066 | 0.073 | 0.083 | 0.086 | 0.09 | 0.075 | 100.0% | 10 |
| total | 6.873 | 9.972 | 12.255 | 13.226 | 14.197 | 10.07 | 100.0% | 10 |
| -> duration | 6.873 | 9.972 | 12.255 | 13.226 | 14.197 | 10.07 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 28.289563
Full duration: 83.258262
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_upload_volume_to_image
args position 0
args values:
{
"args": {
"container_format": "bare",
"disk_format": "raw",
"do_delete": true,
"force": false,
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.079 | 6.174 | 8.359 | 8.528 | 8.697 | 5.797 | 100.0% | 10 |
| cinder_v3.upload_volume_to_image | 26.164 | 42.546 | 44.772 | 44.897 | 45.022 | 39.834 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.357 | 2.848 | 4.464 | 4.511 | 4.559 | 3.122 | 100.0% | 10 |
| glance_v2.delete_image | 5.252 | 6.053 | 7.044 | 7.182 | 7.32 | 6.206 | 100.0% | 10 |
| total | 39.966 | 57.807 | 61.256 | 61.287 | 61.319 | 54.959 | 100.0% | 10 |
| -> duration | 39.966 | 57.807 | 61.256 | 61.287 | 61.319 | 54.959 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 160.193216
Full duration: 191.658652
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nested_level": 1,
"size": {
"max": 1,
"min": 1
},
"create_vm_params": {
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 32.294 | 44.013 | 48.37 | 49.968 | 51.567 | 43.337 | 100.0% | 10 |
| cinder_v3.create_volume | 3.817 | 7.709 | 19.878 | 20.606 | 21.335 | 11.188 | 100.0% | 10 |
| cinder_v3.create_snapshot | 3.83 | 6.591 | 12.594 | 13.494 | 14.393 | 7.111 | 100.0% | 10 |
| nova.attach_volume | 10.77 | 16.71 | 25.14 | 25.361 | 25.582 | 18.164 | 100.0% | 10 |
| nova.detach_volume | 3.714 | 4.659 | 7.188 | 7.897 | 8.607 | 5.364 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.231 | 4.659 | 5.554 | 5.561 | 5.569 | 4.279 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.265 | 6.628 | 9.275 | 9.728 | 10.182 | 6.125 | 100.0% | 10 |
| nova.delete_server | 7.958 | 14.782 | 17.652 | 18.681 | 19.711 | 14.29 | 100.0% | 10 |
| total | 82.754 | 99.506 | 139.089 | 140.511 | 141.934 | 109.859 | 100.0% | 10 |
| -> duration | 81.754 | 98.506 | 138.089 | 139.511 | 140.934 | 108.859 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 314.389773
Full duration: 361.363557
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_snapshot_and_attach_volume
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"size": {
"min": 1,
"max": 1
},
"create_vm_params": {
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 8.724 | 19.052 | 32.586 | 35.232 | 37.879 | 19.967 | 100.0% | 10 |
| cinder_v3.create_snapshot | 2.951 | 9.681 | 17.322 | 17.88 | 18.437 | 10.241 | 100.0% | 10 |
| nova.boot_server | 20.754 | 45.163 | 53.526 | 54.249 | 54.971 | 43.446 | 100.0% | 10 |
| nova.attach_volume | 5.759 | 11.793 | 24.741 | 28.315 | 31.889 | 15.433 | 100.0% | 10 |
| nova.detach_volume | 3.651 | 5.463 | 10.682 | 10.898 | 11.115 | 6.525 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.197 | 4.584 | 5.286 | 5.943 | 6.6 | 4.457 | 100.0% | 10 |
| cinder_v3.delete_volume | 3.279 | 6.679 | 11.67 | 13.71 | 15.75 | 8.051 | 100.0% | 10 |
| nova.delete_server | 14.496 | 23.66 | 30.708 | 36.338 | 41.968 | 23.668 | 100.0% | 10 |
| total | 77.288 | 133.539 | 160.622 | 162.092 | 163.563 | 131.788 | 100.0% | 10 |
| -> duration | 76.288 | 132.539 | 159.622 | 161.092 | 162.563 | 130.788 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 369.191719
Full duration: 419.704108
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 0
args values:
{
"args": {
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 8.777 | 12.804 | 24.866 | 25.528 | 26.189 | 14.621 | 100.0% | 10 |
| total | 8.777 | 12.804 | 24.866 | 25.528 | 26.189 | 14.621 | 100.0% | 10 |
| -> duration | 8.777 | 12.804 | 24.866 | 25.528 | 26.189 | 14.621 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 47.885048
Full duration: 112.341131
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 1
args values:
{
"args": {
"size": {
"min": 1,
"max": 1
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 7.647 | 9.161 | 9.626 | 9.717 | 9.809 | 8.944 | 100.0% | 10 |
| total | 7.647 | 9.161 | 9.626 | 9.717 | 9.809 | 8.944 | 100.0% | 10 |
| -> duration | 7.647 | 9.161 | 9.626 | 9.717 | 9.809 | 8.944 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 26.222578
Full duration: 96.221132
--------------------------------------------------------------------------------
test scenario CinderVolumes.list_volumes
args position 0
args values:
{
"args": {
"detailed": true
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
},
"volumes": {
"size": 1,
"volumes_per_tenant": 4
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.list_volumes | 0.599 | 0.735 | 1.155 | 1.161 | 1.167 | 0.828 | 100.0% | 10 |
| total | 0.6 | 0.735 | 1.155 | 1.161 | 1.167 | 0.828 | 100.0% | 10 |
| -> duration | 0.6 | 0.735 | 1.155 | 1.161 | 1.167 | 0.828 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.254048
Full duration: 120.915606
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_snapshot
args position 0
args values:
{
"args": {
"force": false
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
},
"volumes": {
"size": 1,
"volumes_per_tenant": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 7.251 | 11.177 | 21.145 | 22.071 | 22.997 | 12.259 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 3.013 | 7.882 | 9.376 | 11.153 | 12.93 | 7.714 | 100.0% | 10 |
| total | 13.445 | 17.196 | 28.683 | 30.331 | 31.978 | 19.973 | 100.0% | 10 |
| -> duration | 13.445 | 17.196 | 28.683 | 30.331 | 31.978 | 19.973 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 55.083413
Full duration: 117.638014
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
"args": {
"size": {
"max": 1,
"min": 1
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.187 | 19.002 | 24.733 | 25.964 | 27.194 | 18.458 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.554 | 16.169 | 19.001 | 19.305 | 19.61 | 14.782 | 100.0% | 10 |
| total | 21.424 | 34.918 | 38.658 | 40.3 | 41.942 | 33.241 | 100.0% | 10 |
| -> duration | 21.424 | 34.918 | 38.658 | 40.3 | 41.942 | 33.241 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 93.158757
Full duration: 141.660614
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 1
args values:
{
"args": {
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 14.282 | 21.006 | 28.77 | 28.862 | 28.953 | 21.894 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.362 | 3.674 | 5.176 | 6.236 | 7.295 | 4.092 | 100.0% | 10 |
| total | 21.236 | 24.037 | 32.333 | 32.336 | 32.339 | 25.986 | 100.0% | 10 |
| -> duration | 21.236 | 24.037 | 32.333 | 32.336 | 32.339 | 25.986 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 77.651304
Full duration: 108.036529
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 2
args values:
{
"args": {
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 5.613 | 12.393 | 23.2 | 25.153 | 27.107 | 14.418 | 100.0% | 10 |
| cinder_v3.delete_volume | 3.222 | 5.038 | 6.039 | 6.156 | 6.274 | 4.832 | 100.0% | 10 |
| total | 9.72 | 16.382 | 28.397 | 29.363 | 30.33 | 19.251 | 100.0% | 10 |
| -> duration | 9.72 | 16.382 | 28.397 | 29.363 | 30.33 | 19.251 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 56.29138
Full duration: 92.054899
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_extend_volume
args position 0
args values:
{
"args": {
"new_size": 2,
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 5.293 | 6.626 | 18.317 | 19.942 | 21.567 | 9.936 | 100.0% | 10 |
| cinder_v3.extend_volume | 4.731 | 7.842 | 10.204 | 10.715 | 11.225 | 7.667 | 100.0% | 10 |
| cinder_v3.delete_volume | 3.558 | 6.938 | 11.634 | 13.745 | 15.855 | 8.205 | 100.0% | 10 |
| total | 15.994 | 22.867 | 36.013 | 36.562 | 37.11 | 25.809 | 100.0% | 10 |
| -> duration | 15.994 | 22.867 | 36.013 | 36.562 | 37.11 | 25.809 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 73.047856
Full duration: 102.968867
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_from_volume_and_delete_volume
args position 0
args values:
{
"args": {
"size": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"cinder": {
"gigabytes": -1,
"snapshots": -1,
"volumes": -1
}
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
},
"volumes": {
"size": 1,
"volumes_per_tenant": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 6.266 | 8.751 | 11.882 | 12.302 | 12.723 | 9.417 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.368 | 7.134 | 10.518 | 10.88 | 11.242 | 7.186 | 100.0% | 10 |
| total | 10.604 | 16.106 | 20.662 | 20.773 | 20.884 | 16.604 | 100.0% | 10 |
| -> duration | 10.604 | 16.106 | 20.662 | 20.773 | 20.884 | 16.604 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 47.377973
Full duration: 99.592533
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_get_qos
args position 0
args values:
{
"args": {
"consumer": "both",
"write_iops_sec": "10",
"read_iops_sec": "1000"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.549 | 0.951 | 1.234 | 1.402 | 1.569 | 0.96 | 100.0% | 10 |
| cinder_v3.get_qos | 0.03 | 0.034 | 0.037 | 0.043 | 0.048 | 0.035 | 100.0% | 10 |
| total | 0.584 | 0.983 | 1.266 | 1.435 | 1.605 | 0.995 | 100.0% | 10 |
| -> duration | 0.584 | 0.983 | 1.266 | 1.435 | 1.605 | 0.995 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.952131
Full duration: 29.510663
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_list_qos
args position 0
args values:
{
"args": {
"consumer": "both",
"write_iops_sec": "10",
"read_iops_sec": "1000"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.599 | 0.905 | 1.464 | 1.798 | 2.131 | 1.047 | 100.0% | 10 |
| cinder_v3.list_qos | 0.035 | 0.041 | 0.046 | 0.046 | 0.046 | 0.041 | 100.0% | 10 |
| total | 0.64 | 0.948 | 1.508 | 1.841 | 2.174 | 1.088 | 100.0% | 10 |
| -> duration | 0.64 | 0.948 | 1.508 | 1.841 | 2.174 | 1.088 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.171776
Full duration: 34.100178
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_set_qos
args position 0
args values:
{
"args": {
"consumer": "back-end",
"write_iops_sec": "10",
"read_iops_sec": "1000",
"set_consumer": "both",
"set_write_iops_sec": "11",
"set_read_iops_sec": "1001"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.602 | 1.391 | 2.305 | 2.327 | 2.348 | 1.412 | 100.0% | 10 |
| cinder_v3.set_qos | 0.081 | 0.24 | 0.412 | 0.656 | 0.901 | 0.289 | 100.0% | 10 |
| total | 0.784 | 1.544 | 2.659 | 2.668 | 2.677 | 1.702 | 100.0% | 10 |
| -> duration | 0.784 | 1.544 | 2.659 | 2.668 | 2.677 | 1.702 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.432656
Full duration: 33.432114
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_get_volume_type
args position 0
args values:
{
"args": {
"description": "rally tests creating types"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 1.154 | 2.383 | 3.219 | 3.304 | 3.389 | 2.355 | 100.0% | 10 |
| cinder_v3.get_volume_type | 0.028 | 0.038 | 0.063 | 0.065 | 0.067 | 0.044 | 100.0% | 10 |
| total | 1.193 | 2.415 | 3.248 | 3.336 | 3.425 | 2.399 | 100.0% | 10 |
| -> duration | 1.193 | 2.415 | 3.248 | 3.336 | 3.425 | 2.399 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.718051
Full duration: 38.750442
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_list_volume_types
args position 0
args values:
{
"args": {
"description": "rally tests creating types"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 0.574 | 1.219 | 3.247 | 3.381 | 3.515 | 1.596 | 100.0% | 10 |
| cinder_v3.list_types | 0.041 | 0.05 | 0.062 | 0.064 | 0.066 | 0.052 | 100.0% | 10 |
| total | 0.628 | 1.273 | 3.289 | 3.428 | 3.567 | 1.648 | 100.0% | 10 |
| -> duration | 0.628 | 1.273 | 3.289 | 3.428 | 3.567 | 1.648 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 5.065095
Full duration: 29.741757
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_update_volume_type
args position 0
args values:
{
"args": {
"description": "test",
"update_description": "test update"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type | 0.96 | 1.278 | 2.126 | 2.152 | 2.179 | 1.526 | 100.0% | 10 |
| cinder_v2.update_volume_type | 0.119 | 0.825 | 1.575 | 1.818 | 2.062 | 0.865 | 100.0% | 10 |
| total | 1.412 | 2.111 | 3.509 | 3.776 | 4.044 | 2.391 | 100.0% | 10 |
| -> duration | 1.412 | 2.111 | 3.509 | 3.776 | 4.044 | 2.391 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.675374
Full duration: 38.902308
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_volume_type_and_encryption_type
args position 0
args values:
{
"args": {
"description": "rally tests creating types",
"provider": "LuksEncryptor",
"cipher": "aes-xts-plain64",
"key_size": 512,
"control_location": "front-end"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 0.598 | 1.062 | 1.991 | 2.003 | 2.015 | 1.174 | 100.0% | 10 |
| cinder_v3.create_encryption_type | 0.095 | 0.248 | 0.415 | 0.425 | 0.435 | 0.247 | 100.0% | 10 |
| total | 0.818 | 1.171 | 2.318 | 2.36 | 2.401 | 1.421 | 100.0% | 10 |
| -> duration | 0.818 | 1.171 | 2.318 | 2.36 | 2.401 | 1.421 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.086046
Full duration: 38.10095
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access
args position 0
args values:
{
"args": {
"description": "rally tests creating types"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a5ca7645-88fd-4631-a6f1-c0a52ae796ad has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type | 0.823 | 1.497 | 2.181 | 3.409 | 4.638 | 1.64 | 100.0% | 10 |
| cinder_v2.add_type_access | 0.298 | 0.759 | 3.616 | 3.67 | 3.724 | 1.494 | 100.0% | 10 |
| cinder_v2.list_type_access | 0.033 | 0.045 | 0.048 | 0.049 | 0.051 | 0.042 | 100.0% | 10 |
| total | 1.226 | 2.807 | 4.769 | 4.998 | 5.227 | 3.177 | 100.0% | 10 |
| -> duration | 1.226 | 2.807 | 4.769 | 4.998 | 5.227 | 3.177 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 8.350364
Full duration: 40.546426
HINTS:
* To plot HTML graphics with this data, run:
rally task report a5ca7645-88fd-4631-a6f1-c0a52ae796ad --out output.html
* To generate a JUnit report, run:
rally task export a5ca7645-88fd-4631-a6f1-c0a52ae796ad --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report a5ca7645-88fd-4631-a6f1-c0a52ae796ad --json --out output.json
2020-12-08 13:44:08,464 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a5ca7645-88fd-4631-a6f1-c0a52ae796ad --out /home/opnfv/functest/results/rally_full/cinder.json
2020-12-08 13:44:08,499 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK.
2020-12-08 13:44:08,527 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 13:44:08,894 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ...
2020-12-08 14:12:40,424 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 16b90814-3f01-4e3f-aae3-57789cc1bd99
2020-12-08 14:12:41,675 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 16b90814-3f01-4e3f-aae3-57789cc1bd99
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99: aborted
--------------------------------------------------------------------------------
test scenario HeatStacks.create_and_list_stack
args position 0
args values:
{
"args": {
"template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"heat_stack_owner"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 5.573 | 8.889 | 14.71 | 14.987 | 15.264 | 10.106 | 100.0% | 10 |
| heat.list_stacks | 0.052 | 0.071 | 0.086 | 0.096 | 0.106 | 0.072 | 100.0% | 10 |
| total | 5.68 | 8.958 | 14.78 | 15.053 | 15.325 | 10.178 | 100.0% | 10 |
| -> duration | 3.68 | 6.958 | 12.78 | 13.053 | 13.325 | 8.178 | 100.0% | 10 |
| -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 26.435949
Full duration: 91.419307
--------------------------------------------------------------------------------
test scenario HeatStacks.create_update_delete_stack
args position 0
args values:
{
"args": {
"template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template",
"updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"heat_stack_owner"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 23.126 | 25.703 | 44.802 | 45.461 | 46.119 | 32.744 | 100.0% | 10 |
| heat.update_stack | 12.8 | 32.938 | 42.88 | 43.28 | 43.679 | 31.005 | 100.0% | 10 |
| heat.delete_stack | 10.58 | 22.787 | 33.53 | 36.32 | 39.111 | 23.544 | 100.0% | 10 |
| total | 50.96 | 88.108 | 105.307 | 105.974 | 106.641 | 87.294 | 100.0% | 10 |
| -> duration | 46.96 | 84.108 | 101.307 | 101.974 | 102.641 | 83.294 | 100.0% | 10 |
| -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 242.896402
Full duration: 283.728878
--------------------------------------------------------------------------------
test scenario HeatStacks.create_update_delete_stack
args position 1
args values:
{
"args": {
"template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template",
"updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"heat_stack_owner"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 21.24 | 34.051 | 49.994 | 50.17 | 50.347 | 36.802 | 100.0% | 10 |
| heat.update_stack | 12.103 | 18.28 | 20.187 | 20.513 | 20.839 | 17.859 | 100.0% | 10 |
| heat.delete_stack | 9.139 | 13.023 | 15.455 | 15.686 | 15.916 | 12.895 | 100.0% | 10 |
| total | 53.947 | 62.794 | 83.224 | 83.261 | 83.298 | 67.556 | 100.0% | 10 |
| -> duration | 49.947 | 58.794 | 79.224 | 79.261 | 79.298 | 63.556 | 100.0% | 10 |
| -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 197.367309
Full duration: 237.856897
--------------------------------------------------------------------------------
test scenario HeatStacks.create_update_delete_stack
args position 2
args values:
{
"args": {
"template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template",
"updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"heat_stack_owner"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 45.566 | 53.43 | 62.774 | 63.561 | 64.348 | 54.882 | 100.0% | 10 |
| heat.update_stack | 26.366 | 57.082 | 69.512 | 70.869 | 72.226 | 55.602 | 100.0% | 10 |
| heat.delete_stack | 28.63 | 47.836 | 77.851 | 78.009 | 78.167 | 53.911 | 100.0% | 10 |
| total | 107.352 | 153.82 | 211.536 | 212.264 | 212.991 | 164.395 | 100.0% | 10 |
| -> duration | 103.352 | 149.82 | 207.536 | 208.264 | 208.991 | 160.395 | 100.0% | 10 |
| -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 456.579067
Full duration: 517.232293
--------------------------------------------------------------------------------
test scenario HeatStacks.create_update_delete_stack
args position 3
args values:
{
"args": {
"template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template",
"updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template"
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"heat_stack_owner"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 16b90814-3f01-4e3f-aae3-57789cc1bd99 has 1 error(s)
--------------------------------------------------------------------------------
HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n504 Gateway Time-out
\r\n
nginx\r\n\r\n\r\n'
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 162, in run
files, environment)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack
stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"]
File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create
data=kwargs, headers=headers)
File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request
raise exc.from_response(resp)
heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n504 Gateway Time-out
\r\n
nginx\r\n\r\n\r\n'
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 47.95 | 61.005 | 133.543 | 134.553 | 135.564 | 80.391 | 88.9% | 9 |
| heat.update_stack | 41.589 | 54.141 | 58.935 | 59.005 | 59.074 | 53.38 | 100.0% | 8 |
| heat.delete_stack | 55.781 | 65.566 | 91.674 | 98.6 | 105.526 | 71.46 | 100.0% | 8 |
| total | 61.005 | 195.254 | 237.052 | 238.265 | 239.477 | 191.36 | 88.9% | 9 |
| -> duration | 61.005 | 191.254 | 233.052 | 234.265 | 235.477 | 187.805 | 88.9% | 9 |
| -> idle_duration | 0.0 | 4.0 | 4.0 | 4.0 | 4.0 | 3.556 | 88.9% | 9 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 440.911859
Full duration: 516.712285
HINTS:
* To plot HTML graphics with this data, run:
rally task report 16b90814-3f01-4e3f-aae3-57789cc1bd99 --out output.html
* To generate a JUnit report, run:
rally task export 16b90814-3f01-4e3f-aae3-57789cc1bd99 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 16b90814-3f01-4e3f-aae3-57789cc1bd99 --json --out output.json
At least one workload did not pass SLA criteria.
2020-12-08 14:12:44,788 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 16b90814-3f01-4e3f-aae3-57789cc1bd99 --out /home/opnfv/functest/results/rally_full/heat.json
2020-12-08 14:12:44,799 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed.
2020-12-08 14:12:44,826 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 14:12:45,231 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ...
2020-12-08 14:25:52,677 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 35993756-eff6-4f8c-9f3d-421f55de87a3
2020-12-08 14:25:53,990 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 35993756-eff6-4f8c-9f3d-421f55de87a3
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3: finished
--------------------------------------------------------------------------------
test scenario KeystoneBasic.add_and_remove_user_role
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.355 | 0.936 | 3.874 | 4.094 | 4.315 | 1.946 | 100.0% | 10 |
| keystone_v3.add_role | 0.082 | 0.802 | 1.146 | 1.261 | 1.376 | 0.707 | 100.0% | 10 |
| keystone_v3.revoke_role | 0.149 | 0.662 | 0.857 | 0.995 | 1.133 | 0.58 | 100.0% | 10 |
| total | 0.601 | 2.696 | 5.603 | 5.905 | 6.207 | 3.233 | 100.0% | 10 |
| -> duration | 0.601 | 2.696 | 5.603 | 5.905 | 6.207 | 3.233 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 13.81823
Full duration: 53.056947
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_add_and_list_user_roles
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.318 | 0.841 | 1.272 | 1.751 | 2.23 | 0.867 | 100.0% | 10 |
| keystone_v3.add_role | 0.074 | 0.443 | 1.12 | 1.156 | 1.192 | 0.544 | 100.0% | 10 |
| keystone_v3.list_roles | 0.11 | 0.133 | 0.203 | 0.419 | 0.635 | 0.18 | 100.0% | 10 |
| total | 0.578 | 1.511 | 2.455 | 2.583 | 2.71 | 1.592 | 100.0% | 10 |
| -> duration | 0.578 | 1.511 | 2.455 | 2.583 | 2.71 | 1.592 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.068621
Full duration: 58.090753
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_tenants
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.222 | 1.039 | 1.783 | 1.868 | 1.953 | 1.01 | 100.0% | 10 |
| keystone_v3.list_projects | 0.131 | 0.137 | 0.21 | 0.252 | 0.295 | 0.159 | 100.0% | 10 |
| total | 0.363 | 1.174 | 1.978 | 2.036 | 2.094 | 1.17 | 100.0% | 10 |
| -> duration | 0.363 | 1.174 | 1.978 | 2.036 | 2.094 | 1.17 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 8.309869
Full duration: 55.833829
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_role
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.424 | 0.751 | 3.222 | 3.28 | 3.338 | 1.221 | 100.0% | 10 |
| keystone_v3.delete_role | 0.22 | 0.56 | 1.337 | 1.473 | 1.609 | 0.659 | 100.0% | 10 |
| total | 0.792 | 1.214 | 4.559 | 4.753 | 4.947 | 1.879 | 100.0% | 10 |
| -> duration | 0.792 | 1.214 | 4.559 | 4.753 | 4.947 | 1.879 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.868846
Full duration: 45.38237
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_service
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_service | 0.101 | 1.477 | 2.089 | 2.126 | 2.164 | 1.28 | 100.0% | 10 |
| keystone_v3.delete_service | 0.106 | 0.653 | 1.969 | 2.134 | 2.298 | 0.934 | 100.0% | 10 |
| total | 0.207 | 2.53 | 3.67 | 3.755 | 3.84 | 2.214 | 100.0% | 10 |
| -> duration | 0.207 | 2.53 | 3.67 | 3.755 | 3.84 | 2.214 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.753765
Full duration: 48.651884
--------------------------------------------------------------------------------
test scenario KeystoneBasic.get_entities
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.358 | 1.133 | 2.881 | 3.89 | 4.899 | 1.598 | 100.0% | 10 |
| keystone_v3.create_user | 1.574 | 3.081 | 5.081 | 8.44 | 11.798 | 3.725 | 100.0% | 10 |
| -> keystone_v3.list_roles | 0.048 | 0.057 | 0.276 | 0.289 | 0.302 | 0.11 | 100.0% | 10 |
| -> keystone_v3.add_role | 0.208 | 0.919 | 2.038 | 5.381 | 8.725 | 1.577 | 100.0% | 10 |
| keystone_v3.create_role | 0.26 | 0.808 | 1.987 | 2.691 | 3.396 | 1.128 | 100.0% | 10 |
| keystone_v3.get_project | 0.034 | 0.044 | 0.127 | 0.236 | 0.345 | 0.078 | 100.0% | 10 |
| keystone_v3.get_user | 0.037 | 0.042 | 0.072 | 0.137 | 0.202 | 0.059 | 100.0% | 10 |
| keystone_v3.get_role | 0.031 | 0.038 | 0.043 | 0.048 | 0.053 | 0.039 | 100.0% | 10 |
| keystone_v3.list_services | 0.039 | 0.047 | 0.209 | 0.907 | 1.605 | 0.202 | 100.0% | 10 |
| keystone_v3.get_services | 0.029 | 0.044 | 2.654 | 5.525 | 8.396 | 1.147 | 100.0% | 10 |
| total | 3.896 | 6.685 | 15.953 | 17.082 | 18.212 | 8.198 | 100.0% | 10 |
| -> duration | 3.896 | 6.685 | 15.953 | 17.082 | 18.212 | 8.198 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 32.810085
Full duration: 91.874949
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_update_and_delete_tenant
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.55 | 1.424 | 3.563 | 4.401 | 5.24 | 1.795 | 100.0% | 10 |
| keystone_v3.update_project | 0.392 | 0.618 | 1.21 | 1.581 | 1.952 | 0.759 | 100.0% | 10 |
| keystone_v3.delete_project | 0.262 | 0.874 | 2.427 | 2.497 | 2.567 | 1.141 | 100.0% | 10 |
| total | 1.756 | 3.249 | 5.091 | 6.273 | 7.455 | 3.696 | 100.0% | 10 |
| -> duration | 1.756 | 3.249 | 5.091 | 6.273 | 7.455 | 3.696 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 20.224522
Full duration: 51.060743
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_user
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.277 | 0.586 | 1.155 | 1.158 | 1.161 | 0.685 | 100.0% | 10 |
| total | 0.362 | 0.721 | 1.232 | 1.232 | 1.233 | 0.792 | 100.0% | 10 |
| -> duration | 0.362 | 0.721 | 1.232 | 1.232 | 1.233 | 0.792 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.849513
Full duration: 30.042837
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.298 | 1.0 | 2.061 | 2.239 | 2.417 | 1.159 | 100.0% | 10 |
| total | 0.298 | 1.0 | 2.061 | 2.239 | 2.417 | 1.159 | 100.0% | 10 |
| -> duration | 0.298 | 1.0 | 2.061 | 2.239 | 2.417 | 1.159 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 8.323287
Full duration: 31.757851
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_users
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.22 | 0.927 | 1.998 | 2.069 | 2.139 | 1.087 | 100.0% | 10 |
| keystone_v3.list_users | 0.059 | 0.076 | 0.526 | 0.563 | 0.6 | 0.21 | 100.0% | 10 |
| total | 0.684 | 1.13 | 2.344 | 2.564 | 2.785 | 1.395 | 100.0% | 10 |
| -> duration | 0.684 | 1.13 | 2.344 | 2.564 | 2.785 | 1.395 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 8.914463
Full duration: 35.369993
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant_with_users
args position 0
args values:
{
"args": {
"users_per_tenant": 10
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 35993756-eff6-4f8c-9f3d-421f55de87a3 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.256 | 0.887 | 1.649 | 1.844 | 2.04 | 0.969 | 100.0% | 10 |
| keystone_v3.create_users | 18.118 | 28.84 | 43.03 | 43.224 | 43.417 | 31.701 | 100.0% | 10 |
| -> keystone_v3.create_user (x10) | 18.117 | 28.839 | 43.03 | 43.223 | 43.416 | 31.701 | 100.0% | 10 |
| --> keystone_v3.list_roles (x10) | 0.535 | 0.661 | 2.232 | 4.136 | 6.04 | 1.382 | 100.0% | 10 |
| --> keystone_v3.add_role (x10) | 5.462 | 14.27 | 16.99 | 18.338 | 19.686 | 13.254 | 100.0% | 10 |
| total | 20.701 | 31.1 | 45.925 | 46.027 | 46.128 | 34.748 | 100.0% | 10 |
| -> duration | 20.701 | 31.1 | 45.925 | 46.027 | 46.128 | 34.748 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 102.766864
Full duration: 259.890373
HINTS:
* To plot HTML graphics with this data, run:
rally task report 35993756-eff6-4f8c-9f3d-421f55de87a3 --out output.html
* To generate a JUnit report, run:
rally task export 35993756-eff6-4f8c-9f3d-421f55de87a3 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 35993756-eff6-4f8c-9f3d-421f55de87a3 --json --out output.json
2020-12-08 14:25:57,101 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 35993756-eff6-4f8c-9f3d-421f55de87a3 --out /home/opnfv/functest/results/rally_full/keystone.json
2020-12-08 14:25:57,124 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK.
2020-12-08 14:25:57,156 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 14:25:57,580 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-12-08 14:53:02,065 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: cf6ad8f3-b526-4fdc-bba3-4477e228028c
2020-12-08 14:53:03,428 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid cf6ad8f3-b526-4fdc-bba3-4477e228028c
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c: finished
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_networks
args position 0
args values:
{
"args": {
"network_create_args": {},
"network_update_args": {
"admin_state_up": false
}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.437 | 3.394 | 4.642 | 4.968 | 5.295 | 3.29 | 100.0% | 10 |
| neutron.update_network | 0.921 | 1.204 | 1.665 | 2.072 | 2.479 | 1.339 | 100.0% | 10 |
| total | 2.84 | 4.405 | 6.19 | 6.4 | 6.611 | 4.63 | 100.0% | 10 |
| -> duration | 2.84 | 4.405 | 6.19 | 6.4 | 6.611 | 4.63 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 14.587584
Full duration: 65.469978
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_ports
args position 0
args values:
{
"args": {
"network_create_args": {},
"port_create_args": {},
"port_update_args": {
"admin_state_up": false,
"device_id": "dummy_id",
"device_owner": "dummy_owner"
},
"ports_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"router": {}
},
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 3.817 | 4.887 | 6.04 | 6.06 | 6.08 | 4.929 | 100.0% | 10 |
| neutron.update_port | 1.029 | 1.399 | 2.131 | 2.157 | 2.183 | 1.539 | 100.0% | 10 |
| total | 5.612 | 6.453 | 7.323 | 7.408 | 7.492 | 6.468 | 100.0% | 10 |
| -> duration | 5.612 | 6.453 | 7.323 | 7.408 | 7.492 | 6.468 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 20.097154
Full duration: 97.280428
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_routers
args position 0
args values:
{
"args": {
"network_create_args": {},
"router_create_args": {},
"router_update_args": {
"admin_state_up": false
},
"subnet_cidr_start": "1.1.0.0/30",
"subnet_create_args": {},
"subnets_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1,
"port": -1,
"router": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 27.653027
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_subnets
args position 0
args values:
{
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.4.0.0/16",
"subnet_create_args": {},
"subnet_update_args": {
"enable_dhcp": false
},
"subnets_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.28 | 3.204 | 3.427 | 3.428 | 3.429 | 2.92 | 100.0% | 10 |
| neutron.create_subnet | 1.809 | 2.97 | 4.441 | 4.454 | 4.467 | 2.97 | 100.0% | 10 |
| neutron.update_subnet | 0.956 | 1.7 | 3.021 | 3.046 | 3.072 | 1.903 | 100.0% | 10 |
| total | 4.475 | 7.471 | 10.881 | 10.882 | 10.883 | 7.793 | 100.0% | 10 |
| -> duration | 4.475 | 7.471 | 10.881 | 10.882 | 10.883 | 7.793 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 22.192312
Full duration: 79.806904
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_networks
args position 0
args values:
{
"args": {
"network_create_args": {}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.439 | 2.22 | 3.529 | 3.62 | 3.711 | 2.488 | 100.0% | 10 |
| neutron.delete_network | 0.821 | 1.205 | 1.571 | 1.596 | 1.62 | 1.226 | 100.0% | 10 |
| total | 2.48 | 3.538 | 4.676 | 4.815 | 4.954 | 3.715 | 100.0% | 10 |
| -> duration | 2.48 | 3.538 | 4.676 | 4.815 | 4.954 | 3.715 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.509322
Full duration: 49.481942
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_ports
args position 0
args values:
{
"args": {
"network_create_args": {},
"port_create_args": {},
"ports_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"router": {}
},
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 2.16 | 5.496 | 6.651 | 6.697 | 6.743 | 5.064 | 100.0% | 10 |
| neutron.delete_port | 0.619 | 1.402 | 2.735 | 2.964 | 3.194 | 1.645 | 100.0% | 10 |
| total | 2.778 | 7.814 | 8.166 | 8.166 | 8.167 | 6.709 | 100.0% | 10 |
| -> duration | 2.778 | 7.814 | 8.166 | 8.166 | 8.167 | 6.709 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 18.516162
Full duration: 78.956109
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_subnets
args position 0
args values:
{
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnet_create_args": {},
"subnets_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 2.482 | 4.585 | 5.98 | 6.301 | 6.623 | 4.379 | 100.0% | 10 |
| neutron.create_subnet | 2.392 | 3.9 | 5.652 | 6.632 | 7.612 | 4.21 | 100.0% | 10 |
| neutron.delete_subnet | 0.878 | 2.142 | 4.021 | 4.249 | 4.478 | 2.422 | 100.0% | 10 |
| total | 6.918 | 9.261 | 15.204 | 15.83 | 16.456 | 11.014 | 100.0% | 10 |
| -> duration | 6.918 | 9.261 | 15.204 | 15.83 | 16.456 | 11.014 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 30.388461
Full duration: 96.020568
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
"args": {
"network_create_args": {}
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.575 | 2.643 | 4.323 | 4.532 | 4.742 | 2.885 | 100.0% | 10 |
| neutron.list_networks | 0.159 | 0.219 | 0.519 | 0.628 | 0.737 | 0.3 | 100.0% | 10 |
| total | 1.826 | 2.854 | 4.516 | 4.831 | 5.146 | 3.185 | 100.0% | 10 |
| -> duration | 1.826 | 2.854 | 4.516 | 4.831 | 5.146 | 3.185 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.359811
Full duration: 60.122999
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
"args": {
"network_create_args": {},
"port_create_args": {},
"ports_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"router": {}
},
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 5.614 | 7.887 | 20.779 | 20.99 | 21.201 | 12.171 | 100.0% | 10 |
| neutron.list_ports | 0.104 | 0.936 | 4.173 | 4.361 | 4.548 | 1.631 | 100.0% | 10 |
| total | 5.777 | 12.05 | 21.519 | 22.236 | 22.952 | 13.802 | 100.0% | 10 |
| -> duration | 5.777 | 12.05 | 21.519 | 22.236 | 22.952 | 13.802 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 35.278121
Full duration: 209.866154
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnet_create_args": {},
"subnets_per_network": 1
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 5.916 | 10.306 | 12.059 | 12.086 | 12.112 | 9.589 | 100.0% | 10 |
| neutron.create_subnet | 3.336 | 3.842 | 11.774 | 12.065 | 12.356 | 6.824 | 100.0% | 10 |
| neutron.list_subnets | 0.089 | 0.128 | 1.484 | 1.499 | 1.514 | 0.392 | 100.0% | 10 |
| total | 14.648 | 16.3 | 19.554 | 19.786 | 20.018 | 16.804 | 100.0% | 10 |
| -> duration | 14.648 | 16.3 | 19.554 | 19.786 | 20.018 | 16.804 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 49.806019
Full duration: 224.105991
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_delete_security_groups
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 5.209 | 7.444 | 10.542 | 10.918 | 11.294 | 7.972 | 100.0% | 10 |
| neutron.delete_security_group | 1.088 | 2.041 | 5.233 | 5.387 | 5.54 | 2.777 | 100.0% | 10 |
| total | 6.881 | 10.953 | 14.242 | 14.589 | 14.936 | 10.749 | 100.0% | 10 |
| -> duration | 6.881 | 10.953 | 14.242 | 14.589 | 14.936 | 10.749 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 32.768939
Full duration: 130.093917
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_delete_security_group_rule
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 3.662 | 10.024 | 12.582 | 13.675 | 14.768 | 9.421 | 100.0% | 10 |
| neutron.create_security_group_rule | 3.408 | 6.005 | 9.905 | 10.42 | 10.936 | 6.872 | 100.0% | 10 |
| neutron.delete_security_group_rule | 1.112 | 1.905 | 2.574 | 2.623 | 2.673 | 1.963 | 100.0% | 10 |
| neutron.delete_security_group | 0.978 | 2.579 | 2.936 | 3.084 | 3.232 | 2.433 | 100.0% | 10 |
| total | 11.681 | 19.668 | 27.464 | 27.565 | 27.667 | 20.689 | 100.0% | 10 |
| -> duration | 11.681 | 19.668 | 27.464 | 27.565 | 27.667 | 20.689 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 56.791873
Full duration: 164.744672
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_list_security_group_rules
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 3.17 | 7.731 | 18.056 | 18.292 | 18.528 | 10.11 | 100.0% | 10 |
| neutron.create_security_group_rule | 0.764 | 8.364 | 10.584 | 14.093 | 17.601 | 8.368 | 100.0% | 10 |
| neutron.list_security_group_rules | 0.076 | 2.075 | 2.758 | 2.773 | 2.787 | 1.506 | 100.0% | 10 |
| total | 4.052 | 18.623 | 30.143 | 30.252 | 30.361 | 19.984 | 100.0% | 10 |
| -> duration | 4.052 | 18.623 | 30.143 | 30.252 | 30.361 | 19.984 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 52.023421
Full duration: 102.034921
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_show_security_group
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 1.965 | 3.419 | 3.649 | 3.717 | 3.786 | 3.169 | 100.0% | 10 |
| neutron.show_security_group | 0.059 | 0.081 | 0.362 | 0.366 | 0.371 | 0.136 | 100.0% | 10 |
| total | 2.032 | 3.505 | 3.995 | 4.0 | 4.004 | 3.305 | 100.0% | 10 |
| -> duration | 2.032 | 3.505 | 3.995 | 4.0 | 4.004 | 3.305 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.54192
Full duration: 59.543888
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_ports
args position 0
args values:
{
"args": {
"ports_per_network": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"router": {}
},
"quotas": {
"neutron": {
"network": -1,
"router": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 24.422475
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_routers
args position 0
args values:
{
"args": {
"subnets_per_network": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1,
"router": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 20.916104
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_subnets
args position 0
args values:
{
"args": {
"subnets_per_network": 2
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"router": {}
},
"quotas": {
"neutron": {
"network": -1,
"subnet": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task cf6ad8f3-b526-4fdc-bba3-4477e228028c has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_subnet (x2) | 4.393 | 6.192 | 8.535 | 8.781 | 9.028 | 6.426 | 100.0% | 10 |
| neutron.show_subnet (x2) | 0.453 | 0.817 | 1.151 | 1.252 | 1.354 | 0.857 | 100.0% | 10 |
| total | 4.856 | 7.009 | 9.863 | 10.009 | 10.156 | 7.283 | 100.0% | 10 |
| -> duration | 4.856 | 7.009 | 9.863 | 10.009 | 10.156 | 7.283 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 20.225531
Full duration: 92.254209
HINTS:
* To plot HTML graphics with this data, run:
rally task report cf6ad8f3-b526-4fdc-bba3-4477e228028c --out output.html
* To generate a JUnit report, run:
rally task export cf6ad8f3-b526-4fdc-bba3-4477e228028c --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report cf6ad8f3-b526-4fdc-bba3-4477e228028c --json --out output.json
At least one workload did not pass SLA criteria.
2020-12-08 14:53:06,569 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid cf6ad8f3-b526-4fdc-bba3-4477e228028c --out /home/opnfv/functest/results/rally_full/neutron.json
2020-12-08 14:53:06,592 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-12-08 14:53:06,627 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 14:53:07,008 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ...
2020-12-08 15:10:22,674 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 1b819061-f884-4dd3-b7a5-2a834aa8b4a5
2020-12-08 15:10:23,958 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 1b819061-f884-4dd3-b7a5-2a834aa8b4a5
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5: aborted
--------------------------------------------------------------------------------
test scenario NovaKeypair.create_and_delete_keypair
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"key_pairs": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 1.011 | 1.199 | 1.632 | 1.666 | 1.701 | 1.279 | 100.0% | 10 |
| nova.delete_keypair | 0.058 | 0.174 | 0.308 | 0.388 | 0.468 | 0.188 | 100.0% | 10 |
| total | 1.086 | 1.331 | 1.941 | 2.017 | 2.093 | 1.467 | 100.0% | 10 |
| -> duration | 1.086 | 1.331 | 1.941 | 2.017 | 2.093 | 1.467 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.55889
Full duration: 32.226839
--------------------------------------------------------------------------------
test scenario NovaKeypair.create_and_list_keypairs
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"quotas": {
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"key_pairs": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.939 | 1.489 | 2.529 | 2.547 | 2.564 | 1.587 | 100.0% | 10 |
| nova.list_keypairs | 0.034 | 0.042 | 0.091 | 0.231 | 0.371 | 0.078 | 100.0% | 10 |
| total | 1.137 | 1.526 | 2.589 | 2.607 | 2.624 | 1.665 | 100.0% | 10 |
| -> duration | 1.137 | 1.526 | 2.589 | 2.607 | 2.624 | 1.665 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.232523
Full duration: 38.634438
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_bounce_server
args position 0
args values:
{
"args": {
"actions": [
{
"hard_reboot": 1
},
{
"soft_reboot": 1
},
{
"stop_start": 1
},
{
"rescue_unrescue": 1
}
],
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
},
"quotas": {
"neutron": {
"network": -1,
"port": -1,
"subnet": -1
},
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 30.739151
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_delete_server
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
},
"quotas": {
"neutron": {
"network": -1,
"port": -1,
"subnet": -1
},
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 29.125234
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_list_server
args position 0
args values:
{
"args": {
"detailed": true,
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
},
"quotas": {
"neutron": {
"network": -1,
"port": -1,
"subnet": -1
},
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 35.930775
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_rebuild_server
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"from_image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"to_image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
},
"quotas": {
"neutron": {
"network": -1,
"port": -1,
"subnet": -1
},
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 40.98698
--------------------------------------------------------------------------------
test scenario NovaServers.snapshot_server
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
},
"quotas": {
"neutron": {
"network": -1,
"port": -1,
"subnet": -1
},
"nova": {
"cores": -1,
"floating_ips": -1,
"instances": -1,
"ram": -1,
"security_group_rules": -1,
"security_groups": -1
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 25.140995
--------------------------------------------------------------------------------
test scenario NovaServers.boot_server_from_volume
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"volume_size": 1,
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 16.363 | 20.959 | 33.196 | 47.921 | 62.646 | 25.082 | 100.0% | 10 |
| nova.boot_server | 21.484 | 52.404 | 89.875 | 90.425 | 90.975 | 55.697 | 100.0% | 10 |
| total | 41.954 | 73.009 | 112.353 | 113.412 | 114.471 | 80.78 | 100.0% | 10 |
| -> duration | 40.954 | 72.009 | 111.353 | 112.412 | 113.471 | 79.78 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 224.004155
Full duration: 323.867722
--------------------------------------------------------------------------------
test scenario NovaServers.boot_server
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 30.299 | 37.167 | 53.347 | 55.351 | 57.355 | 41.324 | 100.0% | 10 |
| total | 30.299 | 37.167 | 53.347 | 55.351 | 57.355 | 41.324 | 100.0% | 10 |
| -> duration | 29.299 | 36.167 | 52.347 | 54.351 | 56.355 | 40.324 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 114.858801
Full duration: 169.70861
--------------------------------------------------------------------------------
test scenario NovaServers.list_servers
args position 0
args values:
{
"args": {
"detailed": true
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"servers": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"servers_per_tenant": 2,
"auto_assign_nic": true
},
"network": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 25.764453
--------------------------------------------------------------------------------
test scenario NovaServers.resize_server
args position 0
args values:
{
"args": {
"flavor": {
"name": "rally_full-flavor_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"image": {
"name": "rally_full-img_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"to_flavor": {
"name": "rally_full-flavor_alt_bc01c694-a9d4-4de7-97ba-f6686586ccc9"
},
"confirm": true,
"force_delete": false,
"nics": [
{
"net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff"
}
]
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 has 5 error(s)
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status
fault="Status in failure list %s" % str(failure_statuses))
rally.exceptions.GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status
fault="Status in failure list %s" % str(failure_statuses))
rally.exceptions.GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status
fault="Status in failure list %s" % str(failure_statuses))
rally.exceptions.GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status
fault="Status in failure list %s" % str(failure_statuses))
rally.exceptions.GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 242, in wait_for_status
fault="Status in failure list %s" % str(failure_statuses))
rally.exceptions.GetResourceErrorStatus: Resource has ERROR status.
Fault: Status in failure list {'ERROR'}
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 32.746 | 47.098 | 57.62 | 59.128 | 60.635 | 47.673 | 100.0% | 5 |
| nova.resize | 13.044 | 52.114 | 55.71 | 56.384 | 57.058 | 44.693 | 0.0% | 5 |
| total | 45.79 | 104.156 | 107.002 | 107.599 | 108.195 | 92.366 | 0.0% | 5 |
| -> duration | 44.79 | 103.156 | 106.002 | 106.599 | 107.195 | 91.366 | 0.0% | 5 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 143.293813
Full duration: 209.97545
HINTS:
* To plot HTML graphics with this data, run:
rally task report 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 --out output.html
* To generate a JUnit report, run:
rally task export 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 --json --out output.json
At least one workload did not pass SLA criteria.
2020-12-08 15:10:27,024 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 1b819061-f884-4dd3-b7a5-2a834aa8b4a5 --out /home/opnfv/functest/results/rally_full/nova.json
2020-12-08 15:10:27,039 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed.
2020-12-08 15:10:27,065 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 15:10:27,821 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ...
2020-12-08 15:12:31,531 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 23b1dba2-a73e-487f-8fc1-f985dd70024d
2020-12-08 15:12:32,752 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 23b1dba2-a73e-487f-8fc1-f985dd70024d
--------------------------------------------------------------------------------
Task 23b1dba2-a73e-487f-8fc1-f985dd70024d: finished
--------------------------------------------------------------------------------
test scenario Quotas.cinder_update_and_delete
args position 0
args values:
{
"args": {
"max_quota": 1024
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 23b1dba2-a73e-487f-8fc1-f985dd70024d has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.813 | 1.735 | 3.286 | 3.321 | 3.356 | 2.128 | 100.0% | 10 |
| quotas.delete_quotas | 0.041 | 0.08 | 0.133 | 0.241 | 0.349 | 0.104 | 100.0% | 10 |
| total | 0.879 | 1.81 | 3.379 | 3.399 | 3.419 | 2.232 | 100.0% | 10 |
| -> duration | 0.879 | 1.81 | 3.379 | 3.399 | 3.419 | 2.232 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.801693
Full duration: 32.779089
--------------------------------------------------------------------------------
test scenario Quotas.cinder_update
args position 0
args values:
{
"args": {
"max_quota": 1024
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"api_versions": {
"cinder": {
"version": 3,
"service_type": "volumev3"
}
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 23b1dba2-a73e-487f-8fc1-f985dd70024d has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.886 | 2.03 | 3.696 | 3.833 | 3.969 | 2.233 | 100.0% | 10 |
| total | 0.886 | 2.03 | 3.696 | 3.833 | 3.969 | 2.233 | 100.0% | 10 |
| -> duration | 0.886 | 2.03 | 3.696 | 3.833 | 3.969 | 2.233 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.256924
Full duration: 30.150139
--------------------------------------------------------------------------------
test scenario Quotas.nova_update
args position 0
args values:
{
"args": {
"max_quota": 1024
},
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 23b1dba2-a73e-487f-8fc1-f985dd70024d has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 3.616 | 3.805 | 4.331 | 4.493 | 4.655 | 3.898 | 100.0% | 10 |
| total | 3.616 | 3.805 | 4.331 | 4.493 | 4.655 | 3.898 | 100.0% | 10 |
| -> duration | 3.616 | 3.805 | 4.331 | 4.493 | 4.655 | 3.898 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.183853
Full duration: 36.502011
HINTS:
* To plot HTML graphics with this data, run:
rally task report 23b1dba2-a73e-487f-8fc1-f985dd70024d --out output.html
* To generate a JUnit report, run:
rally task export 23b1dba2-a73e-487f-8fc1-f985dd70024d --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 23b1dba2-a73e-487f-8fc1-f985dd70024d --json --out output.json
2020-12-08 15:12:35,758 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 23b1dba2-a73e-487f-8fc1-f985dd70024d --out /home/opnfv/functest/results/rally_full/quotas.json
2020-12-08 15:12:35,764 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK.
2020-12-08 15:12:35,793 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback
2020-12-08 15:12:35,974 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ...
2020-12-08 15:21:13,805 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 93b932ea-9a0f-420d-b9eb-96cfedb66602
2020-12-08 15:21:15,115 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 93b932ea-9a0f-420d-b9eb-96cfedb66602
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602: finished
--------------------------------------------------------------------------------
test scenario SwiftObjects.create_container_and_object_then_list_objects
args position 0
args values:
{
"args": {
"objects_per_container": 2,
"object_size": 5120
},
"runner": {
"concurrency": 1,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"admin"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container | 1.058 | 1.121 | 1.313 | 1.583 | 1.854 | 1.199 | 100.0% | 10 |
| swift.upload_object (x2) | 1.012 | 1.123 | 1.171 | 1.213 | 1.255 | 1.12 | 100.0% | 10 |
| swift.list_objects | 0.926 | 0.989 | 1.054 | 1.068 | 1.082 | 0.989 | 100.0% | 10 |
| total | 3.076 | 3.28 | 3.446 | 3.697 | 3.948 | 3.311 | 100.0% | 10 |
| -> duration | 3.076 | 3.28 | 3.446 | 3.697 | 3.948 | 3.311 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 33.158867
Full duration: 92.589172
--------------------------------------------------------------------------------
test scenario SwiftObjects.list_objects_in_containers
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 1,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"admin"
],
"swift_objects": {
"containers_per_tenant": 1,
"objects_per_container": 10,
"object_size": 1024
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.list_containers | 1.398 | 1.481 | 1.671 | 1.683 | 1.695 | 1.507 | 100.0% | 10 |
| swift.list_objects | 0.949 | 1.026 | 1.051 | 1.052 | 1.053 | 1.016 | 100.0% | 10 |
| total | 2.441 | 2.493 | 2.65 | 2.687 | 2.724 | 2.523 | 100.0% | 10 |
| -> duration | 2.441 | 2.493 | 2.65 | 2.687 | 2.724 | 2.523 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 25.284303
Full duration: 69.938471
--------------------------------------------------------------------------------
test scenario SwiftObjects.create_container_and_object_then_download_object
args position 0
args values:
{
"args": {
"objects_per_container": 5,
"object_size": 1024
},
"runner": {
"concurrency": 1,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"admin"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container | 0.963 | 1.131 | 1.284 | 1.287 | 1.29 | 1.138 | 100.0% | 10 |
| swift.upload_object (x5) | 2.695 | 2.806 | 2.869 | 2.9 | 2.932 | 2.787 | 100.0% | 10 |
| swift.download_object (x5) | 2.368 | 2.445 | 2.529 | 2.542 | 2.555 | 2.447 | 100.0% | 10 |
| total | 6.159 | 6.363 | 6.582 | 6.621 | 6.66 | 6.373 | 100.0% | 10 |
| -> duration | 6.159 | 6.363 | 6.582 | 6.621 | 6.66 | 6.373 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 63.785373
Full duration: 131.860055
--------------------------------------------------------------------------------
test scenario SwiftObjects.create_container_and_object_then_delete_all
args position 0
args values:
{
"args": {
"objects_per_container": 5,
"object_size": 102400
},
"runner": {
"concurrency": 1,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"admin"
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container | 0.934 | 1.138 | 1.228 | 1.26 | 1.291 | 1.112 | 100.0% | 10 |
| swift.upload_object (x5) | 2.724 | 2.804 | 2.919 | 2.92 | 2.921 | 2.82 | 100.0% | 10 |
| swift.delete_object (x5) | 2.514 | 2.575 | 2.737 | 2.783 | 2.83 | 2.614 | 100.0% | 10 |
| swift.delete_container | 0.556 | 0.644 | 0.694 | 0.702 | 0.71 | 0.644 | 100.0% | 10 |
| total | 7.03 | 7.192 | 7.304 | 7.41 | 7.516 | 7.19 | 100.0% | 10 |
| -> duration | 7.03 | 7.192 | 7.304 | 7.41 | 7.516 | 7.19 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 71.961749
Full duration: 107.913716
--------------------------------------------------------------------------------
test scenario SwiftObjects.list_and_download_objects_in_containers
args position 0
args values:
{
"args": {},
"runner": {
"concurrency": 1,
"times": 10
},
"contexts": {
"users": {
"tenants": 3,
"users_per_tenant": 2
},
"roles": [
"admin"
],
"swift_objects": {
"containers_per_tenant": 1,
"objects_per_container": 5,
"object_size": 10240
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 93b932ea-9a0f-420d-b9eb-96cfedb66602 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.list_containers | 1.401 | 1.478 | 1.598 | 1.615 | 1.632 | 1.49 | 100.0% | 10 |
| swift.list_objects | 0.921 | 0.998 | 1.02 | 1.024 | 1.027 | 0.991 | 100.0% | 10 |
| swift.download_object (x5) | 2.311 | 2.442 | 2.546 | 2.549 | 2.552 | 2.436 | 100.0% | 10 |
| total | 4.756 | 4.921 | 5.017 | 5.031 | 5.044 | 4.917 | 100.0% | 10 |
| -> duration | 4.756 | 4.921 | 5.017 | 5.031 | 5.044 | 4.917 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 49.22728
Full duration: 92.421969
HINTS:
* To plot HTML graphics with this data, run:
rally task report 93b932ea-9a0f-420d-b9eb-96cfedb66602 --out output.html
* To generate a JUnit report, run:
rally task export 93b932ea-9a0f-420d-b9eb-96cfedb66602 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 93b932ea-9a0f-420d-b9eb-96cfedb66602 --json --out output.json
2020-12-08 15:21:18,168 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 93b932ea-9a0f-420d-b9eb-96cfedb66602 --out /home/opnfv/functest/results/rally_full/swift.json
2020-12-08 15:21:18,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK.
2020-12-08 15:21:18,187 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:
+----------------+------------+----------------+-----------+
| Module | Duration | nb. Test Run | Success |
+----------------+------------+----------------+-----------+
| authenticate | 00:02:30 | 60 | 100.00% |
| glance | 00:10:22 | 45 | 88.89% |
| cinder | 00:50:07 | 240 | 100.00% |
| heat | 00:27:26 | 49 | 97.96% |
| keystone | 00:12:41 | 110 | 100.00% |
| neutron | 00:26:22 | 140 | 100.00% |
| nova | 00:16:02 | 45 | 88.89% |
| quotas | 00:01:39 | 30 | 100.00% |
| swift | 00:08:14 | 50 | 100.00% |
| | | | |
| TOTAL: | 02:35:27 | 769 | 98.57% |
+----------------+------------+----------------+-----------+
2020-12-08 15:21:18,187 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.57% in 5/9 modules
2020-12-08 15:21:21,923 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html
2020-12-08 15:21:25,426 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml
2020-12-08 15:21:25,427 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+------------------+------------------+----------------+
| rally_full | functest | 162:47 | FAIL |
+--------------------+------------------+------------------+----------------+