2020-03-25 18:36:55,947 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+----------------------------------------------------------------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------------------------------------------------------------+
| TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results |
| S3_DST_URL | s3://artifacts.opnfv.org/cntt/QRZLIGHIW02L/cntt-opnfv-functest-benchmarking-latest-rally_full-run-37 |
| S3_ENDPOINT_URL | https://storage.googleapis.com |
| DEPLOY_SCENARIO | os-nosdn-nofeature-ha |
| BUILD_TAG | QRZLIGHIW02L |
| DEBUG | false |
| INSTALLER_TYPE | cntt |
| CI_LOOP | daily |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| HTTP_DST_URL | http://artifacts.opnfv.org/cntt/QRZLIGHIW02L/cntt-opnfv-functest-benchmarking-latest-rally_full-run-37 |
| NODE_NAME | intel-pod15 |
+-------------------------+----------------------------------------------------------------------------------------------------------------+
2020-03-25 18:36:55,951 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file
export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod15
2020-03-25 18:36:55,951 - xtesting.ci.run_tests - DEBUG - Test args: rally_full
2020-03-25 18:36:55,965 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'...
2020-03-25 18:36:56,751 - functest.core.tenantnetwork - DEBUG - password: *jpCoVZt[PjfGO6<(t_8-Gy7s@m@BF
2020-03-25 18:36:57,058 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'5bccf4dfd07b47ad89108fc5cc9e64df', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_176bac14-2663-4f43-8201-efe1fbf23f42'})
2020-03-25 18:36:57,351 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'2af8290d7f9444b690dd398c2f13946a', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_176bac14-2663-4f43-8201-efe1fbf23f42'})
2020-03-25 18:36:58,197 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_176bac14-2663-4f43-8201-efe1fbf23f42', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod15', u'key_manager_api_version': u'v1', 'password': '*jpCoVZt[PjfGO6<(t_8-Gy7s@m@BF', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_176bac14-2663-4f43-8201-efe1fbf23f42', 'project_id': u'5bccf4dfd07b47ad89108fc5cc9e64df', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-03-25 18:36:58,201 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_176bac14-2663-4f43-8201-efe1fbf23f42', 'password': '*jpCoVZt[PjfGO6<(t_8-Gy7s@m@BF', 'project_name': 'rally_full-project_176bac14-2663-4f43-8201-efe1fbf23f42', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', 'project_id': '5bccf4dfd07b47ad89108fc5cc9e64df', 'project_domain_name': 'default'}
2020-03-25 18:36:59,252 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'...
2020-03-25 18:37:00,012 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-03-25T18:36:59Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'41650ad9-f180-48b8-89b7-5b5c544c667b', u'provider:segmentation_id': 53, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_176bac14-2663-4f43-8201-efe1fbf23f42', u'admin_state_up': True, u'tenant_id': u'5bccf4dfd07b47ad89108fc5cc9e64df', u'created_at': u'2020-03-25T18:36:59Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'5bccf4dfd07b47ad89108fc5cc9e64df'})
2020-03-25 18:37:01,734 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-03-25T18:37:01Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'9f39dcf6-20d1-4e58-b918-689b37fce36f', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_176bac14-2663-4f43-8201-efe1fbf23f42', u'enable_dhcp': True, u'network_id': u'41650ad9-f180-48b8-89b7-5b5c544c667b', u'tenant_id': u'5bccf4dfd07b47ad89108fc5cc9e64df', u'created_at': u'2020-03-25T18:37:01Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'5bccf4dfd07b47ad89108fc5cc9e64df'})
2020-03-25 18:37:12,744 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-03-25T18:37:06Z', u'revision_number': 6, u'ha': True, u'id': u'd5e6a3a7-7f2d-47bb-b870-b61054d5884c', u'external_gateway_info': {u'network_id': u'd8f03f3d-f8aa-4d60-abba-21936eb3ec60', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'b181b6ab-1dd3-471a-b49b-11477ad62996', u'ip_address': u'10.10.155.47'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_176bac14-2663-4f43-8201-efe1fbf23f42', u'admin_state_up': True, u'tenant_id': u'5bccf4dfd07b47ad89108fc5cc9e64df', u'created_at': u'2020-03-25T18:37:04Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'5bccf4dfd07b47ad89108fc5cc9e64df'})
2020-03-25 18:37:15,849 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/172aa2f0-24a7-4c6f-b509-146a492e0f3d/file', 'owner': u'5bccf4dfd07b47ad89108fc5cc9e64df', 'id': u'172aa2f0-24a7-4c6f-b509-146a492e0f3d', 'size': 12716032, u'self': u'/v2/images/172aa2f0-24a7-4c6f-b509-146a492e0f3d', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'5bccf4dfd07b47ad89108fc5cc9e64df', 'name': 'rally_full-project_176bac14-2663-4f43-8201-efe1fbf23f42', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-03-25T18:37:15Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-03-25T18:37:15Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/172aa2f0-24a7-4c6f-b509-146a492e0f3d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'created': u'2020-03-25T18:37:14Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-03-25T18:37:14Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/172aa2f0-24a7-4c6f-b509-146a492e0f3d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-03-25 18:37:15,977 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'87cb79be4b6d49a4bfd22c72bb4744e5', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'dae74511-24c7-4c6b-be3e-c15e5fcf6e6a', 'swap': 0})
2020-03-25 18:37:16,026 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-03-25 18:37:20,838 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid | created_at | name | status | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 056258a8-de09-4261-ac78-cd9762106469 | 2020-03-25T18:37:20.706966 | opnfv-rally | deploy->finished | |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 056258a8-de09-4261-ac78-cd9762106469
~/.rally/openrc was updated
HINTS:
* To use standard OpenStack clients, set up your env by running:
source ~/.rally/openrc
OpenStack clients are now configured, e.g run:
openstack image list
2020-03-25 18:37:23,498 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------
Available services:
+-------------+----------------+-----------+
| Service | Service Type | Status |
+-------------+----------------+-----------+
| __unknown__ | placement | Available |
| cinder | volume | Available |
| cinder | volumev2 | Available |
| cinder | volumev3 | Available |
| cloud | cloudformation | Available |
| glance | image | Available |
| heat | orchestration | Available |
| keystone | identity | Available |
| neutron | network | Available |
| nova | compute | Available |
| swift | object-store | Available |
+-------------+----------------+-----------+
2020-03-25 18:37:24,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-03-25 18:37:24,728 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'87cb79be4b6d49a4bfd22c72bb4744e5', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7e4ff11c-8472-44af-8813-d488f235319a', 'swap': 0})
2020-03-25 18:37:24,821 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'87cb79be4b6d49a4bfd22c72bb4744e5', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7e4ff11c-8472-44af-8813-d488f235319a', 'swap': 0})
2020-03-25 18:37:24,821 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml
2020-03-25 18:37:24,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 18:37:24,843 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 18:37:24,844 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ...
2020-03-25 18:37:24,844 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 18:38:23,692 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 4f2d31f9-6ce9-449e-8222-21b77db0e1f2
2020-03-25 18:38:23,692 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4f2d31f9-6ce9-449e-8222-21b77db0e1f2
2020-03-25 18:38:23,693 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'4f2d31f9-6ce9-449e-8222-21b77db0e1f2']
2020-03-25 18:38:24,703 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4f2d31f9-6ce9-449e-8222-21b77db0e1f2
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2: finished
--------------------------------------------------------------------------------
test scenario Authenticate.keystone
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.keystone | 0.164 | 0.313 | 0.396 | 0.418 | 0.439 | 0.309 | 100.0% | 10 |
| total | 0.164 | 0.313 | 0.396 | 0.418 | 0.439 | 0.31 | 100.0% | 10 |
| -> duration | 0.164 | 0.313 | 0.396 | 0.418 | 0.439 | 0.31 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.841876
Full duration: 7.532569
--------------------------------------------------------------------------------
test scenario Authenticate.validate_cinder
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_cinder | 0.148 | 0.209 | 0.239 | 0.264 | 0.289 | 0.203 | 100.0% | 10 |
| total | 0.241 | 0.41 | 0.483 | 0.49 | 0.496 | 0.388 | 100.0% | 10 |
| -> duration | 0.241 | 0.41 | 0.483 | 0.49 | 0.496 | 0.388 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.073281
Full duration: 6.532307
--------------------------------------------------------------------------------
test scenario Authenticate.validate_glance
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_glance | 0.205 | 0.297 | 0.517 | 0.528 | 0.539 | 0.364 | 100.0% | 10 |
| total | 0.298 | 0.523 | 0.812 | 0.867 | 0.923 | 0.583 | 100.0% | 10 |
| -> duration | 0.298 | 0.523 | 0.812 | 0.867 | 0.923 | 0.583 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.627221
Full duration: 7.283835
--------------------------------------------------------------------------------
test scenario Authenticate.validate_heat
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_heat | 0.152 | 0.298 | 0.334 | 0.343 | 0.351 | 0.261 | 100.0% | 10 |
| total | 0.249 | 0.558 | 0.574 | 0.575 | 0.575 | 0.493 | 100.0% | 10 |
| -> duration | 0.249 | 0.558 | 0.574 | 0.575 | 0.575 | 0.493 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.393346
Full duration: 7.355623
--------------------------------------------------------------------------------
test scenario Authenticate.validate_neutron
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_neutron | 0.371 | 0.463 | 0.751 | 0.767 | 0.784 | 0.516 | 100.0% | 10 |
| total | 0.458 | 0.644 | 0.956 | 0.972 | 0.988 | 0.675 | 100.0% | 10 |
| -> duration | 0.458 | 0.644 | 0.956 | 0.972 | 0.988 | 0.675 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.771613
Full duration: 8.20689
--------------------------------------------------------------------------------
test scenario Authenticate.validate_nova
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_nova | 0.207 | 0.258 | 0.343 | 0.349 | 0.355 | 0.269 | 100.0% | 10 |
| total | 0.339 | 0.534 | 0.648 | 0.648 | 0.648 | 0.494 | 100.0% | 10 |
| -> duration | 0.339 | 0.534 | 0.648 | 0.648 | 0.648 | 0.494 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.345713
Full duration: 7.553742
HINTS:
* To plot HTML graphics with this data, run:
rally task report 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 --out output.html
* To generate a JUnit report, run:
rally task export 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 --json --out output.json
2020-03-25 18:38:24,704 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'4f2d31f9-6ce9-449e-8222-21b77db0e1f2', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json']
2020-03-25 18:38:26,629 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4f2d31f9-6ce9-449e-8222-21b77db0e1f2 --out /home/opnfv/functest/results/rally_full/authenticate.json
2020-03-25 18:38:26,641 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK.
2020-03-25 18:38:26,642 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml
2020-03-25 18:38:26,642 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 18:38:26,662 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 18:38:26,663 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ...
2020-03-25 18:38:26,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 18:42:44,629 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: ebc757e5-ba3c-4d38-8487-a00dd6b41e37
2020-03-25 18:42:44,630 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ebc757e5-ba3c-4d38-8487-a00dd6b41e37
2020-03-25 18:42:44,630 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'ebc757e5-ba3c-4d38-8487-a00dd6b41e37']
2020-03-25 18:42:45,643 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ebc757e5-ba3c-4d38-8487-a00dd6b41e37
--------------------------------------------------------------------------------
Task ebc757e5-ba3c-4d38-8487-a00dd6b41e37: aborted
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_delete_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ebc757e5-ba3c-4d38-8487-a00dd6b41e37 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.509 | 3.984 | 4.51 | 4.522 | 4.533 | 3.999 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.089 | 0.112 | 0.124 | 0.128 | 0.131 | 0.111 | 100.0% | 10 |
| -> glance_v2.upload_data | 1.096 | 1.25 | 1.577 | 1.62 | 1.663 | 1.314 | 100.0% | 10 |
| glance_v2.delete_image | 0.506 | 0.679 | 0.894 | 0.962 | 1.03 | 0.705 | 100.0% | 10 |
| total | 4.125 | 4.661 | 5.425 | 5.482 | 5.538 | 4.704 | 100.0% | 10 |
| -> duration | 4.125 | 4.661 | 5.425 | 5.482 | 5.538 | 4.704 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 14.236254
Full duration: 22.832448
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_list_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ebc757e5-ba3c-4d38-8487-a00dd6b41e37 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.254 | 3.651 | 26.322 | 45.279 | 64.235 | 13.198 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.095 | 0.124 | 0.142 | 0.148 | 0.153 | 0.126 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.842 | 1.074 | 7.412 | 34.57 | 61.727 | 7.128 | 100.0% | 10 |
| glance_v2.list_images | 0.048 | 0.069 | 0.082 | 0.109 | 0.136 | 0.073 | 100.0% | 10 |
| total | 3.323 | 3.72 | 26.373 | 45.34 | 64.308 | 13.271 | 100.0% | 10 |
| -> duration | 3.323 | 3.72 | 26.373 | 45.34 | 64.308 | 13.271 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 64.314555
Full duration: 74.607517
--------------------------------------------------------------------------------
test scenario GlanceImages.list_images
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ebc757e5-ba3c-4d38-8487-a00dd6b41e37 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.list_images | 0.148 | 0.228 | 0.32 | 0.325 | 0.33 | 0.232 | 100.0% | 10 |
| total | 0.148 | 0.228 | 0.321 | 0.325 | 0.33 | 0.232 | 100.0% | 10 |
| -> duration | 0.148 | 0.228 | 0.321 | 0.325 | 0.33 | 0.232 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.275153
Full duration: 11.984438
--------------------------------------------------------------------------------
test scenario GlanceImages.create_image_and_boot_instances
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
}
}
},
"args": {
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img",
"container_format": "bare",
"disk_format": "qcow2",
"number_instances": 2,
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ebc757e5-ba3c-4d38-8487-a00dd6b41e37 has 2 error(s)
--------------------------------------------------------------------------------
HTTPInternalServerError: 500 Internal Server Error
The server has either erred or is incapable of performing the requested operation.
(HTTP 500)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/glance/images.py", line 247, in run
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/image.py", line 70, in create_image
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 200, in create_image
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 97, in create_image
self.upload_data(image_obj.id, image_location=image_location)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 51, in upload_data
self._clients.glance("2").images.upload(image_id, image_data)
File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/glanceclient/v2/images.py", line 288, in upload
resp, body = self.http_client.put(url, headers=hdrs, data=body)
File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 337, in put
return self.request(url, 'PUT', **kwargs)
File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
HTTPInternalServerError: 500 Internal Server Error
The server has either erred or is incapable of performing the requested operation.
(HTTP 500)
--------------------------------------------------------------------------------
HTTPInternalServerError: 500 Internal Server Error
The server has either erred or is incapable of performing the requested operation.
(HTTP 500)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/glance/images.py", line 247, in run
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/image.py", line 70, in create_image
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 200, in create_image
properties=properties)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 97, in create_image
self.upload_data(image_obj.id, image_location=image_location)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 51, in upload_data
self._clients.glance("2").images.upload(image_id, image_data)
File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 598, in inner
return RequestIdProxy(wrapped(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/glanceclient/v2/images.py", line 288, in upload
resp, body = self.http_client.put(url, headers=hdrs, data=body)
File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 337, in put
return self.request(url, 'PUT', **kwargs)
File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 377, in request
return self._handle_response(resp)
File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 126, in _handle_response
raise exc.from_response(resp, resp.content)
HTTPInternalServerError: 500 Internal Server Error
The server has either erred or is incapable of performing the requested operation.
(HTTP 500)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 6.836 | 52.621 | 52.905 | 52.91 | 52.914 | 34.98 | 60.0% | 5 |
| -> glance_v2.get_image (x2) | 0.109 | 0.119 | 0.121 | 0.121 | 0.122 | 0.117 | 100.0% | 3 |
| -> glance_v2.upload_data | 2.741 | 50.058 | 50.473 | 50.484 | 50.494 | 32.183 | 60.0% | 5 |
| -> glance_v2.get_image | 0.065 | 0.083 | 0.098 | 0.1 | 0.102 | 0.083 | 100.0% | 2 |
| nova.boot_servers | 40.938 | 46.551 | 66.013 | 68.446 | 70.879 | 52.789 | 100.0% | 3 |
| total | 52.622 | 53.387 | 88.506 | 91.169 | 93.832 | 66.655 | 60.0% | 5 |
| -> duration | 52.387 | 52.915 | 87.506 | 90.169 | 92.832 | 66.055 | 60.0% | 5 |
| -> idle_duration | 0.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.6 | 60.0% | 5 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 105.415225
Full duration: 135.68039
HINTS:
* To plot HTML graphics with this data, run:
rally task report ebc757e5-ba3c-4d38-8487-a00dd6b41e37 --out output.html
* To generate a JUnit report, run:
rally task export ebc757e5-ba3c-4d38-8487-a00dd6b41e37 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report ebc757e5-ba3c-4d38-8487-a00dd6b41e37 --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 18:42:45,643 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'ebc757e5-ba3c-4d38-8487-a00dd6b41e37', '--out', u'/home/opnfv/functest/results/rally_full/glance.json']
2020-03-25 18:42:47,839 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ebc757e5-ba3c-4d38-8487-a00dd6b41e37 --out /home/opnfv/functest/results/rally_full/glance.json
2020-03-25 18:42:47,855 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed.
2020-03-25 18:42:47,856 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml
2020-03-25 18:42:47,856 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 18:42:47,877 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 18:42:47,878 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ...
2020-03-25 18:42:47,878 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 19:11:43,013 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: ca40cc0f-1b70-4803-afc4-6c30c8e90307
2020-03-25 19:11:43,014 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ca40cc0f-1b70-4803-afc4-6c30c8e90307
2020-03-25 19:11:43,014 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'ca40cc0f-1b70-4803-afc4-6c30c8e90307']
2020-03-25 19:11:44,169 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ca40cc0f-1b70-4803-afc4-6c30c8e90307
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307: finished
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 22.607 | 29.894 | 36.296 | 36.569 | 36.842 | 29.606 | 100.0% | 10 |
| cinder_v3.create_volume | 2.597 | 3.314 | 6.719 | 6.878 | 7.038 | 4.188 | 100.0% | 10 |
| nova.attach_volume | 3.011 | 3.858 | 5.592 | 5.705 | 5.818 | 4.144 | 100.0% | 10 |
| nova.detach_volume | 2.819 | 3.04 | 3.611 | 3.789 | 3.967 | 3.167 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.278 | 2.498 | 3.155 | 3.914 | 4.673 | 2.752 | 100.0% | 10 |
| nova.delete_server | 5.095 | 8.053 | 10.213 | 12.228 | 14.244 | 8.493 | 100.0% | 10 |
| total | 43.138 | 52.629 | 60.524 | 60.689 | 60.854 | 52.351 | 100.0% | 10 |
| -> duration | 42.138 | 51.629 | 59.524 | 59.689 | 59.854 | 51.351 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 151.915595
Full duration: 166.260866
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_snapshots
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 1,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"force": false
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 2.605 | 4.163 | 5.287 | 6.116 | 6.946 | 4.072 | 100.0% | 10 |
| cinder_v3.list_snapshots | 0.035 | 0.043 | 0.046 | 0.047 | 0.048 | 0.042 | 100.0% | 10 |
| total | 2.645 | 4.207 | 5.323 | 6.157 | 6.99 | 4.114 | 100.0% | 10 |
| -> duration | 2.645 | 4.207 | 5.323 | 6.157 | 6.99 | 4.114 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 11.592025
Full duration: 41.437473
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.183 | 22.911 | 44.632 | 48.46 | 52.288 | 26.115 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.081 | 0.101 | 3.194 | 17.068 | 30.942 | 3.182 | 100.0% | 10 |
| total | 9.901 | 33.9 | 44.735 | 48.563 | 52.392 | 29.297 | 100.0% | 10 |
| -> duration | 9.901 | 33.9 | 44.735 | 48.563 | 52.392 | 29.297 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 88.445356
Full duration: 106.355494
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.104 | 4.752 | 5.775 | 6.248 | 6.721 | 4.753 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.07 | 0.093 | 0.134 | 0.195 | 0.255 | 0.109 | 100.0% | 10 |
| total | 3.226 | 4.915 | 5.861 | 6.337 | 6.813 | 4.862 | 100.0% | 10 |
| -> duration | 3.226 | 4.915 | 5.861 | 6.337 | 6.813 | 4.862 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 13.240259
Full duration: 37.260067
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_upload_volume_to_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"container_format": "bare",
"force": false,
"disk_format": "raw",
"do_delete": true,
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.81 | 3.82 | 6.462 | 6.836 | 7.21 | 4.359 | 100.0% | 10 |
| cinder_v3.upload_volume_to_image | 11.648 | 19.718 | 30.77 | 47.272 | 63.775 | 23.886 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.327 | 2.463 | 3.027 | 3.44 | 3.852 | 2.665 | 100.0% | 10 |
| glance_v2.delete_image | 1.359 | 1.99 | 7.286 | 28.807 | 50.328 | 6.8 | 100.0% | 10 |
| total | 18.444 | 32.478 | 71.535 | 74.461 | 77.387 | 37.71 | 100.0% | 10 |
| -> duration | 18.444 | 32.478 | 71.535 | 74.461 | 77.387 | 37.71 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 116.098961
Full duration: 128.486747
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"create_vm_params": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
]
},
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"nested_level": 1,
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 20.057 | 34.371 | 41.647 | 51.329 | 61.011 | 36.107 | 100.0% | 10 |
| cinder_v3.create_volume | 2.569 | 3.093 | 6.159 | 11.026 | 15.892 | 4.552 | 100.0% | 10 |
| cinder_v3.create_snapshot | 2.401 | 2.718 | 7.281 | 24.682 | 42.084 | 6.695 | 100.0% | 10 |
| nova.attach_volume | 3.101 | 5.678 | 26.033 | 35.353 | 44.673 | 11.838 | 100.0% | 10 |
| nova.detach_volume | 2.785 | 4.428 | 19.489 | 32.702 | 45.915 | 10.518 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.289 | 2.439 | 11.908 | 11.979 | 12.05 | 4.319 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.295 | 2.466 | 9.071 | 12.082 | 15.093 | 4.3 | 100.0% | 10 |
| nova.delete_server | 5.057 | 5.658 | 9.499 | 11.626 | 13.753 | 7.088 | 100.0% | 10 |
| total | 57.683 | 69.487 | 127.168 | 149.571 | 171.973 | 85.419 | 100.0% | 10 |
| -> duration | 56.683 | 68.487 | 126.168 | 148.571 | 170.973 | 84.419 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 304.275917
Full duration: 340.64684
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_snapshot_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"create_vm_params": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
]
},
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.423 | 8.262 | 54.007 | 55.345 | 56.684 | 21.647 | 100.0% | 10 |
| cinder_v3.create_snapshot | 2.751 | 6.144 | 42.415 | 43.731 | 45.046 | 18.701 | 100.0% | 10 |
| nova.boot_server | 18.971 | 27.21 | 39.279 | 41.148 | 43.017 | 29.117 | 100.0% | 10 |
| nova.attach_volume | 2.98 | 4.81 | 28.27 | 30.384 | 32.498 | 9.616 | 100.0% | 10 |
| nova.detach_volume | 2.935 | 3.058 | 3.162 | 3.223 | 3.284 | 3.064 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.287 | 2.505 | 7.117 | 8.1 | 9.083 | 3.783 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.292 | 2.625 | 5.112 | 6.01 | 6.909 | 3.295 | 100.0% | 10 |
| nova.delete_server | 5.063 | 9.109 | 16.495 | 16.703 | 16.91 | 10.459 | 100.0% | 10 |
| total | 55.516 | 83.213 | 141.558 | 145.817 | 150.077 | 99.683 | 100.0% | 10 |
| -> duration | 54.516 | 82.213 | 140.558 | 144.817 | 149.077 | 98.683 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 278.897252
Full duration: 301.953446
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.279 | 4.099 | 5.463 | 5.527 | 5.59 | 4.433 | 100.0% | 10 |
| total | 3.279 | 4.099 | 5.464 | 5.527 | 5.591 | 4.433 | 100.0% | 10 |
| -> duration | 3.279 | 4.099 | 5.464 | 5.527 | 5.591 | 4.433 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.645639
Full duration: 58.427652
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.008 | 4.221 | 5.699 | 5.825 | 5.951 | 4.197 | 100.0% | 10 |
| total | 3.008 | 4.221 | 5.699 | 5.825 | 5.951 | 4.198 | 100.0% | 10 |
| -> duration | 3.008 | 4.221 | 5.699 | 5.825 | 5.951 | 4.198 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.865718
Full duration: 32.117431
--------------------------------------------------------------------------------
test scenario CinderVolumes.list_volumes
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 4,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.list_volumes | 0.244 | 0.376 | 0.571 | 0.679 | 0.788 | 0.402 | 100.0% | 10 |
| total | 0.244 | 0.376 | 0.571 | 0.679 | 0.788 | 0.402 | 100.0% | 10 |
| -> duration | 0.244 | 0.376 | 0.571 | 0.679 | 0.788 | 0.402 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.109343
Full duration: 66.511694
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_snapshot
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 1,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"force": false
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 2.478 | 5.703 | 7.874 | 8.525 | 9.177 | 5.507 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.251 | 2.499 | 4.709 | 5.566 | 6.423 | 3.392 | 100.0% | 10 |
| total | 5.078 | 9.28 | 11.532 | 11.737 | 11.942 | 8.9 | 100.0% | 10 |
| -> duration | 5.078 | 9.28 | 11.532 | 11.737 | 11.942 | 8.9 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 23.658877
Full duration: 53.08383
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.685 | 4.04 | 4.287 | 4.434 | 4.581 | 4.041 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.322 | 2.694 | 6.367 | 6.569 | 6.771 | 4.049 | 100.0% | 10 |
| total | 6.049 | 7.016 | 10.473 | 10.475 | 10.476 | 8.09 | 100.0% | 10 |
| -> duration | 6.049 | 7.016 | 10.473 | 10.475 | 10.476 | 8.09 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 23.635397
Full duration: 62.74105
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.208 | 9.872 | 10.174 | 11.088 | 12.003 | 9.956 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.253 | 2.556 | 2.847 | 2.948 | 3.048 | 2.56 | 100.0% | 10 |
| total | 11.555 | 12.487 | 12.945 | 13.623 | 14.301 | 12.517 | 100.0% | 10 |
| -> duration | 11.555 | 12.487 | 12.945 | 13.623 | 14.301 | 12.517 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 36.846947
Full duration: 50.937177
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 2
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.192 | 3.944 | 4.553 | 4.665 | 4.778 | 3.961 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.269 | 2.707 | 3.325 | 3.36 | 3.395 | 2.774 | 100.0% | 10 |
| total | 5.613 | 6.585 | 7.807 | 7.826 | 7.845 | 6.735 | 100.0% | 10 |
| -> duration | 5.613 | 6.585 | 7.807 | 7.826 | 7.845 | 6.735 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 19.700167
Full duration: 51.518898
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_extend_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"new_size": 2,
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.937 | 3.822 | 5.144 | 5.216 | 5.287 | 3.953 | 100.0% | 10 |
| cinder_v3.extend_volume | 2.39 | 2.782 | 4.059 | 5.118 | 6.177 | 3.197 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.084 | 2.53 | 3.438 | 3.501 | 3.564 | 2.684 | 100.0% | 10 |
| total | 8.162 | 9.278 | 11.782 | 12.596 | 13.411 | 9.835 | 100.0% | 10 |
| -> duration | 8.162 | 9.278 | 11.782 | 12.596 | 13.411 | 9.835 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 28.246971
Full duration: 41.372742
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_from_volume_and_delete_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 1,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 3.106 | 3.689 | 5.246 | 6.682 | 8.117 | 4.13 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.272 | 2.67 | 4.476 | 4.536 | 4.596 | 3.111 | 100.0% | 10 |
| total | 5.887 | 6.96 | 8.3 | 9.495 | 10.69 | 7.241 | 100.0% | 10 |
| -> duration | 5.887 | 6.96 | 8.3 | 9.495 | 10.69 | 7.241 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 21.32586
Full duration: 50.620634
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_get_qos
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"write_iops_sec": "10",
"consumer": "both",
"read_iops_sec": "1000"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.212 | 0.339 | 0.398 | 0.414 | 0.431 | 0.327 | 100.0% | 10 |
| cinder_v3.get_qos | 0.031 | 0.051 | 0.086 | 0.092 | 0.099 | 0.056 | 100.0% | 10 |
| total | 0.26 | 0.396 | 0.443 | 0.453 | 0.462 | 0.384 | 100.0% | 10 |
| -> duration | 0.26 | 0.396 | 0.443 | 0.453 | 0.462 | 0.384 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.213425
Full duration: 13.129693
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_list_qos
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"write_iops_sec": "10",
"consumer": "both",
"read_iops_sec": "1000"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.207 | 0.497 | 3.965 | 4.955 | 5.945 | 1.315 | 100.0% | 10 |
| cinder_v3.list_qos | 0.034 | 0.043 | 0.053 | 0.058 | 0.062 | 0.044 | 100.0% | 10 |
| total | 0.241 | 0.547 | 4.007 | 5.007 | 6.008 | 1.36 | 100.0% | 10 |
| -> duration | 0.241 | 0.547 | 4.007 | 5.007 | 6.008 | 1.36 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.984346
Full duration: 17.096116
--------------------------------------------------------------------------------
test scenario CinderQos.create_and_set_qos
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"set_read_iops_sec": "1001",
"set_consumer": "both",
"read_iops_sec": "1000",
"set_write_iops_sec": "11",
"write_iops_sec": "10",
"consumer": "back-end"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_qos | 0.207 | 0.403 | 0.565 | 0.579 | 0.594 | 0.412 | 100.0% | 10 |
| cinder_v3.set_qos | 0.085 | 0.147 | 0.209 | 0.21 | 0.21 | 0.153 | 100.0% | 10 |
| total | 0.306 | 0.516 | 0.774 | 0.789 | 0.804 | 0.566 | 100.0% | 10 |
| -> duration | 0.306 | 0.516 | 0.774 | 0.789 | 0.804 | 0.566 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.78838
Full duration: 18.081833
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_get_volume_type
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"description": "rally tests creating types"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 0.227 | 0.291 | 0.459 | 0.477 | 0.496 | 0.336 | 100.0% | 10 |
| cinder_v3.get_volume_type | 0.033 | 0.053 | 0.072 | 0.077 | 0.082 | 0.056 | 100.0% | 10 |
| total | 0.27 | 0.361 | 0.51 | 0.523 | 0.535 | 0.392 | 100.0% | 10 |
| -> duration | 0.27 | 0.361 | 0.51 | 0.523 | 0.535 | 0.392 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.150942
Full duration: 9.487611
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_list_volume_types
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"description": "rally tests creating types"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 0.224 | 0.389 | 0.571 | 0.579 | 0.587 | 0.407 | 100.0% | 10 |
| cinder_v3.list_types | 0.062 | 0.1 | 0.124 | 0.149 | 0.175 | 0.103 | 100.0% | 10 |
| total | 0.286 | 0.508 | 0.688 | 0.691 | 0.694 | 0.511 | 100.0% | 10 |
| -> duration | 0.286 | 0.508 | 0.688 | 0.691 | 0.694 | 0.511 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.547556
Full duration: 9.943797
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_and_update_volume_type
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"description": "test",
"update_description": "test update"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type | 0.438 | 0.589 | 1.091 | 1.108 | 1.126 | 0.665 | 100.0% | 10 |
| cinder_v2.update_volume_type | 0.113 | 0.24 | 0.824 | 0.964 | 1.104 | 0.428 | 100.0% | 10 |
| total | 0.734 | 1.068 | 1.427 | 1.561 | 1.695 | 1.093 | 100.0% | 10 |
| -> duration | 0.734 | 1.068 | 1.427 | 1.561 | 1.695 | 1.093 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.079783
Full duration: 14.591145
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_volume_type_and_encryption_type
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"control_location": "front-end",
"cipher": "aes-xts-plain64",
"description": "rally tests creating types",
"key_size": 512,
"provider": "LuksEncryptor"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume_type | 0.222 | 0.303 | 0.432 | 0.451 | 0.47 | 0.325 | 100.0% | 10 |
| cinder_v3.create_encryption_type | 0.114 | 0.156 | 0.232 | 0.282 | 0.332 | 0.179 | 100.0% | 10 |
| total | 0.367 | 0.517 | 0.602 | 0.602 | 0.602 | 0.504 | 100.0% | 10 |
| -> duration | 0.367 | 0.517 | 0.602 | 0.602 | 0.602 | 0.504 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.535391
Full duration: 12.214926
--------------------------------------------------------------------------------
test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"description": "rally tests creating types"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task ca40cc0f-1b70-4803-afc4-6c30c8e90307 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v2.create_volume_type | 0.253 | 0.426 | 0.644 | 0.653 | 0.661 | 0.461 | 100.0% | 10 |
| cinder_v2.add_type_access | 0.06 | 0.134 | 0.327 | 0.344 | 0.361 | 0.164 | 100.0% | 10 |
| cinder_v2.list_type_access | 0.04 | 0.051 | 0.171 | 0.184 | 0.196 | 0.075 | 100.0% | 10 |
| total | 0.442 | 0.652 | 1.028 | 1.039 | 1.051 | 0.7 | 100.0% | 10 |
| -> duration | 0.442 | 0.652 | 1.028 | 1.039 | 1.051 | 0.7 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.946437
Full duration: 13.457106
HINTS:
* To plot HTML graphics with this data, run:
rally task report ca40cc0f-1b70-4803-afc4-6c30c8e90307 --out output.html
* To generate a JUnit report, run:
rally task export ca40cc0f-1b70-4803-afc4-6c30c8e90307 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report ca40cc0f-1b70-4803-afc4-6c30c8e90307 --json --out output.json
2020-03-25 19:11:44,170 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'ca40cc0f-1b70-4803-afc4-6c30c8e90307', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json']
2020-03-25 19:11:46,544 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ca40cc0f-1b70-4803-afc4-6c30c8e90307 --out /home/opnfv/functest/results/rally_full/cinder.json
2020-03-25 19:11:46,612 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK.
2020-03-25 19:11:46,612 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml
2020-03-25 19:11:46,613 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 19:11:46,629 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 19:11:46,629 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ...
2020-03-25 19:11:46,630 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 19:18:49,632 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: e6474308-aac6-4a26-8c85-dded84ed9fb1
2020-03-25 19:18:49,633 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e6474308-aac6-4a26-8c85-dded84ed9fb1
2020-03-25 19:18:49,633 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'e6474308-aac6-4a26-8c85-dded84ed9fb1']
2020-03-25 19:18:50,625 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e6474308-aac6-4a26-8c85-dded84ed9fb1
--------------------------------------------------------------------------------
Task e6474308-aac6-4a26-8c85-dded84ed9fb1: aborted
--------------------------------------------------------------------------------
test scenario HeatStacks.create_and_delete_stack
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"heat_stack_owner"
]
},
"args": {
"template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e6474308-aac6-4a26-8c85-dded84ed9fb1 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 3.38 | 4.373 | 6.123 | 6.128 | 6.134 | 4.721 | 100.0% | 10 |
| heat.delete_stack | 1.209 | 1.246 | 2.351 | 2.36 | 2.368 | 1.575 | 100.0% | 10 |
| total | 4.603 | 6.501 | 7.348 | 7.349 | 7.351 | 6.296 | 100.0% | 10 |
| -> duration | 2.603 | 4.501 | 5.348 | 5.349 | 5.351 | 4.296 | 100.0% | 10 |
| -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 16.277058
Full duration: 32.31964
--------------------------------------------------------------------------------
test scenario HeatStacks.create_and_delete_stack
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"heat_stack_owner"
]
},
"args": {
"template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template",
"parameters": {
"image": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42",
"public_net": "public",
"flavor": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e6474308-aac6-4a26-8c85-dded84ed9fb1 has 1 error(s)
--------------------------------------------------------------------------------
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/stacks.py", line 93, in run
files, environment)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack
stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"]
File "/usr/lib/python2.7/site-packages/heatclient/v1/stacks.py", line 171, in create
data=kwargs, headers=headers)
File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python2.7/site-packages/heatclient/common/http.py", line 323, in request
raise exc.from_response(resp)
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 60.133 | 67.534 | 83.484 | 90.932 | 98.38 | 71.228 | 90.0% | 10 |
| heat.delete_stack | 18.778 | 25.672 | 34.855 | 37.914 | 40.973 | 26.82 | 100.0% | 9 |
| total | 60.133 | 96.52 | 113.788 | 115.473 | 117.159 | 95.366 | 90.0% | 10 |
| -> duration | 60.133 | 94.52 | 111.788 | 113.473 | 115.159 | 93.566 | 90.0% | 10 |
| -> idle_duration | 0.0 | 2.0 | 2.0 | 2.0 | 2.0 | 1.8 | 90.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 298.411624
Full duration: 361.307588
HINTS:
* To plot HTML graphics with this data, run:
rally task report e6474308-aac6-4a26-8c85-dded84ed9fb1 --out output.html
* To generate a JUnit report, run:
rally task export e6474308-aac6-4a26-8c85-dded84ed9fb1 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report e6474308-aac6-4a26-8c85-dded84ed9fb1 --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 19:18:50,626 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'e6474308-aac6-4a26-8c85-dded84ed9fb1', '--out', u'/home/opnfv/functest/results/rally_full/heat.json']
2020-03-25 19:18:52,782 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e6474308-aac6-4a26-8c85-dded84ed9fb1 --out /home/opnfv/functest/results/rally_full/heat.json
2020-03-25 19:18:52,788 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed.
2020-03-25 19:18:52,788 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml
2020-03-25 19:18:52,789 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 19:18:52,811 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 19:18:52,812 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ...
2020-03-25 19:18:52,812 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 19:26:03,375 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: e2a809f4-a846-4ee1-9345-1ad7e55e4e69
2020-03-25 19:26:03,376 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e2a809f4-a846-4ee1-9345-1ad7e55e4e69
2020-03-25 19:26:03,376 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'e2a809f4-a846-4ee1-9345-1ad7e55e4e69']
2020-03-25 19:26:04,445 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e2a809f4-a846-4ee1-9345-1ad7e55e4e69
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69: finished
--------------------------------------------------------------------------------
test scenario KeystoneBasic.add_and_remove_user_role
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.053 | 0.14 | 0.355 | 0.429 | 0.504 | 0.183 | 100.0% | 10 |
| keystone_v3.add_role | 0.057 | 0.081 | 0.195 | 0.231 | 0.267 | 0.112 | 100.0% | 10 |
| keystone_v3.revoke_role | 0.063 | 0.127 | 0.213 | 0.282 | 0.351 | 0.145 | 100.0% | 10 |
| total | 0.213 | 0.381 | 0.737 | 0.753 | 0.769 | 0.44 | 100.0% | 10 |
| -> duration | 0.213 | 0.381 | 0.737 | 0.753 | 0.769 | 0.44 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.10823
Full duration: 15.690393
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_add_and_list_user_roles
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.053 | 0.138 | 0.665 | 0.804 | 0.943 | 0.246 | 100.0% | 10 |
| keystone_v3.add_role | 0.047 | 0.054 | 0.13 | 0.182 | 0.235 | 0.08 | 100.0% | 10 |
| keystone_v3.list_roles | 0.028 | 0.033 | 0.04 | 0.058 | 0.076 | 0.036 | 100.0% | 10 |
| total | 0.143 | 0.228 | 0.919 | 1.007 | 1.095 | 0.363 | 100.0% | 10 |
| -> duration | 0.143 | 0.228 | 0.919 | 1.007 | 1.095 | 0.363 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.727243
Full duration: 13.365785
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_tenants
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.145 | 0.289 | 0.359 | 0.38 | 0.401 | 0.268 | 100.0% | 10 |
| keystone_v3.list_projects | 0.03 | 0.034 | 0.1 | 0.128 | 0.157 | 0.053 | 100.0% | 10 |
| total | 0.18 | 0.347 | 0.435 | 0.437 | 0.438 | 0.321 | 100.0% | 10 |
| -> duration | 0.18 | 0.347 | 0.435 | 0.437 | 0.438 | 0.321 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.949874
Full duration: 47.741234
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_role
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.078 | 0.192 | 0.806 | 1.991 | 3.177 | 0.511 | 100.0% | 10 |
| keystone_v3.delete_role | 0.078 | 0.271 | 0.439 | 0.483 | 0.527 | 0.274 | 100.0% | 10 |
| total | 0.156 | 0.546 | 1.205 | 2.25 | 3.296 | 0.784 | 100.0% | 10 |
| -> duration | 0.156 | 0.546 | 1.205 | 2.25 | 3.296 | 0.784 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 14.204633
Full duration: 23.394331
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_service
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_service | 0.056 | 0.149 | 0.365 | 0.566 | 0.767 | 0.218 | 100.0% | 10 |
| keystone_v3.delete_service | 0.063 | 0.093 | 0.138 | 0.154 | 0.171 | 0.099 | 100.0% | 10 |
| total | 0.128 | 0.243 | 0.528 | 0.695 | 0.861 | 0.318 | 100.0% | 10 |
| -> duration | 0.128 | 0.243 | 0.528 | 0.695 | 0.861 | 0.318 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 16.47765
Full duration: 29.966762
--------------------------------------------------------------------------------
test scenario KeystoneBasic.get_entities
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 55.825502
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_update_and_delete_tenant
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.112 | 0.287 | 3.449 | 4.844 | 6.239 | 1.132 | 100.0% | 10 |
| keystone_v3.update_project | 0.049 | 0.132 | 0.271 | 0.273 | 0.275 | 0.145 | 100.0% | 10 |
| keystone_v3.delete_project | 0.117 | 0.214 | 0.27 | 0.305 | 0.339 | 0.212 | 100.0% | 10 |
| total | 0.405 | 0.61 | 3.98 | 5.357 | 6.735 | 1.489 | 100.0% | 10 |
| -> duration | 0.405 | 0.61 | 3.98 | 5.357 | 6.735 | 1.489 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.065671
Full duration: 18.301039
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_user
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.111 | 0.176 | 1.557 | 6.902 | 12.247 | 1.404 | 100.0% | 10 |
| total | 0.154 | 0.28 | 12.604 | 13.872 | 15.139 | 2.962 | 100.0% | 10 |
| -> duration | 0.154 | 0.28 | 12.604 | 13.872 | 15.139 | 2.962 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 25.691003
Full duration: 45.973313
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.154 | 0.452 | 1.03 | 1.103 | 1.177 | 0.522 | 100.0% | 10 |
| total | 0.154 | 0.452 | 1.03 | 1.104 | 1.177 | 0.522 | 100.0% | 10 |
| -> duration | 0.154 | 0.452 | 1.03 | 1.104 | 1.177 | 0.522 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.797736
Full duration: 11.58601
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_users
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_user | 0.127 | 0.204 | 0.334 | 0.403 | 0.472 | 0.235 | 100.0% | 10 |
| keystone_v3.list_users | 0.054 | 0.067 | 0.127 | 0.153 | 0.179 | 0.081 | 100.0% | 10 |
| total | 0.282 | 0.374 | 0.476 | 0.57 | 0.664 | 0.393 | 100.0% | 10 |
| -> duration | 0.282 | 0.374 | 0.476 | 0.57 | 0.664 | 0.393 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.594919
Full duration: 15.864697
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant_with_users
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {
"users_per_tenant": 10
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e2a809f4-a846-4ee1-9345-1ad7e55e4e69 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.179 | 0.258 | 0.696 | 0.864 | 1.031 | 0.37 | 100.0% | 10 |
| keystone_v3.create_users | 4.864 | 7.66 | 8.278 | 8.373 | 8.469 | 7.288 | 100.0% | 10 |
| -> keystone_v3.create_user (x10) | 4.864 | 7.659 | 8.278 | 8.373 | 8.468 | 7.288 | 100.0% | 10 |
| --> keystone_v3.list_roles (x10) | 0.264 | 0.555 | 1.579 | 1.707 | 1.836 | 0.8 | 100.0% | 10 |
| --> keystone_v3.add_role (x10) | 1.87 | 2.737 | 3.314 | 3.46 | 3.607 | 2.763 | 100.0% | 10 |
| total | 5.578 | 8.952 | 9.162 | 9.215 | 9.267 | 8.342 | 100.0% | 10 |
| -> duration | 5.578 | 8.952 | 9.162 | 9.215 | 9.267 | 8.342 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 24.709831
Full duration: 136.906224
HINTS:
* To plot HTML graphics with this data, run:
rally task report e2a809f4-a846-4ee1-9345-1ad7e55e4e69 --out output.html
* To generate a JUnit report, run:
rally task export e2a809f4-a846-4ee1-9345-1ad7e55e4e69 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report e2a809f4-a846-4ee1-9345-1ad7e55e4e69 --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 19:26:04,446 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'e2a809f4-a846-4ee1-9345-1ad7e55e4e69', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json']
2020-03-25 19:26:06,700 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e2a809f4-a846-4ee1-9345-1ad7e55e4e69 --out /home/opnfv/functest/results/rally_full/keystone.json
2020-03-25 19:26:06,737 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" Failed.
2020-03-25 19:26:06,738 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml
2020-03-25 19:26:06,738 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 19:26:06,757 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 19:26:06,758 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-03-25 19:26:06,758 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 19:44:20,547 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: d1e3c7db-9100-4b7c-9138-46df10ac45d0
2020-03-25 19:44:20,547 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d1e3c7db-9100-4b7c-9138-46df10ac45d0
2020-03-25 19:44:20,547 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'd1e3c7db-9100-4b7c-9138-46df10ac45d0']
2020-03-25 19:44:21,623 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d1e3c7db-9100-4b7c-9138-46df10ac45d0
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0: finished
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_networks
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"args": {
"network_create_args": {},
"network_update_args": {
"admin_state_up": false
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.608 | 0.848 | 1.43 | 1.563 | 1.696 | 1.04 | 100.0% | 10 |
| neutron.update_network | 0.568 | 0.779 | 1.161 | 1.21 | 1.26 | 0.825 | 100.0% | 10 |
| total | 1.338 | 1.648 | 2.679 | 2.763 | 2.846 | 1.865 | 100.0% | 10 |
| -> duration | 1.338 | 1.648 | 2.679 | 2.763 | 2.846 | 1.865 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 5.043135
Full duration: 27.321013
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_ports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"network_create_args": {},
"ports_per_network": 1,
"port_create_args": {},
"port_update_args": {
"device_owner": "dummy_owner",
"device_id": "dummy_id",
"admin_state_up": false
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 1.237 | 2.114 | 2.643 | 2.745 | 2.846 | 2.043 | 100.0% | 10 |
| neutron.update_port | 0.629 | 0.922 | 1.149 | 1.151 | 1.154 | 0.91 | 100.0% | 10 |
| total | 2.098 | 3.03 | 3.641 | 3.7 | 3.759 | 2.953 | 100.0% | 10 |
| -> duration | 2.098 | 3.03 | 3.641 | 3.7 | 3.759 | 2.953 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 8.417095
Full duration: 47.55925
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_routers
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"router": -1,
"network": -1,
"port": -1
}
}
},
"args": {
"subnets_per_network": 1,
"subnet_cidr_start": "1.1.0.0/30",
"network_create_args": {},
"subnet_create_args": {},
"router_update_args": {
"admin_state_up": false
},
"router_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.555 | 1.669 | 2.802 | 3.161 | 3.52 | 1.819 | 100.0% | 10 |
| neutron.create_subnet | 1.485 | 1.873 | 3.441 | 3.505 | 3.569 | 2.159 | 100.0% | 10 |
| neutron.create_router | 5.475 | 9.258 | 13.262 | 13.273 | 13.283 | 9.889 | 100.0% | 10 |
| neutron.add_interface_router | 2.392 | 3.991 | 4.997 | 5.038 | 5.08 | 3.981 | 100.0% | 10 |
| neutron.update_router | 0.509 | 0.703 | 1.256 | 1.621 | 1.986 | 0.852 | 100.0% | 10 |
| total | 11.08 | 19.343 | 22.429 | 23.075 | 23.72 | 18.7 | 100.0% | 10 |
| -> duration | 11.08 | 19.343 | 22.429 | 23.075 | 23.72 | 18.7 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 52.622871
Full duration: 130.875826
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_subnets
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_create_args": {},
"subnets_per_network": 1,
"subnet_cidr_start": "1.4.0.0/16",
"subnet_update_args": {
"enable_dhcp": false
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.559 | 0.892 | 1.338 | 1.406 | 1.474 | 0.934 | 100.0% | 10 |
| neutron.create_subnet | 0.979 | 1.816 | 2.737 | 2.746 | 2.755 | 1.766 | 100.0% | 10 |
| neutron.update_subnet | 0.617 | 0.964 | 1.351 | 1.367 | 1.382 | 0.962 | 100.0% | 10 |
| total | 2.288 | 3.595 | 4.718 | 4.722 | 4.727 | 3.663 | 100.0% | 10 |
| -> duration | 2.288 | 3.595 | 4.718 | 4.722 | 4.727 | 3.663 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.343156
Full duration: 37.077953
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_networks
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"args": {
"network_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.61 | 0.698 | 1.797 | 1.819 | 1.841 | 1.004 | 100.0% | 10 |
| neutron.delete_network | 0.584 | 0.79 | 0.988 | 1.02 | 1.051 | 0.8 | 100.0% | 10 |
| total | 1.276 | 1.542 | 2.754 | 2.784 | 2.814 | 1.803 | 100.0% | 10 |
| -> duration | 1.276 | 1.542 | 2.754 | 2.784 | 2.814 | 1.803 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.502343
Full duration: 20.921742
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_ports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"network_create_args": {},
"ports_per_network": 1,
"port_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port | 1.032 | 1.482 | 2.186 | 2.303 | 2.421 | 1.592 | 100.0% | 10 |
| neutron.delete_port | 0.645 | 0.844 | 1.3 | 1.333 | 1.366 | 0.948 | 100.0% | 10 |
| total | 1.88 | 2.293 | 3.545 | 3.629 | 3.714 | 2.54 | 100.0% | 10 |
| -> duration | 1.88 | 2.293 | 3.545 | 3.629 | 3.714 | 2.54 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 7.112473
Full duration: 76.316451
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_routers
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"router": -1,
"network": -1,
"port": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnets_per_network": 1,
"router_create_args": {},
"subnet_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.611 | 1.072 | 1.201 | 1.213 | 1.226 | 1.01 | 100.0% | 10 |
| neutron.create_subnet | 1.024 | 2.225 | 4.898 | 5.061 | 5.223 | 2.631 | 100.0% | 10 |
| neutron.create_router | 6.718 | 9.6 | 15.296 | 15.782 | 16.268 | 10.88 | 100.0% | 10 |
| neutron.add_interface_router | 2.575 | 3.371 | 4.12 | 4.207 | 4.295 | 3.337 | 100.0% | 10 |
| neutron.remove_interface_router | 1.689 | 2.196 | 2.586 | 2.615 | 2.644 | 2.175 | 100.0% | 10 |
| neutron.delete_router | 3.06 | 5.896 | 7.674 | 8.456 | 9.239 | 5.846 | 100.0% | 10 |
| total | 20.515 | 24.256 | 32.151 | 32.88 | 33.608 | 25.88 | 100.0% | 10 |
| -> duration | 20.515 | 24.256 | 32.151 | 32.88 | 33.608 | 25.88 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 75.707216
Full duration: 143.954903
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_subnets
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"network_create_args": {},
"subnet_create_args": {},
"subnets_per_network": 1,
"subnet_cidr_start": "1.1.0.0/30"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_subnet | 0.911 | 1.195 | 2.408 | 5.693 | 8.977 | 1.943 | 100.0% | 10 |
| neutron.delete_subnet | 0.719 | 0.97 | 1.249 | 1.565 | 1.881 | 1.03 | 100.0% | 10 |
| total | 1.698 | 2.086 | 3.787 | 6.936 | 10.084 | 2.973 | 100.0% | 10 |
| -> duration | 1.698 | 2.086 | 3.787 | 6.936 | 10.084 | 2.973 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.089944
Full duration: 94.535022
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"args": {
"network_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.055822
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"network_create_args": {},
"ports_per_network": 1,
"port_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.064961
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnets_per_network": 1,
"router_create_args": {},
"subnet_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.061092
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_create_args": {},
"subnets_per_network": 1,
"subnet_cidr_start": "1.1.0.0/30"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.491 | 0.906 | 1.353 | 1.408 | 1.463 | 0.939 | 100.0% | 10 |
| neutron.create_subnet | 0.748 | 1.271 | 1.835 | 1.901 | 1.966 | 1.235 | 100.0% | 10 |
| neutron.list_subnets | 0.094 | 0.106 | 0.164 | 0.165 | 0.165 | 0.117 | 100.0% | 10 |
| total | 1.427 | 2.152 | 2.966 | 2.995 | 3.024 | 2.291 | 100.0% | 10 |
| -> duration | 1.427 | 2.152 | 2.966 | 2.995 | 3.024 | 2.291 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.549828
Full duration: 34.268232
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_delete_security_groups
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 0.47 | 1.799 | 2.237 | 2.272 | 2.307 | 1.509 | 100.0% | 10 |
| neutron.delete_security_group | 0.219 | 0.285 | 1.027 | 1.081 | 1.134 | 0.44 | 100.0% | 10 |
| total | 0.752 | 2.159 | 2.503 | 2.519 | 2.536 | 1.949 | 100.0% | 10 |
| -> duration | 0.752 | 2.159 | 2.503 | 2.519 | 2.536 | 1.949 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 5.087289
Full duration: 21.334482
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_delete_security_group_rule
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 0.624 | 2.03 | 4.088 | 4.109 | 4.13 | 2.351 | 100.0% | 10 |
| neutron.create_security_group_rule | 0.395 | 0.676 | 1.505 | 1.593 | 1.681 | 0.811 | 100.0% | 10 |
| neutron.delete_security_group_rule | 0.142 | 0.262 | 0.551 | 0.559 | 0.568 | 0.325 | 100.0% | 10 |
| neutron.delete_security_group | 0.227 | 0.447 | 0.621 | 0.767 | 0.913 | 0.459 | 100.0% | 10 |
| total | 1.389 | 3.551 | 5.712 | 6.038 | 6.363 | 3.947 | 100.0% | 10 |
| -> duration | 1.389 | 3.551 | 5.712 | 6.038 | 6.363 | 3.947 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.549905
Full duration: 23.900581
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_list_security_group_rules
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 0.534 | 0.826 | 1.464 | 1.482 | 1.5 | 1.016 | 100.0% | 10 |
| neutron.create_security_group_rule | 0.288 | 0.569 | 1.084 | 1.232 | 1.38 | 0.676 | 100.0% | 10 |
| neutron.list_security_group_rules | 0.054 | 0.076 | 0.178 | 0.193 | 0.207 | 0.095 | 100.0% | 10 |
| total | 1.363 | 1.811 | 2.013 | 2.154 | 2.295 | 1.786 | 100.0% | 10 |
| -> duration | 1.363 | 1.811 | 2.013 | 2.154 | 2.295 | 1.786 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 5.088757
Full duration: 22.415058
--------------------------------------------------------------------------------
test scenario NeutronSecurityGroup.create_and_show_security_group
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"security_group": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_security_group | 0.317 | 0.578 | 1.531 | 1.539 | 1.547 | 0.874 | 100.0% | 10 |
| neutron.show_security_group | 0.047 | 0.067 | 0.068 | 0.069 | 0.069 | 0.065 | 100.0% | 10 |
| total | 0.382 | 0.643 | 1.598 | 1.606 | 1.614 | 0.938 | 100.0% | 10 |
| -> duration | 0.382 | 0.643 | 1.598 | 1.606 | 1.614 | 0.938 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.562954
Full duration: 18.38661
--------------------------------------------------------------------------------
test scenario NeutronNetworks.set_and_clear_router_gateway
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"admin"
],
"quotas": {
"neutron": {
"router": -1,
"network": -1
}
}
},
"args": {
"network_create_args": {
"router:external": true
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.611 | 2.125 | 2.31 | 2.361 | 2.412 | 1.794 | 100.0% | 10 |
| neutron.create_router | 4.599 | 7.869 | 13.443 | 13.521 | 13.6 | 8.425 | 100.0% | 10 |
| neutron.add_gateway_router | 1.755 | 4.852 | 6.812 | 6.959 | 7.106 | 4.839 | 100.0% | 10 |
| neutron.remove_gateway_router | 1.14 | 2.151 | 4.906 | 5.195 | 5.484 | 2.552 | 100.0% | 10 |
| total | 8.919 | 16.484 | 25.133 | 25.138 | 25.143 | 17.611 | 100.0% | 10 |
| -> duration | 8.919 | 16.484 | 25.133 | 25.138 | 25.143 | 17.611 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 47.937894
Full duration: 83.925037
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_ports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"router": -1,
"network": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"ports_per_network": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_port (x2) | 2.511 | 3.426 | 5.385 | 5.452 | 5.52 | 3.829 | 100.0% | 10 |
| neutron.show_port (x2) | 0.172 | 0.241 | 0.61 | 0.76 | 0.911 | 0.337 | 100.0% | 10 |
| total | 2.718 | 3.721 | 5.713 | 5.757 | 5.801 | 4.167 | 100.0% | 10 |
| -> duration | 2.718 | 3.721 | 5.713 | 5.757 | 5.801 | 4.167 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.341114
Full duration: 56.277174
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_routers
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"subnets_per_network": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.457 | 0.984 | 3.388 | 5.496 | 7.603 | 1.779 | 100.0% | 10 |
| neutron.create_subnet (x2) | 1.378 | 3.399 | 4.107 | 4.447 | 4.786 | 2.993 | 100.0% | 10 |
| neutron.create_router (x2) | 9.438 | 15.516 | 19.599 | 20.654 | 21.71 | 15.011 | 100.0% | 10 |
| neutron.add_interface_router (x2) | 4.522 | 5.941 | 8.556 | 8.568 | 8.579 | 6.36 | 100.0% | 10 |
| neutron.show_router (x2) | 0.189 | 0.235 | 0.277 | 0.325 | 0.373 | 0.242 | 100.0% | 10 |
| total | 18.447 | 28.186 | 30.346 | 32.254 | 34.162 | 26.385 | 100.0% | 10 |
| -> duration | 18.447 | 28.186 | 30.346 | 32.254 | 34.162 | 26.385 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 72.668445
Full duration: 124.569509
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_show_subnets
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"router": {}
}
},
"args": {
"subnets_per_network": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d1e3c7db-9100-4b7c-9138-46df10ac45d0 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_subnet (x2) | 1.687 | 2.795 | 6.369 | 6.484 | 6.599 | 3.757 | 100.0% | 10 |
| neutron.show_subnet (x2) | 0.182 | 0.195 | 0.237 | 0.295 | 0.353 | 0.214 | 100.0% | 10 |
| total | 1.872 | 2.998 | 6.554 | 6.671 | 6.789 | 3.972 | 100.0% | 10 |
| -> duration | 1.872 | 2.998 | 6.554 | 6.671 | 6.789 | 3.972 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 11.101009
Full duration: 92.182578
HINTS:
* To plot HTML graphics with this data, run:
rally task report d1e3c7db-9100-4b7c-9138-46df10ac45d0 --out output.html
* To generate a JUnit report, run:
rally task export d1e3c7db-9100-4b7c-9138-46df10ac45d0 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report d1e3c7db-9100-4b7c-9138-46df10ac45d0 --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 19:44:21,625 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'd1e3c7db-9100-4b7c-9138-46df10ac45d0', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json']
2020-03-25 19:44:23,936 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d1e3c7db-9100-4b7c-9138-46df10ac45d0 --out /home/opnfv/functest/results/rally_full/neutron.json
2020-03-25 19:44:23,991 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-03-25 19:44:23,992 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml
2020-03-25 19:44:23,992 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 19:44:24,010 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 19:44:24,011 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ...
2020-03-25 19:44:24,011 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 20:40:23,060 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 573c16ad-5377-42bc-bd2c-05a6e6260b24
2020-03-25 20:40:23,061 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 573c16ad-5377-42bc-bd2c-05a6e6260b24
2020-03-25 20:40:23,061 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'573c16ad-5377-42bc-bd2c-05a6e6260b24']
2020-03-25 20:40:23,890 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 573c16ad-5377-42bc-bd2c-05a6e6260b24
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24: aborted
--------------------------------------------------------------------------------
test scenario NovaKeypair.create_and_delete_keypair
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"key_pairs": -1,
"cores": -1,
"security_groups": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.337 | 0.582 | 0.899 | 0.927 | 0.955 | 0.63 | 100.0% | 10 |
| nova.delete_keypair | 0.057 | 0.132 | 0.471 | 0.472 | 0.472 | 0.227 | 100.0% | 10 |
| total | 0.626 | 0.858 | 1.021 | 1.044 | 1.068 | 0.857 | 100.0% | 10 |
| -> duration | 0.626 | 0.858 | 1.021 | 1.044 | 1.068 | 0.857 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.496541
Full duration: 11.573597
--------------------------------------------------------------------------------
test scenario NovaKeypair.create_and_list_keypairs
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"key_pairs": -1,
"cores": -1,
"security_groups": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.297 | 0.549 | 0.815 | 0.831 | 0.847 | 0.559 | 100.0% | 10 |
| nova.list_keypairs | 0.036 | 0.048 | 0.322 | 0.343 | 0.364 | 0.104 | 100.0% | 10 |
| total | 0.346 | 0.659 | 0.86 | 0.871 | 0.883 | 0.663 | 100.0% | 10 |
| -> duration | 0.346 | 0.659 | 0.86 | 0.871 | 0.883 | 0.663 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.787192
Full duration: 17.350678
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_bounce_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
},
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"actions": [
{
"hard_reboot": 1
},
{
"soft_reboot": 1
},
{
"stop_start": 1
},
{
"rescue_unrescue": 1
}
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 18.729 | 24.532 | 44.544 | 45.23 | 45.916 | 28.523 | 100.0% | 10 |
| nova.reboot_server | 11.974 | 12.298 | 15.998 | 16.479 | 16.96 | 13.275 | 100.0% | 10 |
| nova.soft_reboot_server | 131.756 | 134.266 | 137.95 | 138.012 | 138.074 | 134.669 | 100.0% | 10 |
| nova.stop_and_start_server | 72.461 | 74.232 | 74.897 | 76.102 | 77.308 | 74.157 | 100.0% | 10 |
| -> nova.stop_server | 62.265 | 62.717 | 64.234 | 64.442 | 64.649 | 63.217 | 100.0% | 10 |
| -> nova.start_server | 9.979 | 10.424 | 12.045 | 12.582 | 13.119 | 10.939 | 100.0% | 10 |
| nova.rescue_and_unrescue_server | 66.823 | 69.353 | 72.152 | 72.478 | 72.803 | 69.537 | 100.0% | 10 |
| -> nova.rescue_server | 64.199 | 66.386 | 67.137 | 67.265 | 67.393 | 66.145 | 100.0% | 10 |
| -> nova.unrescue_server | 2.516 | 3.015 | 5.015 | 5.212 | 5.41 | 3.393 | 100.0% | 10 |
| nova.delete_server | 5.087 | 5.319 | 7.82 | 8.791 | 9.761 | 6.197 | 100.0% | 10 |
| total | 310.855 | 322.151 | 351.407 | 354.523 | 357.639 | 326.398 | 100.0% | 10 |
| -> duration | 301.855 | 313.151 | 342.407 | 345.523 | 348.639 | 317.398 | 100.0% | 10 |
| -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 956.588806
Full duration: 1075.684473
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_delete_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
},
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 22.385 | 31.285 | 50.128 | 52.938 | 55.747 | 33.002 | 100.0% | 10 |
| nova.delete_server | 5.172 | 6.798 | 9.967 | 10.032 | 10.098 | 7.152 | 100.0% | 10 |
| total | 27.679 | 37.665 | 56.252 | 59.713 | 63.174 | 40.154 | 100.0% | 10 |
| -> duration | 26.679 | 36.665 | 55.252 | 58.713 | 62.174 | 39.154 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 117.669496
Full duration: 225.27895
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_list_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
},
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
}
},
"args": {
"detailed": true,
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 20.925 | 38.059 | 56.919 | 58.133 | 59.346 | 38.624 | 100.0% | 10 |
| nova.list_servers | 0.357 | 0.389 | 0.414 | 0.469 | 0.523 | 0.396 | 100.0% | 10 |
| total | 21.323 | 38.442 | 57.283 | 58.497 | 59.712 | 39.02 | 100.0% | 10 |
| -> duration | 20.323 | 37.442 | 56.283 | 57.497 | 58.712 | 38.02 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 98.199768
Full duration: 272.642005
--------------------------------------------------------------------------------
test scenario NovaServers.boot_and_rebuild_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
},
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"from_image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"to_image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 21.287 | 33.287 | 45.873 | 47.267 | 48.661 | 33.689 | 100.0% | 10 |
| nova.rebuild_server | 23.662 | 36.914 | 42.414 | 44.006 | 45.597 | 35.769 | 100.0% | 10 |
| nova.delete_server | 5.149 | 6.027 | 8.092 | 8.094 | 8.096 | 6.411 | 100.0% | 10 |
| total | 62.085 | 72.223 | 93.388 | 94.123 | 94.858 | 75.869 | 100.0% | 10 |
| -> duration | 60.085 | 70.223 | 91.388 | 92.123 | 92.858 | 73.869 | 100.0% | 10 |
| -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 213.541777
Full duration: 309.198555
--------------------------------------------------------------------------------
test scenario NovaServers.snapshot_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
},
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"network": {
"networks_per_tenant": 1,
"start_cidr": "100.1.0.0/25"
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server (x2) | 52.375 | 71.562 | 92.42 | 119.099 | 145.779 | 75.705 | 100.0% | 10 |
| nova.snapshot_server | 6.647 | 7.749 | 11.953 | 12.967 | 13.982 | 8.612 | 100.0% | 10 |
| -> glance_v2.get_image | 0.075 | 0.085 | 0.1 | 0.101 | 0.102 | 0.086 | 100.0% | 10 |
| -> glance.wait_for_image | 6.17 | 7.201 | 10.471 | 11.39 | 12.308 | 7.814 | 100.0% | 10 |
| --> glance_v2.get_image (x4) | 0.162 | 0.179 | 0.186 | 0.186 | 0.187 | 0.175 | 100.0% | 5 |
| --> glance_v2.get_image (x7) | 0.294 | 0.294 | 0.294 | 0.294 | 0.294 | 0.294 | 100.0% | 1 |
| --> glance_v2.get_image (x5) | 0.198 | 0.209 | 0.209 | 0.21 | 0.21 | 0.205 | 100.0% | 3 |
| --> glance_v2.get_image (x6) | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 |
| nova.delete_server (x2) | 10.756 | 19.242 | 37.034 | 38.138 | 39.241 | 22.887 | 100.0% | 10 |
| nova.delete_image | 0.984 | 1.121 | 1.851 | 1.854 | 1.857 | 1.252 | 100.0% | 10 |
| -> glance_v2.delete_image | 0.954 | 1.087 | 1.746 | 1.776 | 1.807 | 1.207 | 100.0% | 10 |
| -> glance.wait_for_delete | 0.029 | 0.035 | 0.05 | 0.083 | 0.115 | 0.043 | 100.0% | 10 |
| --> glance_v2.get_image | 0.029 | 0.035 | 0.049 | 0.082 | 0.115 | 0.043 | 0.0% | 10 |
| total | 77.083 | 99.435 | 144.444 | 157.396 | 170.349 | 108.457 | 100.0% | 10 |
| -> duration | 75.083 | 97.435 | 142.444 | 155.396 | 168.349 | 106.457 | 100.0% | 10 |
| -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 309.92654
Full duration: 431.278228
--------------------------------------------------------------------------------
test scenario NovaServers.boot_server_from_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"volume_size": 1,
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
]
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.463 | 11.369 | 13.424 | 15.311 | 17.198 | 11.716 | 100.0% | 10 |
| nova.boot_server | 26.084 | 41.244 | 80.044 | 105.706 | 131.368 | 53.117 | 100.0% | 10 |
| total | 35.547 | 53.184 | 91.838 | 120.202 | 148.566 | 64.833 | 100.0% | 10 |
| -> duration | 34.547 | 52.184 | 90.838 | 119.202 | 147.566 | 63.833 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 198.291959
Full duration: 244.655814
--------------------------------------------------------------------------------
test scenario NovaServers.boot_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 14.161 | 32.786 | 77.195 | 78.399 | 79.602 | 37.255 | 100.0% | 10 |
| total | 14.161 | 32.786 | 77.196 | 78.399 | 79.602 | 37.255 | 100.0% | 10 |
| -> duration | 13.161 | 31.786 | 76.196 | 77.399 | 78.602 | 36.255 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 141.525585
Full duration: 183.466935
--------------------------------------------------------------------------------
test scenario NovaServers.list_servers
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"network": {},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"servers": {
"servers_per_tenant": 2,
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"auto_assign_nic": true,
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
}
}
},
"args": {
"detailed": true
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.list_servers | 0.519 | 0.577 | 1.598 | 3.865 | 6.132 | 1.216 | 100.0% | 10 |
| total | 0.519 | 0.577 | 1.598 | 3.865 | 6.132 | 1.216 | 100.0% | 10 |
| -> duration | 0.519 | 0.577 | 1.598 | 3.865 | 6.132 | 1.216 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.132107
Full duration: 341.052515
--------------------------------------------------------------------------------
test scenario NovaServers.resize_server
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"confirm": true,
"nics": [
{
"net-id": "41650ad9-f180-48b8-89b7-5b5c544c667b"
}
],
"image": {
"name": "rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"force_delete": false,
"flavor": {
"name": "rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42"
},
"to_flavor": {
"name": "rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 573c16ad-5377-42bc-bd2c-05a6e6260b24 has 5 error(s)
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:05Z'}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status
resource = update_resource(resource)
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager
fault=getattr(res, "fault", "n/a"))
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:05Z'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:02Z'}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status
resource = update_resource(resource)
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager
fault=getattr(res, "fault", "n/a"))
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:02Z'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:38:50Z'}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status
resource = update_resource(resource)
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager
fault=getattr(res, "fault", "n/a"))
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:38:50Z'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:38:58Z'}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status
resource = update_resource(resource)
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager
fault=getattr(res, "fault", "n/a"))
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:38:58Z'}
--------------------------------------------------------------------------------
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:27Z'}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run
self._resize(server, to_flavor)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize
check_interval=CONF.openstack.nova_server_resize_poll_interval
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status
resource = update_resource(resource)
File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager
fault=getattr(res, "fault", "n/a"))
GetResourceErrorStatus: Resource has ERROR status.
Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-03-25T20:39:27Z'}
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 29.866 | 36.691 | 43.579 | 44.347 | 45.116 | 36.668 | 100.0% | 5 |
| nova.resize | 6.805 | 12.76 | 14.269 | 14.385 | 14.501 | 12.04 | 0.0% | 5 |
| total | 36.671 | 50.613 | 57.384 | 58.501 | 59.618 | 48.708 | 0.0% | 5 |
| -> duration | 35.671 | 49.613 | 56.384 | 57.501 | 58.618 | 47.708 | 0.0% | 5 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 78.296783
Full duration: 197.845971
HINTS:
* To plot HTML graphics with this data, run:
rally task report 573c16ad-5377-42bc-bd2c-05a6e6260b24 --out output.html
* To generate a JUnit report, run:
rally task export 573c16ad-5377-42bc-bd2c-05a6e6260b24 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 573c16ad-5377-42bc-bd2c-05a6e6260b24 --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 20:40:23,891 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'573c16ad-5377-42bc-bd2c-05a6e6260b24', '--out', u'/home/opnfv/functest/results/rally_full/nova.json']
2020-03-25 20:40:26,150 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 573c16ad-5377-42bc-bd2c-05a6e6260b24 --out /home/opnfv/functest/results/rally_full/nova.json
2020-03-25 20:40:26,191 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed.
2020-03-25 20:40:26,191 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml
2020-03-25 20:40:26,192 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 20:40:26,211 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 20:40:26,211 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ...
2020-03-25 20:40:26,211 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 20:41:26,901 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: e0f88f6c-3997-40ad-9ea8-8d656cc3f586
2020-03-25 20:41:26,902 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e0f88f6c-3997-40ad-9ea8-8d656cc3f586
2020-03-25 20:41:26,902 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'e0f88f6c-3997-40ad-9ea8-8d656cc3f586']
2020-03-25 20:41:27,662 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e0f88f6c-3997-40ad-9ea8-8d656cc3f586
--------------------------------------------------------------------------------
Task e0f88f6c-3997-40ad-9ea8-8d656cc3f586: finished
--------------------------------------------------------------------------------
test scenario Quotas.cinder_update_and_delete
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"max_quota": 1024
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e0f88f6c-3997-40ad-9ea8-8d656cc3f586 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.61 | 1.42 | 1.735 | 1.769 | 1.803 | 1.249 | 100.0% | 10 |
| quotas.delete_quotas | 0.057 | 0.116 | 0.169 | 0.187 | 0.205 | 0.116 | 100.0% | 10 |
| total | 0.815 | 1.536 | 1.793 | 1.834 | 1.875 | 1.365 | 100.0% | 10 |
| -> duration | 0.815 | 1.536 | 1.793 | 1.834 | 1.875 | 1.365 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 4.128931
Full duration: 11.389856
--------------------------------------------------------------------------------
test scenario Quotas.cinder_update
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"max_quota": 1024
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e0f88f6c-3997-40ad-9ea8-8d656cc3f586 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.402 | 0.751 | 1.218 | 1.247 | 1.277 | 0.819 | 100.0% | 10 |
| total | 0.402 | 0.751 | 1.218 | 1.247 | 1.277 | 0.819 | 100.0% | 10 |
| -> duration | 0.402 | 0.751 | 1.218 | 1.247 | 1.277 | 0.819 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.528063
Full duration: 9.505339
--------------------------------------------------------------------------------
test scenario Quotas.neutron_update
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"max_quota": 1024
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e0f88f6c-3997-40ad-9ea8-8d656cc3f586 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.531 | 0.646 | 1.94 | 1.943 | 1.945 | 1.133 | 100.0% | 10 |
| total | 0.619 | 0.754 | 2.137 | 2.142 | 2.147 | 1.264 | 100.0% | 10 |
| -> duration | 0.619 | 0.754 | 2.137 | 2.142 | 2.147 | 1.264 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 3.55448
Full duration: 10.520643
--------------------------------------------------------------------------------
test scenario Quotas.nova_update
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"max_quota": 1024
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task e0f88f6c-3997-40ad-9ea8-8d656cc3f586 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 1.113 | 1.618 | 3.506 | 3.549 | 3.592 | 2.247 | 100.0% | 10 |
| total | 1.113 | 1.618 | 3.507 | 3.549 | 3.592 | 2.247 | 100.0% | 10 |
| -> duration | 1.113 | 1.618 | 3.507 | 3.549 | 3.592 | 2.247 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.130853
Full duration: 16.165989
HINTS:
* To plot HTML graphics with this data, run:
rally task report e0f88f6c-3997-40ad-9ea8-8d656cc3f586 --out output.html
* To generate a JUnit report, run:
rally task export e0f88f6c-3997-40ad-9ea8-8d656cc3f586 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report e0f88f6c-3997-40ad-9ea8-8d656cc3f586 --json --out output.json
2020-03-25 20:41:27,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'e0f88f6c-3997-40ad-9ea8-8d656cc3f586', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json']
2020-03-25 20:41:29,873 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e0f88f6c-3997-40ad-9ea8-8d656cc3f586 --out /home/opnfv/functest/results/rally_full/quotas.json
2020-03-25 20:41:29,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK.
2020-03-25 20:41:29,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml
2020-03-25 20:41:29,884 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-25 20:41:29,906 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-25 20:41:29,906 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ...
2020-03-25 20:41:29,907 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': '41650ad9-f180-48b8-89b7-5b5c544c667b', 'tenants_amount': 3, 'image_name': 'rally_full-img_176bac14-2663-4f43-8201-efe1fbf23f42', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_176bac14-2663-4f43-8201-efe1fbf23f42', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_176bac14-2663-4f43-8201-efe1fbf23f42', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-25 20:42:46,597 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 0f967bd5-6299-411a-b645-71c3a8c2928c
2020-03-25 20:42:46,598 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0f967bd5-6299-411a-b645-71c3a8c2928c
2020-03-25 20:42:46,598 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'0f967bd5-6299-411a-b645-71c3a8c2928c']
2020-03-25 20:42:47,573 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0f967bd5-6299-411a-b645-71c3a8c2928c
--------------------------------------------------------------------------------
Task 0f967bd5-6299-411a-b645-71c3a8c2928c: aborted
--------------------------------------------------------------------------------
test scenario SwiftObjects.create_container_and_object_then_list_objects
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"admin"
]
},
"args": {
"object_size": 5120,
"objects_per_container": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 0f967bd5-6299-411a-b645-71c3a8c2928c has 1 error(s)
--------------------------------------------------------------------------------
ClientException: Container PUT failed: http://object-store-airship.intel-pod15.opnfv.org/swift/v1/KEY_cc45218f2ed94e81a7b9cc942be495b2/s_rally_d5df9da9_yTu8rupw 409 Conflict BucketAlreadyExists
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/objects.py", line 47, in run
container_name = self._create_container(**kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/utils.py", line 51, in _create_container
self.clients("swift").put_container(container_name, **kwargs)
File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1808, in put_container
query_string=query_string)
File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1722, in _retry
service_token=self.service_token, **kwargs)
File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1061, in put_container
raise ClientException.from_response(resp, 'Container PUT failed', body)
ClientException: Container PUT failed: http://object-store-airship.intel-pod15.opnfv.org/swift/v1/KEY_cc45218f2ed94e81a7b9cc942be495b2/s_rally_d5df9da9_yTu8rupw 409 Conflict BucketAlreadyExists
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container | 0.365 | 0.631 | 0.635 | 0.635 | 0.635 | 0.574 | 80.0% | 5 |
| swift.upload_object (x2) | 0.276 | 0.513 | 0.601 | 0.601 | 0.602 | 0.476 | 100.0% | 4 |
| swift.list_objects | 0.319 | 0.395 | 0.426 | 0.427 | 0.428 | 0.384 | 100.0% | 4 |
| total | 0.609 | 1.493 | 1.637 | 1.649 | 1.662 | 1.265 | 80.0% | 5 |
| -> duration | 0.609 | 1.493 | 1.637 | 1.649 | 1.662 | 1.265 | 80.0% | 5 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 80.0% | 5 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.670151
Full duration: 68.13094
HINTS:
* To plot HTML graphics with this data, run:
rally task report 0f967bd5-6299-411a-b645-71c3a8c2928c --out output.html
* To generate a JUnit report, run:
rally task export 0f967bd5-6299-411a-b645-71c3a8c2928c --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 0f967bd5-6299-411a-b645-71c3a8c2928c --json --out output.json
At least one workload did not pass SLA criteria.
2020-03-25 20:42:47,573 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'0f967bd5-6299-411a-b645-71c3a8c2928c', '--out', u'/home/opnfv/functest/results/rally_full/swift.json']
2020-03-25 20:42:49,855 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0f967bd5-6299-411a-b645-71c3a8c2928c --out /home/opnfv/functest/results/rally_full/swift.json
2020-03-25 20:42:49,859 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" Failed.
2020-03-25 20:42:49,863 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:
+----------------+------------+----------------+-----------+
| Module | Duration | nb. Test Run | Success |
+----------------+------------+----------------+-----------+
| authenticate | 00:00:44 | 60 | 100.00% |
| glance | 00:04:05 | 35 | 94.29% |
| cinder | 00:28:17 | 240 | 100.00% |
| heat | 00:06:33 | 20 | 95.00% |
| keystone | 00:06:54 | 100 | 100.00% |
| neutron | 00:17:36 | 170 | 100.00% |
| nova | 00:55:10 | 105 | 95.24% |
| quotas | 00:00:47 | 40 | 100.00% |
| swift | 00:01:08 | 5 | 80.00% |
| | | | |
| TOTAL: | 02:01:17 | 775 | 98.84% |
+----------------+------------+----------------+-----------+
2020-03-25 20:42:49,864 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.84% in 3/9 modules
2020-03-25 20:42:49,864 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html']
2020-03-25 20:42:52,938 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html
2020-03-25 20:42:52,939 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml']
2020-03-25 20:42:55,937 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml
2020-03-25 20:42:55,937 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+------------------+------------------+----------------+
| rally_full | functest | 125:57 | FAIL |
+--------------------+------------------+------------------+----------------+
2020-03-25 20:43:24,483 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)