2020-03-08 15:10:44,945 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                         VALUE                                                         |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                                    http://testresults.opnfv.org/test/api/v1/results                                   |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/airship/5LECFNS8D319/airship-opnfv-functest-benchmarking-latest-rally_full-run-107      |
|     S3_ENDPOINT_URL     |                                             https://storage.googleapis.com                                            |
|     DEPLOY_SCENARIO     |                                                 os-nosdn-nofeature-ha                                                 |
|        BUILD_TAG        |                                                      5LECFNS8D319                                                     |
|          DEBUG          |                                                          true                                                         |
|      INSTALLER_TYPE     |                                                        airship                                                        |
|         CI_LOOP         |                                                         daily                                                         |
|       TEST_DB_URL       |                                    http://testresults.opnfv.org/test/api/v1/results                                   |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/airship/5LECFNS8D319/airship-opnfv-functest-benchmarking-latest-rally_full-run-107     |
|        NODE_NAME        |                                                      intel-pod17                                                      |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+

2020-03-08 15:10:44,949 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2020-03-08 15:10:44,949 - xtesting.ci.run_tests - DEBUG - Test args: rally_full
2020-03-08 15:10:44,958 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'...
2020-03-08 15:10:45,647 - functest.core.tenantnetwork - DEBUG - password: y83T|Z1b._95>f{XIQRYM9<P=Mxf2=
2020-03-08 15:10:45,766 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'8ac2aa648f6647d3991363fc7de75905', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_a324836a-c5e1-4978-a6d8-8b3ce210d223'})
2020-03-08 15:10:45,843 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'74baf04886d943b0a9aa02df9fe26c6e', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_a324836a-c5e1-4978-a6d8-8b3ce210d223'})
2020-03-08 15:10:46,211 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': 'y83T|Z1b._95>f{XIQRYM9<P=Mxf2=', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'project_id': u'8ac2aa648f6647d3991363fc7de75905', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-03-08 15:10:46,215 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'password': 'y83T|Z1b._95>f{XIQRYM9<P=Mxf2=', 'project_name': 'rally_full-project_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': '8ac2aa648f6647d3991363fc7de75905', 'project_domain_name': 'default'}
2020-03-08 15:10:46,495 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'...
2020-03-08 15:10:46,947 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-03-08T15:10:46Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'70cc4e9a-949b-4c76-a7e1-f892fd4e32be', u'provider:segmentation_id': 4, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'admin_state_up': True, u'tenant_id': u'8ac2aa648f6647d3991363fc7de75905', u'created_at': u'2020-03-08T15:10:46Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'8ac2aa648f6647d3991363fc7de75905'})
2020-03-08 15:10:47,884 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-03-08T15:10:47Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'4177c628-7e9e-4554-bbca-94287594b1a8', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'enable_dhcp': True, u'network_id': u'70cc4e9a-949b-4c76-a7e1-f892fd4e32be', u'tenant_id': u'8ac2aa648f6647d3991363fc7de75905', u'created_at': u'2020-03-08T15:10:47Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'8ac2aa648f6647d3991363fc7de75905'})
2020-03-08 15:10:54,335 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-03-08T15:10:50Z', u'revision_number': 6, u'ha': True, u'id': u'c70333d4-f940-46cf-ada6-9d910e7cf082', u'external_gateway_info': {u'network_id': u'65b43508-63b0-40d0-8ad4-da1961aaf837', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'7d89c483-f0fb-4c10-a5bd-391f61d9a533', u'ip_address': u'10.10.175.32'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'admin_state_up': True, u'tenant_id': u'8ac2aa648f6647d3991363fc7de75905', u'created_at': u'2020-03-08T15:10:48Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'8ac2aa648f6647d3991363fc7de75905'})
2020-03-08 15:10:57,901 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/cc3ac71d-e833-4536-9ca6-c2eea4792a4e/file', 'owner': u'8ac2aa648f6647d3991363fc7de75905', 'id': u'cc3ac71d-e833-4536-9ca6-c2eea4792a4e', 'size': 12716032, u'self': u'/v2/images/cc3ac71d-e833-4536-9ca6-c2eea4792a4e', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'8ac2aa648f6647d3991363fc7de75905', 'name': 'rally_full-project_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-03-08T15:10:57Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-03-08T15:10:57Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/cc3ac71d-e833-4536-9ca6-c2eea4792a4e', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'created': u'2020-03-08T15:10:56Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-03-08T15:10:56Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/cc3ac71d-e833-4536-9ca6-c2eea4792a4e', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-03-08 15:10:57,983 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'9969354681b041eb98992295c036a787', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'3c5932c8-26a0-4441-9e4d-67308fad36d7', 'swap': 0})
2020-03-08 15:10:58,036 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-03-08 15:11:02,340 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| ec6b04d1-2b5a-4d49-9012-824c1195a81b | 2020-03-08T15:11:02.173184 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: ec6b04d1-2b5a-4d49-9012-824c1195a81b
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2020-03-08 15:11:04,980 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2020-03-08 15:11:05,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-03-08 15:11:05,922 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'9969354681b041eb98992295c036a787', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'fdd6c16c-8ef8-4102-8385-da86d9c1c5d7', 'swap': 0})
2020-03-08 15:11:06,015 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'9969354681b041eb98992295c036a787', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'fdd6c16c-8ef8-4102-8385-da86d9c1c5d7', 'swap': 0})
2020-03-08 15:11:06,015 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml
2020-03-08 15:11:06,016 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:11:06,033 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:11:06,036 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ...
2020-03-08 15:11:06,037 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:15:25,856 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 9e5caf71-4fbd-49d4-89ae-02456689fb6d
2020-03-08 15:15:25,856 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 9e5caf71-4fbd-49d4-89ae-02456689fb6d
2020-03-08 15:15:25,857 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'9e5caf71-4fbd-49d4-89ae-02456689fb6d']
2020-03-08 15:15:26,687 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 9e5caf71-4fbd-49d4-89ae-02456689fb6d

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d: finished
--------------------------------------------------------------------------------

test scenario Authenticate.keystone
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.keystone | 0.314     | 0.41         | 0.695        | 0.798        | 0.902     | 0.468     | 100.0%  | 10    |
| total                 | 0.314     | 0.41         | 0.695        | 0.798        | 0.902     | 0.468     | 100.0%  | 10    |
|  -> duration          | 0.314     | 0.41         | 0.695        | 0.798        | 0.902     | 0.468     | 100.0%  | 10    |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.396742
Full duration: 6.357783
--------------------------------------------------------------------------------

test scenario Authenticate.validate_cinder
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_cinder | 0.178     | 0.278        | 0.367        | 0.388        | 0.408     | 0.281     | 100.0%  | 10    |
| total                        | 0.314     | 0.473        | 0.853        | 0.905        | 0.956     | 0.545     | 100.0%  | 10    |
|  -> duration                 | 0.314     | 0.473        | 0.853        | 0.905        | 0.956     | 0.545     | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.509463
Full duration: 68.162256
--------------------------------------------------------------------------------

test scenario Authenticate.validate_glance
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_glance | 0.228     | 0.333        | 13.053       | 14.163       | 15.273    | 4.832     | 100.0%  | 10    |
| total                        | 0.572     | 13.182       | 18.877       | 20.215       | 21.554    | 11.155    | 100.0%  | 10    |
|  -> duration                 | 0.572     | 13.182       | 18.877       | 20.215       | 21.554    | 11.155    | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 36.867966
Full duration: 42.981075
--------------------------------------------------------------------------------

test scenario Authenticate.validate_heat
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_heat | 0.167     | 0.193        | 0.409        | 0.623        | 0.837     | 0.279     | 100.0%  | 10    |
| total                      | 0.265     | 0.535        | 1.093        | 1.112        | 1.131     | 0.639     | 100.0%  | 10    |
|  -> duration               | 0.265     | 0.535        | 1.093        | 1.112        | 1.131     | 0.639     | 100.0%  | 10    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.733456
Full duration: 43.135552
--------------------------------------------------------------------------------

test scenario Authenticate.validate_neutron
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------------+
|                                                       Response Times (sec)                                                       |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_neutron | 0.42      | 0.51         | 0.634        | 0.662        | 0.689     | 0.522     | 100.0%  | 10    |
| total                         | 0.546     | 0.749        | 1.063        | 1.098        | 1.133     | 0.767     | 100.0%  | 10    |
|  -> duration                  | 0.546     | 0.749        | 1.063        | 1.098        | 1.133     | 0.767     | 100.0%  | 10    |
|  -> idle_duration             | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.129364
Full duration: 9.039283
--------------------------------------------------------------------------------

test scenario Authenticate.validate_nova
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "repetitions": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 9e5caf71-4fbd-49d4-89ae-02456689fb6d has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_nova | 0.213     | 0.431        | 15.908       | 18.673       | 21.439    | 5.493     | 100.0%  | 10    |
| total                      | 0.362     | 0.955        | 25.492       | 27.803       | 30.113    | 7.651     | 100.0%  | 10    |
|  -> duration               | 0.362     | 0.955        | 25.492       | 27.803       | 30.113    | 7.651     | 100.0%  | 10    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 32.041837
Full duration: 77.054272

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 9e5caf71-4fbd-49d4-89ae-02456689fb6d --out output.html

* To generate a JUnit report, run:
	rally task export 9e5caf71-4fbd-49d4-89ae-02456689fb6d --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 9e5caf71-4fbd-49d4-89ae-02456689fb6d --json --out output.json


2020-03-08 15:15:26,688 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'9e5caf71-4fbd-49d4-89ae-02456689fb6d', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json']
2020-03-08 15:15:28,807 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 9e5caf71-4fbd-49d4-89ae-02456689fb6d --out /home/opnfv/functest/results/rally_full/authenticate.json

2020-03-08 15:15:28,821 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK.
2020-03-08 15:15:28,821 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml
2020-03-08 15:15:28,821 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:15:28,837 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:15:28,840 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ...
2020-03-08 15:15:28,840 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:23:11,055 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 270e9fee-5dfb-442f-b291-f254fac769f5
2020-03-08 15:23:11,056 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 270e9fee-5dfb-442f-b291-f254fac769f5
2020-03-08 15:23:11,056 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'270e9fee-5dfb-442f-b291-f254fac769f5']
2020-03-08 15:23:11,907 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 270e9fee-5dfb-442f-b291-f254fac769f5

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5: finished
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_delete_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.22      | 3.405        | 3.708        | 3.759        | 3.81      | 3.451     | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.113     | 0.123        | 0.138        | 0.157        | 0.176     | 0.128     | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.9       | 1.042        | 1.135        | 1.28         | 1.426     | 1.058     | 100.0%  | 10    |
| glance_v2.delete_image       | 0.44      | 0.555        | 0.648        | 0.708        | 0.768     | 0.564     | 100.0%  | 10    |
| total                        | 3.719     | 4.034        | 4.299        | 4.304        | 4.308     | 4.015     | 100.0%  | 10    |
|  -> duration                 | 3.719     | 4.034        | 4.299        | 4.304        | 4.308     | 4.015     | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.611738
Full duration: 19.501156
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_list_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.176     | 3.63         | 3.892        | 3.927        | 3.962     | 3.593     | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.107     | 0.123        | 0.205        | 0.219        | 0.232     | 0.147     | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.86      | 1.23         | 1.403        | 1.432        | 1.461     | 1.18      | 100.0%  | 10    |
| glance_v2.list_images        | 0.067     | 0.074        | 0.117        | 0.119        | 0.122     | 0.083     | 100.0%  | 10    |
| total                        | 3.247     | 3.698        | 3.991        | 4.013        | 4.036     | 3.676     | 100.0%  | 10    |
|  -> duration                 | 3.247     | 3.698        | 3.991        | 4.013        | 4.036     | 3.676     | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 11.563508
Full duration: 21.764044
--------------------------------------------------------------------------------

test scenario GlanceImages.list_images
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.list_images | 0.146     | 0.182        | 0.255        | 0.291        | 0.327     | 0.199     | 100.0%  | 10    |
| total                 | 0.146     | 0.182        | 0.256        | 0.291        | 0.327     | 0.2       | 100.0%  | 10    |
|  -> duration          | 0.146     | 0.182        | 0.256        | 0.291        | 0.327     | 0.2       | 100.0%  | 10    |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 22.69092
Full duration: 48.284718
--------------------------------------------------------------------------------

test scenario GlanceImages.create_image_and_boot_instances
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }
    }
  }, 
  "args": {
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", 
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "number_instances": 2, 
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.236     | 3.263        | 3.939        | 3.984        | 4.03      | 3.502     | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.115     | 0.128        | 0.139        | 0.152        | 0.164     | 0.13      | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.904     | 0.926        | 1.502        | 1.52         | 1.537     | 1.115     | 100.0%  | 10    |
| nova.boot_servers            | 30.485    | 45.862       | 64.656       | 71.1         | 77.544    | 47.227    | 100.0%  | 10    |
| total                        | 33.748    | 49.452       | 68.557       | 75.066       | 81.575    | 50.73     | 100.0%  | 10    |
|  -> duration                 | 32.748    | 48.452       | 67.557       | 74.066       | 80.575    | 49.73     | 100.0%  | 10    |
|  -> idle_duration            | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 151.024963
Full duration: 192.705466
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_deactivate_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.293     | 3.569        | 3.787        | 3.799        | 3.811     | 3.58      | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.109     | 0.127        | 0.142        | 0.146        | 0.149     | 0.128     | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.946     | 1.169        | 1.389        | 1.404        | 1.42      | 1.179     | 100.0%  | 10    |
| glance_v2.deactivate_image   | 0.103     | 0.125        | 0.175        | 0.176        | 0.178     | 0.13      | 100.0%  | 10    |
| total                        | 3.417     | 3.745        | 3.913        | 3.926        | 3.938     | 3.71      | 100.0%  | 10    |
|  -> duration                 | 3.417     | 3.745        | 3.913        | 3.926        | 3.938     | 3.71      | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 11.753302
Full duration: 23.615069
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_download_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------+
|                                           Response Times (sec)                                            |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 0     |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 0.0
Full duration: 57.77396
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_get_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.214     | 3.275        | 24.707       | 26.199       | 27.691    | 7.852     | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.111     | 0.124        | 0.128        | 0.128        | 0.128     | 0.122     | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.874     | 0.944        | 1.062        | 1.126        | 1.189     | 0.965     | 100.0%  | 10    |
| glance_v2.get_image          | 0.038     | 0.047        | 0.051        | 0.053        | 0.055     | 0.046     | 100.0%  | 10    |
| total                        | 3.257     | 3.321        | 24.754       | 26.247       | 27.74     | 7.898     | 100.0%  | 10    |
|  -> duration                 | 3.257     | 3.321        | 24.754       | 26.247       | 27.74     | 7.898     | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 30.676125
Full duration: 58.686921
--------------------------------------------------------------------------------

test scenario GlanceImages.create_and_update_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "container_format": "bare", 
    "disk_format": "qcow2", 
    "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 270e9fee-5dfb-442f-b291-f254fac769f5 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                       |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image       | 3.31      | 3.668        | 6.267        | 6.438        | 6.609     | 4.499     | 100.0%  | 10    |
|  -> glance_v2.get_image (x2) | 0.11      | 0.129        | 0.172        | 0.18         | 0.189     | 0.138     | 100.0%  | 10    |
|  -> glance_v2.upload_data    | 0.902     | 1.059        | 2.109        | 2.309        | 2.508     | 1.351     | 100.0%  | 10    |
| glance_v2.update_image       | 0.2       | 0.237        | 0.402        | 0.409        | 0.417     | 0.27      | 100.0%  | 10    |
| total                        | 3.547     | 3.928        | 6.586        | 6.798        | 7.009     | 4.769     | 100.0%  | 10    |
|  -> duration                 | 3.547     | 3.928        | 6.586        | 6.798        | 7.009     | 4.769     | 100.0%  | 10    |
|  -> idle_duration            | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 14.146326
Full duration: 25.195675

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 270e9fee-5dfb-442f-b291-f254fac769f5 --out output.html

* To generate a JUnit report, run:
	rally task export 270e9fee-5dfb-442f-b291-f254fac769f5 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 270e9fee-5dfb-442f-b291-f254fac769f5 --json --out output.json

At least one workload did not pass SLA criteria.


2020-03-08 15:23:11,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'270e9fee-5dfb-442f-b291-f254fac769f5', '--out', u'/home/opnfv/functest/results/rally_full/glance.json']
2020-03-08 15:23:14,076 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 270e9fee-5dfb-442f-b291-f254fac769f5 --out /home/opnfv/functest/results/rally_full/glance.json

2020-03-08 15:23:14,099 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed.
2020-03-08 15:23:14,100 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml
2020-03-08 15:23:14,100 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:23:14,115 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:23:14,123 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ...
2020-03-08 15:23:14,123 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:47:17,113 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: b5733db5-cbb5-4b14-a5ae-6af475c2a7a2
2020-03-08 15:47:17,114 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b5733db5-cbb5-4b14-a5ae-6af475c2a7a2
2020-03-08 15:47:17,114 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'b5733db5-cbb5-4b14-a5ae-6af475c2a7a2']
2020-03-08 15:47:17,954 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b5733db5-cbb5-4b14-a5ae-6af475c2a7a2

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2: aborted
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_attach_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server        | 14.685    | 20.42        | 38.883       | 40.085       | 41.287    | 24.302    | 100.0%  | 10    |
| cinder_v3.create_volume | 2.556     | 2.584        | 2.829        | 2.829        | 2.83      | 2.632     | 100.0%  | 10    |
| nova.attach_volume      | 2.977     | 3.049        | 3.19         | 3.315        | 3.44      | 3.082     | 100.0%  | 10    |
| nova.detach_volume      | 2.881     | 3.077        | 3.126        | 3.129        | 3.132     | 3.033     | 100.0%  | 10    |
| cinder_v3.delete_volume | 2.281     | 2.299        | 2.323        | 2.391        | 2.458     | 2.313     | 100.0%  | 10    |
| nova.delete_server      | 5.076     | 5.188        | 7.625        | 7.7          | 7.775     | 5.717     | 100.0%  | 10    |
| total                   | 30.848    | 37.521       | 55.687       | 57.817       | 59.948    | 41.08     | 100.0%  | 10    |
|  -> duration            | 29.848    | 36.521       | 54.687       | 56.817       | 58.948    | 40.08     | 100.0%  | 10    |
|  -> idle_duration       | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 119.254922
Full duration: 133.680439
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_list_snapshots
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "volumes": {
      "volumes_per_tenant": 1, 
      "size": 1
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "detailed": true, 
    "force": false
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 2.546     | 2.802        | 5.258        | 5.261        | 5.263     | 3.598     | 100.0%  | 10    |
| cinder_v3.list_snapshots  | 0.046     | 0.051        | 0.063        | 0.079        | 0.095     | 0.056     | 100.0%  | 10    |
| total                     | 2.592     | 2.856        | 5.322        | 5.34         | 5.358     | 3.654     | 100.0%  | 10    |
|  -> duration              | 2.592     | 2.856        | 5.322        | 5.34         | 5.358     | 3.654     | 100.0%  | 10    |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.490045
Full duration: 41.771803
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_list_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "detailed": true, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.417     | 9.876        | 10.794       | 11.287       | 11.781    | 10.15     | 100.0%  | 10    |
| cinder_v3.list_volumes  | 0.095     | 0.121        | 0.211        | 0.259        | 0.307     | 0.151     | 100.0%  | 10    |
| total                   | 9.513     | 9.991        | 10.999       | 11.543       | 12.088    | 10.302    | 100.0%  | 10    |
|  -> duration            | 9.513     | 9.991        | 10.999       | 11.543       | 12.088    | 10.302    | 100.0%  | 10    |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 30.333745
Full duration: 42.458475
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_list_volume
args position 1
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "detailed": true, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.792     | 2.939        | 3.059        | 3.08         | 3.101     | 2.943     | 100.0%  | 10    |
| cinder_v3.list_volumes  | 0.092     | 0.097        | 0.149        | 0.19         | 0.232     | 0.116     | 100.0%  | 10    |
| total                   | 2.884     | 3.081        | 3.171        | 3.183        | 3.195     | 3.06      | 100.0%  | 10    |
|  -> duration            | 2.884     | 3.081        | 3.171        | 3.183        | 3.195     | 3.06      | 100.0%  | 10    |
|  -> idle_duration       | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 9.109384
Full duration: 42.222903
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_and_upload_volume_to_image
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "container_format": "bare", 
    "force": false, 
    "disk_format": "raw", 
    "do_delete": true, 
    "size": 1
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------------+
|                                                        Response Times (sec)                                                         |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                           | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume          | 2.623     | 2.686        | 4.55         | 11.732       | 18.914    | 4.338     | 100.0%  | 10    |
| cinder_v3.upload_volume_to_image | 11.1      | 19.727       | 34.285       | 36.475       | 38.665    | 22.249    | 100.0%  | 10    |
| cinder_v3.delete_volume          | 2.293     | 2.363        | 17.829       | 17.871       | 17.912    | 5.453     | 100.0%  | 10    |
| glance_v2.delete_image           | 1.673     | 1.983        | 2.751        | 3.036        | 3.321     | 2.196     | 100.0%  | 10    |
| total                            | 18.076    | 35.884       | 56.594       | 58.854       | 61.114    | 34.236    | 100.0%  | 10    |
|  -> duration                     | 18.076    | 35.884       | 56.594       | 58.854       | 61.114    | 34.236    | 100.0%  | 10    |
|  -> idle_duration                | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 124.890653
Full duration: 241.31667
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "create_vm_params": {
      "nics": [
        {
          "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
        }
      ]
    }, 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "nested_level": 1, 
    "size": {
      "max": 1, 
      "min": 1
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server          | 16.632    | 35.634       | 40.307       | 40.757       | 41.207    | 29.93     | 100.0%  | 10    |
| cinder_v3.create_volume   | 2.549     | 2.604        | 6.309        | 12.932       | 19.555    | 4.728     | 100.0%  | 10    |
| cinder_v3.create_snapshot | 2.345     | 2.393        | 5.866        | 11.619       | 17.373    | 4.118     | 100.0%  | 10    |
| nova.attach_volume        | 3.016     | 3.315        | 7.944        | 19.428       | 30.911    | 6.252     | 100.0%  | 10    |
| nova.detach_volume        | 2.943     | 3.1          | 6.217        | 19.771       | 33.324    | 6.112     | 100.0%  | 10    |
| cinder_v3.delete_snapshot | 2.25      | 2.283        | 15.623       | 17.364       | 19.104    | 5.257     | 100.0%  | 10    |
| cinder_v3.delete_volume   | 2.285     | 2.314        | 17.297       | 19.264       | 21.23     | 6.727     | 100.0%  | 10    |
| nova.delete_server        | 5.141     | 5.247        | 5.485        | 5.525        | 5.565     | 5.286     | 100.0%  | 10    |
| total                     | 39.967    | 62.656       | 87.086       | 117.113      | 147.139   | 68.412    | 100.0%  | 10    |
|  -> duration              | 38.967    | 61.656       | 86.086       | 116.113      | 146.139   | 67.412    | 100.0%  | 10    |
|  -> idle_duration         | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 265.033273
Full duration: 326.225334
--------------------------------------------------------------------------------

test scenario CinderVolumes.create_snapshot_and_attach_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }
    }
  }, 
  "args": {
    "create_vm_params": {
      "nics": [
        {
          "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
        }
      ]
    }, 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "size": {
      "max": 1, 
      "min": 1
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 has 2 error(s)
--------------------------------------------------------------------------------

TimeoutException: Rally tired waiting 200.00 seconds for Volume s_rally_795d8632_9jcvPRiY:d6d2db27-870e-4fa7-a9d6-f59203fe91a1 to become ('AVAILABLE') current status DETACHING

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 511, in run
    self._detach_volume(server, volume)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 771, in _detach_volume
    check_interval=CONF.openstack.nova_detach_volume_poll_interval
  File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 252, in wait_for_status
    timeout=timeout)
TimeoutException: Rally tired waiting 200.00 seconds for Volume s_rally_795d8632_9jcvPRiY:d6d2db27-870e-4fa7-a9d6-f59203fe91a1 to become ('AVAILABLE') current status DETACHING

--------------------------------------------------------------------------------
ClientException: Unknown Error (HTTP 504)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 510, in run
    self._attach_volume(server, volume)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 729, in _attach_volume
    server_id, volume_id, device)
  File "/usr/lib/python2.7/site-packages/novaclient/api_versions.py", line 393, in substitution
    return methods[-1].func(obj, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/v2/volumes.py", line 56, in create_server_volume
    body, "volumeAttachment")
  File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 366, in _create
    resp, body = self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 83, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: Unknown Error (HTTP 504)

--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume   | 2.709     | 3.26         | 27.404       | 32.271       | 37.139    | 10.138    | 100.0%  | 10    |
| cinder_v3.create_snapshot | 2.354     | 2.501        | 7.788        | 31.033       | 54.279    | 7.653     | 100.0%  | 10    |
| nova.boot_server          | 16.581    | 22.322       | 34.047       | 35.006       | 35.965    | 24.542    | 100.0%  | 10    |
| nova.attach_volume        | 2.995     | 11.128       | 81.41        | 91.501       | 101.591   | 35.268    | 90.0%   | 10    |
| nova.detach_volume        | 2.887     | 15.098       | 81.738       | 141.377      | 201.016   | 37.215    | 88.9%   | 9     |
| cinder_v3.delete_snapshot | 2.243     | 2.322        | 22.052       | 23.194       | 24.336    | 7.4       | 100.0%  | 8     |
| cinder_v3.delete_volume   | 2.295     | 2.37         | 14.927       | 18.025       | 21.124    | 6.424     | 100.0%  | 8     |
| nova.delete_server        | 5.116     | 5.282        | 5.34         | 5.369        | 5.397     | 5.247     | 100.0%  | 8     |
| total                     | 38.479    | 73.857       | 280.37       | 291.202      | 302.033   | 126.351   | 80.0%   | 10    |
|  -> duration              | 37.479    | 72.857       | 279.37       | 290.202      | 301.033   | 125.351   | 80.0%   | 10    |
|  -> idle_duration         | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 80.0%   | 10    |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 393.678516
Full duration: 593.865423

HINTS:
* To plot HTML graphics with this data, run:
	rally task report b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 --out output.html

* To generate a JUnit report, run:
	rally task export b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 --json --out output.json

At least one workload did not pass SLA criteria.


2020-03-08 15:47:17,955 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'b5733db5-cbb5-4b14-a5ae-6af475c2a7a2', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json']
2020-03-08 15:47:20,099 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b5733db5-cbb5-4b14-a5ae-6af475c2a7a2 --out /home/opnfv/functest/results/rally_full/cinder.json

2020-03-08 15:47:20,119 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" Failed.
2020-03-08 15:47:20,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml
2020-03-08 15:47:20,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:47:20,135 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:47:20,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ...
2020-03-08 15:47:20,139 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:47:23,444 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: a59cf9d6-9442-4196-90c9-3a84aceb55c4
2020-03-08 15:47:23,445 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a59cf9d6-9442-4196-90c9-3a84aceb55c4
2020-03-08 15:47:23,445 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a59cf9d6-9442-4196-90c9-3a84aceb55c4']
2020-03-08 15:47:24,228 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a59cf9d6-9442-4196-90c9-3a84aceb55c4

--------------------------------------------------------------------------------
Task a59cf9d6-9442-4196-90c9-3a84aceb55c4: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
    self._validate_config_semantic(self.config)
  File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
    result = f(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
    "for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.


2020-03-08 15:47:24,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a59cf9d6-9442-4196-90c9-3a84aceb55c4', '--out', u'/home/opnfv/functest/results/rally_full/heat.json']
2020-03-08 15:47:26,332 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a59cf9d6-9442-4196-90c9-3a84aceb55c4 --out /home/opnfv/functest/results/rally_full/heat.json

2020-03-08 15:47:26,333 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed.
2020-03-08 15:47:26,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml
2020-03-08 15:47:26,334 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:47:26,355 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:47:26,357 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ...
2020-03-08 15:47:26,357 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:47:29,581 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 2f2dc002-f7d6-4e2c-960f-0e809df2f1dd
2020-03-08 15:47:29,581 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 2f2dc002-f7d6-4e2c-960f-0e809df2f1dd
2020-03-08 15:47:29,582 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'2f2dc002-f7d6-4e2c-960f-0e809df2f1dd']
2020-03-08 15:47:30,365 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2f2dc002-f7d6-4e2c-960f-0e809df2f1dd

--------------------------------------------------------------------------------
Task 2f2dc002-f7d6-4e2c-960f-0e809df2f1dd: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
    self._validate_config_semantic(self.config)
  File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
    result = f(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
    "for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.


2020-03-08 15:47:30,366 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'2f2dc002-f7d6-4e2c-960f-0e809df2f1dd', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json']
2020-03-08 15:47:32,431 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2f2dc002-f7d6-4e2c-960f-0e809df2f1dd --out /home/opnfv/functest/results/rally_full/keystone.json

2020-03-08 15:47:32,432 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" Failed.
2020-03-08 15:47:32,433 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml
2020-03-08 15:47:32,433 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:47:32,453 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:47:32,460 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-03-08 15:47:32,460 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 15:47:36,015 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: f7dd24a5-e125-4ae7-a418-3caeaa64e947
2020-03-08 15:47:36,015 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f7dd24a5-e125-4ae7-a418-3caeaa64e947
2020-03-08 15:47:36,016 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'f7dd24a5-e125-4ae7-a418-3caeaa64e947']
2020-03-08 15:47:36,796 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f7dd24a5-e125-4ae7-a418-3caeaa64e947

--------------------------------------------------------------------------------
Task f7dd24a5-e125-4ae7-a418-3caeaa64e947: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
    self._validate_config_semantic(self.config)
  File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
    result = f(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
    "for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.


2020-03-08 15:47:36,797 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'f7dd24a5-e125-4ae7-a418-3caeaa64e947', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json']
2020-03-08 15:47:38,834 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f7dd24a5-e125-4ae7-a418-3caeaa64e947 --out /home/opnfv/functest/results/rally_full/neutron.json

2020-03-08 15:47:38,835 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-03-08 15:47:38,836 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml
2020-03-08 15:47:38,836 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 15:47:38,856 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 15:47:38,864 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ...
2020-03-08 15:47:38,864 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 16:38:54,318 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: bf02cd2d-aa77-40d9-998a-aed4a5767eb3
2020-03-08 16:38:54,318 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : bf02cd2d-aa77-40d9-998a-aed4a5767eb3
2020-03-08 16:38:54,319 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'bf02cd2d-aa77-40d9-998a-aed4a5767eb3']
2020-03-08 16:38:55,205 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid bf02cd2d-aa77-40d9-998a-aed4a5767eb3

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3: aborted
--------------------------------------------------------------------------------

test scenario NovaKeypair.create_and_delete_keypair
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "key_pairs": -1, 
        "cores": -1, 
        "security_groups": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.569     | 0.866        | 1.463        | 1.6          | 1.737     | 0.988     | 100.0%  | 10    |
| nova.delete_keypair | 0.047     | 0.06         | 0.128        | 0.14         | 0.152     | 0.077     | 100.0%  | 10    |
| total               | 0.653     | 0.956        | 1.517        | 1.658        | 1.799     | 1.065     | 100.0%  | 10    |
|  -> duration        | 0.653     | 0.956        | 1.517        | 1.658        | 1.799     | 1.065     | 100.0%  | 10    |
|  -> idle_duration   | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.855812
Full duration: 14.429095
--------------------------------------------------------------------------------

test scenario NovaKeypair.create_and_list_keypairs
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "key_pairs": -1, 
        "cores": -1, 
        "security_groups": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.436     | 0.707        | 1.209        | 1.353        | 1.497     | 0.809     | 100.0%  | 10    |
| nova.list_keypairs  | 0.049     | 0.098        | 0.366        | 0.562        | 0.757     | 0.195     | 100.0%  | 10    |
| total               | 0.54      | 0.786        | 1.505        | 1.526        | 1.547     | 1.004     | 100.0%  | 10    |
|  -> duration        | 0.54      | 0.786        | 1.505        | 1.526        | 1.547     | 1.004     | 100.0%  | 10    |
|  -> idle_duration   | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.749854
Full duration: 70.665375
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_bounce_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "actions": [
      {
        "hard_reboot": 1
      }, 
      {
        "soft_reboot": 1
      }, 
      {
        "stop_start": 1
      }, 
      {
        "rescue_unrescue": 1
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------------+
|                                                        Response Times (sec)                                                        |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server                | 16.849    | 26.214       | 41.288       | 41.351       | 41.414    | 28.288    | 100.0%  | 10    |
| nova.reboot_server              | 11.593    | 22.244       | 26.431       | 26.732       | 27.034    | 20.613    | 100.0%  | 10    |
| nova.soft_reboot_server         | 18.479    | 136.646      | 142.559      | 145.07       | 147.58    | 126.311   | 100.0%  | 10    |
| nova.stop_and_start_server      | 31.413    | 82.118       | 92.031       | 96.023       | 100.016   | 76.334    | 100.0%  | 10    |
|  -> nova.stop_server            | 14.409    | 65.001       | 71.136       | 74.078       | 77.019    | 57.922    | 100.0%  | 10    |
|  -> nova.start_server           | 10.495    | 17.787       | 25.409       | 25.589       | 25.768    | 18.411    | 100.0%  | 10    |
| nova.rescue_and_unrescue_server | 19.734    | 73.551       | 85.37        | 86.916       | 88.463    | 64.121    | 100.0%  | 10    |
|  -> nova.rescue_server          | 16.99     | 67.204       | 80.585       | 83.144       | 85.703    | 56.415    | 100.0%  | 10    |
|  -> nova.unrescue_server        | 2.628     | 5.008        | 15.975       | 17.318       | 18.662    | 7.706     | 100.0%  | 10    |
| nova.delete_server              | 5.093     | 5.358        | 11.2         | 11.677       | 12.154    | 7.362     | 100.0%  | 10    |
| total                           | 193.29    | 358.068      | 380.321      | 381.17       | 382.019   | 323.06    | 100.0%  | 10    |
|  -> duration                    | 184.29    | 349.068      | 371.321      | 372.17       | 373.019   | 314.06    | 100.0%  | 10    |
|  -> idle_duration               | 9.0       | 9.0          | 9.0          | 9.0          | 9.0       | 9.0       | 100.0%  | 10    |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 921.351396
Full duration: 1008.40231
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_delete_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                  |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server   | 16.727    | 31.933       | 41.505       | 42.246       | 42.987    | 30.617    | 100.0%  | 10    |
| nova.delete_server | 5.024     | 5.23         | 7.787        | 7.855        | 7.922     | 5.749     | 100.0%  | 10    |
| total              | 24.606    | 37.287       | 46.889       | 47.497       | 48.105    | 36.366    | 100.0%  | 10    |
|  -> duration       | 23.606    | 36.287       | 45.889       | 46.497       | 47.105    | 35.366    | 100.0%  | 10    |
|  -> idle_duration  | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 96.661491
Full duration: 172.930749
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_list_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "detailed": true, 
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server  | 17.666    | 28.716       | 35.502       | 37.875       | 40.248    | 29.531    | 100.0%  | 10    |
| nova.list_servers | 0.403     | 0.422        | 0.447        | 0.51         | 0.572     | 0.433     | 100.0%  | 10    |
| total             | 18.07     | 29.142       | 35.929       | 38.296       | 40.663    | 29.965    | 100.0%  | 10    |
|  -> duration      | 17.07     | 28.142       | 34.929       | 37.296       | 39.663    | 28.965    | 100.0%  | 10    |
|  -> idle_duration | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 84.214456
Full duration: 172.107764
--------------------------------------------------------------------------------

test scenario NovaServers.boot_and_rebuild_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "from_image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "to_image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server    | 17.201    | 24.566       | 36.81        | 38.89        | 40.97     | 26.501    | 100.0%  | 10    |
| nova.rebuild_server | 31.273    | 36.14        | 44.826       | 48.25        | 51.674    | 38.227    | 100.0%  | 10    |
| nova.delete_server  | 5.107     | 7.44         | 7.605        | 7.637        | 7.669     | 6.623     | 100.0%  | 10    |
| total               | 53.864    | 65.568       | 88.523       | 94.322       | 100.121   | 71.351    | 100.0%  | 10    |
|  -> duration        | 51.864    | 63.568       | 86.523       | 92.322       | 98.121    | 69.351    | 100.0%  | 10    |
|  -> idle_duration   | 2.0       | 2.0          | 2.0          | 2.0          | 2.0       | 2.0       | 100.0%  | 10    |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 213.249356
Full duration: 287.433667
--------------------------------------------------------------------------------

test scenario NovaServers.snapshot_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------------+
|                                                       Response Times (sec)                                                       |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server (x2)         | 40.168    | 58.734       | 109.711      | 117.919      | 126.128   | 68.551    | 100.0%  | 10    |
| nova.snapshot_server          | 6.72      | 7.883        | 8.997        | 9.016        | 9.035     | 7.867     | 100.0%  | 10    |
|  -> glance_v2.get_image       | 0.087     | 0.096        | 0.106        | 0.117        | 0.128     | 0.099     | 100.0%  | 10    |
|  -> glance.wait_for_image     | 6.202     | 7.268        | 8.278        | 8.292        | 8.306     | 7.251     | 100.0%  | 10    |
|  --> glance_v2.get_image (x4) | 0.195     | 0.203        | 0.258        | 0.267        | 0.276     | 0.22      | 100.0%  | 5     |
|  --> glance_v2.get_image (x5) | 0.245     | 0.259        | 0.284        | 0.29         | 0.296     | 0.264     | 100.0%  | 5     |
| nova.delete_server (x2)       | 10.617    | 13.727       | 55.433       | 59.953       | 64.473    | 28.139    | 100.0%  | 10    |
| nova.delete_image             | 1.0       | 1.027        | 1.049        | 1.09         | 1.131     | 1.034     | 100.0%  | 10    |
|  -> glance_v2.delete_image    | 0.934     | 0.979        | 1.007        | 1.036        | 1.065     | 0.981     | 100.0%  | 10    |
|  -> glance.wait_for_delete    | 0.037     | 0.045        | 0.067        | 0.081        | 0.095     | 0.05      | 100.0%  | 10    |
|  --> glance_v2.get_image      | 0.037     | 0.045        | 0.066        | 0.081        | 0.095     | 0.05      | 0.0%    | 10    |
| total                         | 61.065    | 104.936      | 135.218      | 150.57       | 165.922   | 105.592   | 100.0%  | 10    |
|  -> duration                  | 59.065    | 102.936      | 133.218      | 148.57       | 163.922   | 103.592   | 100.0%  | 10    |
|  -> idle_duration             | 2.0       | 2.0          | 2.0          | 2.0          | 2.0       | 2.0       | 100.0%  | 10    |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 280.3129
Full duration: 420.289946
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_from_volume
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "volume_size": 1, 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.277     | 17.667       | 37.456       | 37.459       | 37.462    | 20.662    | 100.0%  | 10    |
| nova.boot_server        | 12.286    | 36.272       | 57.679       | 61.067       | 64.454    | 36.249    | 100.0%  | 10    |
| total                   | 21.815    | 50.89        | 95.135       | 98.526       | 101.917   | 56.911    | 100.0%  | 10    |
|  -> duration            | 20.815    | 49.89        | 94.135       | 97.526       | 100.917   | 55.911    | 100.0%  | 10    |
|  -> idle_duration       | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 153.13831
Full duration: 216.331133
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ], 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server  | 19.58     | 22.853       | 30.574       | 31.227       | 31.88     | 23.908    | 100.0%  | 10    |
| total             | 19.58     | 22.853       | 30.574       | 31.227       | 31.88     | 23.908    | 100.0%  | 10    |
|  -> duration      | 18.58     | 21.853       | 29.574       | 30.227       | 30.88     | 22.908    | 100.0%  | 10    |
|  -> idle_duration | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 69.021102
Full duration: 96.088474
--------------------------------------------------------------------------------

test scenario NovaServers.list_servers
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "network": {}, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "servers": {
      "servers_per_tenant": 2, 
      "flavor": {
        "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
      }, 
      "auto_assign_nic": true, 
      "image": {
        "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
      }
    }
  }, 
  "args": {
    "detailed": true
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+----------------------------------------------------------------------------------------------------------------------+
|                                                 Response Times (sec)                                                 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.list_servers | 0.625     | 0.771        | 1.357        | 1.403        | 1.45      | 0.902     | 100.0%  | 10    |
| total             | 0.625     | 0.771        | 1.357        | 1.403        | 1.45      | 0.902     | 100.0%  | 10    |
|  -> duration      | 0.625     | 0.771        | 1.357        | 1.403        | 1.45      | 0.902     | 100.0%  | 10    |
|  -> idle_duration | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.538994
Full duration: 160.784773
--------------------------------------------------------------------------------

test scenario NovaKeypair.boot_and_delete_server_with_keypair
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "quotas": {
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "key_pairs": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "server_kwargs": {
      "nics": [
        {
          "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
        }
      ]
    }, 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                  |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.create_keypair | 0.32      | 0.527        | 0.798        | 0.854        | 0.91      | 0.56      | 100.0%  | 10    |
| nova.boot_server    | 19.527    | 27.655       | 33.828       | 35.92        | 38.012    | 28.195    | 100.0%  | 10    |
| nova.delete_server  | 5.154     | 5.197        | 5.807        | 6.702        | 7.596     | 5.491     | 100.0%  | 10    |
| nova.delete_keypair | 0.044     | 0.05         | 0.057        | 0.058        | 0.06      | 0.051     | 100.0%  | 10    |
| total               | 25.301    | 33.468       | 40.095       | 43.271       | 46.446    | 34.298    | 100.0%  | 10    |
|  -> duration        | 24.301    | 32.468       | 39.095       | 42.271       | 45.446    | 33.298    | 100.0%  | 10    |
|  -> idle_duration   | 1.0       | 1.0          | 1.0          | 1.0          | 1.0       | 1.0       | 100.0%  | 10    |
+---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 99.586314
Full duration: 176.356344
--------------------------------------------------------------------------------

test scenario NovaServers.boot_server_from_volume_and_delete
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "quotas": {
      "cinder": {
        "gigabytes": -1, 
        "volumes": -1, 
        "snapshots": -1
      }, 
      "nova": {
        "ram": -1, 
        "floating_ips": -1, 
        "security_group_rules": -1, 
        "instances": -1, 
        "cores": -1, 
        "security_groups": -1
      }, 
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "network": {
      "networks_per_tenant": 1, 
      "start_cidr": "100.1.0.0/25"
    }
  }, 
  "args": {
    "volume_size": 1, 
    "flavor": {
      "name": "rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "image": {
      "name": "rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223"
    }, 
    "nics": [
      {
        "net-id": "70cc4e9a-949b-4c76-a7e1-f892fd4e32be"
      }
    ]
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task bf02cd2d-aa77-40d9-998a-aed4a5767eb3 has 1 error(s)
--------------------------------------------------------------------------------

ClientException: Gateway Time-out (HTTP 504)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 189, in run
    volume_type=volume_type)
  File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
    return func(instance, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume
    multiattach=multiattach, backup_id=backup_id)
  File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
    return func(instance, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume
    multiattach=multiattach, backup_id=backup_id))
  File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
    return func(instance, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 73, in create_volume
    .volumes.create(size, **kwargs))
  File "/usr/lib/python2.7/site-packages/cinderclient/v3/volumes.py", line 135, in create
    return self._create('/volumes', body, 'volume')
  File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 330, in _create
    resp, body = self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 203, in post
    return self._cs_request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 191, in _cs_request
    return self.request(url, method, **kwargs)
  File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 177, in request
    raise exceptions.from_response(resp, body)
ClientException: Gateway Time-out (HTTP 504)

--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                    |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 10.205    | 17.018       | 37.945       | 49.033       | 60.122    | 21.658    | 88.9%   | 9     |
| nova.boot_server        | 16.709    | 27.812       | 29.39        | 29.432       | 29.474    | 24.891    | 100.0%  | 8     |
| nova.delete_server      | 5.38      | 13.417       | 57.301       | 58.089       | 58.876    | 27.112    | 100.0%  | 8     |
| total                   | 44.187    | 60.122       | 96.663       | 97.616       | 98.569    | 67.883    | 88.9%   | 9     |
|  -> duration            | 43.187    | 60.122       | 95.663       | 96.616       | 97.569    | 66.994    | 88.9%   | 9     |
|  -> idle_duration       | 0.0       | 1.0          | 1.0          | 1.0          | 1.0       | 0.889     | 88.9%   | 9     |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 160.856221
Full duration: 242.417114

HINTS:
* To plot HTML graphics with this data, run:
	rally task report bf02cd2d-aa77-40d9-998a-aed4a5767eb3 --out output.html

* To generate a JUnit report, run:
	rally task export bf02cd2d-aa77-40d9-998a-aed4a5767eb3 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report bf02cd2d-aa77-40d9-998a-aed4a5767eb3 --json --out output.json

At least one workload did not pass SLA criteria.


2020-03-08 16:38:55,207 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'bf02cd2d-aa77-40d9-998a-aed4a5767eb3', '--out', u'/home/opnfv/functest/results/rally_full/nova.json']
2020-03-08 16:38:57,391 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid bf02cd2d-aa77-40d9-998a-aed4a5767eb3 --out /home/opnfv/functest/results/rally_full/nova.json

2020-03-08 16:38:57,423 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed.
2020-03-08 16:38:57,424 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml
2020-03-08 16:38:57,424 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 16:38:57,439 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 16:38:57,440 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ...
2020-03-08 16:38:57,440 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 16:41:02,852 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 5e4ae8c2-87e1-4704-9493-2a88291c942f
2020-03-08 16:41:02,853 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 5e4ae8c2-87e1-4704-9493-2a88291c942f
2020-03-08 16:41:02,853 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'5e4ae8c2-87e1-4704-9493-2a88291c942f']
2020-03-08 16:41:03,673 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5e4ae8c2-87e1-4704-9493-2a88291c942f

--------------------------------------------------------------------------------
Task 5e4ae8c2-87e1-4704-9493-2a88291c942f: finished
--------------------------------------------------------------------------------

test scenario Quotas.cinder_update_and_delete
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5e4ae8c2-87e1-4704-9493-2a88291c942f has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.331     | 0.434        | 0.696        | 0.698        | 0.701     | 0.486     | 100.0%  | 10    |
| quotas.delete_quotas | 0.039     | 0.07         | 0.082        | 0.084        | 0.086     | 0.063     | 100.0%  | 10    |
| total                | 0.392     | 0.477        | 0.773        | 0.775        | 0.777     | 0.549     | 100.0%  | 10    |
|  -> duration         | 0.392     | 0.477        | 0.773        | 0.775        | 0.777     | 0.549     | 100.0%  | 10    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.583832
Full duration: 7.022163
--------------------------------------------------------------------------------

test scenario Quotas.cinder_update
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "api_versions": {
      "cinder": {
        "service_type": "volumev3", 
        "version": 3
      }
    }, 
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5e4ae8c2-87e1-4704-9493-2a88291c942f has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.391     | 0.474        | 0.59         | 0.596        | 0.602     | 0.488     | 100.0%  | 10    |
| total                | 0.391     | 0.474        | 0.59         | 0.596        | 0.602     | 0.488     | 100.0%  | 10    |
|  -> duration         | 0.391     | 0.474        | 0.59         | 0.596        | 0.602     | 0.488     | 100.0%  | 10    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.409728
Full duration: 55.806766
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5e4ae8c2-87e1-4704-9493-2a88291c942f has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.189     | 0.305        | 0.4          | 0.407        | 0.414     | 0.302     | 100.0%  | 10    |
| total                | 0.283     | 0.486        | 0.521        | 0.537        | 0.553     | 0.452     | 100.0%  | 10    |
|  -> duration         | 0.283     | 0.486        | 0.521        | 0.537        | 0.553     | 0.452     | 100.0%  | 10    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.295708
Full duration: 45.976006
--------------------------------------------------------------------------------

test scenario Quotas.nova_update
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5e4ae8c2-87e1-4704-9493-2a88291c942f has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.337     | 0.509        | 0.649        | 0.668        | 0.686     | 0.522     | 100.0%  | 10    |
| total                | 0.337     | 0.509        | 0.649        | 0.668        | 0.686     | 0.522     | 100.0%  | 10    |
|  -> duration         | 0.337     | 0.509        | 0.649        | 0.668        | 0.686     | 0.522     | 100.0%  | 10    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.448213
Full duration: 7.723897

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 5e4ae8c2-87e1-4704-9493-2a88291c942f --out output.html

* To generate a JUnit report, run:
	rally task export 5e4ae8c2-87e1-4704-9493-2a88291c942f --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 5e4ae8c2-87e1-4704-9493-2a88291c942f --json --out output.json


2020-03-08 16:41:03,674 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'5e4ae8c2-87e1-4704-9493-2a88291c942f', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json']
2020-03-08 16:41:05,791 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5e4ae8c2-87e1-4704-9493-2a88291c942f --out /home/opnfv/functest/results/rally_full/quotas.json

2020-03-08 16:41:05,801 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK.
2020-03-08 16:41:05,802 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml
2020-03-08 16:41:05,802 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-08 16:41:05,818 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-03-08 16:41:05,819 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ...
2020-03-08 16:41:05,819 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': '70cc4e9a-949b-4c76-a7e1-f892fd4e32be', 'tenants_amount': 3, 'image_name': 'rally_full-img_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_a324836a-c5e1-4978-a6d8-8b3ce210d223', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-03-08 16:48:56,669 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: c1aaa215-7108-4a23-996a-e8d41c558c14
2020-03-08 16:48:56,669 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c1aaa215-7108-4a23-996a-e8d41c558c14
2020-03-08 16:48:56,670 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'c1aaa215-7108-4a23-996a-e8d41c558c14']
2020-03-08 16:48:57,494 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c1aaa215-7108-4a23-996a-e8d41c558c14

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14: finished
--------------------------------------------------------------------------------

test scenario SwiftObjects.create_container_and_object_then_list_objects
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "roles": [
      "admin"
    ]
  }, 
  "args": {
    "object_size": 5120, 
    "objects_per_container": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container   | 0.359     | 0.53         | 27.727       | 43.01        | 58.292    | 8.657     | 100.0%  | 10    |
| swift.upload_object (x2) | 0.247     | 0.328        | 0.365        | 0.37         | 0.376     | 0.319     | 100.0%  | 10    |
| swift.list_objects       | 0.274     | 0.335        | 31.407       | 35.438       | 39.469    | 7.262     | 100.0%  | 10    |
| total                    | 0.939     | 1.294        | 42.04        | 50.482       | 58.925    | 16.239    | 100.0%  | 10    |
|  -> duration             | 0.939     | 1.294        | 42.04        | 50.482       | 58.925    | 16.239    | 100.0%  | 10    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 61.146824
Full duration: 93.413952
--------------------------------------------------------------------------------

test scenario SwiftObjects.list_objects_in_containers
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "roles": [
      "admin"
    ], 
    "swift_objects": {
      "object_size": 1024, 
      "containers_per_tenant": 1, 
      "objects_per_container": 10
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                   |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.list_containers | 0.401     | 0.548        | 0.754        | 0.77         | 0.787     | 0.57      | 100.0%  | 10    |
| swift.list_objects    | 0.321     | 0.389        | 0.464        | 0.548        | 0.631     | 0.409     | 100.0%  | 10    |
| total                 | 0.779     | 0.961        | 1.182        | 1.186        | 1.19      | 0.979     | 100.0%  | 10    |
|  -> duration          | 0.779     | 0.961        | 1.182        | 1.186        | 1.19      | 0.979     | 100.0%  | 10    |
|  -> idle_duration     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.702728
Full duration: 63.573582
--------------------------------------------------------------------------------

test scenario SwiftObjects.create_container_and_object_then_download_object
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "roles": [
      "admin"
    ]
  }, 
  "args": {
    "object_size": 1024, 
    "objects_per_container": 5
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container     | 0.283     | 0.477        | 0.616        | 0.63         | 0.645     | 0.473     | 100.0%  | 10    |
| swift.upload_object (x5)   | 0.985     | 1.19         | 1.268        | 1.3          | 1.333     | 1.167     | 100.0%  | 10    |
| swift.download_object (x5) | 0.881     | 1.111        | 1.185        | 1.215        | 1.246     | 1.078     | 100.0%  | 10    |
| total                      | 2.394     | 2.716        | 2.896        | 2.913        | 2.929     | 2.719     | 100.0%  | 10    |
|  -> duration               | 2.394     | 2.716        | 2.896        | 2.913        | 2.929     | 2.719     | 100.0%  | 10    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.974317
Full duration: 151.964651
--------------------------------------------------------------------------------

test scenario SwiftObjects.create_container_and_object_then_delete_all
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "roles": [
      "admin"
    ]
  }, 
  "args": {
    "object_size": 102400, 
    "objects_per_container": 5
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.create_container   | 0.3       | 0.455        | 0.858        | 0.873        | 0.887     | 0.515     | 100.0%  | 10    |
| swift.upload_object (x5) | 0.994     | 1.147        | 1.291        | 1.298        | 1.305     | 1.154     | 100.0%  | 10    |
| swift.delete_object (x5) | 0.891     | 1.072        | 1.229        | 1.263        | 1.298     | 1.076     | 100.0%  | 10    |
| swift.delete_container   | 0.192     | 0.244        | 0.372        | 0.399        | 0.427     | 0.285     | 100.0%  | 10    |
| total                    | 2.454     | 3.069        | 3.302        | 3.419        | 3.536     | 3.031     | 100.0%  | 10    |
|  -> duration             | 2.454     | 3.069        | 3.302        | 3.419        | 3.536     | 3.031     | 100.0%  | 10    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 8.829707
Full duration: 20.721274
--------------------------------------------------------------------------------

test scenario SwiftObjects.list_and_download_objects_in_containers
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 10
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 2, 
      "tenants": 3
    }, 
    "roles": [
      "admin"
    ], 
    "swift_objects": {
      "object_size": 10240, 
      "containers_per_tenant": 2, 
      "objects_per_container": 5
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c1aaa215-7108-4a23-996a-e8d41c558c14 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------+
|                                                      Response Times (sec)                                                      |
+-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                      | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| swift.list_containers       | 0.46      | 0.539        | 0.721        | 0.726        | 0.73      | 0.577     | 100.0%  | 10    |
| swift.list_objects (x2)     | 0.609     | 0.766        | 0.81         | 0.833        | 0.857     | 0.752     | 100.0%  | 10    |
| swift.download_object (x10) | 1.639     | 1.853        | 1.976        | 1.992        | 2.008     | 1.838     | 100.0%  | 10    |
| total                       | 2.882     | 3.203        | 3.302        | 3.414        | 3.526     | 3.168     | 100.0%  | 10    |
|  -> duration                | 2.882     | 3.203        | 3.302        | 3.414        | 3.526     | 3.168     | 100.0%  | 10    |
|  -> idle_duration           | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
+-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 9.265371
Full duration: 92.719142

HINTS:
* To plot HTML graphics with this data, run:
	rally task report c1aaa215-7108-4a23-996a-e8d41c558c14 --out output.html

* To generate a JUnit report, run:
	rally task export c1aaa215-7108-4a23-996a-e8d41c558c14 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report c1aaa215-7108-4a23-996a-e8d41c558c14 --json --out output.json


2020-03-08 16:48:57,495 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'c1aaa215-7108-4a23-996a-e8d41c558c14', '--out', u'/home/opnfv/functest/results/rally_full/swift.json']
2020-03-08 16:48:59,671 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c1aaa215-7108-4a23-996a-e8d41c558c14 --out /home/opnfv/functest/results/rally_full/swift.json

2020-03-08 16:48:59,693 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK.
2020-03-08 16:48:59,695 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+----------------+------------+----------------+-----------+
|  Module        |  Duration  |  nb. Test Run  |  Success  |
+----------------+------------+----------------+-----------+
|  authenticate  |  00:04:06  |       60       |  100.00%  |
|  glance        |  00:07:27  |       70       |  100.00%  |
|  cinder        |  00:23:41  |       70       |   97.14%  |
|  heat          |  00:00:00  |       0        |    0.00%  |
|  keystone      |  00:00:00  |       0        |    0.00%  |
|  neutron       |  00:00:00  |       0        |    0.00%  |
|  nova          |  00:50:38  |      119       |   99.16%  |
|  quotas        |  00:01:56  |       40       |  100.00%  |
|  swift         |  00:07:02  |       50       |  100.00%  |
|                |            |                |           |
|  TOTAL:        |  01:34:52  |      409       |   99.27%  |
+----------------+------------+----------------+-----------+

2020-03-08 16:48:59,696 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.27% in 3/9 modules
2020-03-08 16:48:59,696 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html']
2020-03-08 16:49:02,255 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html

2020-03-08 16:49:02,256 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml']
2020-03-08 16:49:04,675 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml

2020-03-08 16:49:04,676 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_full     |     functest     |      98:18       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2020-03-08 16:49:18,699 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)