2019-12-06 16:44:15,878 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+---------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                  VALUE                                                  |
+-------------------------+---------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                             http://testresults.opnfv.org/test/api/v1/results                            |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/airship/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-42      |
|     S3_ENDPOINT_URL     |                                      https://storage.googleapis.com                                     |
|     DEPLOY_SCENARIO     |                                          os-nosdn-nofeature-ha                                          |
|        BUILD_TAG        |                                               PVE78Z5S3XXN                                              |
|          DEBUG          |                                                   true                                                  |
|      INSTALLER_TYPE     |                                                 airship                                                 |
|         CI_LOOP         |                                                  daily                                                  |
|       TEST_DB_URL       |                             http://testresults.opnfv.org/test/api/v1/results                            |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/airship/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-42     |
|        NODE_NAME        |                                               intel-pod17                                               |
+-------------------------+---------------------------------------------------------------------------------------------------------+

2019-12-06 16:44:15,882 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2019-12-06 16:44:15,882 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2019-12-06 16:44:15,890 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2019-12-06 16:44:16,709 - functest.core.tenantnetwork - DEBUG - password: niW<X~2sCq.Tpv~@xCsC9j6lk6v.cj
2019-12-06 16:44:16,802 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'4c81714983ea4bf48e56caf2dbb97ab7', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_c433cd1f-7011-425d-960b-9e577d836ae9'})
2019-12-06 16:44:16,874 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'ad5be6f159794d1c8810aa2051b34911', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_c433cd1f-7011-425d-960b-9e577d836ae9'})
2019-12-06 16:44:17,258 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_c433cd1f-7011-425d-960b-9e577d836ae9', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': 'niW<X~2sCq.Tpv~@xCsC9j6lk6v.cj', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_c433cd1f-7011-425d-960b-9e577d836ae9', 'project_id': u'4c81714983ea4bf48e56caf2dbb97ab7', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2019-12-06 16:44:17,262 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_c433cd1f-7011-425d-960b-9e577d836ae9', 'password': 'niW<X~2sCq.Tpv~@xCsC9j6lk6v.cj', 'project_name': 'rally_jobs-project_c433cd1f-7011-425d-960b-9e577d836ae9', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': '4c81714983ea4bf48e56caf2dbb97ab7', 'project_domain_name': 'default'}
2019-12-06 16:44:17,564 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2019-12-06 16:44:18,021 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2019-12-06T16:44:17Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'd71d7e60-e00f-412d-b2c5-0da8e010377a', u'provider:segmentation_id': 22, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_c433cd1f-7011-425d-960b-9e577d836ae9', u'admin_state_up': True, u'tenant_id': u'4c81714983ea4bf48e56caf2dbb97ab7', u'created_at': u'2019-12-06T16:44:17Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'4c81714983ea4bf48e56caf2dbb97ab7'})
2019-12-06 16:44:19,144 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2019-12-06T16:44:18Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'367f3f13-b7c5-41c1-b4f1-351aa924a59b', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_c433cd1f-7011-425d-960b-9e577d836ae9', u'enable_dhcp': True, u'network_id': u'd71d7e60-e00f-412d-b2c5-0da8e010377a', u'tenant_id': u'4c81714983ea4bf48e56caf2dbb97ab7', u'created_at': u'2019-12-06T16:44:18Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'4c81714983ea4bf48e56caf2dbb97ab7'})
2019-12-06 16:44:25,223 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2019-12-06T16:44:21Z', u'revision_number': 6, u'ha': True, u'id': u'4c7b2ece-2b3d-4f74-8ee6-95512be71e05', u'external_gateway_info': {u'network_id': u'e0c63426-b096-4519-8b4a-70833c52e253', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'5b469d69-dc2f-4e18-989d-1c7512cb4505', u'ip_address': u'10.10.175.34'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_c433cd1f-7011-425d-960b-9e577d836ae9', u'admin_state_up': True, u'tenant_id': u'4c81714983ea4bf48e56caf2dbb97ab7', u'created_at': u'2019-12-06T16:44:19Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'4c81714983ea4bf48e56caf2dbb97ab7'})
2019-12-06 16:44:28,908 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/1e3c26df-8d16-4e99-91bd-6352787ca62d/file', 'owner': u'4c81714983ea4bf48e56caf2dbb97ab7', 'id': u'1e3c26df-8d16-4e99-91bd-6352787ca62d', 'size': 12716032, u'self': u'/v2/images/1e3c26df-8d16-4e99-91bd-6352787ca62d', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'4c81714983ea4bf48e56caf2dbb97ab7', 'name': 'rally_jobs-project_c433cd1f-7011-425d-960b-9e577d836ae9', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-12-06T16:44:28Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2019-12-06T16:44:28Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_c433cd1f-7011-425d-960b-9e577d836ae9', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/1e3c26df-8d16-4e99-91bd-6352787ca62d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_c433cd1f-7011-425d-960b-9e577d836ae9', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_c433cd1f-7011-425d-960b-9e577d836ae9', 'created': u'2019-12-06T16:44:27Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2019-12-06T16:44:27Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/1e3c26df-8d16-4e99-91bd-6352787ca62d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_c433cd1f-7011-425d-960b-9e577d836ae9', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2019-12-06 16:44:29,006 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_c433cd1f-7011-425d-960b-9e577d836ae9', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'6623b7f5b4a84c3ea4396f40b4a7fe0e', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'c8f2274d-94ee-4321-a5a1-619b658beac4', 'swap': 0})
2019-12-06 16:44:29,070 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2019-12-06 16:44:33,362 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 7083e741-6ec0-4de1-ae8b-28b410bba931 | 2019-12-06T16:44:33.189745 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 7083e741-6ec0-4de1-ae8b-28b410bba931
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2019-12-06 16:44:36,045 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2019-12-06 16:44:36,811 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2019-12-06 16:44:36,992 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_c433cd1f-7011-425d-960b-9e577d836ae9', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'6623b7f5b4a84c3ea4396f40b4a7fe0e', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'fd57e035-4ac7-4616-91f0-a8bbc03d319d', 'swap': 0})
2019-12-06 16:44:37,092 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_c433cd1f-7011-425d-960b-9e577d836ae9', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'6623b7f5b4a84c3ea4396f40b4a7fe0e', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'fd57e035-4ac7-4616-91f0-a8bbc03d319d', 'swap': 0})
2019-12-06 16:44:37,097 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2019-12-06 16:44:37,098 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2019-12-06 16:44:37,115 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'^NeutronTrunk']
2019-12-06 16:44:37,369 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2019-12-06 16:44:37,369 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2019-12-06 17:31:28,358 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: a38cb504-469b-4d43-9a71-262dfaf88b68
2019-12-06 17:31:28,358 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a38cb504-469b-4d43-9a71-262dfaf88b68
2019-12-06 17:31:28,359 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a38cb504-469b-4d43-9a71-262dfaf88b68']
2019-12-06 17:31:29,416 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a38cb504-469b-4d43-9a71-262dfaf88b68

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.821     | 3.302        | 7.173        | 7.746        | 8.499     | 4.166     | 100.0%  | 100   |
| neutron.list_networks  | 0.208     | 2.18         | 4.564        | 4.841        | 5.629     | 2.434     | 100.0%  | 100   |
| total                  | 2.316     | 6.72         | 9.015        | 9.908        | 11.075    | 6.6       | 100.0%  | 100   |
|  -> duration           | 2.316     | 6.72         | 9.015        | 9.908        | 11.075    | 6.6       | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 35.458467
Full duration: 77.136432
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.888     | 3.799        | 5.006        | 5.175        | 6.26      | 3.656     | 100.0%  | 40    |
| neutron.update_network | 1.456     | 4.614        | 5.431        | 5.523        | 5.694     | 4.086     | 100.0%  | 40    |
| total                  | 3.041     | 8.115        | 9.645        | 9.689        | 10.604    | 7.742     | 100.0%  | 40    |
|  -> duration           | 3.041     | 8.115        | 9.645        | 9.689        | 10.604    | 7.742     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 17.247978
Full duration: 38.298344
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.951     | 3.224        | 6.678        | 7.514        | 9.762     | 4.097     | 100.0%  | 40    |
| neutron.delete_network | 1.311     | 3.399        | 7.218        | 7.222        | 7.382     | 4.034     | 100.0%  | 40    |
| total                  | 4.487     | 8.338        | 9.909        | 10.12        | 12.147    | 8.131     | 100.0%  | 40    |
|  -> duration           | 4.487     | 8.338        | 9.909        | 10.12        | 12.147    | 8.131     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 19.147481
Full duration: 24.65787
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.621     | 3.331        | 5.594        | 6.063        | 7.237     | 3.579     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 4.148     | 15.173       | 17.427       | 17.989       | 18.452    | 14.046    | 100.0%  | 40    |
| neutron.list_subnets       | 0.211     | 2.111        | 3.556        | 3.913        | 4.146     | 1.986     | 100.0%  | 40    |
| total                      | 9.324     | 19.98        | 24.197       | 24.351       | 27.379    | 19.612    | 100.0%  | 40    |
|  -> duration               | 9.324     | 19.98        | 24.197       | 24.351       | 27.379    | 19.612    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 43.949903
Full duration: 116.407918
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.483     | 3.012        | 5.482        | 5.947        | 7.115     | 3.176     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 4.4       | 12.34        | 20.296       | 21.446       | 22.485    | 12.583    | 100.0%  | 100   |
| neutron.update_subnet (x2) | 4.509     | 11.921       | 18.155       | 19.158       | 20.798    | 12.006    | 100.0%  | 100   |
| total                      | 14.782    | 27.352       | 35.84        | 40.549       | 43.336    | 27.765    | 100.0%  | 100   |
|  -> duration               | 14.782    | 27.352       | 35.84        | 40.549       | 43.336    | 27.765    | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 144.144217
Full duration: 307.114643
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.57      | 4.606        | 5.509        | 5.602        | 6.178     | 3.651     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 3.005     | 11.712       | 17.27        | 17.435       | 18.037    | 12.154    | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 3.451     | 12.559       | 22.657       | 25.82        | 34.087    | 14.443    | 100.0%  | 40    |
| total                      | 16.573    | 27.944       | 44.628       | 47.778       | 55.958    | 30.249    | 100.0%  | 40    |
|  -> duration               | 16.573    | 27.944       | 44.628       | 47.778       | 55.958    | 30.249    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 67.116038
Full duration: 92.580751
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 2 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.868     | 2.651        | 5.59         | 5.913        | 6.437     | 3.323     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 6.505     | 13.107       | 14.697       | 14.935       | 16.83     | 12.585    | 100.0%  | 40    |
| neutron.create_router (x2)        | 21.062    | 72.962       | 90.26        | 91.853       | 92.526    | 66.314    | 100.0%  | 38    |
| neutron.add_interface_router (x2) | 5.644     | 32.012       | 49.4         | 51.525       | 53.092    | 30.813    | 100.0%  | 38    |
| neutron.list_routers              | 0.227     | 0.858        | 1.812        | 1.95         | 2.107     | 0.99      | 100.0%  | 38    |
| neutron.create_router             | 60.012    | 60.015       | 60.018       | 60.018       | 60.019    | 60.015    | 0.0%    | 2     |
| total                             | 68.379    | 114.032      | 126.378      | 134.795      | 140.453   | 112.123   | 95.0%   | 40    |
|  -> duration                      | 68.379    | 114.032      | 126.378      | 134.795      | 140.453   | 112.123   | 95.0%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 95.0%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 242.304724
Full duration: 465.231554
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.833     | 3.551        | 4.608        | 4.796        | 8.129     | 3.351     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 3.65      | 11.646       | 14.86        | 15.46        | 19.22     | 11.788    | 100.0%  | 40    |
| neutron.create_router (x2)        | 41.028    | 62.965       | 81.208       | 82.675       | 87.137    | 64.873    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 16.16     | 32.951       | 40.509       | 41.575       | 43.492    | 31.627    | 100.0%  | 40    |
| neutron.update_router (x2)        | 1.365     | 7.259        | 12.41        | 13.305       | 13.586    | 7.563     | 100.0%  | 40    |
| total                             | 98.222    | 119.932      | 127.331      | 135.84       | 138.206   | 119.203   | 100.0%  | 40    |
|  -> duration                      | 98.222    | 119.932      | 127.331      | 135.84       | 138.206   | 119.203   | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 250.584107
Full duration: 478.53753
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.842     | 3.786        | 4.835        | 4.93         | 5.303     | 3.444     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 4.465     | 12.124       | 14.731       | 14.802       | 15.175    | 11.887    | 100.0%  | 40    |
| neutron.create_router (x2)           | 40.093    | 68.697       | 82.483       | 99.634       | 105.865   | 67.266    | 100.0%  | 40    |
| neutron.add_interface_router (x2)    | 15.078    | 28.782       | 51.335       | 52.09        | 53.567    | 33.219    | 100.0%  | 40    |
| neutron.remove_interface_router (x2) | 6.995     | 27.9         | 38.94        | 43.018       | 44.903    | 28.34     | 100.0%  | 40    |
| neutron.delete_router (x2)           | 8.643     | 33.671       | 51.789       | 55.691       | 56.981    | 36.264    | 100.0%  | 40    |
| total                                | 148.23    | 180.507      | 194.935      | 197.698      | 201.631   | 180.422   | 100.0%  | 40    |
|  -> duration                         | 148.23    | 180.507      | 194.935      | 197.698      | 201.631   | 180.422   | 100.0%  | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 375.118639
Full duration: 466.784113
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.448     | 0.792        | 1.188        | 1.247        | 1.305     | 0.826     | 100.0%  | 8     |
| neutron.create_port (x50) | 96.22     | 105.95       | 114.027      | 114.091      | 114.155   | 107.294   | 100.0%  | 8     |
| neutron.list_ports        | 0.892     | 1.461        | 1.983        | 1.985        | 1.987     | 1.458     | 100.0%  | 8     |
| total                     | 98.073    | 108.233      | 116.55       | 116.556      | 116.562   | 109.581   | 100.0%  | 8     |
|  -> duration              | 98.073    | 108.233      | 116.55       | 116.556      | 116.562   | 109.581   | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 224.656443
Full duration: 341.577773
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.94      | 3.177        | 5.788        | 5.835        | 7.112     | 3.601     | 100.0%  | 40    |
| neutron.create_port (x5) | 20.542    | 34.345       | 39.82        | 41.716       | 42.018    | 32.52     | 100.0%  | 40    |
| neutron.update_port (x5) | 9.611     | 18.138       | 28.052       | 28.805       | 29.316    | 19.637    | 100.0%  | 40    |
| total                    | 40.756    | 56.86        | 61.907       | 63.053       | 67.609    | 55.76     | 100.0%  | 40    |
|  -> duration             | 40.756    | 56.86        | 61.907       | 63.053       | 67.609    | 55.76     | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 115.874732
Full duration: 192.238874
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.833     | 3.16         | 3.863        | 4.59         | 6.124     | 2.92      | 100.0%  | 40    |
| neutron.create_port (x5) | 27.43     | 34.631       | 41.715       | 42.21        | 42.641    | 35.192    | 100.0%  | 40    |
| neutron.delete_port (x5) | 16.24     | 28.504       | 33.532       | 34.054       | 35.458    | 28.004    | 100.0%  | 40    |
| total                    | 55.273    | 63.732       | 73.602       | 74.025       | 77.014    | 66.118    | 100.0%  | 40    |
|  -> duration             | 55.273    | 63.732       | 73.602       | 74.025       | 77.014    | 66.118    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 136.504682
Full duration: 156.82762
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task a38cb504-469b-4d43-9a71-262dfaf88b68 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.202     | 0.502        | 0.731        | 0.74         | 0.779     | 0.511     | 100.0%  | 39    |
| total                | 0.467     | 1.117        | 1.352        | 1.375        | 1.683     | 1.088     | 100.0%  | 39    |
|  -> duration         | 0.467     | 1.117        | 1.352        | 1.375        | 1.683     | 1.088     | 100.0%  | 39    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 39    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 2.930263
Full duration: 30.278

HINTS:
* To plot HTML graphics with this data, run:
	rally task report a38cb504-469b-4d43-9a71-262dfaf88b68 --out output.html

* To generate a JUnit report, run:
	rally task export a38cb504-469b-4d43-9a71-262dfaf88b68 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report a38cb504-469b-4d43-9a71-262dfaf88b68 --json --out output.json

At least one workload did not pass SLA criteria.


2019-12-06 17:31:29,418 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a38cb504-469b-4d43-9a71-262dfaf88b68', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2019-12-06 17:31:31,847 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a38cb504-469b-4d43-9a71-262dfaf88b68 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2019-12-06 17:31:31,961 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2019-12-06 17:31:31,963 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:46:27  |      607       |   99.67%  |
|           |            |                |           |
|  TOTAL:   |  00:46:27  |      607       |   99.67%  |
+-----------+------------+----------------+-----------+

2019-12-06 17:31:31,963 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 99.67% in 0/1 modules
2019-12-06 17:31:31,963 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2019-12-06 17:31:34,441 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2019-12-06 17:31:34,441 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2019-12-06 17:31:36,724 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2019-12-06 17:31:36,725 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      47:19       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2019-12-06 17:31:49,711 - functest.core.singlevm - DEBUG - Cleaning security group f1faa2e7-b7d4-4f01-ab01-81d1ed8235a6
2019-12-06 17:31:51,287 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)