2020-06-09 19:14:48,282 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                         VALUE                                                         |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                                    http://testresults.opnfv.org/test/api/v1/results                                   |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/airship/HCF7HDDTNUOG/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-180      |
|     S3_ENDPOINT_URL     |                                             https://storage.googleapis.com                                            |
|     DEPLOY_SCENARIO     |                                                 os-nosdn-nofeature-ha                                                 |
|        BUILD_TAG        |                                                      HCF7HDDTNUOG                                                     |
|          DEBUG          |                                                          true                                                         |
|      INSTALLER_TYPE     |                                                        airship                                                        |
|         CI_LOOP         |                                                         daily                                                         |
|       TEST_DB_URL       |                                    http://testresults.opnfv.org/test/api/v1/results                                   |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/airship/HCF7HDDTNUOG/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-180     |
|        NODE_NAME        |                                                      intel-pod17                                                      |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+

2020-06-09 19:14:48,286 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2020-06-09 19:14:48,287 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2020-06-09 19:14:48,295 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2020-06-09 19:14:49,202 - functest.core.tenantnetwork - DEBUG - password: _]TVr-|Q(w9Yh>i6r,WJh>cgYAlC}R
2020-06-09 19:14:49,304 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'82b522c64d8247a4bf6a24defd1714ec', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8'})
2020-06-09 19:14:49,375 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'8600ccddcde6447592b8f370fefb7931', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8'})
2020-06-09 19:14:49,752 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': '_]TVr-|Q(w9Yh>i6r,WJh>cgYAlC}R', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8', 'project_id': u'82b522c64d8247a4bf6a24defd1714ec', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-06-09 19:14:49,756 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8', 'password': '_]TVr-|Q(w9Yh>i6r,WJh>cgYAlC}R', 'project_name': 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': '82b522c64d8247a4bf6a24defd1714ec', 'project_domain_name': 'default'}
2020-06-09 19:14:50,042 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2020-06-09 19:14:50,522 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-06-09T19:14:50Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'4c7a45cc-948c-48c2-978b-dfd426b73395', u'provider:segmentation_id': 92, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_2031b002-1cf2-4961-88ec-7dde94b20df8', u'admin_state_up': True, u'tenant_id': u'82b522c64d8247a4bf6a24defd1714ec', u'created_at': u'2020-06-09T19:14:50Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'82b522c64d8247a4bf6a24defd1714ec'})
2020-06-09 19:14:51,623 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-06-09T19:14:51Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'0419d136-22da-4afc-88ab-7474236f56ca', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_2031b002-1cf2-4961-88ec-7dde94b20df8', u'enable_dhcp': True, u'network_id': u'4c7a45cc-948c-48c2-978b-dfd426b73395', u'tenant_id': u'82b522c64d8247a4bf6a24defd1714ec', u'created_at': u'2020-06-09T19:14:51Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'82b522c64d8247a4bf6a24defd1714ec'})
2020-06-09 19:14:57,260 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-06-09T19:14:53Z', u'revision_number': 6, u'ha': True, u'id': u'3ca2b084-f939-4767-867f-ab102c20fd36', u'external_gateway_info': {u'network_id': u'cd9faff9-8fc5-4316-9419-eec7416c30bd', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'b7c874d8-88f2-451a-b78a-a4e954fb915a', u'ip_address': u'10.10.175.45'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_2031b002-1cf2-4961-88ec-7dde94b20df8', u'admin_state_up': True, u'tenant_id': u'82b522c64d8247a4bf6a24defd1714ec', u'created_at': u'2020-06-09T19:14:52Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'82b522c64d8247a4bf6a24defd1714ec'})
2020-06-09 19:15:01,188 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/5da263c2-d28a-4dbc-9dc8-00640d9f570d/file', 'owner': u'82b522c64d8247a4bf6a24defd1714ec', 'id': u'5da263c2-d28a-4dbc-9dc8-00640d9f570d', 'size': 12716032, u'self': u'/v2/images/5da263c2-d28a-4dbc-9dc8-00640d9f570d', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'82b522c64d8247a4bf6a24defd1714ec', 'name': 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-06-09T19:15:01Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-06-09T19:15:01Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_2031b002-1cf2-4961-88ec-7dde94b20df8', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/5da263c2-d28a-4dbc-9dc8-00640d9f570d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_2031b002-1cf2-4961-88ec-7dde94b20df8', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_2031b002-1cf2-4961-88ec-7dde94b20df8', 'created': u'2020-06-09T19:14:59Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-06-09T19:14:59Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/5da263c2-d28a-4dbc-9dc8-00640d9f570d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_2031b002-1cf2-4961-88ec-7dde94b20df8', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-06-09 19:15:01,315 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_2031b002-1cf2-4961-88ec-7dde94b20df8', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'0702162c1afe47ecbc6c6cdbf79ec74d', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'65212330-f586-4831-9bf2-d9e0b2be2f92', 'swap': 0})
2020-06-09 19:15:01,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-06-09 19:15:05,788 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 143e4057-40e9-4dd9-b22a-a726a41ef1c4 | 2020-06-09T19:15:05.628517 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 143e4057-40e9-4dd9-b22a-a726a41ef1c4
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2020-06-09 19:15:08,523 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2020-06-09 19:15:09,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-06-09 19:15:09,479 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_2031b002-1cf2-4961-88ec-7dde94b20df8', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'0702162c1afe47ecbc6c6cdbf79ec74d', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'5acecdb2-bdc8-4cac-90f3-dfe7e34f7588', 'swap': 0})
2020-06-09 19:15:09,578 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_2031b002-1cf2-4961-88ec-7dde94b20df8', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'0702162c1afe47ecbc6c6cdbf79ec74d', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'5acecdb2-bdc8-4cac-90f3-dfe7e34f7588', 'swap': 0})
2020-06-09 19:15:09,582 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2020-06-09 19:15:09,584 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-06-09 19:15:09,599 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server']
2020-06-09 19:15:09,859 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-06-09 19:15:09,859 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2020-06-09 19:54:01,778 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3
2020-06-09 19:54:01,779 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3
2020-06-09 19:54:01,779 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3']
2020-06-09 19:54:02,802 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.506     | 1.265        | 2.748        | 12.517       | 30.52     | 2.806     | 100.0%  | 100   |
| neutron.list_networks  | 0.278     | 0.553        | 1.241        | 1.866        | 2.097     | 0.698     | 100.0%  | 100   |
| total                  | 1.004     | 1.906        | 4.598        | 12.98        | 31.067    | 3.504     | 100.0%  | 100   |
|  -> duration           | 1.004     | 1.906        | 4.598        | 12.98        | 31.067    | 3.504     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 37.953162
Full duration: 124.372964
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.544     | 1.367        | 2.251        | 2.871        | 3.104     | 1.555     | 100.0%  | 40    |
| neutron.update_network | 0.64      | 1.219        | 2.109        | 2.314        | 2.472     | 1.369     | 100.0%  | 40    |
| total                  | 1.544     | 2.733        | 4.115        | 4.225        | 4.391     | 2.924     | 100.0%  | 40    |
|  -> duration           | 1.544     | 2.733        | 4.115        | 4.225        | 4.391     | 2.924     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.6152
Full duration: 20.807106
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.695     | 1.252        | 4.773        | 5.053        | 5.157     | 1.97      | 100.0%  | 40    |
| neutron.delete_network | 0.66      | 1.713        | 4.604        | 4.672        | 4.729     | 2.015     | 100.0%  | 40    |
| total                  | 2.138     | 3.444        | 5.802        | 5.961        | 6.254     | 3.986     | 100.0%  | 40    |
|  -> duration           | 2.138     | 3.444        | 5.802        | 5.961        | 6.254     | 3.986     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 9.416655
Full duration: 14.800416
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.507     | 1.475        | 2.312        | 3.298        | 3.731     | 1.531     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.502     | 4.652        | 8.613        | 8.878        | 10.909    | 5.091     | 100.0%  | 40    |
| neutron.list_subnets       | 0.192     | 0.713        | 1.64         | 2.103        | 2.514     | 0.876     | 100.0%  | 40    |
| total                      | 2.581     | 6.873        | 12.331       | 12.869       | 14.407    | 7.499     | 100.0%  | 40    |
|  -> duration               | 2.581     | 6.873        | 12.331       | 12.869       | 14.407    | 7.499     | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 20.425306
Full duration: 91.997216
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.48      | 1.365        | 18.343       | 39.502       | 64.844    | 5.749     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 1.382     | 3.052        | 5.564        | 5.799        | 9.982     | 3.486     | 100.0%  | 100   |
| neutron.update_subnet (x2) | 1.331     | 3.205        | 5.707        | 6.174        | 8.804     | 3.524     | 100.0%  | 100   |
| total                      | 4.152     | 8.539        | 22.161       | 53.704       | 67.777    | 12.759    | 100.0%  | 100   |
|  -> duration               | 4.152     | 8.539        | 22.161       | 53.704       | 67.777    | 12.759    | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 98.865742
Full duration: 174.124808
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.523     | 1.356        | 25.525       | 39.212       | 43.652    | 6.233     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.422     | 3.072        | 4.296        | 4.866        | 5.252     | 3.024     | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 1.579     | 3.953        | 5.403        | 5.705        | 8.266     | 3.745     | 100.0%  | 40    |
| total                      | 3.981     | 9.252        | 28.836       | 42.641       | 47.014    | 13.024    | 100.0%  | 40    |
|  -> duration               | 3.981     | 9.252        | 28.836       | 42.641       | 47.014    | 13.024    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 59.25222
Full duration: 103.503625
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.493     | 1.348        | 2.719        | 3.681        | 21.08     | 2.401     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.402     | 3.611        | 5.013        | 5.238        | 5.387     | 3.517     | 100.0%  | 40    |
| neutron.create_router (x2)        | 9.3       | 19.425       | 26.161       | 27.022       | 30.611    | 19.14     | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 4.781     | 10.188       | 14.698       | 15.268       | 15.71     | 10.4      | 100.0%  | 40    |
| neutron.list_routers              | 0.23      | 0.433        | 0.83         | 0.864        | 1.038     | 0.498     | 100.0%  | 40    |
| total                             | 21.932    | 36.815       | 44.112       | 45.019       | 47.209    | 35.956    | 100.0%  | 40    |
|  -> duration                      | 21.932    | 36.815       | 44.112       | 45.019       | 47.209    | 35.956    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 82.596105
Full duration: 302.524492
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.458     | 1.556        | 7.848        | 20.428       | 40.041    | 4.334     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.517     | 3.353        | 4.812        | 5.099        | 5.842     | 3.341     | 100.0%  | 40    |
| neutron.create_router (x2)        | 5.689     | 12.407       | 23.069       | 24.078       | 24.688    | 13.713    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 4.532     | 10.286       | 16.026       | 16.57        | 33.986    | 11.133    | 100.0%  | 40    |
| neutron.update_router (x2)        | 1.057     | 2.24         | 5.33         | 9.982        | 34.633    | 4.238     | 100.0%  | 40    |
| total                             | 17.729    | 39.417       | 51.837       | 55.591       | 56.952    | 36.76     | 100.0%  | 40    |
|  -> duration                      | 17.729    | 39.417       | 51.837       | 55.591       | 56.952    | 36.76     | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 107.257102
Full duration: 193.43837
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 2 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 378, in _create_network_structure
    network = self._create_network(network_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 80, in _create_network
    {"network": network_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 817, in create_network
    return self.post(self.networks_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 378, in _create_network_structure
    network = self._create_network(network_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 80, in _create_network
    {"network": network_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 817, in create_network
    return self.post(self.networks_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.498     | 1.929        | 20.069       | 57.88        | 77.139    | 8.975     | 95.0%   | 40    |
| neutron.create_subnet (x2)           | 1.385     | 3.179        | 4.22         | 4.381        | 4.415     | 3.093     | 100.0%  | 38    |
| neutron.create_router (x2)           | 9.255     | 17.951       | 27.598       | 31.791       | 58.251    | 19.799    | 100.0%  | 38    |
| neutron.add_interface_router (x2)    | 4.676     | 9.677        | 17.422       | 19.304       | 41.435    | 11.403    | 100.0%  | 38    |
| neutron.remove_interface_router (x2) | 3.832     | 8.113        | 21.191       | 51.737       | 61.06     | 12.061    | 100.0%  | 38    |
| neutron.delete_router (x2)           | 4.626     | 10.378       | 17.509       | 30.451       | 51.199    | 12.171    | 100.0%  | 38    |
| total                                | 32.022    | 62.186       | 83.02        | 107.896      | 130.098   | 64.577    | 95.0%   | 40    |
|  -> duration                         | 32.022    | 62.186       | 83.02        | 107.896      | 130.098   | 64.577    | 95.0%   | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 95.0%   | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 192.678425
Full duration: 296.350635
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.488     | 0.732        | 1.013        | 1.05         | 1.086     | 0.749     | 100.0%  | 8     |
| neutron.create_port (x50) | 69.005    | 72.215       | 93.968       | 94.247       | 94.527    | 77.537    | 100.0%  | 8     |
| neutron.list_ports        | 0.675     | 0.986        | 1.465        | 1.475        | 1.484     | 1.008     | 100.0%  | 8     |
| total                     | 70.532    | 74.076       | 95.856       | 96.001       | 96.147    | 79.298    | 100.0%  | 8     |
|  -> duration              | 70.532    | 74.076       | 95.856       | 96.001       | 96.147    | 79.298    | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 167.95203
Full duration: 277.687901
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.523     | 1.414        | 2.306        | 3.015        | 3.9       | 1.503     | 100.0%  | 40    |
| neutron.create_port (x5) | 5.96      | 10.493       | 15.4         | 16.212       | 17.659    | 10.834    | 100.0%  | 40    |
| neutron.update_port (x5) | 3.573     | 5.725        | 7.857        | 9.59         | 11.129    | 6.036     | 100.0%  | 40    |
| total                    | 11.404    | 17.769       | 23.139       | 23.852       | 25.676    | 18.393    | 100.0%  | 40    |
|  -> duration             | 11.404    | 17.769       | 23.139       | 23.852       | 25.676    | 18.393    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 44.75567
Full duration: 166.831735
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.511     | 1.269        | 2.222        | 2.38         | 3.086     | 1.398     | 100.0%  | 40    |
| neutron.create_port (x5) | 6.302     | 9.625        | 12.944       | 15.954       | 17.517    | 10.024    | 100.0%  | 40    |
| neutron.delete_port (x5) | 4.457     | 7.006        | 10.319       | 10.533       | 10.687    | 7.358     | 100.0%  | 40    |
| total                    | 11.719    | 17.731       | 24.42        | 28.396       | 29.846    | 18.799    | 100.0%  | 40    |
|  -> duration             | 11.719    | 17.731       | 24.42        | 28.396       | 29.846    | 18.799    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 43.837639
Full duration: 57.600698
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 10 error(s)
--------------------------------------------------------------------------------

AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 72, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/quotas/quotas.py", line 128, in run
    quota_update_fn = self.admin_clients("neutron").update_quota
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 108, in admin_clients
    return client(version) if version is not None else client()
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
    self.cache[key] = self.create_client(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
    endpoint_override=self._get_endpoint(service_type),
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
    api_url = self.keystone.service_catalog.url_for(**kw)
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
    return self.auth_ref.service_catalog
  File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
    raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'rally_jobs-user_2031b002-1cf2-4961-88ec-7dde94b20df8' in project 'rally_jobs-project_2031b002-1cf2-4961-88ec-7dde94b20df8': [BadGateway] Bad Gateway (HTTP 502)

--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.194     | 0.215        | 0.266        | 0.282        | 0.336     | 0.226     | 100.0%  | 30    |
| total                | 0.32      | 9.488        | 53.483       | 53.593       | 53.719    | 21.649    | 75.0%   | 40    |
|  -> duration         | 0.32      | 9.488        | 53.483       | 53.593       | 53.719    | 21.649    | 75.0%   | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 75.0%   | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 54.082137
Full duration: 157.005588
--------------------------------------------------------------------------------

test scenario NeutronTrunks.create_and_list_trunk_subports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 4
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": 1000
      }
    }
  }, 
  "args": {
    "subport_count": 125
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------------+
|                                                        Response Times (sec)                                                        |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network          | 0.899     | 0.998        | 1.109        | 1.114        | 1.118     | 1.003     | 100.0%  | 4     |
| neutron.create_subnet           | 0.672     | 0.788        | 0.96         | 0.975        | 0.99      | 0.81      | 100.0%  | 4     |
| neutron.create_port (x125)      | 163.634   | 172.563      | 180.64       | 180.937      | 181.234   | 172.498   | 100.0%  | 4     |
| neutron.create_trunk            | 40.275    | 47.725       | 54.961       | 55.136       | 55.31     | 47.759    | 100.0%  | 4     |
| neutron.update_port             | 1.685     | 1.757        | 1.778        | 1.781        | 1.784     | 1.746     | 100.0%  | 4     |
| neutron.list_trunks             | 0.056     | 0.074        | 0.18         | 0.202        | 0.225     | 0.107     | 100.0%  | 4     |
| neutron.list_ports_by_device_id | 0.318     | 0.413        | 0.465        | 0.465        | 0.465     | 0.402     | 100.0%  | 4     |
| neutron.delete_trunk            | 0.508     | 0.66         | 0.7          | 0.703        | 0.705     | 0.633     | 100.0%  | 4     |
| total                           | 210.833   | 225.516      | 234.717      | 236.361      | 238.006   | 224.968   | 100.0%  | 4     |
|  -> duration                    | 210.833   | 225.516      | 234.717      | 236.361      | 238.006   | 224.968   | 100.0%  | 4     |
|  -> idle_duration               | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 4     |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 238.013936
Full duration: 327.889814

HINTS:
* To plot HTML graphics with this data, run:
	rally task report b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 --out output.html

* To generate a JUnit report, run:
	rally task export b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 --json --out output.json

At least one workload did not pass SLA criteria.


2020-06-09 19:54:02,805 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2020-06-09 19:54:05,221 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b0f106a6-9cd0-4d34-bf14-bd6d85ec89c3 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2020-06-09 19:54:05,380 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-06-09 19:54:05,381 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:38:28  |      612       |   98.04%  |
|           |            |                |           |
|  TOTAL:   |  00:38:28  |      612       |   98.04%  |
+-----------+------------+----------------+-----------+

2020-06-09 19:54:05,381 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 98.04% in 0/1 modules
2020-06-09 19:54:05,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2020-06-09 19:54:08,019 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2020-06-09 19:54:08,019 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2020-06-09 19:54:10,359 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2020-06-09 19:54:10,360 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      39:20       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2020-06-09 19:54:24,594 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)