2020-01-16 15:38:18,992 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                        VALUE                                                         |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                                   http://testresults.opnfv.org/test/api/v1/results                                   |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/airship/RGL00QOJX265/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-74      |
|     S3_ENDPOINT_URL     |                                            https://storage.googleapis.com                                            |
|     DEPLOY_SCENARIO     |                                                os-nosdn-nofeature-ha                                                 |
|        BUILD_TAG        |                                                     RGL00QOJX265                                                     |
|          DEBUG          |                                                         true                                                         |
|      INSTALLER_TYPE     |                                                       airship                                                        |
|         CI_LOOP         |                                                        daily                                                         |
|       TEST_DB_URL       |                                   http://testresults.opnfv.org/test/api/v1/results                                   |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/airship/RGL00QOJX265/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-74     |
|        NODE_NAME        |                                                     intel-pod17                                                      |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+

2020-01-16 15:38:18,996 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2020-01-16 15:38:18,997 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2020-01-16 15:38:19,006 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2020-01-16 15:38:19,707 - functest.core.tenantnetwork - DEBUG - password: L[K3]PNhxI(8N}UaZKrbIbwpLjYlLk
2020-01-16 15:38:19,800 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'd20803d925ff4c33a07292f66f1485eb', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_9bdb4f2d-660c-4fab-89d6-3d877d2b9760'})
2020-01-16 15:38:19,871 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'f09812eebf3146658fe021d41e7518ba', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_9bdb4f2d-660c-4fab-89d6-3d877d2b9760'})
2020-01-16 15:38:20,246 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': 'L[K3]PNhxI(8N}UaZKrbIbwpLjYlLk', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'project_id': u'd20803d925ff4c33a07292f66f1485eb', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-01-16 15:38:20,250 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'password': 'L[K3]PNhxI(8N}UaZKrbIbwpLjYlLk', 'project_name': 'rally_jobs-project_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': 'd20803d925ff4c33a07292f66f1485eb', 'project_domain_name': 'default'}
2020-01-16 15:38:20,546 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2020-01-16 15:38:20,989 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-01-16T15:38:20Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'29be3cd7-2af3-4631-a3c3-7a8c5946b0f4', u'provider:segmentation_id': 59, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'admin_state_up': True, u'tenant_id': u'd20803d925ff4c33a07292f66f1485eb', u'created_at': u'2020-01-16T15:38:20Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'd20803d925ff4c33a07292f66f1485eb'})
2020-01-16 15:38:22,116 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-01-16T15:38:21Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'43e2b341-b684-44b6-a195-fcbcaa9ebe13', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'enable_dhcp': True, u'network_id': u'29be3cd7-2af3-4631-a3c3-7a8c5946b0f4', u'tenant_id': u'd20803d925ff4c33a07292f66f1485eb', u'created_at': u'2020-01-16T15:38:21Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'd20803d925ff4c33a07292f66f1485eb'})
2020-01-16 15:38:28,061 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-01-16T15:38:24Z', u'revision_number': 6, u'ha': True, u'id': u'b7108c6f-2125-4d71-8264-be850ea34e0f', u'external_gateway_info': {u'network_id': u'eb12a613-fce9-4d75-952a-028f5f17f0e7', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'31eef09b-6754-427e-888e-856e40fdcf15', u'ip_address': u'10.10.175.35'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'admin_state_up': True, u'tenant_id': u'd20803d925ff4c33a07292f66f1485eb', u'created_at': u'2020-01-16T15:38:22Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'd20803d925ff4c33a07292f66f1485eb'})
2020-01-16 15:38:31,605 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/3e8d252b-a993-415d-bc0a-9c24f0b2842e/file', 'owner': u'd20803d925ff4c33a07292f66f1485eb', 'id': u'3e8d252b-a993-415d-bc0a-9c24f0b2842e', 'size': 12716032, u'self': u'/v2/images/3e8d252b-a993-415d-bc0a-9c24f0b2842e', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'd20803d925ff4c33a07292f66f1485eb', 'name': 'rally_jobs-project_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-01-16T15:38:31Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-01-16T15:38:31Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/3e8d252b-a993-415d-bc0a-9c24f0b2842e', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'created': u'2020-01-16T15:38:30Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-01-16T15:38:30Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/3e8d252b-a993-415d-bc0a-9c24f0b2842e', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-01-16 15:38:31,687 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'8c686b01c85542ef85ba66b90fead4d9', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'4f085dd8-1b99-4de2-9f4b-8db46f88d6f0', 'swap': 0})
2020-01-16 15:38:31,746 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-01-16 15:38:36,073 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 292dd3df-d228-41cd-8410-6d69790d644a | 2020-01-16T15:38:35.908142 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 292dd3df-d228-41cd-8410-6d69790d644a
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2020-01-16 15:38:38,737 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2020-01-16 15:38:39,519 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-01-16 15:38:39,700 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'8c686b01c85542ef85ba66b90fead4d9', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'0676ca0f-d29d-4f22-a15a-caa7c221efad', 'swap': 0})
2020-01-16 15:38:39,786 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_9bdb4f2d-660c-4fab-89d6-3d877d2b9760', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'8c686b01c85542ef85ba66b90fead4d9', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'0676ca0f-d29d-4f22-a15a-caa7c221efad', 'swap': 0})
2020-01-16 15:38:39,789 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2020-01-16 15:38:39,790 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-16 15:38:39,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-16 15:38:40,088 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-01-16 15:38:40,088 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2020-01-16 16:09:43,351 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 37cf64c4-4c8f-4fb8-bd71-840b18da9cea
2020-01-16 16:09:43,352 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 37cf64c4-4c8f-4fb8-bd71-840b18da9cea
2020-01-16 16:09:43,352 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'37cf64c4-4c8f-4fb8-bd71-840b18da9cea']
2020-01-16 16:09:44,357 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 37cf64c4-4c8f-4fb8-bd71-840b18da9cea

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.572     | 1.318        | 2.267        | 2.437        | 3.442     | 1.446     | 100.0%  | 100   |
| neutron.list_networks  | 0.225     | 0.711        | 1.218        | 1.458        | 1.926     | 0.747     | 100.0%  | 100   |
| total                  | 1.028     | 2.152        | 3.026        | 3.551        | 4.286     | 2.193     | 100.0%  | 100   |
|  -> duration           | 1.028     | 2.152        | 3.026        | 3.551        | 4.286     | 2.193     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.134222
Full duration: 32.291733
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.466     | 1.059        | 1.595        | 2.31         | 2.581     | 1.151     | 100.0%  | 40    |
| neutron.update_network | 0.661     | 1.447        | 1.941        | 2.563        | 2.638     | 1.464     | 100.0%  | 40    |
| total                  | 1.136     | 2.435        | 3.591        | 3.809        | 4.514     | 2.615     | 100.0%  | 40    |
|  -> duration           | 1.136     | 2.435        | 3.591        | 3.809        | 4.514     | 2.615     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 6.68806
Full duration: 19.749912
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.426     | 1.15         | 2.779        | 2.976        | 4.608     | 1.443     | 100.0%  | 40    |
| neutron.delete_network | 0.621     | 1.258        | 2.922        | 3.294        | 3.724     | 1.592     | 100.0%  | 40    |
| total                  | 1.206     | 2.8          | 5.013        | 5.195        | 5.822     | 3.035     | 100.0%  | 40    |
|  -> duration           | 1.206     | 2.8          | 5.013        | 5.195        | 5.822     | 3.035     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.586028
Full duration: 12.733921
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.483     | 1.066        | 1.623        | 1.723        | 1.869     | 1.11      | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.711     | 3.424        | 5.038        | 5.267        | 5.38      | 3.652     | 100.0%  | 40    |
| neutron.list_subnets       | 0.24      | 0.602        | 1.028        | 1.199        | 1.313     | 0.695     | 100.0%  | 40    |
| total                      | 3.672     | 5.049        | 7.036        | 7.55         | 7.839     | 5.457     | 100.0%  | 40    |
|  -> duration               | 3.672     | 5.049        | 7.036        | 7.55         | 7.839     | 5.457     | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.605244
Full duration: 44.875986
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.434     | 0.958        | 1.941        | 2.572        | 2.739     | 1.106     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 1.516     | 3.775        | 7.046        | 11.634       | 12.837    | 4.316     | 100.0%  | 100   |
| neutron.update_subnet (x2) | 1.384     | 3.714        | 7.436        | 9.776        | 13.281    | 4.301     | 100.0%  | 100   |
| total                      | 3.765     | 8.635        | 17.588       | 20.197       | 23.334    | 9.723     | 100.0%  | 100   |
|  -> duration               | 3.765     | 8.635        | 17.588       | 20.197       | 23.334    | 9.723     | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 54.462135
Full duration: 219.385107
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.444     | 1.035        | 1.923        | 2.153        | 2.568     | 1.217     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.472     | 3.365        | 5.385        | 5.989        | 6.406     | 3.598     | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 1.665     | 5.206        | 8.059        | 9.187        | 9.49      | 5.363     | 100.0%  | 40    |
| total                      | 5.473     | 10.026       | 12.991       | 13.753       | 13.912    | 10.179    | 100.0%  | 40    |
|  -> duration               | 5.473     | 10.026       | 12.991       | 13.753       | 13.912    | 10.179    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 23.581017
Full duration: 85.578192
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.419     | 1.088        | 2.218        | 3.179        | 16.199    | 1.882     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.467     | 3.51         | 4.874        | 5.196        | 6.042     | 3.494     | 100.0%  | 40    |
| neutron.create_router (x2)        | 9.539     | 20.392       | 25.651       | 27.158       | 28.365    | 20.034    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 4.584     | 10.277       | 14.578       | 14.946       | 15.692    | 10.763    | 100.0%  | 40    |
| neutron.list_routers              | 0.238     | 0.366        | 0.664        | 0.699        | 1.198     | 0.443     | 100.0%  | 40    |
| total                             | 21.636    | 37.231       | 44.712       | 48.156       | 48.704    | 36.616    | 100.0%  | 40    |
|  -> duration                      | 21.636    | 37.231       | 44.712       | 48.156       | 48.704    | 36.616    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 85.457944
Full duration: 268.228948
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.414     | 1.245        | 2.941        | 7.907        | 26.986    | 2.582     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.428     | 3.049        | 5.56         | 5.829        | 7.343     | 3.453     | 100.0%  | 40    |
| neutron.create_router (x2)        | 6.787     | 12.444       | 18.22        | 18.831       | 21.297    | 13.217    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 5.131     | 9.585        | 16.125       | 16.271       | 20.691    | 10.493    | 100.0%  | 40    |
| neutron.update_router (x2)        | 1.116     | 2.098        | 5.364        | 7.603        | 33.944    | 3.496     | 100.0%  | 40    |
| total                             | 20.594    | 31.571       | 44.249       | 45.875       | 62.927    | 33.242    | 100.0%  | 40    |
|  -> duration                      | 20.594    | 31.571       | 44.249       | 45.875       | 62.927    | 33.242    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 95.849352
Full duration: 296.067458
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.409     | 1.39         | 5.109        | 16.527       | 49.705    | 3.968     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 1.337     | 2.806        | 4.867        | 6.097        | 7.581     | 3.128     | 100.0%  | 40    |
| neutron.create_router (x2)           | 8.976     | 19.671       | 37.359       | 38.838       | 42.35     | 21.786    | 100.0%  | 40    |
| neutron.add_interface_router (x2)    | 4.771     | 10.914       | 17.54        | 20.932       | 29.337    | 11.295    | 100.0%  | 40    |
| neutron.remove_interface_router (x2) | 3.664     | 8.654        | 18.834       | 19.148       | 28.896    | 9.89      | 100.0%  | 40    |
| neutron.delete_router (x2)           | 4.563     | 8.782        | 20.861       | 21.336       | 26.849    | 10.871    | 100.0%  | 40    |
| total                                | 35.913    | 60.664       | 79.454       | 82.539       | 105.214   | 60.939    | 100.0%  | 40    |
|  -> duration                         | 35.913    | 60.664       | 79.454       | 82.539       | 105.214   | 60.939    | 100.0%  | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 160.227174
Full duration: 215.856903
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.473     | 0.868        | 1.241        | 1.27         | 1.3       | 0.907     | 100.0%  | 8     |
| neutron.create_port (x50) | 66.284    | 68.538       | 100.717      | 100.733      | 100.75    | 79.298    | 100.0%  | 8     |
| neutron.list_ports        | 0.642     | 1.009        | 2.03         | 2.035        | 2.039     | 1.162     | 100.0%  | 8     |
| total                     | 67.791    | 70.167       | 103.996      | 104.037      | 104.079   | 81.37     | 100.0%  | 8     |
|  -> duration              | 67.791    | 70.167       | 103.996      | 104.037      | 104.079   | 81.37     | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 171.876293
Full duration: 355.497322
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 6 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 445, in run
    port = self._create_port(network, port_create_args)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 445, in run
    port = self._create_port(network, port_create_args)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 445, in run
    port = self._create_port(network, port_create_args)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 445, in run
    port = self._create_port(network, port_create_args)
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 443, in run
    network = self._get_or_create_network(network_create_args)
  File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper
    return f(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 328, in _get_or_create_network
    return self._create_network(network_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 80, in _create_network
    {"network": network_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 817, in create_network
    return self.post(self.networks_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 443, in run
    network = self._get_or_create_network(network_create_args)
  File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper
    return f(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 328, in _get_or_create_network
    return self._create_network(network_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 80, in _create_network
    {"network": network_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 817, in create_network
    return self.post(self.networks_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.44      | 2.293        | 54.319       | 58.516       | 60.15     | 11.286    | 95.0%   | 40    |
| neutron.create_port (x5) | 4.222     | 9.362        | 63.433       | 63.645       | 66.197    | 17.991    | 89.5%   | 38    |
| neutron.update_port (x5) | 3.203     | 6.257        | 29.279       | 63.188       | 66.132    | 12.288    | 100.0%  | 34    |
| neutron.update_port (x4) | 2.097     | 2.137        | 2.275        | 2.301        | 2.327     | 2.175     | 100.0%  | 4     |
| <no-name-action>         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 0.0%    | 4     |
| total                    | 8.906     | 20.223       | 119.156      | 122.171      | 125.081   | 39.041    | 85.0%   | 40    |
|  -> duration             | 8.906     | 20.223       | 119.156      | 122.171      | 125.081   | 39.041    | 85.0%   | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 85.0%   | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 143.401952
Full duration: 180.939591
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.429     | 1.359        | 2.526        | 2.74         | 3.934     | 1.538     | 100.0%  | 40    |
| neutron.create_port (x5) | 4.855     | 10.873       | 13.275       | 13.637       | 14.159    | 10.69     | 100.0%  | 40    |
| neutron.delete_port (x5) | 3.756     | 7.948        | 9.972        | 10.042       | 12.787    | 7.782     | 100.0%  | 40    |
| total                    | 9.092     | 19.925       | 24.731       | 25.467       | 26.729    | 20.011    | 100.0%  | 40    |
|  -> duration             | 9.092     | 19.925       | 24.731       | 25.467       | 26.729    | 20.011    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 46.59539
Full duration: 62.450357
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 37cf64c4-4c8f-4fb8-bd71-840b18da9cea has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.198     | 0.341        | 0.44         | 0.549        | 0.692     | 0.35      | 100.0%  | 40    |
| total                | 0.392     | 0.633        | 0.856        | 0.861        | 0.937     | 0.639     | 100.0%  | 40    |
|  -> duration         | 0.392     | 0.633        | 0.856        | 0.861        | 0.937     | 0.639     | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.544137
Full duration: 44.012889

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 37cf64c4-4c8f-4fb8-bd71-840b18da9cea --out output.html

* To generate a JUnit report, run:
	rally task export 37cf64c4-4c8f-4fb8-bd71-840b18da9cea --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 37cf64c4-4c8f-4fb8-bd71-840b18da9cea --json --out output.json

At least one workload did not pass SLA criteria.


2020-01-16 16:09:44,360 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'37cf64c4-4c8f-4fb8-bd71-840b18da9cea', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2020-01-16 16:09:46,799 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 37cf64c4-4c8f-4fb8-bd71-840b18da9cea --out /home/opnfv/functest/results/rally_jobs/neutron.json

2020-01-16 16:09:46,913 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-01-16 16:09:46,914 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:30:37  |      608       |   99.01%  |
|           |            |                |           |
|  TOTAL:   |  00:30:37  |      608       |   99.01%  |
+-----------+------------+----------------+-----------+

2020-01-16 16:09:46,914 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 99.01% in 0/1 modules
2020-01-16 16:09:46,914 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2020-01-16 16:09:49,412 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2020-01-16 16:09:49,412 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2020-01-16 16:09:51,688 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2020-01-16 16:09:51,688 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      31:31       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2020-01-16 16:10:05,078 - functest.core.singlevm - DEBUG - Cleaning security group cf3d216a-46f4-4eef-b638-5bf45ba9698d
2020-01-16 16:10:06,660 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)