2019-11-29 15:25:09,759 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                  VALUE                                                   |
+-------------------------+----------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                             http://testresults.opnfv.org/test/api/v1/results                             |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/xtesting/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-37      |
|     S3_ENDPOINT_URL     |                                      https://storage.googleapis.com                                      |
|     DEPLOY_SCENARIO     |                                          os-nosdn-nofeature-ha                                           |
|        BUILD_TAG        |                                                                                                          |
|          DEBUG          |                                                   true                                                   |
|      INSTALLER_TYPE     |                                                 airship                                                  |
|         CI_LOOP         |                                                  daily                                                   |
|       TEST_DB_URL       |                             http://testresults.opnfv.org/test/api/v1/results                             |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/xtesting/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-37     |
|        NODE_NAME        |                                               intel-pod17                                                |
+-------------------------+----------------------------------------------------------------------------------------------------------+

2019-11-29 15:25:09,763 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2019-11-29 15:25:09,763 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2019-11-29 15:25:09,772 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2019-11-29 15:25:10,328 - functest.core.tenantnetwork - DEBUG - password: >?uV3<g]xqL{0f4y_^=Sv---T69[1(
2019-11-29 15:25:10,424 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_1c08216e-82e3-473c-ad9a-36d0e625b445'})
2019-11-29 15:25:10,494 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'00bd92a2ae6644eb813d88a6cae93717', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_1c08216e-82e3-473c-ad9a-36d0e625b445'})
2019-11-29 15:25:10,856 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_1c08216e-82e3-473c-ad9a-36d0e625b445', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': '>?uV3<g]xqL{0f4y_^=Sv---T69[1(', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_1c08216e-82e3-473c-ad9a-36d0e625b445', 'project_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2019-11-29 15:25:10,860 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_1c08216e-82e3-473c-ad9a-36d0e625b445', 'password': '>?uV3<g]xqL{0f4y_^=Sv---T69[1(', 'project_name': 'rally_jobs-project_1c08216e-82e3-473c-ad9a-36d0e625b445', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': 'ba86df98a3cf4d3fa4f1d97ba46d3ce9', 'project_domain_name': 'default'}
2019-11-29 15:25:11,156 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2019-11-29 15:25:11,873 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2019-11-29T15:25:11Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'a287bfca-b119-496b-8f59-a2d73ed959bf', u'provider:segmentation_id': 64, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_1c08216e-82e3-473c-ad9a-36d0e625b445', u'admin_state_up': True, u'tenant_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', u'created_at': u'2019-11-29T15:25:11Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9'})
2019-11-29 15:25:13,019 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2019-11-29T15:25:12Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'f052ea48-d811-4327-b5d1-6386f82cdf3a', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_1c08216e-82e3-473c-ad9a-36d0e625b445', u'enable_dhcp': True, u'network_id': u'a287bfca-b119-496b-8f59-a2d73ed959bf', u'tenant_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', u'created_at': u'2019-11-29T15:25:12Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9'})
2019-11-29 15:25:19,847 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2019-11-29T15:25:15Z', u'revision_number': 6, u'ha': True, u'id': u'97c14dd4-7874-4031-95f9-573e4e87118d', u'external_gateway_info': {u'network_id': u'1565c8c3-e6fc-4cd3-8986-24e0c3d18d42', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'4dea47bb-3162-4203-81fc-ef4113450c32', u'ip_address': u'10.10.175.35'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_1c08216e-82e3-473c-ad9a-36d0e625b445', u'admin_state_up': True, u'tenant_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', u'created_at': u'2019-11-29T15:25:13Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9'})
2019-11-29 15:25:23,436 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/4ff886d9-1eeb-4e5d-bf3b-5151b7d48f68/file', 'owner': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', 'id': u'4ff886d9-1eeb-4e5d-bf3b-5151b7d48f68', 'size': 12716032, u'self': u'/v2/images/4ff886d9-1eeb-4e5d-bf3b-5151b7d48f68', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ba86df98a3cf4d3fa4f1d97ba46d3ce9', 'name': 'rally_jobs-project_1c08216e-82e3-473c-ad9a-36d0e625b445', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-11-29T15:25:23Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2019-11-29T15:25:23Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_1c08216e-82e3-473c-ad9a-36d0e625b445', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/4ff886d9-1eeb-4e5d-bf3b-5151b7d48f68', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_1c08216e-82e3-473c-ad9a-36d0e625b445', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_1c08216e-82e3-473c-ad9a-36d0e625b445', 'created': u'2019-11-29T15:25:22Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2019-11-29T15:25:22Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/4ff886d9-1eeb-4e5d-bf3b-5151b7d48f68', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_1c08216e-82e3-473c-ad9a-36d0e625b445', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2019-11-29 15:25:23,512 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_1c08216e-82e3-473c-ad9a-36d0e625b445', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'd01987620f11483da2667b8e39cf8fc0', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'e7e87c5d-547e-4495-855a-4ea20af52138', 'swap': 0})
2019-11-29 15:25:23,571 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2019-11-29 15:25:27,802 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 2ccea3cf-28e9-4e0c-9d08-d8830b446a18 | 2019-11-29T15:25:27.684438 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 2ccea3cf-28e9-4e0c-9d08-d8830b446a18
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2019-11-29 15:25:30,393 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2019-11-29 15:25:31,163 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2019-11-29 15:25:31,338 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_1c08216e-82e3-473c-ad9a-36d0e625b445', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'd01987620f11483da2667b8e39cf8fc0', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'9607c9c6-2165-4c2a-8292-5a9ca5d72509', 'swap': 0})
2019-11-29 15:25:31,445 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_1c08216e-82e3-473c-ad9a-36d0e625b445', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'd01987620f11483da2667b8e39cf8fc0', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'9607c9c6-2165-4c2a-8292-5a9ca5d72509', 'swap': 0})
2019-11-29 15:25:31,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2019-11-29 15:25:31,450 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2019-11-29 15:25:31,467 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'^NeutronTrunk']
2019-11-29 15:25:31,717 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2019-11-29 15:25:31,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2019-11-29 16:14:59,583 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 62345f71-e953-4e84-8614-bc2871839791
2019-11-29 16:14:59,584 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 62345f71-e953-4e84-8614-bc2871839791
2019-11-29 16:14:59,584 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'62345f71-e953-4e84-8614-bc2871839791']
2019-11-29 16:15:00,598 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 62345f71-e953-4e84-8614-bc2871839791

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.745     | 3.865        | 5.513        | 5.758        | 7.493     | 3.911     | 100.0%  | 100   |
| neutron.list_networks  | 0.45      | 1.647        | 2.768        | 3.032        | 3.899     | 1.742     | 100.0%  | 100   |
| total                  | 2.681     | 5.528        | 7.632        | 7.927        | 10.2      | 5.653     | 100.0%  | 100   |
|  -> duration           | 2.681     | 5.528        | 7.632        | 7.927        | 10.2      | 5.653     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 30.698448
Full duration: 72.239333
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.476     | 3.292        | 5.87         | 7.914        | 8.534     | 3.38      | 100.0%  | 40    |
| neutron.update_network | 0.705     | 5.398        | 9.145        | 9.315        | 9.447     | 5.521     | 100.0%  | 40    |
| total                  | 2.868     | 8.757        | 13.184       | 13.776       | 13.942    | 8.902     | 100.0%  | 40    |
|  -> duration           | 2.868     | 8.757        | 13.184       | 13.776       | 13.942    | 8.902     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 20.227233
Full duration: 44.020354
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.827     | 3.697        | 5.238        | 5.861        | 9.587     | 3.749     | 100.0%  | 40    |
| neutron.delete_network | 1.715     | 3.901        | 6.733        | 6.824        | 7.012     | 4.445     | 100.0%  | 40    |
| total                  | 2.662     | 8.65         | 10.436       | 10.971       | 13.697    | 8.194     | 100.0%  | 40    |
|  -> duration           | 2.662     | 8.65         | 10.436       | 10.971       | 13.697    | 8.194     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 18.310596
Full duration: 23.630914
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.452     | 3.382        | 5.258        | 5.571        | 6.063     | 3.21      | 100.0%  | 40    |
| neutron.create_subnet (x2) | 5.374     | 11.214       | 17.336       | 17.403       | 17.48     | 11.725    | 100.0%  | 40    |
| neutron.list_subnets       | 0.486     | 1.612        | 2.684        | 2.864        | 3.112     | 1.729     | 100.0%  | 40    |
| total                      | 11.259    | 16.351       | 22.42        | 22.788       | 23.415    | 16.664    | 100.0%  | 40    |
|  -> duration               | 11.259    | 16.351       | 22.42        | 22.788       | 23.415    | 16.664    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 37.366889
Full duration: 110.267202
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.463     | 3.34         | 5.744        | 7.473        | 9.378     | 3.55      | 100.0%  | 100   |
| neutron.create_subnet (x2) | 4.65      | 11.957       | 15.693       | 17.188       | 20.139    | 12.158    | 100.0%  | 100   |
| neutron.update_subnet (x2) | 4.741     | 12.084       | 17.695       | 19.301       | 20.031    | 12.262    | 100.0%  | 100   |
| total                      | 18.349    | 27.77        | 33.897       | 35.233       | 37.461    | 27.97     | 100.0%  | 100   |
|  -> duration               | 18.349    | 27.77        | 33.897       | 35.233       | 37.461    | 27.97     | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 143.724968
Full duration: 332.676946
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.715     | 3.377        | 5.403        | 5.69         | 6.078     | 3.422     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 4.844     | 13.202       | 15.001       | 15.31        | 15.98     | 12.388    | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 4.726     | 14.957       | 24.702       | 26.855       | 28.037    | 15.844    | 100.0%  | 40    |
| total                      | 19.9      | 30.497       | 40.805       | 42.53        | 46.072    | 31.655    | 100.0%  | 40    |
|  -> duration               | 19.9      | 30.497       | 40.805       | 42.53        | 46.072    | 31.655    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 66.388827
Full duration: 93.87749
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 3 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.447     | 3.004        | 4.519        | 4.693        | 5.723     | 2.896     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 5.828     | 11.926       | 13.655       | 13.748       | 14.493    | 11.229    | 100.0%  | 40    |
| neutron.create_router (x2)        | 12.788    | 83.543       | 97.264       | 98.219       | 100.75    | 74.421    | 100.0%  | 37    |
| neutron.add_interface_router (x2) | 8.806     | 36.891       | 55.983       | 56.85        | 57.73     | 34.824    | 100.0%  | 37    |
| neutron.list_routers              | 0.275     | 0.735        | 1.836        | 2.674        | 3.014     | 0.967     | 100.0%  | 37    |
| neutron.create_router             | 60.009    | 60.012       | 60.015       | 60.016       | 60.016    | 60.012    | 0.0%    | 3     |
| total                             | 69.91     | 124.923      | 162.521      | 170.346      | 174.782   | 120.573   | 92.5%   | 40    |
|  -> duration                      | 69.91     | 124.923      | 162.521      | 170.346      | 174.782   | 120.573   | 92.5%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 92.5%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 272.131879
Full duration: 521.289666
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 1 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 324, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.99      | 3.018        | 5.113        | 6.501        | 6.852     | 3.473     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 7.852     | 12.598       | 16.051       | 16.476       | 17.146    | 12.439    | 100.0%  | 40    |
| neutron.create_router (x2)        | 36.657    | 69.771       | 81.443       | 81.628       | 82.774    | 65.746    | 100.0%  | 39    |
| neutron.add_interface_router (x2) | 9.798     | 39.142       | 51.446       | 51.986       | 53.791    | 34.438    | 100.0%  | 39    |
| neutron.update_router (x2)        | 1.401     | 6.307        | 12.293       | 12.453       | 12.572    | 6.9       | 100.0%  | 39    |
| neutron.create_router             | 60.008    | 60.008       | 60.008       | 60.008       | 60.008    | 60.008    | 0.0%    | 1     |
| total                             | 74.672    | 118.599      | 144.396      | 144.72       | 152.271   | 121.82    | 97.5%   | 40    |
|  -> duration                      | 74.672    | 118.599      | 144.396      | 144.72       | 152.271   | 121.82    | 97.5%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 97.5%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 258.752763
Full duration: 504.834898
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 1.538     | 3.214        | 5.167        | 5.392        | 7.828     | 3.43      | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 7.104     | 10.895       | 15.649       | 15.904       | 16.493    | 11.861    | 100.0%  | 40    |
| neutron.create_router (x2)           | 55.471    | 63.674       | 73.662       | 78.121       | 80.05     | 64.856    | 100.0%  | 40    |
| neutron.add_interface_router (x2)    | 19.005    | 29.452       | 45.669       | 46.132       | 47.98     | 32.917    | 100.0%  | 40    |
| neutron.remove_interface_router (x2) | 11.227    | 31.549       | 46.955       | 47.269       | 48.466    | 31.082    | 100.0%  | 40    |
| neutron.delete_router (x2)           | 13.384    | 32.096       | 46.957       | 50.61        | 54.559    | 33.553    | 100.0%  | 40    |
| total                                | 163.842   | 176.668      | 188.505      | 192.704      | 196.463   | 177.7     | 100.0%  | 40    |
|  -> duration                         | 163.842   | 176.668      | 188.505      | 192.704      | 196.463   | 177.7     | 100.0%  | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 362.325501
Full duration: 447.431713
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 2 error(s)
--------------------------------------------------------------------------------

ServiceUnavailable: The server is currently unavailable. Please try again at a later time.<br /><br />



Neutron server returns request_ids: ['req-e75630be-9d9a-4d43-89cc-ba5ae328e18f']

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 415, in run
    self._create_port(network, port_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
ServiceUnavailable: The server is currently unavailable. Please try again at a later time.<br /><br />



Neutron server returns request_ids: ['req-e75630be-9d9a-4d43-89cc-ba5ae328e18f']

--------------------------------------------------------------------------------
InternalServerError: Request Failed: internal server error while processing your request.
Neutron server returns request_ids: ['req-17bf744f-1f6b-4096-905e-1c93d30afa12']

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 415, in run
    self._create_port(network, port_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 266, in _create_port
    return self.clients("neutron").create_port({"port": port_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 794, in create_port
    return self.post(self.ports_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
InternalServerError: Request Failed: internal server error while processing your request.
Neutron server returns request_ids: ['req-17bf744f-1f6b-4096-905e-1c93d30afa12']

--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.559     | 0.91         | 1.387        | 1.495        | 1.603     | 0.976     | 100.0%  | 8     |
| neutron.create_port (x50) | 103.324   | 108.974      | 171.967      | 172.034      | 172.101   | 128.187   | 100.0%  | 6     |
| neutron.list_ports        | 0.898     | 1.082        | 1.373        | 1.385        | 1.398     | 1.12      | 100.0%  | 6     |
| neutron.create_port (x43) | 150.741   | 150.741      | 150.741      | 150.741      | 150.741   | 150.741   | 0.0%    | 1     |
| neutron.create_port (x42) | 145.373   | 145.373      | 145.373      | 145.373      | 145.373   | 145.373   | 0.0%    | 1     |
| total                     | 105.297   | 130.034      | 174.019      | 174.282      | 174.545   | 134.973   | 75.0%   | 8     |
|  -> duration              | 105.297   | 130.034      | 174.019      | 174.282      | 174.545   | 134.973   | 75.0%   | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 75.0%   | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 280.673138
Full duration: 398.138365
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.588     | 2.705        | 5.771        | 6.007        | 6.123     | 3.158     | 100.0%  | 40    |
| neutron.create_port (x5) | 25.703    | 37.215       | 40.915       | 42.0         | 44.048    | 35.884    | 100.0%  | 40    |
| neutron.update_port (x5) | 8.109     | 23.98        | 29.671       | 30.154       | 30.494    | 23.535    | 100.0%  | 40    |
| total                    | 38.095    | 59.07        | 72.216       | 75.26        | 75.428    | 62.578    | 100.0%  | 40    |
|  -> duration             | 38.095    | 59.07        | 72.216       | 75.26        | 75.428    | 62.578    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 130.724298
Full duration: 208.202176
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.487     | 5.571        | 6.234        | 6.767        | 6.81      | 3.817     | 100.0%  | 40    |
| neutron.create_port (x5) | 25.539    | 35.667       | 41.303       | 41.828       | 42.987    | 35.607    | 100.0%  | 40    |
| neutron.delete_port (x5) | 14.674    | 25.918       | 32.383       | 32.759       | 34.811    | 26.37     | 100.0%  | 40    |
| total                    | 51.754    | 65.755       | 74.134       | 74.215       | 74.486    | 65.796    | 100.0%  | 40    |
|  -> duration             | 51.754    | 65.755       | 74.134       | 74.215       | 74.486    | 65.796    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 134.79185
Full duration: 157.008535
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 62345f71-e953-4e84-8614-bc2871839791 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.196     | 0.53         | 1.395        | 1.424        | 1.583     | 0.729     | 100.0%  | 40    |
| total                | 0.523     | 1.69         | 2.293        | 2.437        | 2.547     | 1.64      | 100.0%  | 40    |
|  -> duration         | 0.523     | 1.69         | 2.293        | 2.437        | 2.547     | 1.64      | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 3.814199
Full duration: 35.659744

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 62345f71-e953-4e84-8614-bc2871839791 --out output.html

* To generate a JUnit report, run:
	rally task export 62345f71-e953-4e84-8614-bc2871839791 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 62345f71-e953-4e84-8614-bc2871839791 --json --out output.json

At least one workload did not pass SLA criteria.


2019-11-29 16:15:00,601 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'62345f71-e953-4e84-8614-bc2871839791', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2019-11-29 16:15:02,994 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 62345f71-e953-4e84-8614-bc2871839791 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2019-11-29 16:15:03,108 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2019-11-29 16:15:03,109 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:49:09  |      608       |   99.01%  |
|           |            |                |           |
|  TOTAL:   |  00:49:09  |      608       |   99.01%  |
+-----------+------------+----------------+-----------+

2019-11-29 16:15:03,110 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 99.01% in 0/1 modules
2019-11-29 16:15:03,110 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2019-11-29 16:15:05,566 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2019-11-29 16:15:05,567 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2019-11-29 16:15:07,761 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2019-11-29 16:15:07,761 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      49:57       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2019-11-29 16:15:20,522 - functest.core.singlevm - DEBUG - Cleaning security group 2434b638-1db0-4fe0-b212-b11039418ca6
2019-11-29 16:15:20,720 - functest.core.singlevm - DEBUG - Orphan security group 2434b638-1db0-4fe0-b212-b11039418ca6 in use
2019-11-29 16:15:20,920 - functest.core.singlevm - DEBUG - Cleaning security group c1ce0cd1-4822-4c04-b136-883c88249d7b
2019-11-29 16:15:22,528 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)