2020-03-01 22:43:22,313 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                     VALUE                                                      |
+-------------------------+----------------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                                http://testresults.opnfv.org/test/api/v1/results                                |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/cntt/FD7YVOGM8J4N/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-14      |
|     S3_ENDPOINT_URL     |                                         https://storage.googleapis.com                                         |
|     DEPLOY_SCENARIO     |                                             os-nosdn-nofeature-ha                                              |
|        BUILD_TAG        |                                                  FD7YVOGM8J4N                                                  |
|          DEBUG          |                                                      true                                                      |
|      INSTALLER_TYPE     |                                                      cntt                                                      |
|         CI_LOOP         |                                                     daily                                                      |
|       TEST_DB_URL       |                                http://testresults.opnfv.org/test/api/v1/results                                |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/cntt/FD7YVOGM8J4N/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-14     |
|        NODE_NAME        |                                                  intel-pod15                                                   |
+-------------------------+----------------------------------------------------------------------------------------------------------------+

2020-03-01 22:43:22,319 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod15

2020-03-01 22:43:22,320 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2020-03-01 22:43:22,334 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2020-03-01 22:43:23,067 - functest.core.tenantnetwork - DEBUG - password: 5SPo,vbGM(QO4=vRgCyQAA.8H5S=>t
2020-03-01 22:43:23,253 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_2b27a997-d3f4-4e12-88a5-ac32b92267f9'})
2020-03-01 22:43:23,329 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'5c5af5aa6fcf4aa2ab0f366e1dd2d289', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_2b27a997-d3f4-4e12-88a5-ac32b92267f9'})
2020-03-01 22:43:23,725 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod15', u'key_manager_api_version': u'v1', 'password': '5SPo,vbGM(QO4=vRgCyQAA.8H5S=>t', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'project_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-03-01 22:43:23,729 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'password': '5SPo,vbGM(QO4=vRgCyQAA.8H5S=>t', 'project_name': 'rally_jobs-project_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', 'project_id': '106bc4e3ecea4d2b9f4956c12d3d3e78', 'project_domain_name': 'default'}
2020-03-01 22:43:24,071 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2020-03-01 22:43:24,566 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-03-01T22:43:24Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'2f519d28-58e0-4795-a905-16d30d00ad4c', u'provider:segmentation_id': 89, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'admin_state_up': True, u'tenant_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', u'created_at': u'2020-03-01T22:43:24Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78'})
2020-03-01 22:43:26,023 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-03-01T22:43:25Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'c7b654d3-0eb2-49b2-8671-328742a72c3e', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'enable_dhcp': True, u'network_id': u'2f519d28-58e0-4795-a905-16d30d00ad4c', u'tenant_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', u'created_at': u'2020-03-01T22:43:25Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78'})
2020-03-01 22:43:34,991 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-03-01T22:43:30Z', u'revision_number': 6, u'ha': True, u'id': u'70538501-8125-4eb9-a213-e8aaf508e25c', u'external_gateway_info': {u'network_id': u'780c4078-6db9-469a-8d3a-3854a061a87d', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'38de742d-06c2-400b-a6e2-2d686fcc5212', u'ip_address': u'10.10.155.45'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'admin_state_up': True, u'tenant_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', u'created_at': u'2020-03-01T22:43:29Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'106bc4e3ecea4d2b9f4956c12d3d3e78'})
2020-03-01 22:43:42,152 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/b7ebcf2e-b1a5-470e-bc4c-79c723906b4d/file', 'owner': u'106bc4e3ecea4d2b9f4956c12d3d3e78', 'id': u'b7ebcf2e-b1a5-470e-bc4c-79c723906b4d', 'size': 12716032, u'self': u'/v2/images/b7ebcf2e-b1a5-470e-bc4c-79c723906b4d', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'106bc4e3ecea4d2b9f4956c12d3d3e78', 'name': 'rally_jobs-project_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-03-01T22:43:39Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-03-01T22:43:39Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/b7ebcf2e-b1a5-470e-bc4c-79c723906b4d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'created': u'2020-03-01T22:43:38Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-03-01T22:43:38Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/b7ebcf2e-b1a5-470e-bc4c-79c723906b4d', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_2b27a997-d3f4-4e12-88a5-ac32b92267f9', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-03-01 22:43:43,793 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'7eab1f24776f47a491e32462965d5f55', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'934d864b-d7b9-4c79-b921-11f0a5121d7b', 'swap': 0})
2020-03-01 22:43:43,840 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-03-01 22:43:48,855 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 3416ad10-c498-40a9-a7cf-edf15e892722 | 2020-03-01T22:43:48.780024 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 3416ad10-c498-40a9-a7cf-edf15e892722
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2020-03-01 22:43:51,670 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2020-03-01 22:43:52,564 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-03-01 22:43:52,982 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'7eab1f24776f47a491e32462965d5f55', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7fc1d510-d62a-4a0d-bf0f-faac2841bcc1', 'swap': 0})
2020-03-01 22:43:53,074 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_2b27a997-d3f4-4e12-88a5-ac32b92267f9', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'7eab1f24776f47a491e32462965d5f55', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7fc1d510-d62a-4a0d-bf0f-faac2841bcc1', 'swap': 0})
2020-03-01 22:43:53,078 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2020-03-01 22:43:53,079 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-03-01 22:43:53,099 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied.
2020-03-01 22:43:53,099 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk']
2020-03-01 22:43:53,465 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-03-01 22:43:53,465 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2020-03-01 23:20:10,809 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: b99ceb1f-0ac6-4ff5-8b38-110c39b915fc
2020-03-01 23:20:10,809 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b99ceb1f-0ac6-4ff5-8b38-110c39b915fc
2020-03-01 23:20:10,810 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'b99ceb1f-0ac6-4ff5-8b38-110c39b915fc']
2020-03-01 23:20:12,022 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b99ceb1f-0ac6-4ff5-8b38-110c39b915fc

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.891     | 3.265        | 7.531        | 8.015        | 9.112     | 3.831     | 100.0%  | 100   |
| neutron.list_networks  | 0.212     | 1.172        | 2.782        | 3.466        | 5.752     | 1.511     | 100.0%  | 100   |
| total                  | 1.23      | 4.676        | 9.564        | 10.26        | 11.211    | 5.342     | 100.0%  | 100   |
|  -> duration           | 1.23      | 4.676        | 9.564        | 10.26        | 11.211    | 5.342     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 28.628715
Full duration: 55.949125
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 2.403     | 4.997        | 7.404        | 7.551        | 8.719     | 5.32      | 100.0%  | 40    |
| neutron.update_network | 0.684     | 1.84         | 2.774        | 3.581        | 3.82      | 1.965     | 100.0%  | 40    |
| total                  | 4.008     | 7.316        | 9.538        | 9.91         | 10.521    | 7.286     | 100.0%  | 40    |
|  -> duration           | 4.008     | 7.316        | 9.538        | 9.91         | 10.521    | 7.286     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 15.920728
Full duration: 29.508691
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.746     | 2.083        | 3.725        | 3.861        | 4.099     | 2.332     | 100.0%  | 40    |
| neutron.delete_network | 0.782     | 1.699        | 3.314        | 3.97         | 4.168     | 2.008     | 100.0%  | 40    |
| total                  | 1.803     | 4.54         | 5.702        | 7.185        | 7.679     | 4.34      | 100.0%  | 40    |
|  -> duration           | 1.803     | 4.54         | 5.702        | 7.185        | 7.679     | 4.34      | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.689004
Full duration: 21.415348
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.959     | 4.061        | 17.488       | 17.641       | 17.889    | 6.361     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 11.65     | 26.077       | 29.324       | 29.544       | 29.799    | 23.627    | 100.0%  | 40    |
| neutron.list_subnets       | 0.205     | 0.575        | 2.691        | 3.209        | 3.959     | 0.958     | 100.0%  | 40    |
| total                      | 18.036    | 32.876       | 33.687       | 33.816       | 33.851    | 30.946    | 100.0%  | 40    |
|  -> duration               | 18.036    | 32.876       | 33.687       | 33.816       | 33.851    | 30.946    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 66.484344
Full duration: 118.777311
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.693     | 4.309        | 8.276        | 9.167        | 10.399    | 4.67      | 100.0%  | 100   |
| neutron.create_subnet (x2) | 4.601     | 14.033       | 19.61        | 20.808       | 26.881    | 13.768    | 100.0%  | 100   |
| neutron.update_subnet (x2) | 1.805     | 4.183        | 6.659        | 7.188        | 10.217    | 4.339     | 100.0%  | 100   |
| total                      | 7.948     | 23.533       | 29.972       | 32.601       | 32.821    | 22.777    | 100.0%  | 100   |
|  -> duration               | 7.948     | 23.533       | 29.972       | 32.601       | 32.821    | 22.777    | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 118.53123
Full duration: 178.139309
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.766     | 5.48         | 10.523       | 10.955       | 11.259    | 5.553     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.902     | 10.71        | 17.219       | 17.626       | 19.778    | 10.348    | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 1.982     | 4.391        | 5.972        | 6.922        | 7.987     | 4.426     | 100.0%  | 40    |
| total                      | 4.809     | 19.708       | 30.099       | 31.106       | 34.729    | 20.329    | 100.0%  | 40    |
|  -> duration               | 4.809     | 19.708       | 30.099       | 31.106       | 34.729    | 20.329    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 48.577085
Full duration: 63.262137
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 2 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 1.922     | 4.703        | 13.951       | 15.629       | 17.417    | 6.602     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 5.964     | 18.254       | 38.603       | 39.684       | 41.444    | 20.816    | 100.0%  | 40    |
| neutron.create_router (x2)        | 66.965    | 91.699       | 101.083      | 103.106      | 105.09    | 90.004    | 95.0%   | 40    |
| neutron.add_interface_router (x2) | 16.318    | 22.372       | 28.439       | 30.243       | 32.515    | 22.768    | 100.0%  | 38    |
| neutron.list_routers              | 0.183     | 0.368        | 2.058        | 2.336        | 4.229     | 0.747     | 100.0%  | 38    |
| neutron.add_interface_router      | 8.815     | 12.143       | 14.806       | 15.138       | 15.471    | 12.143    | 100.0%  | 2     |
| <no-name-action>                  | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 0.0%    | 2     |
| total                             | 108.534   | 136.932      | 165.83       | 168.147      | 172.773   | 140.369   | 95.0%   | 40    |
|  -> duration                      | 108.534   | 136.932      | 165.83       | 168.147      | 172.773   | 140.369   | 95.0%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 95.0%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 290.111052
Full duration: 418.354747
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 1.465     | 4.489        | 9.656        | 10.811       | 12.211    | 5.313     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 6.259     | 18.109       | 31.639       | 33.091       | 39.814    | 19.393    | 100.0%  | 40    |
| neutron.create_router (x2)        | 33.805    | 61.871       | 71.901       | 78.032       | 83.116    | 58.216    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 8.569     | 15.83        | 18.585       | 19.884       | 23.627    | 15.191    | 100.0%  | 40    |
| neutron.update_router (x2)        | 1.56      | 3.667        | 7.488        | 7.793        | 9.374     | 4.414     | 100.0%  | 40    |
| total                             | 69.651    | 106.558      | 113.351      | 114.743      | 116.761   | 102.526   | 100.0%  | 40    |
|  -> duration                      | 69.651    | 106.558      | 113.351      | 114.743      | 116.761   | 102.526   | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 221.043015
Full duration: 326.76692
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 1 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 1.079     | 7.366        | 11.46        | 12.106       | 14.348    | 7.732     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 10.214    | 16.22        | 42.336       | 42.894       | 44.16     | 24.483    | 100.0%  | 40    |
| neutron.create_router (x2)           | 39.159    | 50.873       | 100.409      | 103.485      | 105.768   | 69.722    | 100.0%  | 39    |
| neutron.add_interface_router (x2)    | 7.369     | 13.542       | 24.42        | 25.889       | 29.504    | 15.211    | 100.0%  | 39    |
| neutron.remove_interface_router (x2) | 3.718     | 8.498        | 11.522       | 12.965       | 21.61     | 8.498     | 100.0%  | 39    |
| neutron.delete_router (x2)           | 8.269     | 17.036       | 24.253       | 26.663       | 29.988    | 17.269    | 100.0%  | 39    |
| neutron.create_router                | 60.012    | 60.012       | 60.012       | 60.012       | 60.012    | 60.012    | 0.0%    | 1     |
| total                                | 86.975    | 123.022      | 189.208      | 195.002      | 200.169   | 141.649   | 97.5%   | 40    |
|  -> duration                         | 86.975    | 123.022      | 189.208      | 195.002      | 200.169   | 141.649   | 97.5%   | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 97.5%   | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 301.796088
Full duration: 348.750587
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.487     | 0.818        | 1.065        | 1.087        | 1.109     | 0.827     | 100.0%  | 8     |
| neutron.create_port (x50) | 95.373    | 104.762      | 112.337      | 112.98       | 113.623   | 104.558   | 100.0%  | 8     |
| neutron.list_ports        | 0.561     | 1.218        | 1.619        | 1.724        | 1.828     | 1.179     | 100.0%  | 8     |
| total                     | 97.44     | 106.598      | 114.297      | 115.25       | 116.203   | 106.567   | 100.0%  | 8     |
|  -> duration              | 97.44     | 106.598      | 114.297      | 115.25       | 116.203   | 106.567   | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 225.488789
Full duration: 291.621852
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 1.996     | 2.966        | 6.012        | 8.071        | 8.35      | 3.501     | 100.0%  | 40    |
| neutron.create_port (x5) | 22.836    | 30.096       | 36.482       | 37.274       | 40.873    | 31.001    | 100.0%  | 40    |
| neutron.update_port (x5) | 7.111     | 11.318       | 13.428       | 14.152       | 18.862    | 11.394    | 100.0%  | 40    |
| total                    | 36.325    | 45.188       | 52.23        | 52.432       | 53.241    | 45.897    | 100.0%  | 40    |
|  -> duration             | 36.325    | 45.188       | 52.23        | 52.432       | 53.241    | 45.897    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 95.864919
Full duration: 136.035451
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 1.069     | 2.543        | 5.071        | 5.709        | 6.034     | 3.022     | 100.0%  | 40    |
| neutron.create_port (x5) | 22.399    | 33.065       | 39.76        | 40.268       | 42.631    | 33.378    | 100.0%  | 40    |
| neutron.delete_port (x5) | 5.927     | 13.296       | 15.46        | 16.027       | 16.531    | 12.516    | 100.0%  | 40    |
| total                    | 39.289    | 48.888       | 56.429       | 56.932       | 59.529    | 48.917    | 100.0%  | 40    |
|  -> duration             | 39.289    | 48.888       | 56.429       | 56.932       | 59.529    | 48.917    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 100.193082
Full duration: 118.121437
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b99ceb1f-0ac6-4ff5-8b38-110c39b915fc has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 6.388     | 7.821        | 8.394        | 8.492        | 8.836     | 7.748     | 100.0%  | 40    |
| total                | 6.538     | 8.065        | 8.529        | 8.589        | 8.921     | 7.926     | 100.0%  | 40    |
|  -> duration         | 6.538     | 8.065        | 8.529        | 8.589        | 8.921     | 7.926     | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 16.523946
Full duration: 50.177984

HINTS:
* To plot HTML graphics with this data, run:
	rally task report b99ceb1f-0ac6-4ff5-8b38-110c39b915fc --out output.html

* To generate a JUnit report, run:
	rally task export b99ceb1f-0ac6-4ff5-8b38-110c39b915fc --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report b99ceb1f-0ac6-4ff5-8b38-110c39b915fc --json --out output.json

At least one workload did not pass SLA criteria.


2020-03-01 23:20:12,024 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'b99ceb1f-0ac6-4ff5-8b38-110c39b915fc', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2020-03-01 23:20:14,531 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b99ceb1f-0ac6-4ff5-8b38-110c39b915fc --out /home/opnfv/functest/results/rally_jobs/neutron.json

2020-03-01 23:20:14,674 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-03-01 23:20:14,675 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:35:56  |      608       |   99.51%  |
|           |            |                |           |
|  TOTAL:   |  00:35:56  |      608       |   99.51%  |
+-----------+------------+----------------+-----------+

2020-03-01 23:20:14,675 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 99.51% in 0/1 modules
2020-03-01 23:20:14,676 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2020-03-01 23:20:17,600 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2020-03-01 23:20:17,600 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2020-03-01 23:20:19,957 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2020-03-01 23:20:19,958 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      36:56       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2020-03-01 23:20:37,028 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)