2019-12-05 08:21:30,991 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+---------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                               VALUE                                               |
+-------------------------+---------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                          http://testresults.opnfv.org/test/api/v1/results                         |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/cntt/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-12      |
|     S3_ENDPOINT_URL     |                                   https://storage.googleapis.com                                  |
|     DEPLOY_SCENARIO     |                                       os-nosdn-nofeature-ha                                       |
|        BUILD_TAG        |                                            3W2XSU20IVX8                                           |
|          DEBUG          |                                                true                                               |
|      INSTALLER_TYPE     |                                                cntt                                               |
|         CI_LOOP         |                                               daily                                               |
|       TEST_DB_URL       |                          http://testresults.opnfv.org/test/api/v1/results                         |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/cntt/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-12     |
|        NODE_NAME        |                                            intel-pod10                                            |
+-------------------------+---------------------------------------------------------------------------------------------------+

2019-12-05 08:21:30,998 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod10.opnfv.org/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod10

2019-12-05 08:21:30,998 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2019-12-05 08:21:31,012 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2019-12-05 08:21:31,759 - functest.core.tenantnetwork - DEBUG - password: 201wd!)a,41ps0_8NoY>vpV,8-Qp|{
2019-12-05 08:21:31,875 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'f0e8f8c920084338ad7efa0052ab9e79', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_fc0afa90-b8ce-405b-8895-901acf090a7e'})
2019-12-05 08:21:31,945 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'c26663ab1b304164b9b79c2855b6d3f6', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_fc0afa90-b8ce-405b-8895-901acf090a7e'})
2019-12-05 08:21:32,266 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_fc0afa90-b8ce-405b-8895-901acf090a7e', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod10', u'key_manager_api_version': u'v1', 'password': '201wd!)a,41ps0_8NoY>vpV,8-Qp|{', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_fc0afa90-b8ce-405b-8895-901acf090a7e', 'project_id': u'f0e8f8c920084338ad7efa0052ab9e79', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod10.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2019-12-05 08:21:32,270 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_fc0afa90-b8ce-405b-8895-901acf090a7e', 'password': '201wd!)a,41ps0_8NoY>vpV,8-Qp|{', 'project_name': 'rally_jobs-project_fc0afa90-b8ce-405b-8895-901acf090a7e', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod10.opnfv.org/v3', 'project_id': 'f0e8f8c920084338ad7efa0052ab9e79', 'project_domain_name': 'default'}
2019-12-05 08:21:32,524 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2019-12-05 08:21:33,043 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2019-12-05T08:21:32Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'113eae7d-fd20-443b-aab2-41c324227bbe', u'provider:segmentation_id': 18, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_fc0afa90-b8ce-405b-8895-901acf090a7e', u'admin_state_up': True, u'tenant_id': u'f0e8f8c920084338ad7efa0052ab9e79', u'created_at': u'2019-12-05T08:21:32Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'f0e8f8c920084338ad7efa0052ab9e79'})
2019-12-05 08:21:34,038 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2019-12-05T08:21:33Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'd5cd72d1-bc9b-4dae-b37e-d6f78a1aa824', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_fc0afa90-b8ce-405b-8895-901acf090a7e', u'enable_dhcp': True, u'network_id': u'113eae7d-fd20-443b-aab2-41c324227bbe', u'tenant_id': u'f0e8f8c920084338ad7efa0052ab9e79', u'created_at': u'2019-12-05T08:21:33Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'f0e8f8c920084338ad7efa0052ab9e79'})
2019-12-05 08:21:39,314 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2019-12-05T08:21:35Z', u'revision_number': 6, u'ha': True, u'id': u'1223830f-00bd-4149-98f1-18b6c324056f', u'external_gateway_info': {u'network_id': u'8b1519a6-924b-4a17-9290-651be84f8221', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'b1e4a441-7c54-4563-a4e9-731832aacf80', u'ip_address': u'10.10.175.31'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_fc0afa90-b8ce-405b-8895-901acf090a7e', u'admin_state_up': True, u'tenant_id': u'f0e8f8c920084338ad7efa0052ab9e79', u'created_at': u'2019-12-05T08:21:34Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'f0e8f8c920084338ad7efa0052ab9e79'})
2019-12-05 08:21:42,586 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/a7de2bd3-d7a8-4b32-b53c-34e3a936883a/file', 'owner': u'f0e8f8c920084338ad7efa0052ab9e79', 'id': u'a7de2bd3-d7a8-4b32-b53c-34e3a936883a', 'size': 12716032, u'self': u'/v2/images/a7de2bd3-d7a8-4b32-b53c-34e3a936883a', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'f0e8f8c920084338ad7efa0052ab9e79', 'name': 'rally_jobs-project_fc0afa90-b8ce-405b-8895-901acf090a7e', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-12-05T08:21:42Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2019-12-05T08:21:42Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_fc0afa90-b8ce-405b-8895-901acf090a7e', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/a7de2bd3-d7a8-4b32-b53c-34e3a936883a', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_fc0afa90-b8ce-405b-8895-901acf090a7e', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_fc0afa90-b8ce-405b-8895-901acf090a7e', 'created': u'2019-12-05T08:21:41Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2019-12-05T08:21:41Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/a7de2bd3-d7a8-4b32-b53c-34e3a936883a', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_fc0afa90-b8ce-405b-8895-901acf090a7e', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2019-12-05 08:21:42,658 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_fc0afa90-b8ce-405b-8895-901acf090a7e', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'adc3df7849914a2db08ea6bc83450697', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'c2582896-c41c-4b28-be23-51df1363471f', 'swap': 0})
2019-12-05 08:21:42,703 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2019-12-05 08:21:47,746 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 73fd856b-a948-481b-b13e-5d86f51604c5 | 2019-12-05T08:21:47.289060 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 73fd856b-a948-481b-b13e-5d86f51604c5
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2019-12-05 08:21:50,256 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2019-12-05 08:21:51,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2019-12-05 08:21:52,870 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_fc0afa90-b8ce-405b-8895-901acf090a7e', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'adc3df7849914a2db08ea6bc83450697', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'1112cac7-a895-4a77-8241-c2b30f7d4bc9', 'swap': 0})
2019-12-05 08:21:52,945 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_fc0afa90-b8ce-405b-8895-901acf090a7e', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'adc3df7849914a2db08ea6bc83450697', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'1112cac7-a895-4a77-8241-c2b30f7d4bc9', 'swap': 0})
2019-12-05 08:21:52,950 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2019-12-05 08:21:52,951 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2019-12-05 08:21:52,979 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'^NeutronTrunk']
2019-12-05 08:21:53,346 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2019-12-05 08:21:53,346 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2019-12-05 09:09:20,330 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 5d17afcc-0dc0-49ec-8f35-eebf966ed807
2019-12-05 09:09:20,330 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 5d17afcc-0dc0-49ec-8f35-eebf966ed807
2019-12-05 09:09:20,331 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'5d17afcc-0dc0-49ec-8f35-eebf966ed807']
2019-12-05 09:09:21,487 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5d17afcc-0dc0-49ec-8f35-eebf966ed807

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.645     | 3.597        | 5.007        | 5.877        | 10.272    | 3.771     | 100.0%  | 100   |
| neutron.list_networks  | 0.28      | 1.856        | 3.176        | 3.857        | 4.644     | 2.031     | 100.0%  | 100   |
| total                  | 0.925     | 5.695        | 8.164        | 8.42         | 12.269    | 5.803     | 100.0%  | 100   |
|  -> duration           | 0.925     | 5.695        | 8.164        | 8.42         | 12.269    | 5.803     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 32.103505
Full duration: 71.078022
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 1.049     | 3.073        | 6.153        | 6.983        | 7.472     | 3.566     | 100.0%  | 40    |
| neutron.update_network | 0.647     | 4.85         | 7.309        | 7.351        | 7.548     | 4.716     | 100.0%  | 40    |
| total                  | 3.364     | 7.873        | 11.15        | 11.26        | 12.001    | 8.282     | 100.0%  | 40    |
|  -> duration           | 3.364     | 7.873        | 11.15        | 11.26        | 12.001    | 8.282     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 19.212949
Full duration: 41.061173
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.825     | 3.507        | 6.227        | 6.572        | 9.097     | 3.91      | 100.0%  | 40    |
| neutron.delete_network | 0.811     | 4.119        | 6.936        | 7.123        | 7.209     | 4.205     | 100.0%  | 40    |
| total                  | 3.563     | 8.103        | 9.977        | 10.813       | 12.464    | 8.116     | 100.0%  | 40    |
|  -> duration           | 3.563     | 8.103        | 9.977        | 10.813       | 12.464    | 8.116     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 18.626681
Full duration: 23.273393
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.816     | 3.031        | 5.488        | 5.57         | 5.898     | 3.395     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 7.274     | 12.361       | 14.966       | 16.99        | 19.04     | 12.222    | 100.0%  | 40    |
| neutron.list_subnets       | 0.319     | 1.264        | 2.888        | 3.455        | 3.634     | 1.484     | 100.0%  | 40    |
| total                      | 10.358    | 16.911       | 20.715       | 22.303       | 27.301    | 17.101    | 100.0%  | 40    |
|  -> duration               | 10.358    | 16.911       | 20.715       | 22.303       | 27.301    | 17.101    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 37.692571
Full duration: 114.533469
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.467     | 2.931        | 6.005        | 6.705        | 20.983    | 3.672     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 6.485     | 12.732       | 22.202       | 27.867       | 33.269    | 14.317    | 100.0%  | 100   |
| neutron.update_subnet (x2) | 4.404     | 12.673       | 21.349       | 25.624       | 37.446    | 13.673    | 100.0%  | 100   |
| total                      | 17.362    | 28.83        | 46.459       | 49.59        | 54.043    | 31.663    | 100.0%  | 100   |
|  -> duration               | 17.362    | 28.83        | 46.459       | 49.59        | 54.043    | 31.663    | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 163.501512
Full duration: 319.215465
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.927     | 3.656        | 5.825        | 5.932        | 6.536     | 3.739     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 3.551     | 11.502       | 13.815       | 14.342       | 14.879    | 11.034    | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 5.79      | 12.859       | 23.205       | 23.647       | 28.852    | 13.483    | 100.0%  | 40    |
| total                      | 17.475    | 27.159       | 38.893       | 39.297       | 44.343    | 28.257    | 100.0%  | 40    |
|  -> duration               | 17.475    | 27.159       | 38.893       | 39.297       | 44.343    | 28.257    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 64.901899
Full duration: 90.71463
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 5 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.865     | 3.253        | 6.083        | 8.86         | 17.472    | 4.084     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 7.869     | 12.222       | 26.68        | 30.22        | 30.316    | 14.228    | 100.0%  | 40    |
| neutron.create_router (x2)        | 60.838    | 75.387       | 97.252       | 99.922       | 107.191   | 77.823    | 89.7%   | 39    |
| neutron.add_interface_router (x2) | 18.718    | 37.145       | 51.517       | 55.959       | 56.737    | 37.364    | 100.0%  | 35    |
| neutron.list_routers              | 0.288     | 1.04         | 1.455        | 1.643        | 1.963     | 0.977     | 100.0%  | 35    |
| neutron.add_interface_router      | 11.868    | 17.419       | 18.015       | 18.071       | 18.127    | 16.208    | 100.0%  | 4     |
| <no-name-action>                  | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 0.0%    | 4     |
| neutron.create_router             | 60.01     | 60.01        | 60.01        | 60.01        | 60.01     | 60.01     | 0.0%    | 1     |
| total                             | 74.584    | 133.78       | 155.681      | 160.879      | 165.035   | 130.861   | 87.5%   | 40    |
|  -> duration                      | 74.584    | 133.78       | 155.681      | 160.879      | 165.035   | 130.861   | 87.5%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 87.5%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 275.477021
Full duration: 540.244498
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.72      | 3.392        | 4.628        | 4.803        | 5.112     | 3.41      | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 7.007     | 12.104       | 12.87        | 13.169       | 14.196    | 11.418    | 100.0%  | 40    |
| neutron.create_router (x2)        | 38.009    | 67.448       | 88.114       | 93.089       | 102.173   | 69.611    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 12.272    | 32.913       | 48.126       | 48.697       | 49.809    | 32.467    | 100.0%  | 40    |
| neutron.update_router (x2)        | 2.459     | 7.726        | 9.725        | 9.879        | 11.074    | 7.191     | 100.0%  | 40    |
| total                             | 99.464    | 122.915      | 137.25       | 137.605      | 141.484   | 124.098   | 100.0%  | 40    |
|  -> duration                      | 99.464    | 122.915      | 137.25       | 137.605      | 141.484   | 124.098   | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 263.386562
Full duration: 496.641981
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.383     | 2.744        | 5.615        | 6.048        | 7.198     | 3.015     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 7.459     | 11.864       | 13.902       | 14.907       | 18.474    | 11.914    | 100.0%  | 40    |
| neutron.create_router (x2)           | 40.409    | 54.834       | 70.019       | 71.253       | 74.508    | 56.675    | 100.0%  | 40    |
| neutron.add_interface_router (x2)    | 15.492    | 29.972       | 50.666       | 51.828       | 52.312    | 34.046    | 100.0%  | 40    |
| neutron.remove_interface_router (x2) | 9.746     | 36.144       | 52.736       | 53.34        | 53.753    | 35.539    | 100.0%  | 40    |
| neutron.delete_router (x2)           | 4.322     | 22.87        | 42.642       | 42.725       | 46.27     | 23.96     | 100.0%  | 40    |
| total                                | 143.409   | 163.118      | 179.453      | 179.517      | 180.259   | 165.149   | 100.0%  | 40    |
|  -> duration                         | 143.409   | 163.118      | 179.453      | 179.517      | 180.259   | 165.149   | 100.0%  | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 340.972736
Full duration: 425.367027
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.397     | 0.905        | 1.383        | 1.405        | 1.428     | 0.961     | 100.0%  | 8     |
| neutron.create_port (x50) | 62.609    | 99.711       | 116.599      | 117.611      | 118.623   | 95.091    | 100.0%  | 8     |
| neutron.list_ports        | 0.763     | 1.069        | 1.222        | 1.29         | 1.359     | 1.041     | 100.0%  | 8     |
| total                     | 64.687    | 102.04       | 118.399      | 119.364      | 120.329   | 97.096    | 100.0%  | 8     |
|  -> duration              | 64.687    | 102.04       | 118.399      | 119.364      | 120.329   | 97.096    | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 204.138066
Full duration: 323.423269
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.528     | 2.713        | 5.931        | 6.2          | 6.715     | 2.971     | 100.0%  | 40    |
| neutron.create_port (x5) | 14.228    | 37.029       | 55.913       | 57.335       | 58.286    | 37.784    | 100.0%  | 40    |
| neutron.update_port (x5) | 5.303     | 16.94        | 27.5         | 36.146       | 38.161    | 18.086    | 100.0%  | 40    |
| total                    | 46.24     | 58.262       | 70.459       | 72.071       | 78.014    | 58.843    | 100.0%  | 40    |
|  -> duration             | 46.24     | 58.262       | 70.459       | 72.071       | 78.014    | 58.843    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 124.368505
Full duration: 197.701502
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.671     | 2.612        | 5.282        | 5.714        | 6.127     | 2.955     | 100.0%  | 40    |
| neutron.create_port (x5) | 20.975    | 37.337       | 46.314       | 48.717       | 51.367    | 36.22     | 100.0%  | 40    |
| neutron.delete_port (x5) | 11.971    | 22.42        | 36.393       | 36.823       | 37.085    | 22.965    | 100.0%  | 40    |
| total                    | 53.563    | 62.525       | 64.67        | 65.269       | 68.29     | 62.141    | 100.0%  | 40    |
|  -> duration             | 53.563    | 62.525       | 64.67        | 65.269       | 68.29     | 62.141    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 127.408871
Full duration: 147.036293
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task 5d17afcc-0dc0-49ec-8f35-eebf966ed807 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.531     | 1.494        | 1.943        | 1.961        | 1.98      | 1.454     | 100.0%  | 40    |
| total                | 0.655     | 1.772        | 2.548        | 2.638        | 2.798     | 1.795     | 100.0%  | 40    |
|  -> duration         | 0.655     | 1.772        | 2.548        | 2.638        | 2.798     | 1.795     | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.083389
Full duration: 26.502346

HINTS:
* To plot HTML graphics with this data, run:
	rally task report 5d17afcc-0dc0-49ec-8f35-eebf966ed807 --out output.html

* To generate a JUnit report, run:
	rally task export 5d17afcc-0dc0-49ec-8f35-eebf966ed807 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report 5d17afcc-0dc0-49ec-8f35-eebf966ed807 --json --out output.json

At least one workload did not pass SLA criteria.


2019-12-05 09:09:21,489 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'5d17afcc-0dc0-49ec-8f35-eebf966ed807', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2019-12-05 09:09:23,965 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5d17afcc-0dc0-49ec-8f35-eebf966ed807 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2019-12-05 09:09:24,106 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2019-12-05 09:09:24,107 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:46:56  |      608       |   99.18%  |
|           |            |                |           |
|  TOTAL:   |  00:46:56  |      608       |   99.18%  |
+-----------+------------+----------------+-----------+

2019-12-05 09:09:24,107 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 99.18% in 0/1 modules
2019-12-05 09:09:24,108 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2019-12-05 09:09:26,706 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2019-12-05 09:09:26,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2019-12-05 09:09:29,342 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2019-12-05 09:09:29,343 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      47:57       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2019-12-05 09:09:40,800 - functest.core.singlevm - DEBUG - Cleaning security group aa54f26e-2ecc-4652-a1fe-7251f4fae019
2019-12-05 09:09:42,402 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)