2019-12-02 01:10:48,926 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+-------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                 VALUE                                                 |
+-------------------------+-------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                            http://testresults.opnfv.org/test/api/v1/results                           |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/xtesting/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-11      |
|     S3_ENDPOINT_URL     |                                     https://storage.googleapis.com                                    |
|     DEPLOY_SCENARIO     |                                         os-nosdn-nofeature-ha                                         |
|        BUILD_TAG        |                   jenkins-cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-11                   |
|          DEBUG          |                                                  true                                                 |
|      INSTALLER_TYPE     |                                                  cntt                                                 |
|         CI_LOOP         |                                                 daily                                                 |
|       TEST_DB_URL       |                            http://testresults.opnfv.org/test/api/v1/results                           |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/xtesting/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-11     |
|        NODE_NAME        |                                              intel-pod10                                              |
+-------------------------+-------------------------------------------------------------------------------------------------------+

2019-12-02 01:10:48,932 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod10.opnfv.org/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod10

2019-12-02 01:10:48,932 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2019-12-02 01:10:48,946 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2019-12-02 01:10:49,683 - functest.core.tenantnetwork - DEBUG - password: ibtKz~E+>zt.Ib?En<NY>i[>|Rf.Cz
2019-12-02 01:10:49,783 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'b94500dfc9cf4b39aea9dd4f0066982e', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_ea5dba7a-26ed-41a3-a99d-2112f0148bad'})
2019-12-02 01:10:49,844 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'af31c8aa7884413dab652b76d066f9cc', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_ea5dba7a-26ed-41a3-a99d-2112f0148bad'})
2019-12-02 01:10:50,149 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod10', u'key_manager_api_version': u'v1', 'password': 'ibtKz~E+>zt.Ib?En<NY>i[>|Rf.Cz', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'project_id': u'b94500dfc9cf4b39aea9dd4f0066982e', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod10.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2019-12-02 01:10:50,153 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'password': 'ibtKz~E+>zt.Ib?En<NY>i[>|Rf.Cz', 'project_name': 'rally_jobs-project_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod10.opnfv.org/v3', 'project_id': 'b94500dfc9cf4b39aea9dd4f0066982e', 'project_domain_name': 'default'}
2019-12-02 01:10:50,407 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2019-12-02 01:10:50,797 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2019-12-02T01:10:50Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'ba7793d9-8e39-4197-807c-0ebd251a19a9', u'provider:segmentation_id': 42, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'admin_state_up': True, u'tenant_id': u'b94500dfc9cf4b39aea9dd4f0066982e', u'created_at': u'2019-12-02T01:10:50Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'b94500dfc9cf4b39aea9dd4f0066982e'})
2019-12-02 01:10:51,839 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2019-12-02T01:10:51Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'94c92b00-f623-4612-91a2-4ae7dd779e77', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'enable_dhcp': True, u'network_id': u'ba7793d9-8e39-4197-807c-0ebd251a19a9', u'tenant_id': u'b94500dfc9cf4b39aea9dd4f0066982e', u'created_at': u'2019-12-02T01:10:51Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'b94500dfc9cf4b39aea9dd4f0066982e'})
2019-12-02 01:10:57,472 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2019-12-02T01:10:53Z', u'revision_number': 6, u'ha': True, u'id': u'961ca7cb-693c-43d4-b7ed-38be211fe082', u'external_gateway_info': {u'network_id': u'6b184f56-21e9-45b0-9f7a-fbe89039590b', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'6a1fe57a-3135-4cdf-ac63-9ecfcfa5b0ac', u'ip_address': u'10.10.175.36'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'admin_state_up': True, u'tenant_id': u'b94500dfc9cf4b39aea9dd4f0066982e', u'created_at': u'2019-12-02T01:10:52Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'b94500dfc9cf4b39aea9dd4f0066982e'})
2019-12-02 01:11:00,705 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/9d10dab1-39a5-4169-9b8e-5b6d82e17a8f/file', 'owner': u'b94500dfc9cf4b39aea9dd4f0066982e', 'id': u'9d10dab1-39a5-4169-9b8e-5b6d82e17a8f', 'size': 12716032, u'self': u'/v2/images/9d10dab1-39a5-4169-9b8e-5b6d82e17a8f', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'b94500dfc9cf4b39aea9dd4f0066982e', 'name': 'rally_jobs-project_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-12-02T01:11:00Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2019-12-02T01:11:00Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/9d10dab1-39a5-4169-9b8e-5b6d82e17a8f', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'created': u'2019-12-02T01:10:59Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2019-12-02T01:10:59Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/9d10dab1-39a5-4169-9b8e-5b6d82e17a8f', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_ea5dba7a-26ed-41a3-a99d-2112f0148bad', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2019-12-02 01:11:00,781 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ffe0f3401f394823906fe5f1a2b6b17a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'5a32fabe-a9c7-4d28-97ff-0c0432eadeea', 'swap': 0})
2019-12-02 01:11:00,837 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2019-12-02 01:11:06,092 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| 7843bee4-49cc-41cf-a381-e43522e5986e | 2019-12-02T01:11:05.625713 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: 7843bee4-49cc-41cf-a381-e43522e5986e
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2019-12-02 01:11:08,776 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2019-12-02 01:11:09,740 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2019-12-02 01:11:09,898 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ffe0f3401f394823906fe5f1a2b6b17a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'b26e7e33-b40d-41ee-9d0f-b24d72c870d9', 'swap': 0})
2019-12-02 01:11:09,977 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_ea5dba7a-26ed-41a3-a99d-2112f0148bad', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ffe0f3401f394823906fe5f1a2b6b17a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod10', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'b26e7e33-b40d-41ee-9d0f-b24d72c870d9', 'swap': 0})
2019-12-02 01:11:09,982 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2019-12-02 01:11:09,982 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2019-12-02 01:11:10,009 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'^NeutronTrunk']
2019-12-02 01:11:10,271 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2019-12-02 01:11:10,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2019-12-02 01:57:22,534 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: c6103430-c09a-432d-a4ca-44564a0a3d94
2019-12-02 01:57:22,535 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c6103430-c09a-432d-a4ca-44564a0a3d94
2019-12-02 01:57:22,535 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'c6103430-c09a-432d-a4ca-44564a0a3d94']
2019-12-02 01:57:23,468 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c6103430-c09a-432d-a4ca-44564a0a3d94

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.688     | 3.625        | 5.829        | 6.481        | 7.794     | 3.972     | 100.0%  | 100   |
| neutron.list_networks  | 0.297     | 1.687        | 2.973        | 3.305        | 3.916     | 1.87      | 100.0%  | 100   |
| total                  | 1.022     | 5.77         | 7.795        | 8.178        | 9.319     | 5.843     | 100.0%  | 100   |
|  -> duration           | 1.022     | 5.77         | 7.795        | 8.178        | 9.319     | 5.843     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 31.898262
Full duration: 71.989299
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.847     | 3.152        | 5.22         | 5.676        | 6.075     | 3.362     | 100.0%  | 40    |
| neutron.update_network | 0.956     | 5.25         | 6.234        | 6.285        | 6.399     | 4.484     | 100.0%  | 40    |
| total                  | 3.481     | 8.111        | 9.366        | 9.874        | 11.291    | 7.846     | 100.0%  | 40    |
|  -> duration           | 3.481     | 8.111        | 9.366        | 9.874        | 11.291    | 7.846     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 17.512083
Full duration: 38.057125
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.898     | 3.077        | 4.835        | 5.375        | 8.314     | 3.507     | 100.0%  | 40    |
| neutron.delete_network | 0.762     | 5.187        | 6.388        | 6.517        | 6.53      | 4.901     | 100.0%  | 40    |
| total                  | 4.632     | 8.633        | 9.412        | 9.52         | 13.047    | 8.407     | 100.0%  | 40    |
|  -> duration           | 4.632     | 8.633        | 9.412        | 9.52         | 13.047    | 8.407     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 19.010193
Full duration: 23.668148
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.844     | 3.085        | 5.736        | 5.808        | 5.84      | 2.989     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 5.843     | 12.618       | 14.883       | 15.078       | 15.201    | 11.851    | 100.0%  | 40    |
| neutron.list_subnets       | 0.228     | 1.475        | 2.662        | 2.745        | 3.605     | 1.633     | 100.0%  | 40    |
| total                      | 12.018    | 16.78        | 18.248       | 19.159       | 22.211    | 16.474    | 100.0%  | 40    |
|  -> duration               | 12.018    | 16.78        | 18.248       | 19.159       | 22.211    | 16.474    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 35.944699
Full duration: 110.796876
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.425     | 2.371        | 5.045        | 5.485        | 6.877     | 2.837     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 5.465     | 13.821       | 17.806       | 18.631       | 20.559    | 13.63     | 100.0%  | 100   |
| neutron.update_subnet (x2) | 2.296     | 11.531       | 17.942       | 18.627       | 20.648    | 11.549    | 100.0%  | 100   |
| total                      | 14.366    | 28.211       | 33.548       | 35.743       | 39.63     | 28.016    | 100.0%  | 100   |
|  -> duration               | 14.366    | 28.211       | 33.548       | 35.743       | 39.63     | 28.016    | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 144.684239
Full duration: 289.241787
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.392     | 3.116        | 4.336        | 5.447        | 5.555     | 3.044     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 7.491     | 11.718       | 14.684       | 15.016       | 15.92     | 11.715    | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 11.473    | 18.223       | 21.908       | 24.173       | 27.363    | 17.842    | 100.0%  | 40    |
| total                      | 23.787    | 32.641       | 37.894       | 38.174       | 40.856    | 32.602    | 100.0%  | 40    |
|  -> duration               | 23.787    | 32.641       | 37.894       | 38.174       | 40.856    | 32.602    | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 67.783994
Full duration: 96.816164
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 1 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 261, in run
    router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.447     | 3.004        | 6.063        | 6.214        | 7.49      | 3.07      | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 8.84      | 11.973       | 13.969       | 14.856       | 16.148    | 12.081    | 100.0%  | 40    |
| neutron.create_router (x2)        | 23.167    | 69.569       | 106.38       | 108.564      | 109.937   | 70.723    | 100.0%  | 39    |
| neutron.add_interface_router (x2) | 7.464     | 27.595       | 52.888       | 56.872       | 59.038    | 30.714    | 100.0%  | 39    |
| neutron.list_routers              | 0.263     | 0.896        | 1.687        | 1.717        | 1.992     | 0.994     | 100.0%  | 39    |
| neutron.create_router             | 60.011    | 60.011       | 60.011       | 60.011       | 60.011    | 60.011    | 0.0%    | 1     |
| total                             | 73.98     | 113.072      | 161.006      | 162.85       | 172.796   | 116.522   | 97.5%   | 40    |
|  -> duration                      | 73.98     | 113.072      | 161.006      | 162.85       | 172.796   | 116.522   | 97.5%   | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 97.5%   | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 254.57474
Full duration: 503.982696
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.426     | 2.887        | 4.755        | 5.332        | 6.622     | 2.936     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 4.774     | 14.519       | 16.262       | 16.351       | 17.059    | 13.646    | 100.0%  | 40    |
| neutron.create_router (x2)        | 40.437    | 49.242       | 60.688       | 61.324       | 61.806    | 51.969    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 13.127    | 36.799       | 47.769       | 48.239       | 50.263    | 35.955    | 100.0%  | 40    |
| neutron.update_router (x2)        | 3.576     | 9.704        | 12.686       | 13.002       | 14.381    | 9.283     | 100.0%  | 40    |
| total                             | 91.579    | 114.328      | 120.763      | 123.743      | 132.723   | 113.79    | 100.0%  | 40    |
|  -> duration                      | 91.579    | 114.328      | 120.763      | 123.743      | 132.723   | 113.79    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 236.675235
Full duration: 461.764666
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 8 error(s)
--------------------------------------------------------------------------------

NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 356, in run
    subnets_per_network, router_create_args)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 385, in _create_network_structure
    router = self._create_router(router_create_args or {})
  File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 215, in _create_router
    {"router": router_create_args})
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 885, in create_router
    return self.post(self.routers_path, body=body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
    headers=headers, params=params)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
    self._handle_fault_response(status_code, replybody, resp)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
    exception_handler_v20(status_code, error_body)
  File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
    request_ids=request_ids)
NeutronClientException: <html>
<head><title>504 Gateway Time-out</title></head>
<body>
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx</center>
</body>
</html>


--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.421     | 2.861        | 4.76         | 5.703        | 6.334     | 3.054     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 9.49      | 11.326       | 13.965       | 15.098       | 16.89     | 11.925    | 100.0%  | 40    |
| neutron.create_router (x2)           | 46.315    | 81.113       | 101.589      | 107.555      | 115.22    | 75.901    | 84.2%   | 38    |
| neutron.add_interface_router (x2)    | 9.923     | 40.986       | 63.789       | 63.854       | 64.189    | 38.172    | 100.0%  | 32    |
| neutron.remove_interface_router (x2) | 4.081     | 28.279       | 43.797       | 48.359       | 51.812    | 25.729    | 100.0%  | 32    |
| neutron.delete_router (x2)           | 4.765     | 36.613       | 53.435       | 55.398       | 68.973    | 34.04     | 100.0%  | 32    |
| neutron.add_interface_router         | 5.115     | 8.989        | 12.092       | 12.381       | 12.67     | 9.158     | 100.0%  | 6     |
| <no-name-action>                     | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 0.0%    | 6     |
| neutron.create_router                | 60.006    | 60.01        | 60.013       | 60.013       | 60.014    | 60.01     | 0.0%    | 2     |
| total                                | 75.141    | 173.498      | 209.231      | 212.729      | 223.238   | 169.812   | 80.0%   | 40    |
|  -> duration                         | 75.141    | 173.498      | 209.231      | 212.729      | 223.238   | 169.812   | 80.0%   | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 80.0%   | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 366.189901
Full duration: 478.38836
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.439     | 0.935        | 1.205        | 1.291        | 1.377     | 0.883     | 100.0%  | 8     |
| neutron.create_port (x50) | 64.666    | 89.672       | 104.145      | 105.374      | 106.603   | 87.846    | 100.0%  | 8     |
| neutron.list_ports        | 0.879     | 1.236        | 1.497        | 1.512        | 1.527     | 1.186     | 100.0%  | 8     |
| total                     | 66.539    | 91.97        | 106.295      | 107.486      | 108.678   | 89.918    | 100.0%  | 8     |
|  -> duration              | 66.539    | 91.97        | 106.295      | 107.486      | 108.678   | 89.918    | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 185.71907
Full duration: 300.15148
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.486     | 2.713        | 5.1          | 5.284        | 5.568     | 2.601     | 100.0%  | 40    |
| neutron.create_port (x5) | 18.69     | 33.81        | 47.654       | 48.106       | 50.719    | 35.227    | 100.0%  | 40    |
| neutron.update_port (x5) | 6.837     | 19.107       | 31.633       | 32.162       | 33.404    | 19.074    | 100.0%  | 40    |
| total                    | 42.281    | 57.617       | 62.595       | 64.198       | 66.98     | 56.903    | 100.0%  | 40    |
|  -> duration             | 42.281    | 57.617       | 62.595       | 64.198       | 66.98     | 56.903    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 118.345227
Full duration: 191.222974
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.414     | 1.724        | 4.559        | 5.942        | 6.452     | 2.363     | 100.0%  | 40    |
| neutron.create_port (x5) | 16.669    | 43.415       | 51.141       | 51.398       | 52.046    | 39.648    | 100.0%  | 40    |
| neutron.delete_port (x5) | 11.491    | 15.88        | 38.111       | 38.517       | 39.364    | 21.418    | 100.0%  | 40    |
| total                    | 53.818    | 63.692       | 68.229       | 69.127       | 74.166    | 63.43     | 100.0%  | 40    |
|  -> duration             | 53.818    | 63.692       | 68.229       | 69.127       | 74.166    | 63.43     | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 131.280436
Full duration: 152.276324
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task c6103430-c09a-432d-a4ca-44564a0a3d94 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.42      | 1.786        | 2.257        | 2.318        | 2.367     | 1.694     | 100.0%  | 40    |
| total                | 0.555     | 1.96         | 2.891        | 2.981        | 3.069     | 2.016     | 100.0%  | 40    |
|  -> duration         | 0.555     | 1.96         | 2.891        | 2.981        | 3.069     | 2.016     | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 4.509009
Full duration: 28.143415

HINTS:
* To plot HTML graphics with this data, run:
	rally task report c6103430-c09a-432d-a4ca-44564a0a3d94 --out output.html

* To generate a JUnit report, run:
	rally task export c6103430-c09a-432d-a4ca-44564a0a3d94 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report c6103430-c09a-432d-a4ca-44564a0a3d94 --json --out output.json

At least one workload did not pass SLA criteria.


2019-12-02 01:57:23,470 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'c6103430-c09a-432d-a4ca-44564a0a3d94', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2019-12-02 01:57:25,680 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c6103430-c09a-432d-a4ca-44564a0a3d94 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2019-12-02 01:57:25,822 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2019-12-02 01:57:25,823 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:45:46  |      608       |   98.52%  |
|           |            |                |           |
|  TOTAL:   |  00:45:46  |      608       |   98.52%  |
+-----------+------------+----------------+-----------+

2019-12-02 01:57:25,823 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 98.52% in 0/1 modules
2019-12-02 01:57:25,823 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2019-12-02 01:57:28,425 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2019-12-02 01:57:28,425 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2019-12-02 01:57:30,899 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2019-12-02 01:57:30,899 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      46:40       |      FAIL      |
+--------------------+------------------+------------------+----------------+

2019-12-02 01:57:42,491 - functest.core.singlevm - DEBUG - Cleaning security group 325f6b2a-8b23-4fae-b846-f6bbc08130bc
2019-12-02 01:57:42,663 - functest.core.singlevm - DEBUG - Orphan security group 325f6b2a-8b23-4fae-b846-f6bbc08130bc in use
2019-12-02 01:57:42,706 - functest.core.singlevm - DEBUG - Cleaning security group 59b5179f-fe1b-40bb-9966-5b71d0b4c438
2019-12-02 01:57:43,167 - functest.core.singlevm - DEBUG - Cleaning security group be28683d-a9b6-4906-9ebe-c896c76b5edd
2019-12-02 01:57:43,335 - functest.core.singlevm - DEBUG - Orphan security group be28683d-a9b6-4906-9ebe-c896c76b5edd in use
2019-12-02 01:57:44,622 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)