2020-02-23 16:08:50,024 - xtesting.ci.run_tests - INFO - Deployment description:

+-------------------------+----------------------------------------------------------------------------------------------------------------------+
|         ENV VAR         |                                                        VALUE                                                         |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+
|     TEST_DB_EXT_URL     |                                   http://testresults.opnfv.org/test/api/v1/results                                   |
|        S3_DST_URL       |      s3://artifacts.opnfv.org/airship/YRMNT20M3TH0/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-93      |
|     S3_ENDPOINT_URL     |                                            https://storage.googleapis.com                                            |
|     DEPLOY_SCENARIO     |                                                os-nosdn-nofeature-ha                                                 |
|        BUILD_TAG        |                                                     YRMNT20M3TH0                                                     |
|          DEBUG          |                                                         true                                                         |
|      INSTALLER_TYPE     |                                                       airship                                                        |
|         CI_LOOP         |                                                        daily                                                         |
|       TEST_DB_URL       |                                   http://testresults.opnfv.org/test/api/v1/results                                   |
|       HTTP_DST_URL      |     http://artifacts.opnfv.org/airship/YRMNT20M3TH0/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-93     |
|        NODE_NAME        |                                                     intel-pod17                                                      |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+

2020-02-23 16:08:50,028 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file

export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17

2020-02-23 16:08:50,028 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2020-02-23 16:08:50,037 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2020-02-23 16:08:50,788 - functest.core.tenantnetwork - DEBUG - password: +FG46FFDB6.pt2t<MgAQ5UjNa7<s5}
2020-02-23 16:08:50,871 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'e58879c75f754775b9dd72a231b7662c', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_be9818a9-2553-4fd7-951d-8e4e1050857b'})
2020-02-23 16:08:50,945 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'07cc78feb75a4f91a4d825c843fff805', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_be9818a9-2553-4fd7-951d-8e4e1050857b'})
2020-02-23 16:08:51,301 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_be9818a9-2553-4fd7-951d-8e4e1050857b', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': '+FG46FFDB6.pt2t<MgAQ5UjNa7<s5}', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_be9818a9-2553-4fd7-951d-8e4e1050857b', 'project_id': u'e58879c75f754775b9dd72a231b7662c', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-02-23 16:08:51,305 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_be9818a9-2553-4fd7-951d-8e4e1050857b', 'password': '+FG46FFDB6.pt2t<MgAQ5UjNa7<s5}', 'project_name': 'rally_jobs-project_be9818a9-2553-4fd7-951d-8e4e1050857b', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': 'e58879c75f754775b9dd72a231b7662c', 'project_domain_name': 'default'}
2020-02-23 16:08:51,576 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2020-02-23 16:08:52,030 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-02-23T16:08:51Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'0cba53de-315e-46fd-80a2-c91169276fe1', u'provider:segmentation_id': 22, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_be9818a9-2553-4fd7-951d-8e4e1050857b', u'admin_state_up': True, u'tenant_id': u'e58879c75f754775b9dd72a231b7662c', u'created_at': u'2020-02-23T16:08:51Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'e58879c75f754775b9dd72a231b7662c'})
2020-02-23 16:08:53,082 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-02-23T16:08:52Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'3c706a3c-db17-47e5-b62a-16dd628aa76e', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_be9818a9-2553-4fd7-951d-8e4e1050857b', u'enable_dhcp': True, u'network_id': u'0cba53de-315e-46fd-80a2-c91169276fe1', u'tenant_id': u'e58879c75f754775b9dd72a231b7662c', u'created_at': u'2020-02-23T16:08:52Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'e58879c75f754775b9dd72a231b7662c'})
2020-02-23 16:08:59,144 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-02-23T16:08:55Z', u'revision_number': 6, u'ha': True, u'id': u'574e94c5-d258-4423-9483-eaa4bb9a8964', u'external_gateway_info': {u'network_id': u'dc690202-911c-4da1-a9ba-0cc0d6aeef43', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'0c358f21-401f-45c5-8b2a-c0b5cf33a227', u'ip_address': u'10.10.175.37'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_be9818a9-2553-4fd7-951d-8e4e1050857b', u'admin_state_up': True, u'tenant_id': u'e58879c75f754775b9dd72a231b7662c', u'created_at': u'2020-02-23T16:08:53Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'e58879c75f754775b9dd72a231b7662c'})
2020-02-23 16:09:03,007 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/ba8ce6fd-91e1-40ff-8920-55e1596e3968/file', 'owner': u'e58879c75f754775b9dd72a231b7662c', 'id': u'ba8ce6fd-91e1-40ff-8920-55e1596e3968', 'size': 12716032, u'self': u'/v2/images/ba8ce6fd-91e1-40ff-8920-55e1596e3968', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'e58879c75f754775b9dd72a231b7662c', 'name': 'rally_jobs-project_be9818a9-2553-4fd7-951d-8e4e1050857b', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-02-23T16:09:02Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-02-23T16:09:02Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_be9818a9-2553-4fd7-951d-8e4e1050857b', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/ba8ce6fd-91e1-40ff-8920-55e1596e3968', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_be9818a9-2553-4fd7-951d-8e4e1050857b', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_be9818a9-2553-4fd7-951d-8e4e1050857b', 'created': u'2020-02-23T16:09:01Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-02-23T16:09:01Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/ba8ce6fd-91e1-40ff-8920-55e1596e3968', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_be9818a9-2553-4fd7-951d-8e4e1050857b', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-02-23 16:09:03,091 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_be9818a9-2553-4fd7-951d-8e4e1050857b', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1d831e9f7a564b38914465de80b87463', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'0f5e39d8-6d24-44fc-a0a1-5154ba152a7c', 'swap': 0})
2020-02-23 16:09:03,152 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-02-23 16:09:07,648 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid                                 | created_at                 | name        | status           | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| ff534a35-73ab-4589-baae-48f0e4c4ce78 | 2020-02-23T16:09:07.482356 | opnfv-rally | deploy->finished |        |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: ff534a35-73ab-4589-baae-48f0e4c4ce78
~/.rally/openrc was updated

HINTS:

* To use standard OpenStack clients, set up your env by running:
	source ~/.rally/openrc
  OpenStack clients are now configured, e.g run:
	openstack image list

2020-02-23 16:09:10,327 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------

Available services:
+-------------+----------------+-----------+
| Service     | Service Type   | Status    |
+-------------+----------------+-----------+
| __unknown__ | placement      | Available |
| cinder      | volume         | Available |
| cinder      | volumev2       | Available |
| cinder      | volumev3       | Available |
| cloud       | cloudformation | Available |
| glance      | image          | Available |
| heat        | orchestration  | Available |
| keystone    | identity       | Available |
| neutron     | network        | Available |
| nova        | compute        | Available |
| swift       | object-store   | Available |
+-------------+----------------+-----------+



2020-02-23 16:09:11,082 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-02-23 16:09:11,274 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_be9818a9-2553-4fd7-951d-8e4e1050857b', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1d831e9f7a564b38914465de80b87463', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'4b7935ad-d5bc-4f29-9c24-d7be083d49ba', 'swap': 0})
2020-02-23 16:09:11,376 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_be9818a9-2553-4fd7-951d-8e4e1050857b', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1d831e9f7a564b38914465de80b87463', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'4b7935ad-d5bc-4f29-9c24-d7be083d49ba', 'swap': 0})
2020-02-23 16:09:11,380 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2020-02-23 16:09:11,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-02-23 16:09:11,396 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-02-23 16:09:11,670 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-02-23 16:09:11,670 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2020-02-23 16:33:26,610 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: b3303a65-2da4-4195-a418-9fd6793b9bc8
2020-02-23 16:33:26,611 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b3303a65-2da4-4195-a418-9fd6793b9bc8
2020-02-23 16:33:26,611 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'b3303a65-2da4-4195-a418-9fd6793b9bc8']
2020-02-23 16:33:27,612 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b3303a65-2da4-4195-a418-9fd6793b9bc8

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8: finished
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": 119
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_networks": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.597     | 1.42         | 2.517        | 2.981        | 3.655     | 1.625     | 100.0%  | 100   |
| neutron.list_networks  | 0.231     | 0.66         | 1.085        | 1.214        | 1.416     | 0.703     | 100.0%  | 100   |
| total                  | 1.008     | 2.274        | 3.433        | 3.765        | 3.969     | 2.328     | 100.0%  | 100   |
|  -> duration           | 1.008     | 2.274        | 3.433        | 3.765        | 3.969     | 2.328     | 100.0%  | 100   |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 12.836899
Full duration: 64.116913
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "network_update_args": {
      "name": "_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.476     | 1.365        | 3.117        | 3.334        | 3.974     | 1.825     | 100.0%  | 40    |
| neutron.update_network | 0.666     | 1.232        | 2.311        | 2.982        | 3.12      | 1.432     | 100.0%  | 40    |
| total                  | 1.564     | 2.692        | 5.018        | 5.466        | 6.254     | 3.257     | 100.0%  | 40    |
|  -> duration           | 1.564     | 2.692        | 5.018        | 5.466        | 6.254     | 3.257     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.72332
Full duration: 32.825039
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {}, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+---------------------------------------------------------------------------------------------------------------------------+
|                                                   Response Times (sec)                                                    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.507     | 1.532        | 2.312        | 2.431        | 3.118     | 1.492     | 100.0%  | 40    |
| neutron.delete_network | 0.645     | 1.534        | 2.261        | 2.37         | 2.467     | 1.56      | 100.0%  | 40    |
| total                  | 1.453     | 3.222        | 3.946        | 4.343        | 5.019     | 3.053     | 100.0%  | 40    |
|  -> duration           | 1.453     | 3.222        | 3.946        | 4.343        | 5.019     | 3.053     | 100.0%  | 40    |
|  -> idle_duration      | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 7.558839
Full duration: 12.840875
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.473     | 1.369        | 2.353        | 2.614        | 2.873     | 1.401     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.545     | 3.386        | 6.827        | 7.018        | 7.173     | 3.957     | 100.0%  | 40    |
| neutron.list_subnets       | 0.228     | 0.495        | 1.118        | 1.393        | 1.766     | 0.633     | 100.0%  | 40    |
| total                      | 2.437     | 5.564        | 9.803        | 10.005       | 10.713    | 5.991     | 100.0%  | 40    |
|  -> duration               | 2.437     | 5.564        | 9.803        | 10.005       | 10.713    | 5.991     | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 16.808303
Full duration: 50.199993
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 100
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 5, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.4.0.0/16", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "subnet_update_args": {
      "name": "_subnet_updated", 
      "enable_dhcp": true
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.395     | 0.895        | 1.943        | 2.619        | 3.481     | 1.118     | 100.0%  | 100   |
| neutron.create_subnet (x2) | 1.35      | 4.25         | 6.364        | 6.903        | 8.871     | 4.102     | 100.0%  | 100   |
| neutron.update_subnet (x2) | 1.363     | 3.444        | 6.599        | 6.845        | 8.32      | 3.909     | 100.0%  | 100   |
| total                      | 3.695     | 9.701        | 12.841       | 13.358       | 14.643    | 9.129     | 100.0%  | 100   |
|  -> duration               | 3.695     | 9.701        | 12.841       | 13.358       | 14.643    | 9.129     | 100.0%  | 100   |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 100   |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 48.350577
Full duration: 100.245341
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                      |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                     | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network     | 0.45      | 1.143        | 1.8          | 1.948        | 2.101     | 1.159     | 100.0%  | 40    |
| neutron.create_subnet (x2) | 1.716     | 3.595        | 6.059        | 6.25         | 6.405     | 3.569     | 100.0%  | 40    |
| neutron.delete_subnet (x2) | 1.896     | 3.632        | 6.737        | 7.0          | 8.052     | 3.985     | 100.0%  | 40    |
| total                      | 4.452     | 8.143        | 12.838       | 14.427       | 14.687    | 8.713     | 100.0%  | 40    |
|  -> duration               | 4.452     | 8.143        | 12.838       | 14.427       | 14.687    | 8.713     | 100.0%  | 40    |
|  -> idle_duration          | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 20.766436
Full duration: 33.887353
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": null, 
    "router_create_args": null
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.47      | 1.017        | 1.629        | 1.678        | 2.023     | 1.063     | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.363     | 3.588        | 5.703        | 6.136        | 6.498     | 3.649     | 100.0%  | 40    |
| neutron.create_router (x2)        | 9.134     | 19.483       | 27.625       | 29.586       | 30.883    | 19.828    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 5.217     | 9.086        | 14.796       | 15.7         | 17.125    | 10.049    | 100.0%  | 40    |
| neutron.list_routers              | 0.263     | 0.48         | 0.757        | 0.832        | 1.233     | 0.514     | 100.0%  | 40    |
| total                             | 20.112    | 34.147       | 47.244       | 49.677       | 50.812    | 35.104    | 100.0%  | 40    |
|  -> duration                      | 20.112    | 34.147       | 47.244       | 49.677       | 50.812    | 35.104    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 87.982142
Full duration: 339.547814
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "subnets_per_network": 2, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "network_create_args": {}, 
    "subnet_create_args": {}, 
    "router_update_args": {
      "name": "_router_updated", 
      "admin_state_up": false
    }, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+--------------------------------------------------------------------------------------------------------------------------------------+
|                                                         Response Times (sec)                                                         |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network            | 0.462     | 1.658        | 3.733        | 3.892        | 4.062     | 1.82      | 100.0%  | 40    |
| neutron.create_subnet (x2)        | 1.484     | 3.957        | 7.044        | 7.827        | 7.876     | 4.215     | 100.0%  | 40    |
| neutron.create_router (x2)        | 8.791     | 17.88        | 32.3         | 36.022       | 37.202    | 20.044    | 100.0%  | 40    |
| neutron.add_interface_router (x2) | 5.072     | 9.408        | 17.458       | 19.218       | 20.795    | 10.324    | 100.0%  | 40    |
| neutron.update_router (x2)        | 1.044     | 2.214        | 3.587        | 3.902        | 4.339     | 2.333     | 100.0%  | 40    |
| total                             | 20.63     | 34.671       | 60.795       | 66.542       | 68.691    | 38.735    | 100.0%  | 40    |
|  -> duration                      | 20.63     | 34.671       | 60.795       | 66.542       | 68.691    | 38.735    | 100.0%  | 40    |
|  -> idle_duration                 | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 93.410756
Full duration: 180.437437
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "subnet_cidr_start": "1.1.0.0/30", 
    "subnets_per_network": 2, 
    "subnet_create_args": {}, 
    "router_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------------------+
|                                                          Response Times (sec)                                                           |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network               | 0.426     | 0.991        | 13.47        | 13.894       | 14.57     | 3.563     | 100.0%  | 40    |
| neutron.create_subnet (x2)           | 1.457     | 2.9          | 4.918        | 5.147        | 6.11      | 3.245     | 100.0%  | 40    |
| neutron.create_router (x2)           | 9.143     | 18.169       | 26.17        | 29.177       | 33.178    | 18.818    | 100.0%  | 40    |
| neutron.add_interface_router (x2)    | 4.7       | 10.605       | 15.204       | 15.679       | 17.569    | 10.754    | 100.0%  | 40    |
| neutron.remove_interface_router (x2) | 3.58      | 7.206        | 11.971       | 13.533       | 14.47     | 7.566     | 100.0%  | 40    |
| neutron.delete_router (x2)           | 4.263     | 8.235        | 11.283       | 13.484       | 17.401    | 8.269     | 100.0%  | 40    |
| total                                | 38.577    | 50.922       | 65.824       | 69.145       | 73.288    | 52.216    | 100.0%  | 40    |
|  -> duration                         | 38.577    | 50.922       | 65.824       | 69.145       | 73.288    | 52.216    | 100.0%  | 40    |
|  -> idle_duration                    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 126.735283
Full duration: 156.091096
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
  "runner": {
    "concurrency": 4, 
    "times": 8
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "port": 811, 
        "subnet": -1, 
        "network": -1, 
        "router": -1
      }
    }
  }, 
  "args": {
    "network_create_args": null, 
    "ports_per_network": 50, 
    "port_create_args": null
  }, 
  "sla": {
    "max_avg_duration_per_atomic": {
      "neutron.list_ports": 15
    }, 
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+------------------------------------------------------------------------------------------------------------------------------+
|                                                     Response Times (sec)                                                     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                    | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network    | 0.447     | 0.841        | 0.914        | 0.959        | 1.004     | 0.734     | 100.0%  | 8     |
| neutron.create_port (x50) | 53.447    | 73.76        | 86.053       | 87.94        | 89.828    | 73.207    | 100.0%  | 8     |
| neutron.list_ports        | 0.618     | 1.012        | 1.244        | 1.26         | 1.275     | 1.003     | 100.0%  | 8     |
| total                     | 54.943    | 75.776       | 87.793       | 89.6         | 91.408    | 74.948    | 100.0%  | 8     |
|  -> duration              | 54.943    | 75.776       | 87.793       | 89.6         | 91.408    | 74.948    | 100.0%  | 8     |
|  -> idle_duration         | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 8     |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 167.911221
Full duration: 254.531458
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}, 
    "port_update_args": {
      "device_owner": "dummy_owner", 
      "device_id": "dummy_id", 
      "name": "_port_updated", 
      "admin_state_up": false
    }
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.45      | 1.068        | 2.026        | 2.332        | 3.121     | 1.165     | 100.0%  | 40    |
| neutron.create_port (x5) | 6.344     | 9.947        | 12.699       | 13.303       | 13.87     | 10.103    | 100.0%  | 40    |
| neutron.update_port (x5) | 3.461     | 6.216        | 7.985        | 8.222        | 8.694     | 6.195     | 100.0%  | 40    |
| total                    | 12.113    | 17.373       | 21.761       | 22.104       | 22.329    | 17.463    | 100.0%  | 40    |
|  -> duration             | 12.113    | 17.373       | 21.761       | 22.104       | 22.329    | 17.463    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 39.885532
Full duration: 99.193811
--------------------------------------------------------------------------------

test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 1
    }, 
    "quotas": {
      "neutron": {
        "network": -1, 
        "port": -1
      }
    }
  }, 
  "args": {
    "network_create_args": {}, 
    "ports_per_network": 5, 
    "port_create_args": {}
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-----------------------------------------------------------------------------------------------------------------------------+
|                                                    Response Times (sec)                                                     |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action                   | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network   | 0.439     | 1.029        | 2.302        | 3.352        | 4.214     | 1.237     | 100.0%  | 40    |
| neutron.create_port (x5) | 5.197     | 13.736       | 17.161       | 18.548       | 18.987    | 13.921    | 100.0%  | 40    |
| neutron.delete_port (x5) | 3.257     | 12.146       | 14.71        | 15.194       | 16.898    | 11.229    | 100.0%  | 40    |
| total                    | 14.657    | 27.153       | 32.903       | 33.189       | 34.048    | 26.387    | 100.0%  | 40    |
|  -> duration             | 14.657    | 27.153       | 32.903       | 33.189       | 34.048    | 26.387    | 100.0%  | 40    |
|  -> idle_duration        | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 64.889968
Full duration: 83.699093
--------------------------------------------------------------------------------

test scenario Quotas.neutron_update
args position 0
args values:
{
  "runner": {
    "concurrency": 20, 
    "times": 40
  }, 
  "contexts": {
    "users": {
      "users_per_tenant": 1, 
      "tenants": 20
    }
  }, 
  "args": {
    "max_quota": 1024
  }, 
  "sla": {
    "failure_rate": {
      "max": 0
    }
  }, 
  "hooks": []
}

--------------------------------------------------------------------------------
Task b3303a65-2da4-4195-a418-9fd6793b9bc8 has 0 error(s)
--------------------------------------------------------------------------------

+-------------------------------------------------------------------------------------------------------------------------+
|                                                  Response Times (sec)                                                   |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| quotas.update_quotas | 0.178     | 0.294        | 0.436        | 0.463        | 0.593     | 0.307     | 100.0%  | 40    |
| total                | 0.311     | 0.555        | 0.743        | 0.749        | 0.784     | 0.567     | 100.0%  | 40    |
|  -> duration         | 0.311     | 0.555        | 0.743        | 0.749        | 0.784     | 0.567     | 100.0%  | 40    |
|  -> idle_duration    | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 40    |
+----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+

Load duration: 1.324943
Full duration: 28.421778

HINTS:
* To plot HTML graphics with this data, run:
	rally task report b3303a65-2da4-4195-a418-9fd6793b9bc8 --out output.html

* To generate a JUnit report, run:
	rally task export b3303a65-2da4-4195-a418-9fd6793b9bc8 --type junit --to output.xml

* To get raw JSON output of task results, run:
	rally task report b3303a65-2da4-4195-a418-9fd6793b9bc8 --json --out output.json


2020-02-23 16:33:27,614 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'b3303a65-2da4-4195-a418-9fd6793b9bc8', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2020-02-23 16:33:30,022 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b3303a65-2da4-4195-a418-9fd6793b9bc8 --out /home/opnfv/functest/results/rally_jobs/neutron.json

2020-02-23 16:33:30,137 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK.
2020-02-23 16:33:30,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:

+-----------+------------+----------------+-----------+
|  Module   |  Duration  |  nb. Test Run  |  Success  |
+-----------+------------+----------------+-----------+
|  neutron  |  00:23:56  |      608       |  100.00%  |
|           |            |                |           |
|  TOTAL:   |  00:23:56  |      608       |  100.00%  |
+-----------+------------+----------------+-----------+

2020-02-23 16:33:30,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules
2020-02-23 16:33:30,138 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2020-02-23 16:33:32,700 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html

2020-02-23 16:33:32,701 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2020-02-23 16:33:35,006 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml

2020-02-23 16:33:35,007 - xtesting.ci.run_tests - INFO - Test result:

+--------------------+------------------+------------------+----------------+
|     TEST CASE      |     PROJECT      |     DURATION     |     RESULT     |
+--------------------+------------------+------------------+----------------+
|     rally_jobs     |     functest     |      24:43       |      PASS      |
+--------------------+------------------+------------------+----------------+

2020-02-23 16:33:47,935 - functest.core.singlevm - DEBUG - Cleaning security group 8ee245c0-f2e9-44af-924f-d01e43212b95
2020-02-23 16:33:49,566 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)