2020-04-07 18:52:35,052 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
| TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results |
| S3_DST_URL | s3://artifacts.opnfv.org/airship/FAN2RY0KVKSB/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-132 |
| S3_ENDPOINT_URL | https://storage.googleapis.com |
| DEPLOY_SCENARIO | os-nosdn-nofeature-ha |
| BUILD_TAG | FAN2RY0KVKSB |
| DEBUG | true |
| INSTALLER_TYPE | airship |
| CI_LOOP | daily |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| HTTP_DST_URL | http://artifacts.opnfv.org/airship/FAN2RY0KVKSB/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-132 |
| NODE_NAME | intel-pod17 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------+
2020-04-07 18:52:35,057 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file
export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17
2020-04-07 18:52:35,057 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs
2020-04-07 18:52:35,066 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'...
2020-04-07 18:52:35,830 - functest.core.tenantnetwork - DEBUG - password: +JQpO{.+Wj0xFD?3tCBb5,y9(*?Wu~
2020-04-07 18:52:35,925 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_jobs', 'enabled': True, 'id': u'eda62d27a11c45ac8754b33670cdb416', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_jobs-project_ac65d686-5a04-441b-aefa-0cdd97cf6437'})
2020-04-07 18:52:35,992 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'a2c813bff90640019df65144c0e87524', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_jobs-user_ac65d686-5a04-441b-aefa-0cdd97cf6437'})
2020-04-07 18:52:36,349 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_jobs-project_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': '+JQpO{.+Wj0xFD?3tCBb5,y9(*?Wu~', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_jobs-user_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'project_id': u'eda62d27a11c45ac8754b33670cdb416', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-04-07 18:52:36,354 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_jobs-user_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'password': '+JQpO{.+Wj0xFD?3tCBb5,y9(*?Wu~', 'project_name': 'rally_jobs-project_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': 'eda62d27a11c45ac8754b33670cdb416', 'project_domain_name': 'default'}
2020-04-07 18:52:36,656 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'...
2020-04-07 18:52:37,147 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-04-07T18:52:36Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'd61555c0-c8a5-4d9f-ad5d-a3c1b45c62a9', u'provider:segmentation_id': 50, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-net_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'admin_state_up': True, u'tenant_id': u'eda62d27a11c45ac8754b33670cdb416', u'created_at': u'2020-04-07T18:52:36Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'eda62d27a11c45ac8754b33670cdb416'})
2020-04-07 18:52:38,353 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-04-07T18:52:37Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'a94c5801-91a9-4ec9-94ea-04e8fe8e1e1b', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_jobs-subnet_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'enable_dhcp': True, u'network_id': u'd61555c0-c8a5-4d9f-ad5d-a3c1b45c62a9', u'tenant_id': u'eda62d27a11c45ac8754b33670cdb416', u'created_at': u'2020-04-07T18:52:37Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'eda62d27a11c45ac8754b33670cdb416'})
2020-04-07 18:52:44,341 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-04-07T18:52:40Z', u'revision_number': 8, u'ha': True, u'id': u'06a9d7c4-009d-4c72-9ea4-3e40ed34ee26', u'external_gateway_info': {u'network_id': u'0d411766-c098-415c-beb1-cfcb10bbfd74', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'95fe0a84-b68a-4eb7-9cb6-72b50eb7d0fc', u'ip_address': u'10.10.175.33'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_jobs-router_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'admin_state_up': True, u'tenant_id': u'eda62d27a11c45ac8754b33670cdb416', u'created_at': u'2020-04-07T18:52:38Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'eda62d27a11c45ac8754b33670cdb416'})
2020-04-07 18:52:48,016 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/f8ddec0d-586a-46f9-9ab7-295ca1c8067f/file', 'owner': u'eda62d27a11c45ac8754b33670cdb416', 'id': u'f8ddec0d-586a-46f9-9ab7-295ca1c8067f', 'size': 12716032, u'self': u'/v2/images/f8ddec0d-586a-46f9-9ab7-295ca1c8067f', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'eda62d27a11c45ac8754b33670cdb416', 'name': 'rally_jobs-project_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-04-07T18:52:47Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-04-07T18:52:47Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_jobs-img_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/f8ddec0d-586a-46f9-9ab7-295ca1c8067f', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_jobs-img_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'created': u'2020-04-07T18:52:46Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-04-07T18:52:46Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/f8ddec0d-586a-46f9-9ab7-295ca1c8067f', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_jobs-img_ac65d686-5a04-441b-aefa-0cdd97cf6437', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-04-07 18:52:48,091 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ce0405f54e944de08faef5a619e4b022', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'63872174-c6b9-4a77-bd22-593f0d85a932', 'swap': 0})
2020-04-07 18:52:48,149 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-04-07 18:52:52,529 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid | created_at | name | status | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| d903a3e3-462f-45d3-9103-a6d53c8a00de | 2020-04-07T18:52:52.371948 | opnfv-rally | deploy->finished | |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: d903a3e3-462f-45d3-9103-a6d53c8a00de
~/.rally/openrc was updated
HINTS:
* To use standard OpenStack clients, set up your env by running:
source ~/.rally/openrc
OpenStack clients are now configured, e.g run:
openstack image list
2020-04-07 18:52:55,190 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------
Available services:
+-------------+----------------+-----------+
| Service | Service Type | Status |
+-------------+----------------+-----------+
| __unknown__ | placement | Available |
| cinder | volume | Available |
| cinder | volumev2 | Available |
| cinder | volumev3 | Available |
| cloud | cloudformation | Available |
| glance | image | Available |
| heat | orchestration | Available |
| keystone | identity | Available |
| neutron | network | Available |
| nova | compute | Available |
| swift | object-store | Available |
+-------------+----------------+-----------+
2020-04-07 18:52:55,950 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-04-07 18:52:56,125 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ce0405f54e944de08faef5a619e4b022', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'eabbaad5-d71f-4eaa-b8de-bae7c3671a50', 'swap': 0})
2020-04-07 18:52:56,232 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_ac65d686-5a04-441b-aefa-0cdd97cf6437', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ce0405f54e944de08faef5a619e4b022', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'eabbaad5-d71f-4eaa-b8de-bae7c3671a50', 'swap': 0})
2020-04-07 18:52:56,236 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml
2020-04-07 18:52:56,237 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-04-07 18:52:56,252 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server']
2020-04-07 18:52:56,529 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-04-07 18:52:56,529 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml']
2020-04-07 19:29:25,187 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: a46f4895-59bf-4f55-9adc-fee87e26eed0
2020-04-07 19:29:25,188 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a46f4895-59bf-4f55-9adc-fee87e26eed0
2020-04-07 19:29:25,188 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a46f4895-59bf-4f55-9adc-fee87e26eed0']
2020-04-07 19:29:26,225 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a46f4895-59bf-4f55-9adc-fee87e26eed0
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0: finished
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_networks
args position 0
args values:
{
"runner": {
"concurrency": 20,
"times": 100
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"network": 119
}
}
},
"args": {},
"sla": {
"max_avg_duration_per_atomic": {
"neutron.list_networks": 15
},
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.492 | 1.184 | 1.81 | 2.045 | 3.235 | 1.235 | 100.0% | 100 |
| neutron.list_networks | 0.231 | 0.653 | 1.028 | 1.12 | 1.446 | 0.668 | 100.0% | 100 |
| total | 0.791 | 1.844 | 2.637 | 2.747 | 3.508 | 1.903 | 100.0% | 100 |
| -> duration | 0.791 | 1.844 | 2.637 | 2.747 | 3.508 | 1.903 | 100.0% | 100 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.939251
Full duration: 31.860679
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_networks
args position 1
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"network": -1
}
}
},
"args": {
"network_create_args": {},
"network_update_args": {
"name": "_updated",
"admin_state_up": false
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.511 | 1.264 | 2.275 | 2.694 | 2.892 | 1.412 | 100.0% | 40 |
| neutron.update_network | 0.605 | 1.671 | 2.269 | 2.326 | 2.702 | 1.615 | 100.0% | 40 |
| total | 1.44 | 2.861 | 4.504 | 4.587 | 4.937 | 3.027 | 100.0% | 40 |
| -> duration | 1.44 | 2.861 | 4.504 | 4.587 | 4.937 | 3.027 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 7.680471
Full duration: 45.12252
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_networks
args position 2
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.727 | 1.127 | 2.066 | 2.131 | 2.843 | 1.281 | 100.0% | 40 |
| neutron.delete_network | 0.655 | 1.38 | 2.03 | 2.251 | 2.329 | 1.38 | 100.0% | 40 |
| total | 1.532 | 2.658 | 3.43 | 3.502 | 3.916 | 2.662 | 100.0% | 40 |
| -> duration | 1.532 | 2.658 | 3.43 | 3.502 | 3.916 | 2.662 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 6.285198
Full duration: 11.594127
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_subnets
args position 0
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
}
},
"args": {
"subnets_per_network": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.466 | 5.142 | 19.349 | 19.38 | 20.179 | 8.584 | 100.0% | 40 |
| neutron.create_subnet (x2) | 1.342 | 2.511 | 3.656 | 4.238 | 4.673 | 2.638 | 100.0% | 40 |
| neutron.list_subnets | 0.176 | 0.378 | 0.698 | 0.739 | 1.15 | 0.437 | 100.0% | 40 |
| total | 2.304 | 8.828 | 23.09 | 23.613 | 24.252 | 11.659 | 100.0% | 40 |
| -> duration | 2.304 | 8.828 | 23.09 | 23.613 | 24.252 | 11.659 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 25.039479
Full duration: 57.643889
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_subnets
args position 1
args values:
{
"runner": {
"concurrency": 20,
"times": 100
},
"contexts": {
"users": {
"users_per_tenant": 5,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"port": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.4.0.0/16",
"subnets_per_network": 2,
"subnet_create_args": {},
"subnet_update_args": {
"name": "_subnet_updated",
"enable_dhcp": true
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.432 | 0.965 | 2.212 | 2.737 | 3.589 | 1.166 | 100.0% | 100 |
| neutron.create_subnet (x2) | 1.44 | 3.295 | 7.106 | 8.041 | 10.757 | 4.01 | 100.0% | 100 |
| neutron.update_subnet (x2) | 1.368 | 3.569 | 6.204 | 7.253 | 10.148 | 3.857 | 100.0% | 100 |
| total | 4.051 | 8.199 | 14.282 | 15.268 | 16.491 | 9.032 | 100.0% | 100 |
| -> duration | 4.051 | 8.199 | 14.282 | 15.268 | 16.491 | 9.032 | 100.0% | 100 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 48.599284
Full duration: 187.432973
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_subnets
args position 2
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnets_per_network": 2,
"subnet_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 3 error(s)
--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 226, in run
network = self._get_or_create_network(network_create_args)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper
return f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 328, in _get_or_create_network
return self._create_network(network_create_args or {})
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 79, in _create_network
return self.clients("neutron").create_network(
File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 96, in clients
return client(version) if version is not None else client()
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
self.cache[key] = self.create_client(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
endpoint_override=self._get_endpoint(service_type),
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
api_url = self.keystone.service_catalog.url_for(**kw)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
return self.auth_ref.service_catalog
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 226, in run
network = self._get_or_create_network(network_create_args)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper
return f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 328, in _get_or_create_network
return self._create_network(network_create_args or {})
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 79, in _create_network
return self.clients("neutron").create_network(
File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 96, in clients
return client(version) if version is not None else client()
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
self.cache[key] = self.create_client(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
endpoint_override=self._get_endpoint(service_type),
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
api_url = self.keystone.service_catalog.url_for(**kw)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
return self.auth_ref.service_catalog
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
--------------------------------------------------------------------------------
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/network.py", line 226, in run
network = self._get_or_create_network(network_create_args)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper
return f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 328, in _get_or_create_network
return self._create_network(network_create_args or {})
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/neutron/utils.py", line 79, in _create_network
return self.clients("neutron").create_network(
File "/usr/lib/python2.7/site-packages/rally_openstack/scenario.py", line 96, in clients
return client(version) if version is not None else client()
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__
self.cache[key] = self.create_client(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 442, in create_client
endpoint_override=self._get_endpoint(service_type),
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint
api_url = self.keystone.service_catalog.url_for(**kw)
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog
return self.auth_ref.service_catalog
File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref
raise e
AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod17.opnfv.org:80/v3 for user 'c_rally_f14f4768_TEkDpazs' in project 'c_rally_f14f4768_LVFu1RG9': [BadGateway] Bad Gateway (HTTP 502)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.457 | 1.541 | 43.559 | 44.821 | 52.468 | 17.265 | 92.5% | 40 |
| neutron.create_subnet (x2) | 1.302 | 2.022 | 3.799 | 4.259 | 4.497 | 2.326 | 100.0% | 37 |
| neutron.delete_subnet (x2) | 1.501 | 2.982 | 4.345 | 4.9 | 5.0 | 2.922 | 100.0% | 37 |
| total | 3.58 | 9.982 | 47.627 | 48.709 | 55.585 | 22.12 | 92.5% | 40 |
| -> duration | 3.58 | 9.982 | 47.627 | 48.709 | 55.585 | 22.12 | 92.5% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 92.5% | 40 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 60.182888
Full duration: 73.591322
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_routers
args position 0
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"network_create_args": null,
"subnet_cidr_start": "1.1.0.0/30",
"subnets_per_network": 2,
"subnet_create_args": null,
"router_create_args": null
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.455 | 1.183 | 1.885 | 2.42 | 3.102 | 1.232 | 100.0% | 40 |
| neutron.create_subnet (x2) | 1.456 | 3.466 | 6.052 | 6.193 | 7.588 | 3.902 | 100.0% | 40 |
| neutron.create_router (x2) | 8.365 | 21.09 | 36.249 | 38.179 | 47.836 | 24.026 | 100.0% | 40 |
| neutron.add_interface_router (x2) | 5.323 | 9.111 | 19.825 | 25.325 | 26.193 | 11.66 | 100.0% | 40 |
| neutron.list_routers | 0.218 | 0.378 | 0.957 | 1.295 | 1.357 | 0.543 | 100.0% | 40 |
| total | 21.314 | 36.68 | 66.403 | 68.552 | 71.536 | 41.362 | 100.0% | 40 |
| -> duration | 21.314 | 36.68 | 66.403 | 68.552 | 71.536 | 41.362 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 95.146329
Full duration: 275.700723
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_routers
args position 1
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"subnets_per_network": 2,
"subnet_cidr_start": "1.1.0.0/30",
"network_create_args": {},
"subnet_create_args": {},
"router_update_args": {
"name": "_router_updated",
"admin_state_up": false
},
"router_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.447 | 1.421 | 2.027 | 2.639 | 2.818 | 1.417 | 100.0% | 40 |
| neutron.create_subnet (x2) | 1.265 | 4.559 | 6.886 | 7.436 | 7.902 | 4.626 | 100.0% | 40 |
| neutron.create_router (x2) | 9.292 | 25.17 | 31.477 | 32.884 | 34.836 | 23.899 | 100.0% | 40 |
| neutron.add_interface_router (x2) | 4.531 | 11.031 | 22.464 | 26.005 | 29.065 | 12.752 | 100.0% | 40 |
| neutron.update_router (x2) | 1.109 | 2.493 | 4.644 | 4.816 | 5.675 | 2.809 | 100.0% | 40 |
| total | 21.69 | 48.387 | 57.024 | 60.394 | 67.544 | 45.504 | 100.0% | 40 |
| -> duration | 21.69 | 48.387 | 57.024 | 60.394 | 67.544 | 45.504 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 107.441076
Full duration: 250.889866
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_routers
args position 2
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"network_create_args": {},
"subnet_cidr_start": "1.1.0.0/30",
"subnets_per_network": 2,
"subnet_create_args": {},
"router_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.488 | 1.327 | 2.088 | 2.196 | 2.605 | 1.325 | 100.0% | 40 |
| neutron.create_subnet (x2) | 1.59 | 3.213 | 4.777 | 6.041 | 6.864 | 3.48 | 100.0% | 40 |
| neutron.create_router (x2) | 9.697 | 17.572 | 21.298 | 21.536 | 23.284 | 17.26 | 100.0% | 40 |
| neutron.add_interface_router (x2) | 4.556 | 9.564 | 13.179 | 14.844 | 16.456 | 9.689 | 100.0% | 40 |
| neutron.remove_interface_router (x2) | 4.2 | 7.689 | 12.951 | 15.002 | 17.077 | 8.564 | 100.0% | 40 |
| neutron.delete_router (x2) | 4.54 | 9.246 | 14.391 | 15.905 | 17.681 | 10.123 | 100.0% | 40 |
| total | 36.693 | 48.373 | 65.48 | 68.253 | 70.611 | 50.443 | 100.0% | 40 |
| -> duration | 36.693 | 48.373 | 65.48 | 68.253 | 70.611 | 50.443 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 112.911946
Full duration: 195.670798
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_list_ports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 8
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"port": 811,
"subnet": -1,
"network": -1,
"router": -1
}
}
},
"args": {
"network_create_args": null,
"ports_per_network": 50,
"port_create_args": null
},
"sla": {
"max_avg_duration_per_atomic": {
"neutron.list_ports": 15
},
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.476 | 0.595 | 1.104 | 1.105 | 1.107 | 0.694 | 100.0% | 8 |
| neutron.create_port (x50) | 88.926 | 93.492 | 103.227 | 103.642 | 104.057 | 95.411 | 100.0% | 8 |
| neutron.list_ports | 0.632 | 1.005 | 1.675 | 1.699 | 1.724 | 1.131 | 100.0% | 8 |
| total | 90.652 | 94.981 | 104.963 | 105.381 | 105.799 | 97.24 | 100.0% | 8 |
| -> duration | 90.652 | 94.981 | 104.963 | 105.381 | 105.799 | 97.24 | 100.0% | 8 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 200.597578
Full duration: 257.017968
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_update_ports
args position 1
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
}
},
"args": {
"network_create_args": {},
"ports_per_network": 5,
"port_create_args": {},
"port_update_args": {
"device_owner": "dummy_owner",
"device_id": "dummy_id",
"name": "_port_updated",
"admin_state_up": false
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.478 | 1.095 | 1.813 | 2.709 | 3.094 | 1.22 | 100.0% | 40 |
| neutron.create_port (x5) | 6.607 | 10.051 | 12.958 | 14.966 | 16.805 | 10.221 | 100.0% | 40 |
| neutron.update_port (x5) | 3.281 | 6.206 | 7.404 | 7.652 | 9.278 | 6.131 | 100.0% | 40 |
| total | 12.96 | 17.42 | 21.185 | 21.698 | 24.5 | 17.574 | 100.0% | 40 |
| -> duration | 12.96 | 17.42 | 21.185 | 21.698 | 24.5 | 17.574 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 39.551599
Full duration: 112.5601
--------------------------------------------------------------------------------
test scenario NeutronNetworks.create_and_delete_ports
args position 2
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"network": -1,
"port": -1
}
}
},
"args": {
"network_create_args": {},
"ports_per_network": 5,
"port_create_args": {}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.458 | 1.071 | 1.857 | 7.47 | 17.609 | 1.992 | 100.0% | 40 |
| neutron.create_port (x5) | 4.934 | 9.25 | 12.577 | 12.816 | 13.446 | 9.514 | 100.0% | 40 |
| neutron.delete_port (x5) | 3.773 | 7.194 | 8.534 | 8.92 | 10.058 | 6.977 | 100.0% | 40 |
| total | 12.838 | 17.997 | 22.343 | 23.089 | 26.323 | 18.484 | 100.0% | 40 |
| -> duration | 12.838 | 17.997 | 22.343 | 23.089 | 26.323 | 18.484 | 100.0% | 40 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 |
+--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 49.38341
Full duration: 87.993655
--------------------------------------------------------------------------------
test scenario Quotas.neutron_update
args position 0
args values:
{
"runner": {
"concurrency": 20,
"times": 40
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 20
}
},
"args": {
"max_quota": 1024
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 132.20422
--------------------------------------------------------------------------------
test scenario NeutronTrunks.create_and_list_trunk_subports
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 4
},
"contexts": {
"users": {
"users_per_tenant": 1,
"tenants": 1
},
"quotas": {
"neutron": {
"network": -1,
"port": 1000
}
}
},
"args": {
"subport_count": 125
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a46f4895-59bf-4f55-9adc-fee87e26eed0 has 3 error(s)
--------------------------------------------------------------------------------
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 41, in run
trunk = self._create_trunk(trunk_payload)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 53, in _create_trunk
return self.clients("neutron").create_trunk({'trunk': trunk_payload})
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 2091, in create_trunk
return self.post(self.trunks_path, body=body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
headers=headers, params=params)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
request_ids=request_ids)
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 41, in run
trunk = self._create_trunk(trunk_payload)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 53, in _create_trunk
return self.clients("neutron").create_trunk({'trunk': trunk_payload})
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 2091, in create_trunk
return self.post(self.trunks_path, body=body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
headers=headers, params=params)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
request_ids=request_ids)
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 41, in run
trunk = self._create_trunk(trunk_payload)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/root/.rally/plugins/trunk_scenario.py", line 53, in _create_trunk
return self.clients("neutron").create_trunk({'trunk': trunk_payload})
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 2091, in create_trunk
return self.post(self.trunks_path, body=body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 359, in post
headers=headers, params=params)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request
self._handle_fault_response(status_code, replybody, resp)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response
exception_handler_v20(status_code, error_body)
File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20
request_ids=request_ids)
NeutronClientException:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| neutron.create_network | 0.688 | 0.799 | 0.907 | 0.913 | 0.918 | 0.801 | 100.0% | 4 |
| neutron.create_subnet | 0.71 | 0.804 | 0.912 | 0.919 | 0.927 | 0.811 | 100.0% | 4 |
| neutron.create_port (x125) | 264.728 | 284.315 | 300.469 | 302.233 | 303.996 | 284.339 | 100.0% | 4 |
| neutron.create_trunk | 39.267 | 60.005 | 60.008 | 60.009 | 60.01 | 54.821 | 25.0% | 4 |
| neutron.update_port | 3.31 | 3.31 | 3.31 | 3.31 | 3.31 | 3.31 | 100.0% | 1 |
| neutron.list_trunks | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 100.0% | 1 |
| neutron.list_ports_by_device_id | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 100.0% | 1 |
| neutron.delete_trunk | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 0.502 | 100.0% | 1 |
| total | 326.169 | 343.669 | 352.501 | 353.181 | 353.862 | 341.842 | 25.0% | 4 |
| -> duration | 326.169 | 343.669 | 352.501 | 353.181 | 353.862 | 341.842 | 25.0% | 4 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 25.0% | 4 |
+---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 353.868826
Full duration: 449.152815
HINTS:
* To plot HTML graphics with this data, run:
rally task report a46f4895-59bf-4f55-9adc-fee87e26eed0 --out output.html
* To generate a JUnit report, run:
rally task export a46f4895-59bf-4f55-9adc-fee87e26eed0 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report a46f4895-59bf-4f55-9adc-fee87e26eed0 --json --out output.json
At least one workload did not pass SLA criteria.
2020-04-07 19:29:26,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a46f4895-59bf-4f55-9adc-fee87e26eed0', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json']
2020-04-07 19:29:28,665 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a46f4895-59bf-4f55-9adc-fee87e26eed0 --out /home/opnfv/functest/results/rally_jobs/neutron.json
2020-04-07 19:29:28,789 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-04-07 19:29:28,791 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:
+-----------+------------+----------------+-----------+
| Module | Duration | nb. Test Run | Success |
+-----------+------------+----------------+-----------+
| neutron | 00:36:08 | 572 | 98.95% |
| | | | |
| TOTAL: | 00:36:08 | 572 | 98.95% |
+-----------+------------+----------------+-----------+
2020-04-07 19:29:28,791 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 98.95% in 0/1 modules
2020-04-07 19:29:28,791 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html']
2020-04-07 19:29:31,295 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html
2020-04-07 19:29:31,296 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml']
2020-04-07 19:29:33,637 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml
2020-04-07 19:29:33,638 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+------------------+------------------+----------------+
| rally_jobs | functest | 36:57 | FAIL |
+--------------------+------------------+------------------+----------------+
2020-04-07 19:29:47,384 - functest.core.singlevm - DEBUG - Cleaning security group 578054a0-d24f-4904-952e-f761ff47d746
2020-04-07 19:29:47,640 - functest.core.singlevm - DEBUG - Orphan security group 578054a0-d24f-4904-952e-f761ff47d746 in use
2020-04-07 19:29:49,092 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)