2020-01-07 14:31:49,387 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+----------------------------------------------------------------------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+
| TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results |
| S3_DST_URL | s3://artifacts.opnfv.org/airship/KVB6DMHYX71U/airship-opnfv-functest-benchmarking-latest-rally_full-run-67 |
| S3_ENDPOINT_URL | https://storage.googleapis.com |
| DEPLOY_SCENARIO | os-nosdn-nofeature-ha |
| BUILD_TAG | KVB6DMHYX71U |
| DEBUG | true |
| INSTALLER_TYPE | airship |
| CI_LOOP | daily |
| TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results |
| HTTP_DST_URL | http://artifacts.opnfv.org/airship/KVB6DMHYX71U/airship-opnfv-functest-benchmarking-latest-rally_full-run-67 |
| NODE_NAME | intel-pod17 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------+
2020-01-07 14:31:49,391 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file
export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_USERNAME=admin
export OS_PROJECT_NAME=admin
export OS_PASSWORD=password123
export OS_IDENTITY_API_VERSION=3
export OS_INTERFACE=public
export OS_REGION_NAME=intel-pod17
2020-01-07 14:31:49,391 - xtesting.ci.run_tests - DEBUG - Test args: rally_full
2020-01-07 14:31:49,401 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'...
2020-01-07 14:31:50,121 - functest.core.tenantnetwork - DEBUG - password: N4=USF.mU7-~A5w<@VAmZgl@N8MWbJ
2020-01-07 14:31:50,214 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'f86f1ab82dd746da9dec5d8abff7fd0f', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_78346a9f-65ab-4661-bcd5-fbe91ce23483'})
2020-01-07 14:31:50,289 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'f259d4125f1d499e9fc4f5798452956d', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_78346a9f-65ab-4661-bcd5-fbe91ce23483'})
2020-01-07 14:31:50,667 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': 'N4=USF.mU7-~A5w<@VAmZgl@N8MWbJ', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'project_id': u'f86f1ab82dd746da9dec5d8abff7fd0f', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}}
2020-01-07 14:31:50,671 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'password': 'N4=USF.mU7-~A5w<@VAmZgl@N8MWbJ', 'project_name': 'rally_full-project_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': 'f86f1ab82dd746da9dec5d8abff7fd0f', 'project_domain_name': 'default'}
2020-01-07 14:31:50,971 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'...
2020-01-07 14:31:51,420 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-01-07T14:31:51Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'89a5a689-a184-4936-b66a-c3b0e636677e', u'provider:segmentation_id': 30, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'admin_state_up': True, u'tenant_id': u'f86f1ab82dd746da9dec5d8abff7fd0f', u'created_at': u'2020-01-07T14:31:51Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'f86f1ab82dd746da9dec5d8abff7fd0f'})
2020-01-07 14:31:52,461 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-01-07T14:31:52Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'b9d35e10-bd5a-4f0a-89a6-85123dc4a704', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'enable_dhcp': True, u'network_id': u'89a5a689-a184-4936-b66a-c3b0e636677e', u'tenant_id': u'f86f1ab82dd746da9dec5d8abff7fd0f', u'created_at': u'2020-01-07T14:31:52Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'f86f1ab82dd746da9dec5d8abff7fd0f'})
2020-01-07 14:31:58,784 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-01-07T14:31:54Z', u'revision_number': 6, u'ha': True, u'id': u'e4a158ef-b840-415a-ba0c-74de3fdf305b', u'external_gateway_info': {u'network_id': u'a90e7088-1dba-4dc9-97a8-85b05349536b', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'60efcd1b-69ec-4a93-aa04-419fce84af5f', u'ip_address': u'10.10.175.43'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'admin_state_up': True, u'tenant_id': u'f86f1ab82dd746da9dec5d8abff7fd0f', u'created_at': u'2020-01-07T14:31:53Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'f86f1ab82dd746da9dec5d8abff7fd0f'})
2020-01-07 14:32:02,136 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/bcf0ec39-c79f-43bf-b8b5-4829afab8ac2/file', 'owner': u'f86f1ab82dd746da9dec5d8abff7fd0f', 'id': u'bcf0ec39-c79f-43bf-b8b5-4829afab8ac2', 'size': 12716032, u'self': u'/v2/images/bcf0ec39-c79f-43bf-b8b5-4829afab8ac2', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'f86f1ab82dd746da9dec5d8abff7fd0f', 'name': 'rally_full-project_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-01-07T14:32:02Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-01-07T14:32:02Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/bcf0ec39-c79f-43bf-b8b5-4829afab8ac2', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'created': u'2020-01-07T14:32:01Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-01-07T14:32:01Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/bcf0ec39-c79f-43bf-b8b5-4829afab8ac2', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}})
2020-01-07 14:32:02,221 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'e1299273f9524f0a86123cafe71ed5f4', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'd81568a3-04f5-4bdc-88a6-91f2093fc839', 'swap': 0})
2020-01-07 14:32:02,284 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment...
2020-01-07 14:32:06,619 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally
+--------------------------------------+----------------------------+-------------+------------------+--------+
| uuid | created_at | name | status | active |
+--------------------------------------+----------------------------+-------------+------------------+--------+
| cb0f4d9a-f4c1-4ca7-9d86-c53d59d97d41 | 2020-01-07T14:32:06.455058 | opnfv-rally | deploy->finished | |
+--------------------------------------+----------------------------+-------------+------------------+--------+
Using deployment: cb0f4d9a-f4c1-4ca7-9d86-c53d59d97d41
~/.rally/openrc was updated
HINTS:
* To use standard OpenStack clients, set up your env by running:
source ~/.rally/openrc
OpenStack clients are now configured, e.g run:
openstack image list
2020-01-07 14:32:09,393 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check
--------------------------------------------------------------------------------
Platform openstack:
--------------------------------------------------------------------------------
Available services:
+-------------+----------------+-----------+
| Service | Service Type | Status |
+-------------+----------------+-----------+
| __unknown__ | placement | Available |
| cinder | volume | Available |
| cinder | volumev2 | Available |
| cinder | volumev3 | Available |
| cloud | cloudformation | Available |
| glance | image | Available |
| heat | orchestration | Available |
| keystone | identity | Available |
| neutron | network | Available |
| nova | compute | Available |
| swift | object-store | Available |
+-------------+----------------+-----------+
2020-01-07 14:32:10,195 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests...
2020-01-07 14:32:10,377 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'e1299273f9524f0a86123cafe71ed5f4', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'03962152-6570-496b-bd5f-67e933784df1', 'swap': 0})
2020-01-07 14:32:10,471 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'e1299273f9524f0a86123cafe71ed5f4', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'03962152-6570-496b-bd5f-67e933784df1', 'swap': 0})
2020-01-07 14:32:10,472 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml
2020-01-07 14:32:10,472 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 14:32:10,489 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 14:32:10,492 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ...
2020-01-07 14:32:10,492 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 14:33:01,510 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a
2020-01-07 14:33:01,510 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a
2020-01-07 14:33:01,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a']
2020-01-07 14:33:02,320 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a: finished
--------------------------------------------------------------------------------
test scenario Authenticate.keystone
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.keystone | 0.197 | 0.378 | 0.442 | 0.461 | 0.48 | 0.368 | 100.0% | 10 |
| total | 0.197 | 0.379 | 0.442 | 0.461 | 0.48 | 0.368 | 100.0% | 10 |
| -> duration | 0.197 | 0.379 | 0.442 | 0.461 | 0.48 | 0.368 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.106035
Full duration: 5.940094
--------------------------------------------------------------------------------
test scenario Authenticate.validate_cinder
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_cinder | 0.165 | 0.269 | 0.569 | 0.577 | 0.584 | 0.363 | 100.0% | 10 |
| total | 0.333 | 0.693 | 0.83 | 0.836 | 0.843 | 0.629 | 100.0% | 10 |
| -> duration | 0.333 | 0.693 | 0.83 | 0.836 | 0.843 | 0.629 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.684977
Full duration: 6.508181
--------------------------------------------------------------------------------
test scenario Authenticate.validate_glance
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_glance | 0.232 | 0.323 | 0.408 | 0.446 | 0.484 | 0.324 | 100.0% | 10 |
| total | 0.331 | 0.548 | 0.742 | 0.753 | 0.765 | 0.541 | 100.0% | 10 |
| -> duration | 0.331 | 0.548 | 0.742 | 0.753 | 0.765 | 0.541 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.547814
Full duration: 6.512757
--------------------------------------------------------------------------------
test scenario Authenticate.validate_heat
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_heat | 0.168 | 0.27 | 0.439 | 0.494 | 0.549 | 0.296 | 100.0% | 10 |
| total | 0.265 | 0.503 | 0.713 | 0.756 | 0.799 | 0.504 | 100.0% | 10 |
| -> duration | 0.265 | 0.503 | 0.713 | 0.756 | 0.799 | 0.504 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.456626
Full duration: 5.801035
--------------------------------------------------------------------------------
test scenario Authenticate.validate_neutron
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_neutron | 0.453 | 0.526 | 0.669 | 0.71 | 0.751 | 0.561 | 100.0% | 10 |
| total | 0.549 | 0.747 | 0.909 | 1.051 | 1.194 | 0.757 | 100.0% | 10 |
| -> duration | 0.549 | 0.747 | 0.909 | 1.051 | 1.194 | 0.757 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.080308
Full duration: 6.396154
--------------------------------------------------------------------------------
test scenario Authenticate.validate_nova
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"repetitions": 2
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| authenticate.validate_nova | 0.241 | 0.301 | 0.781 | 0.786 | 0.792 | 0.456 | 100.0% | 10 |
| total | 0.349 | 0.464 | 1.096 | 1.097 | 1.098 | 0.67 | 100.0% | 10 |
| -> duration | 0.349 | 0.464 | 1.096 | 1.097 | 1.098 | 0.67 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.822731
Full duration: 6.664367
HINTS:
* To plot HTML graphics with this data, run:
rally task report a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a --out output.html
* To generate a JUnit report, run:
rally task export a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a --json --out output.json
2020-01-07 14:33:02,321 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json']
2020-01-07 14:33:04,435 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a4a320ca-7b8a-47e1-bbf5-fb187ecdd39a --out /home/opnfv/functest/results/rally_full/authenticate.json
2020-01-07 14:33:04,448 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK.
2020-01-07 14:33:04,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml
2020-01-07 14:33:04,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 14:33:04,464 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 14:33:04,466 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ...
2020-01-07 14:33:04,466 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 14:39:00,551 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 4b08fa53-0707-4cd1-bf68-de9cbebb051a
2020-01-07 14:39:00,552 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4b08fa53-0707-4cd1-bf68-de9cbebb051a
2020-01-07 14:39:00,552 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'4b08fa53-0707-4cd1-bf68-de9cbebb051a']
2020-01-07 14:39:01,384 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4b08fa53-0707-4cd1-bf68-de9cbebb051a
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a: finished
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_delete_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.228 | 3.348 | 3.6 | 3.619 | 3.639 | 3.402 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.11 | 0.128 | 0.151 | 0.191 | 0.231 | 0.138 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.885 | 0.992 | 1.224 | 1.232 | 1.241 | 1.03 | 100.0% | 10 |
| glance_v2.delete_image | 0.51 | 0.593 | 0.639 | 0.645 | 0.651 | 0.578 | 100.0% | 10 |
| total | 3.767 | 3.941 | 4.195 | 4.211 | 4.227 | 3.98 | 100.0% | 10 |
| -> duration | 3.767 | 3.941 | 4.195 | 4.211 | 4.227 | 3.98 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.611995
Full duration: 18.722549
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_list_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.257 | 3.557 | 5.779 | 5.942 | 6.104 | 4.008 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.121 | 0.15 | 0.176 | 0.184 | 0.192 | 0.151 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.924 | 1.08 | 3.382 | 3.498 | 3.614 | 1.587 | 100.0% | 10 |
| glance_v2.list_images | 0.057 | 0.08 | 0.15 | 0.152 | 0.155 | 0.096 | 100.0% | 10 |
| total | 3.4 | 3.663 | 5.856 | 6.02 | 6.184 | 4.104 | 100.0% | 10 |
| -> duration | 3.4 | 3.663 | 5.856 | 6.02 | 6.184 | 4.104 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 11.51629
Full duration: 23.376826
--------------------------------------------------------------------------------
test scenario GlanceImages.list_images
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+--------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.list_images | 0.148 | 0.196 | 0.291 | 0.298 | 0.304 | 0.212 | 100.0% | 10 |
| total | 0.148 | 0.196 | 0.291 | 0.298 | 0.304 | 0.213 | 100.0% | 10 |
| -> duration | 0.148 | 0.196 | 0.291 | 0.298 | 0.304 | 0.213 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 1.156552
Full duration: 6.114883
--------------------------------------------------------------------------------
test scenario GlanceImages.create_image_and_boot_instances
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"nova": {
"ram": -1,
"floating_ips": -1,
"security_group_rules": -1,
"instances": -1,
"cores": -1,
"security_groups": -1
}
}
},
"args": {
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img",
"container_format": "bare",
"disk_format": "qcow2",
"number_instances": 2,
"nics": [
{
"net-id": "89a5a689-a184-4936-b66a-c3b0e636677e"
}
],
"flavor": {
"name": "rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.205 | 3.319 | 3.789 | 3.802 | 3.814 | 3.42 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.115 | 0.123 | 0.135 | 0.137 | 0.139 | 0.125 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.848 | 0.981 | 1.345 | 1.35 | 1.356 | 1.05 | 100.0% | 10 |
| nova.boot_servers | 25.798 | 50.528 | 67.534 | 67.712 | 67.89 | 50.152 | 100.0% | 10 |
| total | 29.003 | 53.848 | 71.316 | 71.344 | 71.373 | 53.572 | 100.0% | 10 |
| -> duration | 28.003 | 52.848 | 70.316 | 70.344 | 70.373 | 52.572 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 151.08482
Full duration: 197.640345
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_deactivate_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.23 | 3.4 | 4.398 | 5.347 | 6.295 | 3.785 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.105 | 0.129 | 0.265 | 0.27 | 0.276 | 0.155 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.892 | 1.052 | 1.28 | 1.554 | 1.827 | 1.124 | 100.0% | 10 |
| glance_v2.deactivate_image | 0.103 | 0.124 | 0.21 | 0.215 | 0.22 | 0.145 | 100.0% | 10 |
| total | 3.353 | 3.561 | 4.522 | 5.519 | 6.515 | 3.93 | 100.0% | 10 |
| -> duration | 3.353 | 3.561 | 4.522 | 5.519 | 6.515 | 3.93 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 17.003432
Full duration: 25.859851
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_download_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.232 | 3.621 | 3.852 | 3.879 | 3.906 | 3.571 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.114 | 0.135 | 0.15 | 0.154 | 0.158 | 0.135 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.892 | 1.259 | 1.497 | 1.506 | 1.514 | 1.208 | 100.0% | 10 |
| glance_v2.download_image | 0.305 | 0.376 | 0.413 | 0.419 | 0.425 | 0.368 | 100.0% | 10 |
| total | 3.547 | 4.026 | 4.231 | 4.255 | 4.279 | 3.939 | 100.0% | 10 |
| -> duration | 3.547 | 4.026 | 4.231 | 4.255 | 4.279 | 3.939 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.020887
Full duration: 20.965439
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_get_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.213 | 3.493 | 3.955 | 3.968 | 3.981 | 3.564 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.118 | 0.133 | 0.143 | 0.144 | 0.144 | 0.132 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.866 | 1.123 | 1.491 | 1.514 | 1.537 | 1.181 | 100.0% | 10 |
| glance_v2.get_image | 0.043 | 0.048 | 0.078 | 0.08 | 0.081 | 0.055 | 100.0% | 10 |
| total | 3.26 | 3.543 | 4.005 | 4.034 | 4.062 | 3.619 | 100.0% | 10 |
| -> duration | 3.26 | 3.543 | 4.005 | 4.034 | 4.062 | 3.619 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 11.557357
Full duration: 20.047799
--------------------------------------------------------------------------------
test scenario GlanceImages.create_and_update_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"container_format": "bare",
"disk_format": "qcow2",
"image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 4b08fa53-0707-4cd1-bf68-de9cbebb051a has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| glance_v2.create_image | 3.301 | 3.535 | 3.743 | 3.794 | 3.844 | 3.536 | 100.0% | 10 |
| -> glance_v2.get_image (x2) | 0.104 | 0.151 | 0.193 | 0.206 | 0.218 | 0.152 | 100.0% | 10 |
| -> glance_v2.upload_data | 0.966 | 1.119 | 1.367 | 1.403 | 1.439 | 1.133 | 100.0% | 10 |
| glance_v2.update_image | 0.203 | 0.302 | 0.357 | 0.358 | 0.359 | 0.292 | 100.0% | 10 |
| total | 3.504 | 3.826 | 4.1 | 4.152 | 4.204 | 3.828 | 100.0% | 10 |
| -> duration | 3.504 | 3.826 | 4.1 | 4.152 | 4.204 | 3.828 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.027511
Full duration: 26.635856
HINTS:
* To plot HTML graphics with this data, run:
rally task report 4b08fa53-0707-4cd1-bf68-de9cbebb051a --out output.html
* To generate a JUnit report, run:
rally task export 4b08fa53-0707-4cd1-bf68-de9cbebb051a --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 4b08fa53-0707-4cd1-bf68-de9cbebb051a --json --out output.json
2020-01-07 14:39:01,385 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'4b08fa53-0707-4cd1-bf68-de9cbebb051a', '--out', u'/home/opnfv/functest/results/rally_full/glance.json']
2020-01-07 14:39:03,503 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4b08fa53-0707-4cd1-bf68-de9cbebb051a --out /home/opnfv/functest/results/rally_full/glance.json
2020-01-07 14:39:03,527 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK.
2020-01-07 14:39:03,528 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml
2020-01-07 14:39:03,528 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 14:39:03,543 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 14:39:03,551 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ...
2020-01-07 14:39:03,551 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:03:05,348 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 46fc795e-d996-4f25-a079-6995eb06eb87
2020-01-07 15:03:05,349 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 46fc795e-d996-4f25-a079-6995eb06eb87
2020-01-07 15:03:05,349 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'46fc795e-d996-4f25-a079-6995eb06eb87']
2020-01-07 15:03:06,249 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 46fc795e-d996-4f25-a079-6995eb06eb87
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87: aborted
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"nics": [
{
"net-id": "89a5a689-a184-4936-b66a-c3b0e636677e"
}
],
"flavor": {
"name": "rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"image": {
"name": "rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 17.488 | 23.259 | 44.752 | 46.461 | 48.17 | 28.033 | 100.0% | 10 |
| cinder_v3.create_volume | 2.55 | 2.592 | 2.663 | 2.669 | 2.674 | 2.604 | 100.0% | 10 |
| nova.attach_volume | 3.073 | 3.178 | 6.186 | 6.932 | 7.677 | 4.182 | 100.0% | 10 |
| nova.detach_volume | 2.908 | 2.963 | 3.435 | 4.384 | 5.333 | 3.229 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.288 | 2.298 | 2.467 | 2.505 | 2.544 | 2.352 | 100.0% | 10 |
| nova.delete_server | 5.128 | 5.351 | 6.007 | 6.831 | 7.656 | 5.626 | 100.0% | 10 |
| total | 35.754 | 40.801 | 63.632 | 65.44 | 67.249 | 46.028 | 100.0% | 10 |
| -> duration | 34.754 | 39.801 | 62.632 | 64.44 | 66.249 | 45.028 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 125.839076
Full duration: 139.271965
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_snapshots
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 1,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"force": false
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 2.53 | 2.774 | 4.971 | 4.971 | 4.972 | 3.552 | 100.0% | 10 |
| cinder_v3.list_snapshots | 0.048 | 0.056 | 0.065 | 0.065 | 0.066 | 0.056 | 100.0% | 10 |
| total | 2.579 | 2.835 | 5.034 | 5.035 | 5.037 | 3.608 | 100.0% | 10 |
| -> duration | 2.579 | 2.835 | 5.034 | 5.035 | 5.037 | 3.608 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.345664
Full duration: 39.870525
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"image": {
"name": "rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 9.397 | 9.782 | 10.096 | 10.122 | 10.148 | 9.763 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.091 | 0.105 | 0.177 | 0.187 | 0.197 | 0.123 | 100.0% | 10 |
| total | 9.5 | 9.88 | 10.24 | 10.245 | 10.249 | 9.887 | 100.0% | 10 |
| -> duration | 9.5 | 9.88 | 10.24 | 10.245 | 10.249 | 9.887 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 29.2294
Full duration: 42.221702
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_list_volume
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true,
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.793 | 3.093 | 3.736 | 4.876 | 6.017 | 3.392 | 100.0% | 10 |
| cinder_v3.list_volumes | 0.092 | 0.109 | 0.276 | 0.747 | 1.218 | 0.229 | 100.0% | 10 |
| total | 2.964 | 3.32 | 4.305 | 5.212 | 6.119 | 3.621 | 100.0% | 10 |
| -> duration | 2.964 | 3.32 | 4.305 | 5.212 | 6.119 | 3.621 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.729194
Full duration: 25.502461
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_upload_volume_to_image
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"container_format": "bare",
"force": false,
"disk_format": "raw",
"do_delete": true,
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.613 | 2.751 | 3.147 | 3.212 | 3.276 | 2.857 | 100.0% | 10 |
| cinder_v3.upload_volume_to_image | 11.314 | 20.706 | 25.569 | 25.761 | 25.953 | 19.645 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.279 | 2.308 | 2.403 | 2.506 | 2.609 | 2.342 | 100.0% | 10 |
| glance_v2.delete_image | 1.722 | 1.883 | 2.327 | 3.761 | 5.195 | 2.199 | 100.0% | 10 |
| total | 18.038 | 27.624 | 33.524 | 34.645 | 35.765 | 27.044 | 100.0% | 10 |
| -> duration | 18.038 | 27.624 | 33.524 | 34.645 | 35.765 | 27.044 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 78.807153
Full duration: 91.4741
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"create_vm_params": {
"nics": [
{
"net-id": "89a5a689-a184-4936-b66a-c3b0e636677e"
}
]
},
"flavor": {
"name": "rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"image": {
"name": "rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"nested_level": 1,
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| nova.boot_server | 16.953 | 26.534 | 43.626 | 45.435 | 47.244 | 29.023 | 100.0% | 10 |
| cinder_v3.create_volume | 2.573 | 2.611 | 2.755 | 2.788 | 2.821 | 2.637 | 100.0% | 10 |
| cinder_v3.create_snapshot | 2.351 | 2.382 | 2.397 | 2.397 | 2.398 | 2.378 | 100.0% | 10 |
| nova.attach_volume | 3.111 | 3.244 | 6.12 | 6.839 | 7.558 | 4.13 | 100.0% | 10 |
| nova.detach_volume | 2.899 | 2.961 | 3.477 | 4.356 | 5.234 | 3.22 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.245 | 2.27 | 2.298 | 2.346 | 2.393 | 2.281 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.284 | 2.32 | 2.452 | 2.482 | 2.512 | 2.353 | 100.0% | 10 |
| nova.delete_server | 5.128 | 5.509 | 7.937 | 8.011 | 8.085 | 6.302 | 100.0% | 10 |
| total | 41.351 | 49.059 | 64.874 | 66.687 | 68.5 | 52.325 | 100.0% | 10 |
| -> duration | 40.351 | 48.059 | 63.874 | 65.687 | 67.5 | 51.325 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 146.313707
Full duration: 159.578215
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_snapshot_and_attach_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"create_vm_params": {
"nics": [
{
"net-id": "89a5a689-a184-4936-b66a-c3b0e636677e"
}
]
},
"flavor": {
"name": "rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"image": {
"name": "rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483"
},
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.715 | 2.902 | 3.236 | 3.296 | 3.356 | 2.965 | 100.0% | 10 |
| cinder_v3.create_snapshot | 2.371 | 2.431 | 5.353 | 5.439 | 5.525 | 3.036 | 100.0% | 10 |
| nova.boot_server | 19.552 | 22.674 | 31.574 | 32.673 | 33.773 | 24.462 | 100.0% | 10 |
| nova.attach_volume | 3.043 | 3.213 | 6.616 | 8.253 | 9.89 | 4.152 | 100.0% | 10 |
| nova.detach_volume | 2.904 | 3.095 | 9.356 | 10.395 | 11.435 | 4.505 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.241 | 2.262 | 2.599 | 3.957 | 5.315 | 2.568 | 100.0% | 10 |
| cinder_v3.delete_volume | 2.306 | 2.332 | 2.371 | 2.373 | 2.376 | 2.335 | 100.0% | 10 |
| nova.delete_server | 5.22 | 6.454 | 11.888 | 20.525 | 29.162 | 9.06 | 100.0% | 10 |
| total | 43.21 | 51.413 | 64.08 | 65.298 | 66.516 | 53.086 | 100.0% | 10 |
| -> duration | 42.21 | 50.413 | 63.08 | 64.298 | 65.516 | 52.086 | 100.0% | 10 |
| -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 162.933742
Full duration: 176.123348
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {
"size": 1
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.745 | 3.287 | 3.499 | 3.5 | 3.5 | 3.192 | 100.0% | 10 |
| total | 2.745 | 3.287 | 3.5 | 3.5 | 3.501 | 3.193 | 100.0% | 10 |
| -> duration | 2.745 | 3.287 | 3.5 | 3.5 | 3.501 | 3.193 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.233645
Full duration: 55.810551
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_volume
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 2.757 | 3.206 | 3.697 | 3.712 | 3.728 | 3.217 | 100.0% | 10 |
| total | 2.757 | 3.206 | 3.697 | 3.713 | 3.728 | 3.217 | 100.0% | 10 |
| -> duration | 2.757 | 3.206 | 3.697 | 3.713 | 3.728 | 3.217 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 9.232059
Full duration: 21.832059
--------------------------------------------------------------------------------
test scenario CinderVolumes.list_volumes
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 4,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"detailed": true
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+---------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.list_volumes | 0.251 | 0.585 | 3.869 | 6.499 | 9.128 | 1.628 | 100.0% | 10 |
| total | 0.251 | 0.585 | 3.869 | 6.499 | 9.128 | 1.628 | 100.0% | 10 |
| -> duration | 0.251 | 0.585 | 3.869 | 6.499 | 9.128 | 1.628 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 10.139966
Full duration: 96.505554
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_snapshot
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"volumes": {
"volumes_per_tenant": 1,
"size": 1
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"force": false
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 0 error(s)
--------------------------------------------------------------------------------
+------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_snapshot | 2.756 | 31.388 | 39.417 | 40.792 | 42.167 | 23.716 | 100.0% | 10 |
| cinder_v3.delete_snapshot | 2.447 | 23.955 | 26.642 | 26.839 | 27.036 | 17.878 | 100.0% | 10 |
| total | 5.204 | 45.165 | 63.509 | 64.837 | 66.165 | 41.594 | 100.0% | 10 |
| -> duration | 5.204 | 45.165 | 63.509 | 64.837 | 66.165 | 41.594 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 116.043912
Full duration: 335.883669
--------------------------------------------------------------------------------
test scenario CinderVolumes.create_and_delete_volume
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"api_versions": {
"cinder": {
"service_type": "volumev3",
"version": 3
}
},
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"quotas": {
"cinder": {
"gigabytes": -1,
"volumes": -1,
"snapshots": -1
}
}
},
"args": {
"size": {
"max": 1,
"min": 1
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 46fc795e-d996-4f25-a079-6995eb06eb87 has 2 error(s)
--------------------------------------------------------------------------------
ClientException: Gateway Time-out (HTTP 504)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 242, in run
volume = self.cinder.create_volume(size, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume
multiattach=multiattach, backup_id=backup_id)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume
multiattach=multiattach, backup_id=backup_id))
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 73, in create_volume
.volumes.create(size, **kwargs))
File "/usr/lib/python2.7/site-packages/cinderclient/v3/volumes.py", line 135, in create
return self._create('/volumes', body, 'volume')
File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 330, in _create
resp, body = self.api.client.post(url, body=body)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 203, in post
return self._cs_request(url, 'POST', **kwargs)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 191, in _cs_request
return self.request(url, method, **kwargs)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 177, in request
raise exceptions.from_response(resp, body)
ClientException: Gateway Time-out (HTTP 504)
--------------------------------------------------------------------------------
ClientException: Gateway Time-out (HTTP 504)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 242, in run
volume = self.cinder.create_volume(size, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume
multiattach=multiattach, backup_id=backup_id)
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume
multiattach=multiattach, backup_id=backup_id))
File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper
return func(instance, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 73, in create_volume
.volumes.create(size, **kwargs))
File "/usr/lib/python2.7/site-packages/cinderclient/v3/volumes.py", line 135, in create
return self._create('/volumes', body, 'volume')
File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 330, in _create
resp, body = self.api.client.post(url, body=body)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 203, in post
return self._cs_request(url, 'POST', **kwargs)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 191, in _cs_request
return self.request(url, method, **kwargs)
File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 177, in request
raise exceptions.from_response(resp, body)
ClientException: Gateway Time-out (HTTP 504)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| cinder_v3.create_volume | 30.027 | 36.784 | 60.114 | 60.116 | 60.118 | 43.581 | 77.8% | 9 |
| cinder_v3.delete_volume | 18.088 | 23.989 | 57.965 | 58.008 | 58.051 | 31.175 | 100.0% | 7 |
| total | 48.116 | 60.113 | 112.668 | 113.865 | 115.063 | 67.829 | 77.8% | 9 |
| -> duration | 48.116 | 60.113 | 112.668 | 113.865 | 115.063 | 67.829 | 77.8% | 9 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 77.8% | 9 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 166.215747
Full duration: 232.56321
HINTS:
* To plot HTML graphics with this data, run:
rally task report 46fc795e-d996-4f25-a079-6995eb06eb87 --out output.html
* To generate a JUnit report, run:
rally task export 46fc795e-d996-4f25-a079-6995eb06eb87 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 46fc795e-d996-4f25-a079-6995eb06eb87 --json --out output.json
At least one workload did not pass SLA criteria.
2020-01-07 15:03:06,251 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'46fc795e-d996-4f25-a079-6995eb06eb87', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json']
2020-01-07 15:03:08,406 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 46fc795e-d996-4f25-a079-6995eb06eb87 --out /home/opnfv/functest/results/rally_full/cinder.json
2020-01-07 15:03:08,437 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" Failed.
2020-01-07 15:03:08,437 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml
2020-01-07 15:03:08,438 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:03:08,453 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:03:08,456 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ...
2020-01-07 15:03:08,457 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:10:00,381 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 542444bc-b0aa-4081-871d-63672e154866
2020-01-07 15:10:00,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 542444bc-b0aa-4081-871d-63672e154866
2020-01-07 15:10:00,382 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'542444bc-b0aa-4081-871d-63672e154866']
2020-01-07 15:10:01,168 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 542444bc-b0aa-4081-871d-63672e154866
--------------------------------------------------------------------------------
Task 542444bc-b0aa-4081-871d-63672e154866: aborted
--------------------------------------------------------------------------------
test scenario HeatStacks.create_and_delete_stack
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"heat_stack_owner"
]
},
"args": {
"template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template"
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 542444bc-b0aa-4081-871d-63672e154866 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 3.085 | 3.467 | 3.856 | 3.928 | 4.001 | 3.494 | 100.0% | 10 |
| heat.delete_stack | 1.26 | 1.272 | 1.296 | 1.299 | 1.302 | 1.276 | 100.0% | 10 |
| total | 4.359 | 4.732 | 5.14 | 5.21 | 5.28 | 4.769 | 100.0% | 10 |
| -> duration | 2.359 | 2.732 | 3.14 | 3.21 | 3.28 | 2.769 | 100.0% | 10 |
| -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 12.075152
Full duration: 24.325258
--------------------------------------------------------------------------------
test scenario HeatStacks.create_and_delete_stack
args position 1
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
},
"roles": [
"heat_stack_owner"
]
},
"args": {
"template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template",
"parameters": {
"image": "rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483",
"public_net": "public",
"flavor": "rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483"
}
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task 542444bc-b0aa-4081-871d-63672e154866 has 2 error(s)
--------------------------------------------------------------------------------
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/stacks.py", line 93, in run
files, environment)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack
stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"]
File "/usr/lib/python2.7/site-packages/heatclient/v1/stacks.py", line 171, in create
data=kwargs, headers=headers)
File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python2.7/site-packages/heatclient/common/http.py", line 323, in request
raise exc.from_response(resp)
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/stacks.py", line 93, in run
files, environment)
File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack
stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"]
File "/usr/lib/python2.7/site-packages/heatclient/v1/stacks.py", line 171, in create
data=kwargs, headers=headers)
File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post
return self.request(url, 'POST', **kwargs)
File "/usr/lib/python2.7/site-packages/heatclient/common/http.py", line 323, in request
raise exc.from_response(resp)
HTTPException: ERROR:
504 Gateway Time-out
504 Gateway Time-out
nginx
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| heat.create_stack | 42.359 | 55.34 | 123.525 | 123.644 | 123.763 | 67.061 | 80.0% | 10 |
| heat.delete_stack | 13.629 | 24.669 | 34.076 | 39.874 | 45.672 | 23.997 | 100.0% | 8 |
| total | 60.161 | 72.258 | 137.199 | 137.295 | 137.392 | 86.259 | 80.0% | 10 |
| -> duration | 60.161 | 70.258 | 135.199 | 135.295 | 135.392 | 84.659 | 80.0% | 10 |
| -> idle_duration | 0.0 | 2.0 | 2.0 | 2.0 | 2.0 | 1.6 | 80.0% | 10 |
+-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 276.274408
Full duration: 362.595868
HINTS:
* To plot HTML graphics with this data, run:
rally task report 542444bc-b0aa-4081-871d-63672e154866 --out output.html
* To generate a JUnit report, run:
rally task export 542444bc-b0aa-4081-871d-63672e154866 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report 542444bc-b0aa-4081-871d-63672e154866 --json --out output.json
At least one workload did not pass SLA criteria.
2020-01-07 15:10:01,169 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'542444bc-b0aa-4081-871d-63672e154866', '--out', u'/home/opnfv/functest/results/rally_full/heat.json']
2020-01-07 15:10:03,269 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 542444bc-b0aa-4081-871d-63672e154866 --out /home/opnfv/functest/results/rally_full/heat.json
2020-01-07 15:10:03,275 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed.
2020-01-07 15:10:03,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml
2020-01-07 15:10:03,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:10:03,294 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:10:03,296 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ...
2020-01-07 15:10:03,297 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:12:43,291 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: d7b579c3-9d05-47b0-9e8f-794fb6668dc3
2020-01-07 15:12:43,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d7b579c3-9d05-47b0-9e8f-794fb6668dc3
2020-01-07 15:12:43,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'd7b579c3-9d05-47b0-9e8f-794fb6668dc3']
2020-01-07 15:12:44,136 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d7b579c3-9d05-47b0-9e8f-794fb6668dc3
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3: finished
--------------------------------------------------------------------------------
test scenario KeystoneBasic.add_and_remove_user_role
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.045 | 0.256 | 24.208 | 24.227 | 24.246 | 8.271 | 100.0% | 10 |
| keystone_v3.add_role | 0.037 | 0.043 | 0.065 | 0.125 | 0.186 | 0.057 | 100.0% | 10 |
| keystone_v3.revoke_role | 0.055 | 0.072 | 27.28 | 27.823 | 28.366 | 5.624 | 100.0% | 10 |
| total | 0.139 | 0.487 | 42.712 | 44.602 | 46.492 | 13.952 | 100.0% | 10 |
| -> duration | 0.139 | 0.487 | 42.712 | 44.602 | 46.492 | 13.952 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 54.063529
Full duration: 64.087311
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_add_and_list_user_roles
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+----------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_role | 0.048 | 0.107 | 0.162 | 0.164 | 0.166 | 0.114 | 100.0% | 10 |
| keystone_v3.add_role | 0.031 | 0.044 | 0.086 | 0.089 | 0.093 | 0.05 | 100.0% | 10 |
| keystone_v3.list_roles | 0.029 | 0.041 | 0.146 | 0.158 | 0.17 | 0.073 | 100.0% | 10 |
| total | 0.147 | 0.25 | 0.3 | 0.314 | 0.327 | 0.238 | 100.0% | 10 |
| -> duration | 0.147 | 0.25 | 0.3 | 0.314 | 0.327 | 0.238 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.324486
Full duration: 12.751318
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_tenants
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-------------------------------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| keystone_v3.create_project | 0.115 | 0.215 | 0.313 | 0.331 | 0.349 | 0.22 | 100.0% | 10 |
| keystone_v3.list_projects | 0.027 | 0.043 | 0.15 | 0.159 | 0.167 | 0.07 | 100.0% | 10 |
| total | 0.147 | 0.309 | 0.395 | 0.401 | 0.407 | 0.29 | 100.0% | 10 |
| -> duration | 0.147 | 0.309 | 0.395 | 0.401 | 0.407 | 0.29 | 100.0% | 10 |
| -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 2.204559
Full duration: 58.162115
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_role
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.053081
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_delete_service
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.054257
--------------------------------------------------------------------------------
test scenario KeystoneBasic.get_entities
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.051677
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_update_and_delete_tenant
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {
"users": {
"users_per_tenant": 2,
"tenants": 3
}
},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.052872
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_user
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.034518
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.031452
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_and_list_users
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.031628
--------------------------------------------------------------------------------
test scenario KeystoneBasic.create_tenant_with_users
args position 0
args values:
{
"runner": {
"concurrency": 4,
"times": 10
},
"contexts": {},
"args": {
"users_per_tenant": 10
},
"sla": {
"failure_rate": {
"max": 0
}
},
"hooks": []
}
--------------------------------------------------------------------------------
Task d7b579c3-9d05-47b0-9e8f-794fb6668dc3 has 0 error(s)
--------------------------------------------------------------------------------
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 |
+--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
Load duration: 0.0
Full duration: 0.032424
HINTS:
* To plot HTML graphics with this data, run:
rally task report d7b579c3-9d05-47b0-9e8f-794fb6668dc3 --out output.html
* To generate a JUnit report, run:
rally task export d7b579c3-9d05-47b0-9e8f-794fb6668dc3 --type junit --to output.xml
* To get raw JSON output of task results, run:
rally task report d7b579c3-9d05-47b0-9e8f-794fb6668dc3 --json --out output.json
At least one workload did not pass SLA criteria.
2020-01-07 15:12:44,137 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'd7b579c3-9d05-47b0-9e8f-794fb6668dc3', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json']
2020-01-07 15:12:46,245 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d7b579c3-9d05-47b0-9e8f-794fb6668dc3 --out /home/opnfv/functest/results/rally_full/keystone.json
2020-01-07 15:12:46,261 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" Failed.
2020-01-07 15:12:46,261 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml
2020-01-07 15:12:46,261 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:12:46,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:12:46,284 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ...
2020-01-07 15:12:46,284 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:12:49,786 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda
2020-01-07 15:12:49,786 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda
2020-01-07 15:12:49,787 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda']
2020-01-07 15:12:50,567 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda
--------------------------------------------------------------------------------
Task 0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
self._validate_config_semantic(self.config)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
result = f(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
"for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.
2020-01-07 15:12:50,567 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json']
2020-01-07 15:12:52,575 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0254b5d9-ae2b-4d3c-a2ba-0d7dd53c6dda --out /home/opnfv/functest/results/rally_full/neutron.json
2020-01-07 15:12:52,576 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed.
2020-01-07 15:12:52,576 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml
2020-01-07 15:12:52,577 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:12:52,597 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:12:52,604 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ...
2020-01-07 15:12:52,604 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:12:56,219 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: a2ebffdd-76d4-4c21-b730-1203a52496be
2020-01-07 15:12:56,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a2ebffdd-76d4-4c21-b730-1203a52496be
2020-01-07 15:12:56,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a2ebffdd-76d4-4c21-b730-1203a52496be']
2020-01-07 15:12:56,993 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a2ebffdd-76d4-4c21-b730-1203a52496be
--------------------------------------------------------------------------------
Task a2ebffdd-76d4-4c21-b730-1203a52496be: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
self._validate_config_semantic(self.config)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
result = f(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
"for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.
2020-01-07 15:12:56,994 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a2ebffdd-76d4-4c21-b730-1203a52496be', '--out', u'/home/opnfv/functest/results/rally_full/nova.json']
2020-01-07 15:12:58,987 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a2ebffdd-76d4-4c21-b730-1203a52496be --out /home/opnfv/functest/results/rally_full/nova.json
2020-01-07 15:12:58,988 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed.
2020-01-07 15:12:58,988 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml
2020-01-07 15:12:58,989 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:12:59,009 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:12:59,010 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ...
2020-01-07 15:12:59,010 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:13:02,073 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: a2f7934e-fc0f-4276-abc0-1d4d53bf60b2
2020-01-07 15:13:02,074 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a2f7934e-fc0f-4276-abc0-1d4d53bf60b2
2020-01-07 15:13:02,074 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a2f7934e-fc0f-4276-abc0-1d4d53bf60b2']
2020-01-07 15:13:02,871 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a2f7934e-fc0f-4276-abc0-1d4d53bf60b2
--------------------------------------------------------------------------------
Task a2f7934e-fc0f-4276-abc0-1d4d53bf60b2: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
self._validate_config_semantic(self.config)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
result = f(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
"for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.
2020-01-07 15:13:02,872 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a2f7934e-fc0f-4276-abc0-1d4d53bf60b2', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json']
2020-01-07 15:13:04,866 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a2f7934e-fc0f-4276-abc0-1d4d53bf60b2 --out /home/opnfv/functest/results/rally_full/quotas.json
2020-01-07 15:13:04,867 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" Failed.
2020-01-07 15:13:04,867 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml
2020-01-07 15:13:04,867 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist...
2020-01-07 15:13:04,888 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_get_console_url', u'NovaServers.resize_server', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk']
2020-01-07 15:13:04,890 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ...
2020-01-07 15:13:04,890 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': '89a5a689-a184-4936-b66a-c3b0e636677e', 'tenants_amount': 3, 'image_name': 'rally_full-img_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78346a9f-65ab-4661-bcd5-fbe91ce23483', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"]
2020-01-07 15:13:08,066 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 4fb88eec-6c4e-4f45-8f18-0f11e8bef804
2020-01-07 15:13:08,067 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4fb88eec-6c4e-4f45-8f18-0f11e8bef804
2020-01-07 15:13:08,067 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'4fb88eec-6c4e-4f45-8f18-0f11e8bef804']
2020-01-07 15:13:08,856 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4fb88eec-6c4e-4f45-8f18-0f11e8bef804
--------------------------------------------------------------------------------
Task 4fb88eec-6c4e-4f45-8f18-0f11e8bef804: crashed
--------------------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate
self._validate_config_semantic(self.config)
File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper
result = f(self, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic
"for more details." % ", ".join(failed))
ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details.
2020-01-07 15:13:08,857 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'4fb88eec-6c4e-4f45-8f18-0f11e8bef804', '--out', u'/home/opnfv/functest/results/rally_full/swift.json']
2020-01-07 15:13:10,820 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4fb88eec-6c4e-4f45-8f18-0f11e8bef804 --out /home/opnfv/functest/results/rally_full/swift.json
2020-01-07 15:13:10,821 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" Failed.
2020-01-07 15:13:10,825 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report:
+----------------+------------+----------------+-----------+
| Module | Duration | nb. Test Run | Success |
+----------------+------------+----------------+-----------+
| authenticate | 00:00:37 | 60 | 100.00% |
| glance | 00:05:39 | 80 | 100.00% |
| cinder | 00:23:36 | 119 | 98.32% |
| heat | 00:06:26 | 20 | 90.00% |
| keystone | 00:02:15 | 30 | 100.00% |
| neutron | 00:00:00 | 0 | 0.00% |
| nova | 00:00:00 | 0 | 0.00% |
| quotas | 00:00:00 | 0 | 0.00% |
| swift | 00:00:00 | 0 | 0.00% |
| | | | |
| TOTAL: | 00:38:36 | 309 | 98.71% |
+----------------+------------+----------------+-----------+
2020-01-07 15:13:10,826 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.71% in 2/9 modules
2020-01-07 15:13:10,826 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html']
2020-01-07 15:13:13,240 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html
2020-01-07 15:13:13,240 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml']
2020-01-07 15:13:15,606 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml
2020-01-07 15:13:15,606 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+------------------+------------------+----------------+
| rally_full | functest | 41:25 | FAIL |
+--------------------+------------------+------------------+----------------+
2020-01-07 15:13:30,565 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)