2020-03-23 20:46:23,426 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/Y5GPZY733G05/cntt-opnfv-functest-benchmarking-latest-rally_full-run-35 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | Y5GPZY733G05 | | DEBUG | false | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/Y5GPZY733G05/cntt-opnfv-functest-benchmarking-latest-rally_full-run-35 | | NODE_NAME | intel-pod15 | +-------------------------+----------------------------------------------------------------------------------------------------------------+ 2020-03-23 20:46:23,431 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-03-23 20:46:23,431 - xtesting.ci.run_tests - DEBUG - Test args: rally_full 2020-03-23 20:46:23,445 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2020-03-23 20:46:24,223 - functest.core.tenantnetwork - DEBUG - password: [kwy]ff4wBvdJ+}P2=*gFguc^E?p~. 2020-03-23 20:46:24,364 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'50560356d7b14567990459d67b83de61', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_78c3e855-4bea-4272-a41b-fcc798d8e98e'}) 2020-03-23 20:46:24,459 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'795b5314eec64c4885d13064f2d70904', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_78c3e855-4bea-4272-a41b-fcc798d8e98e'}) 2020-03-23 20:46:24,779 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod15', u'key_manager_api_version': u'v1', 'password': '[kwy]ff4wBvdJ+}P2=*gFguc^E?p~.', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'project_id': u'50560356d7b14567990459d67b83de61', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}} 2020-03-23 20:46:24,783 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'password': '[kwy]ff4wBvdJ+}P2=*gFguc^E?p~.', 'project_name': 'rally_full-project_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', 'project_id': '50560356d7b14567990459d67b83de61', 'project_domain_name': 'default'} 2020-03-23 20:46:25,049 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2020-03-23 20:46:25,662 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-03-23T20:46:25Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'9ad39e91-4cad-4615-9f92-9b0a3e42b42f', u'provider:segmentation_id': 26, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'admin_state_up': True, u'tenant_id': u'50560356d7b14567990459d67b83de61', u'created_at': u'2020-03-23T20:46:25Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'50560356d7b14567990459d67b83de61'}) 2020-03-23 20:46:27,041 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-03-23T20:46:26Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'34b05743-c658-41ab-9146-66c339a2dca9', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'enable_dhcp': True, u'network_id': u'9ad39e91-4cad-4615-9f92-9b0a3e42b42f', u'tenant_id': u'50560356d7b14567990459d67b83de61', u'created_at': u'2020-03-23T20:46:26Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'50560356d7b14567990459d67b83de61'}) 2020-03-23 20:46:34,498 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-03-23T20:46:29Z', u'revision_number': 6, u'ha': True, u'id': u'c9c1e30f-22be-432e-8521-f4a30cca52e9', u'external_gateway_info': {u'network_id': u'19581490-592b-4cb9-a835-e81e753c8ed6', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'102f5c91-f666-4137-82a1-7c217ade4a57', u'ip_address': u'10.10.155.32'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'admin_state_up': True, u'tenant_id': u'50560356d7b14567990459d67b83de61', u'created_at': u'2020-03-23T20:46:28Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'50560356d7b14567990459d67b83de61'}) 2020-03-23 20:46:38,472 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/c56e322f-f3e4-4dd7-8da6-a4e2a5522f34/file', 'owner': u'50560356d7b14567990459d67b83de61', 'id': u'c56e322f-f3e4-4dd7-8da6-a4e2a5522f34', 'size': 12716032, u'self': u'/v2/images/c56e322f-f3e4-4dd7-8da6-a4e2a5522f34', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'50560356d7b14567990459d67b83de61', 'name': 'rally_full-project_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-03-23T20:46:38Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-03-23T20:46:38Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/c56e322f-f3e4-4dd7-8da6-a4e2a5522f34', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'created': u'2020-03-23T20:46:37Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-03-23T20:46:37Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/c56e322f-f3e4-4dd7-8da6-a4e2a5522f34', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}}) 2020-03-23 20:46:38,573 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'3448df21939b47fb94a5d30e6c26fa15', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'bdd7b82b-8028-4ccd-a1b4-4ade19cc4605', 'swap': 0}) 2020-03-23 20:46:38,632 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-03-23 20:46:43,431 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 4b6c8112-a3eb-47cd-a80d-6b3eeff8fba6 | 2020-03-23T20:46:43.285649 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 4b6c8112-a3eb-47cd-a80d-6b3eeff8fba6 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-03-23 20:46:46,125 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-03-23 20:46:47,125 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-03-23 20:46:47,415 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'3448df21939b47fb94a5d30e6c26fa15', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'514e898a-2ada-4c8d-bccd-2ce78801d592', 'swap': 0}) 2020-03-23 20:46:47,491 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'3448df21939b47fb94a5d30e6c26fa15', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'514e898a-2ada-4c8d-bccd-2ce78801d592', 'swap': 0}) 2020-03-23 20:46:47,491 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2020-03-23 20:46:47,491 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 20:46:47,515 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 20:46:47,516 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-03-23 20:46:47,516 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 20:48:21,594 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 2020-03-23 20:48:21,595 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 2020-03-23 20:48:21,595 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'7adb71eb-3541-499f-9e3c-5acd4e3d81f9'] 2020-03-23 20:48:22,630 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.166 | 0.329 | 0.626 | 1.74 | 2.854 | 0.564 | 100.0% | 10 | | total | 0.166 | 0.329 | 0.626 | 1.74 | 2.854 | 0.564 | 100.0% | 10 | | -> duration | 0.166 | 0.329 | 0.626 | 1.74 | 2.854 | 0.564 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.4668 Full duration: 11.936585 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.15 | 0.24 | 2.24 | 2.286 | 2.332 | 1.008 | 100.0% | 10 | | total | 0.239 | 0.401 | 2.52 | 2.641 | 2.762 | 1.208 | 100.0% | 10 | | -> duration | 0.239 | 0.401 | 2.52 | 2.641 | 2.762 | 1.208 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.186897 Full duration: 12.947896 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.226 | 0.293 | 0.57 | 0.57 | 0.571 | 0.353 | 100.0% | 10 | | total | 0.304 | 0.562 | 0.763 | 0.776 | 0.788 | 0.571 | 100.0% | 10 | | -> duration | 0.304 | 0.562 | 0.763 | 0.776 | 0.788 | 0.571 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.588358 Full duration: 9.316206 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.155 | 0.178 | 0.56 | 0.578 | 0.595 | 0.279 | 100.0% | 10 | | total | 0.252 | 0.389 | 0.804 | 0.807 | 0.811 | 0.484 | 100.0% | 10 | | -> duration | 0.252 | 0.389 | 0.804 | 0.807 | 0.811 | 0.484 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.260379 Full duration: 20.183618 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.371 | 0.46 | 0.614 | 0.636 | 0.658 | 0.502 | 100.0% | 10 | | total | 0.468 | 0.699 | 0.806 | 0.811 | 0.816 | 0.673 | 100.0% | 10 | | -> duration | 0.468 | 0.699 | 0.806 | 0.811 | 0.816 | 0.673 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.911679 Full duration: 11.709222 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.188 | 0.285 | 0.445 | 0.502 | 0.56 | 0.318 | 100.0% | 10 | | total | 0.33 | 0.528 | 0.645 | 0.738 | 0.831 | 0.525 | 100.0% | 10 | | -> duration | 0.33 | 0.528 | 0.645 | 0.738 | 0.831 | 0.525 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.464532 Full duration: 11.919845 HINTS: * To plot HTML graphics with this data, run: rally task report 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 --out output.html * To generate a JUnit report, run: rally task export 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 --json --out output.json 2020-03-23 20:48:22,630 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'7adb71eb-3541-499f-9e3c-5acd4e3d81f9', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json'] 2020-03-23 20:48:24,846 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7adb71eb-3541-499f-9e3c-5acd4e3d81f9 --out /home/opnfv/functest/results/rally_full/authenticate.json 2020-03-23 20:48:24,859 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-03-23 20:48:24,859 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml 2020-03-23 20:48:24,860 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 20:48:24,882 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 20:48:24,882 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-03-23 20:48:24,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 20:58:50,914 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 8bccab72-e5f1-48af-b5c7-d6d422c65549 2020-03-23 20:58:50,914 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 8bccab72-e5f1-48af-b5c7-d6d422c65549 2020-03-23 20:58:50,914 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'8bccab72-e5f1-48af-b5c7-d6d422c65549'] 2020-03-23 20:58:51,693 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8bccab72-e5f1-48af-b5c7-d6d422c65549 -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.391 | 3.845 | 4.517 | 4.533 | 4.549 | 3.915 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.099 | 0.125 | 0.139 | 0.142 | 0.144 | 0.124 | 100.0% | 10 | | -> glance_v2.upload_data | 0.926 | 1.356 | 2.08 | 2.081 | 2.082 | 1.437 | 100.0% | 10 | | glance_v2.delete_image | 0.563 | 0.749 | 0.944 | 1.465 | 1.985 | 0.827 | 100.0% | 10 | | total | 4.118 | 4.576 | 5.422 | 5.76 | 6.098 | 4.742 | 100.0% | 10 | | -> duration | 4.118 | 4.576 | 5.422 | 5.76 | 6.098 | 4.742 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.408479 Full duration: 22.89212 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.3 | 3.686 | 4.117 | 4.398 | 4.679 | 3.736 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.102 | 0.108 | 0.135 | 0.135 | 0.136 | 0.113 | 100.0% | 10 | | -> glance_v2.upload_data | 0.881 | 1.096 | 1.617 | 1.902 | 2.188 | 1.263 | 100.0% | 10 | | glance_v2.list_images | 0.052 | 0.061 | 0.072 | 0.074 | 0.077 | 0.063 | 100.0% | 10 | | total | 3.36 | 3.751 | 4.183 | 4.466 | 4.749 | 3.799 | 100.0% | 10 | | -> duration | 3.36 | 3.751 | 4.183 | 4.466 | 4.749 | 3.799 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.026018 Full duration: 33.762202 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.144 | 0.216 | 0.27 | 0.284 | 0.297 | 0.211 | 100.0% | 10 | | total | 0.145 | 0.216 | 0.27 | 0.284 | 0.298 | 0.211 | 100.0% | 10 | | -> duration | 0.145 | 0.216 | 0.27 | 0.284 | 0.298 | 0.211 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.137517 Full duration: 22.526411 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.231 | 4.116 | 5.059 | 6.417 | 7.774 | 4.326 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.09 | 0.114 | 0.161 | 0.168 | 0.174 | 0.12 | 100.0% | 10 | | -> glance_v2.upload_data | 0.82 | 1.532 | 2.047 | 2.256 | 2.464 | 1.486 | 100.0% | 10 | | nova.boot_servers | 39.704 | 51.657 | 60.361 | 61.606 | 62.85 | 50.966 | 100.0% | 10 | | total | 42.936 | 55.85 | 66.441 | 67.151 | 67.86 | 55.293 | 100.0% | 10 | | -> duration | 41.936 | 54.85 | 65.441 | 66.151 | 66.86 | 54.293 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 157.887259 Full duration: 247.616307 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.198 | 3.596 | 16.12 | 18.914 | 21.707 | 6.529 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.099 | 0.109 | 0.156 | 0.177 | 0.198 | 0.12 | 100.0% | 10 | | -> glance_v2.upload_data | 0.86 | 1.153 | 13.701 | 16.428 | 19.154 | 4.092 | 100.0% | 10 | | glance_v2.deactivate_image | 0.104 | 0.137 | 0.249 | 0.57 | 0.89 | 0.214 | 100.0% | 10 | | total | 3.302 | 3.764 | 16.259 | 19.05 | 21.841 | 6.743 | 100.0% | 10 | | -> duration | 3.302 | 3.764 | 16.259 | 19.05 | 21.841 | 6.743 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.842236 Full duration: 54.014706 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_download_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.22 | 3.606 | 3.967 | 4.326 | 4.685 | 3.692 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.098 | 0.105 | 0.125 | 0.132 | 0.138 | 0.111 | 100.0% | 10 | | -> glance_v2.upload_data | 0.864 | 1.136 | 1.559 | 1.907 | 2.255 | 1.236 | 100.0% | 10 | | glance_v2.download_image | 0.273 | 0.31 | 0.333 | 0.351 | 0.368 | 0.308 | 100.0% | 10 | | total | 3.514 | 3.929 | 4.327 | 4.649 | 4.971 | 4.0 | 100.0% | 10 | | -> duration | 3.514 | 3.929 | 4.327 | 4.649 | 4.971 | 4.0 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.514197 Full duration: 86.179659 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_get_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.517 | 4.381 | 13.215 | 15.977 | 18.738 | 6.532 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.1 | 0.116 | 0.127 | 0.128 | 0.128 | 0.116 | 100.0% | 10 | | -> glance_v2.upload_data | 1.048 | 2.031 | 10.846 | 13.605 | 16.363 | 4.099 | 100.0% | 10 | | glance_v2.get_image | 0.032 | 0.043 | 0.131 | 0.134 | 0.137 | 0.059 | 100.0% | 10 | | total | 3.553 | 4.429 | 13.259 | 16.02 | 18.781 | 6.592 | 100.0% | 10 | | -> duration | 3.553 | 4.429 | 13.259 | 16.02 | 18.781 | 6.592 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.888455 Full duration: 58.416356 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_update_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8bccab72-e5f1-48af-b5c7-d6d422c65549 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.333 | 3.503 | 4.117 | 4.226 | 4.334 | 3.632 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.103 | 0.119 | 0.139 | 0.149 | 0.159 | 0.124 | 100.0% | 10 | | -> glance_v2.upload_data | 0.909 | 1.088 | 1.583 | 1.585 | 1.586 | 1.174 | 100.0% | 10 | | glance_v2.update_image | 0.235 | 0.256 | 0.359 | 0.417 | 0.475 | 0.297 | 100.0% | 10 | | total | 3.613 | 3.748 | 4.464 | 4.572 | 4.68 | 3.93 | 100.0% | 10 | | -> duration | 3.613 | 3.748 | 4.464 | 4.572 | 4.68 | 3.93 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.250631 Full duration: 83.96399 HINTS: * To plot HTML graphics with this data, run: rally task report 8bccab72-e5f1-48af-b5c7-d6d422c65549 --out output.html * To generate a JUnit report, run: rally task export 8bccab72-e5f1-48af-b5c7-d6d422c65549 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8bccab72-e5f1-48af-b5c7-d6d422c65549 --json --out output.json 2020-03-23 20:58:51,694 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'8bccab72-e5f1-48af-b5c7-d6d422c65549', '--out', u'/home/opnfv/functest/results/rally_full/glance.json'] 2020-03-23 20:58:53,650 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8bccab72-e5f1-48af-b5c7-d6d422c65549 --out /home/opnfv/functest/results/rally_full/glance.json 2020-03-23 20:58:53,680 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-03-23 20:58:53,681 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml 2020-03-23 20:58:53,681 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 20:58:53,700 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 20:58:53,701 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-03-23 20:58:53,701 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 20:58:57,664 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 4471f4d0-834a-44c1-929e-80d3959393b9 2020-03-23 20:58:57,664 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 4471f4d0-834a-44c1-929e-80d3959393b9 2020-03-23 20:58:57,664 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'4471f4d0-834a-44c1-929e-80d3959393b9'] 2020-03-23 20:58:58,670 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4471f4d0-834a-44c1-929e-80d3959393b9 -------------------------------------------------------------------------------- Task 4471f4d0-834a-44c1-929e-80d3959393b9: crashed -------------------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 394, in validate self._validate_config_semantic(self.config) File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 248, in wrapper result = f(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/engine.py", line 364, in _validate_config_semantic "for more details." % ", ".join(failed)) ValidationError: Validation error: One or several platforms are not available: existing@openstack. Check logs for more details. 2020-03-23 20:58:58,671 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'4471f4d0-834a-44c1-929e-80d3959393b9', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json'] 2020-03-23 20:59:00,590 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4471f4d0-834a-44c1-929e-80d3959393b9 --out /home/opnfv/functest/results/rally_full/cinder.json 2020-03-23 20:59:00,591 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" Failed. 2020-03-23 20:59:00,591 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml 2020-03-23 20:59:00,591 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 20:59:00,615 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 20:59:00,615 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-03-23 20:59:00,616 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 21:28:23,515 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 537178fe-596f-43ac-b796-004b20c57d8d 2020-03-23 21:28:23,515 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 537178fe-596f-43ac-b796-004b20c57d8d 2020-03-23 21:28:23,515 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'537178fe-596f-43ac-b796-004b20c57d8d'] 2020-03-23 21:28:24,577 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 537178fe-596f-43ac-b796-004b20c57d8d -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.394 | 15.392 | 16.795 | 16.843 | 16.892 | 13.988 | 100.0% | 10 | | heat.delete_stack | 1.235 | 2.333 | 2.521 | 3.004 | 3.486 | 2.236 | 100.0% | 10 | | total | 8.631 | 17.729 | 19.127 | 19.217 | 19.306 | 16.225 | 100.0% | 10 | | -> duration | 6.631 | 15.729 | 17.127 | 17.217 | 17.306 | 14.225 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.385671 Full duration: 104.337976 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template", "parameters": { "image": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e", "public_net": "public", "flavor": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 43.43 | 75.363 | 190.886 | 211.574 | 232.262 | 107.385 | 100.0% | 10 | | heat.delete_stack | 13.365 | 19.84 | 51.946 | 54.2 | 56.454 | 29.275 | 100.0% | 10 | | total | 61.19 | 117.03 | 207.438 | 237.936 | 268.434 | 136.66 | 100.0% | 10 | | -> duration | 59.19 | 115.03 | 205.438 | 235.936 | 266.434 | 134.66 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 365.113711 Full duration: 380.767062 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_volume.yaml.template", "parameters": { "network_id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f", "image": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e", "flavor": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 43.198 | 78.35 | 168.477 | 209.417 | 250.357 | 100.814 | 100.0% | 10 | | heat.delete_stack | 12.195 | 31.938 | 69.304 | 129.036 | 188.769 | 44.963 | 100.0% | 10 | | total | 58.684 | 125.128 | 270.487 | 279.121 | 287.755 | 145.777 | 100.0% | 10 | | -> duration | 56.684 | 123.128 | 268.487 | 277.121 | 285.755 | 143.777 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 395.093775 Full duration: 409.220554 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.211 | 4.672 | 27.956 | 28.432 | 28.907 | 10.301 | 100.0% | 10 | | heat.list_stacks | 0.05 | 0.068 | 0.082 | 0.082 | 0.083 | 0.068 | 100.0% | 10 | | total | 3.262 | 4.729 | 28.022 | 28.502 | 28.982 | 10.369 | 100.0% | 10 | | -> duration | 1.262 | 2.729 | 26.022 | 26.502 | 26.982 | 8.369 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.66112 Full duration: 59.427062 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 9.66 | 11.721 | 13.99 | 14.614 | 15.238 | 11.902 | 100.0% | 10 | | heat.update_stack | 5.724 | 8.676 | 13.415 | 13.433 | 13.451 | 9.369 | 100.0% | 10 | | heat.delete_stack | 4.544 | 8.944 | 11.232 | 11.717 | 12.203 | 8.711 | 100.0% | 10 | | total | 19.96 | 31.576 | 33.252 | 35.609 | 37.966 | 29.982 | 100.0% | 10 | | -> duration | 15.96 | 27.576 | 29.252 | 31.609 | 33.966 | 25.982 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.449009 Full duration: 98.146539 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.42 | 9.468 | 13.241 | 13.778 | 14.315 | 10.54 | 100.0% | 10 | | heat.update_stack | 4.755 | 6.204 | 9.254 | 9.704 | 10.153 | 6.835 | 100.0% | 10 | | heat.delete_stack | 1.251 | 3.473 | 6.854 | 7.379 | 7.904 | 4.111 | 100.0% | 10 | | total | 16.663 | 20.878 | 29.83 | 29.921 | 30.012 | 21.486 | 100.0% | 10 | | -> duration | 12.663 | 16.878 | 25.83 | 25.921 | 26.012 | 17.486 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 55.866503 Full duration: 74.25109 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 13.91 | 15.657 | 18.002 | 18.782 | 19.562 | 16.109 | 100.0% | 10 | | heat.update_stack | 8.169 | 13.158 | 15.761 | 15.781 | 15.8 | 12.566 | 100.0% | 10 | | heat.delete_stack | 8.887 | 13.393 | 15.471 | 15.475 | 15.479 | 12.887 | 100.0% | 10 | | total | 30.967 | 43.278 | 47.671 | 48.144 | 48.617 | 41.562 | 100.0% | 10 | | -> duration | 26.967 | 39.278 | 43.671 | 44.144 | 44.617 | 37.562 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 114.845466 Full duration: 142.036557 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.97 | 13.224 | 16.472 | 19.845 | 23.218 | 13.658 | 100.0% | 10 | | heat.update_stack | 6.156 | 9.864 | 15.04 | 16.188 | 17.337 | 10.457 | 100.0% | 10 | | heat.delete_stack | 7.823 | 10.552 | 16.631 | 16.634 | 16.638 | 11.441 | 100.0% | 10 | | total | 28.915 | 33.64 | 42.145 | 46.371 | 50.597 | 35.556 | 100.0% | 10 | | -> duration | 24.915 | 29.64 | 38.145 | 42.371 | 46.597 | 31.556 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 96.810537 Full duration: 112.601823 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.557 | 13.408 | 18.701 | 18.785 | 18.869 | 13.9 | 100.0% | 10 | | heat.update_stack | 5.61 | 8.284 | 9.249 | 9.358 | 9.466 | 7.905 | 100.0% | 10 | | heat.delete_stack | 2.354 | 7.284 | 10.022 | 10.057 | 10.092 | 6.748 | 100.0% | 10 | | total | 17.749 | 29.539 | 35.08 | 35.388 | 35.695 | 28.553 | 100.0% | 10 | | -> duration | 13.749 | 25.539 | 31.08 | 31.388 | 31.695 | 24.553 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 75.267611 Full duration: 104.498331 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.11 | 12.681 | 15.365 | 15.482 | 15.6 | 11.554 | 100.0% | 10 | | heat.update_stack | 6.892 | 8.232 | 13.358 | 13.392 | 13.425 | 9.794 | 100.0% | 10 | | heat.delete_stack | 4.545 | 8.375 | 10.026 | 10.028 | 10.03 | 7.728 | 100.0% | 10 | | total | 20.123 | 26.509 | 36.998 | 37.312 | 37.627 | 29.076 | 100.0% | 10 | | -> duration | 16.123 | 22.509 | 32.998 | 33.312 | 33.627 | 25.076 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.080714 Full duration: 99.070297 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.318 | 8.121 | 11.13 | 11.258 | 11.386 | 8.699 | 100.0% | 10 | | heat.check_stack | 1.42 | 2.496 | 2.593 | 2.612 | 2.63 | 2.409 | 100.0% | 10 | | heat.delete_stack | 3.44 | 5.63 | 5.775 | 6.278 | 6.781 | 5.1 | 100.0% | 10 | | total | 13.52 | 16.229 | 17.738 | 17.76 | 17.783 | 16.209 | 100.0% | 10 | | -> duration | 11.52 | 14.229 | 15.738 | 15.76 | 15.783 | 14.209 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.371222 Full duration: 60.271272 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.919 | 9.311 | 11.441 | 11.542 | 11.643 | 8.428 | 100.0% | 10 | | heat.suspend_stack | 1.327 | 2.484 | 2.543 | 2.57 | 2.598 | 2.179 | 100.0% | 10 | | heat.resume_stack | 2.504 | 2.575 | 3.602 | 3.668 | 3.734 | 2.849 | 100.0% | 10 | | heat.delete_stack | 3.429 | 3.439 | 4.547 | 4.549 | 4.551 | 3.776 | 100.0% | 10 | | total | 13.716 | 18.29 | 19.442 | 19.682 | 19.921 | 17.232 | 100.0% | 10 | | -> duration | 11.716 | 16.29 | 17.442 | 17.682 | 17.921 | 15.232 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.397379 Full duration: 60.875594 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 537178fe-596f-43ac-b796-004b20c57d8d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.209 | 0.315 | 0.495 | 0.512 | 0.528 | 0.351 | 100.0% | 10 | | total | 0.209 | 0.315 | 0.495 | 0.512 | 0.529 | 0.351 | 100.0% | 10 | | -> duration | 0.209 | 0.315 | 0.495 | 0.512 | 0.529 | 0.351 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.013601 Full duration: 20.467291 HINTS: * To plot HTML graphics with this data, run: rally task report 537178fe-596f-43ac-b796-004b20c57d8d --out output.html * To generate a JUnit report, run: rally task export 537178fe-596f-43ac-b796-004b20c57d8d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 537178fe-596f-43ac-b796-004b20c57d8d --json --out output.json 2020-03-23 21:28:24,578 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'537178fe-596f-43ac-b796-004b20c57d8d', '--out', u'/home/opnfv/functest/results/rally_full/heat.json'] 2020-03-23 21:28:26,586 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 537178fe-596f-43ac-b796-004b20c57d8d --out /home/opnfv/functest/results/rally_full/heat.json 2020-03-23 21:28:26,622 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-03-23 21:28:26,623 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2020-03-23 21:28:26,623 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 21:28:26,642 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 21:28:26,642 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-03-23 21:28:26,642 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 21:32:40,924 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: acc6f118-d6f2-4da8-863b-ca155849704a 2020-03-23 21:32:40,924 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : acc6f118-d6f2-4da8-863b-ca155849704a 2020-03-23 21:32:40,924 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'acc6f118-d6f2-4da8-863b-ca155849704a'] 2020-03-23 21:32:42,024 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid acc6f118-d6f2-4da8-863b-ca155849704a -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.061 | 0.141 | 0.297 | 0.624 | 0.951 | 0.226 | 100.0% | 10 | | keystone_v3.add_role | 0.052 | 0.157 | 0.4 | 0.651 | 0.901 | 0.225 | 100.0% | 10 | | keystone_v3.revoke_role | 0.058 | 0.172 | 0.333 | 0.352 | 0.371 | 0.183 | 100.0% | 10 | | total | 0.274 | 0.448 | 1.308 | 1.38 | 1.453 | 0.634 | 100.0% | 10 | | -> duration | 0.274 | 0.448 | 1.308 | 1.38 | 1.453 | 0.634 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.734659 Full duration: 23.208446 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.048 | 0.317 | 1.316 | 1.332 | 1.347 | 0.538 | 100.0% | 10 | | keystone_v3.add_role | 0.048 | 0.136 | 0.419 | 0.785 | 1.152 | 0.274 | 100.0% | 10 | | keystone_v3.list_roles | 0.027 | 0.035 | 0.051 | 0.092 | 0.134 | 0.043 | 100.0% | 10 | | total | 0.136 | 0.542 | 1.691 | 1.705 | 1.719 | 0.855 | 100.0% | 10 | | -> duration | 0.136 | 0.542 | 1.691 | 1.705 | 1.719 | 0.855 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.375071 Full duration: 16.978957 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.126 | 0.282 | 0.64 | 0.677 | 0.714 | 0.373 | 100.0% | 10 | | keystone_v3.list_projects | 0.028 | 0.033 | 0.083 | 0.091 | 0.098 | 0.048 | 100.0% | 10 | | total | 0.161 | 0.368 | 0.716 | 0.731 | 0.745 | 0.422 | 100.0% | 10 | | -> duration | 0.161 | 0.368 | 0.716 | 0.731 | 0.745 | 0.422 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.369975 Full duration: 16.438124 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.067 | 0.24 | 0.474 | 0.535 | 0.597 | 0.288 | 100.0% | 10 | | keystone_v3.delete_role | 0.086 | 0.35 | 2.558 | 2.587 | 2.616 | 1.109 | 100.0% | 10 | | total | 0.24 | 0.706 | 3.01 | 3.043 | 3.076 | 1.397 | 100.0% | 10 | | -> duration | 0.24 | 0.706 | 3.01 | 3.043 | 3.076 | 1.397 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.213837 Full duration: 18.803768 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.05 | 0.142 | 0.27 | 0.291 | 0.312 | 0.164 | 100.0% | 10 | | keystone_v3.delete_service | 0.079 | 0.212 | 0.306 | 0.32 | 0.334 | 0.217 | 100.0% | 10 | | total | 0.129 | 0.402 | 0.467 | 0.541 | 0.615 | 0.382 | 100.0% | 10 | | -> duration | 0.129 | 0.402 | 0.467 | 0.541 | 0.615 | 0.382 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.367531 Full duration: 9.684229 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.113 | 0.181 | 0.328 | 0.334 | 0.341 | 0.208 | 100.0% | 10 | | keystone_v3.create_user | 0.226 | 0.342 | 0.396 | 0.409 | 0.423 | 0.337 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.025 | 0.032 | 0.069 | 0.072 | 0.075 | 0.04 | 100.0% | 10 | | -> keystone_v3.add_role | 0.067 | 0.093 | 0.142 | 0.151 | 0.161 | 0.104 | 100.0% | 10 | | keystone_v3.create_role | 0.039 | 0.088 | 0.118 | 0.128 | 0.139 | 0.085 | 100.0% | 10 | | keystone_v3.get_project | 0.021 | 0.026 | 0.029 | 0.03 | 0.031 | 0.026 | 100.0% | 10 | | keystone_v3.get_user | 0.021 | 0.022 | 0.028 | 0.029 | 0.03 | 0.024 | 100.0% | 10 | | keystone_v3.get_role | 0.02 | 0.025 | 0.038 | 0.044 | 0.05 | 0.028 | 100.0% | 10 | | keystone_v3.list_services | 0.02 | 0.03 | 0.037 | 0.039 | 0.04 | 0.031 | 100.0% | 10 | | keystone_v3.get_services | 0.019 | 0.023 | 0.033 | 0.052 | 0.072 | 0.029 | 100.0% | 10 | | total | 0.661 | 0.799 | 0.88 | 0.881 | 0.883 | 0.791 | 100.0% | 10 | | -> duration | 0.661 | 0.799 | 0.88 | 0.881 | 0.883 | 0.791 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.636348 Full duration: 21.309489 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.168 | 0.377 | 0.668 | 0.68 | 0.691 | 0.437 | 100.0% | 10 | | keystone_v3.update_project | 0.106 | 0.187 | 0.656 | 1.17 | 1.684 | 0.359 | 100.0% | 10 | | keystone_v3.delete_project | 0.261 | 0.344 | 1.084 | 1.222 | 1.359 | 0.542 | 100.0% | 10 | | total | 0.812 | 1.104 | 2.268 | 2.367 | 2.466 | 1.339 | 100.0% | 10 | | -> duration | 0.812 | 1.104 | 2.268 | 2.367 | 2.466 | 1.339 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.382308 Full duration: 12.775777 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.125 | 0.194 | 0.236 | 0.267 | 0.299 | 0.193 | 100.0% | 10 | | total | 0.179 | 0.248 | 0.304 | 0.328 | 0.352 | 0.248 | 100.0% | 10 | | -> duration | 0.179 | 0.248 | 0.304 | 0.328 | 0.352 | 0.248 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.609227 Full duration: 26.847565 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.111 | 0.142 | 0.295 | 0.354 | 0.413 | 0.188 | 100.0% | 10 | | total | 0.111 | 0.142 | 0.295 | 0.354 | 0.414 | 0.188 | 100.0% | 10 | | -> duration | 0.111 | 0.142 | 0.295 | 0.354 | 0.414 | 0.188 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.283551 Full duration: 8.688562 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.118 | 0.212 | 0.372 | 0.466 | 0.559 | 0.257 | 100.0% | 10 | | keystone_v3.list_users | 0.058 | 0.066 | 0.128 | 0.159 | 0.19 | 0.086 | 100.0% | 10 | | total | 0.243 | 0.357 | 0.602 | 0.659 | 0.716 | 0.405 | 100.0% | 10 | | -> duration | 0.243 | 0.357 | 0.602 | 0.659 | 0.716 | 0.405 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.069312 Full duration: 20.758866 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task acc6f118-d6f2-4da8-863b-ca155849704a has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.104 | 0.17 | 0.29 | 0.29 | 0.29 | 0.18 | 100.0% | 10 | | keystone_v3.create_users | 4.112 | 4.349 | 8.346 | 8.356 | 8.366 | 5.748 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 4.112 | 4.349 | 8.346 | 8.355 | 8.365 | 5.747 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.266 | 0.296 | 1.149 | 2.225 | 3.302 | 0.723 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 1.079 | 1.687 | 5.117 | 5.247 | 5.378 | 2.332 | 100.0% | 10 | | total | 4.563 | 4.91 | 8.884 | 8.917 | 8.951 | 6.4 | 100.0% | 10 | | -> duration | 4.563 | 4.91 | 8.884 | 8.917 | 8.951 | 6.4 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.294026 Full duration: 56.875341 HINTS: * To plot HTML graphics with this data, run: rally task report acc6f118-d6f2-4da8-863b-ca155849704a --out output.html * To generate a JUnit report, run: rally task export acc6f118-d6f2-4da8-863b-ca155849704a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report acc6f118-d6f2-4da8-863b-ca155849704a --json --out output.json 2020-03-23 21:32:42,024 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'acc6f118-d6f2-4da8-863b-ca155849704a', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json'] 2020-03-23 21:32:44,307 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid acc6f118-d6f2-4da8-863b-ca155849704a --out /home/opnfv/functest/results/rally_full/keystone.json 2020-03-23 21:32:44,347 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-03-23 21:32:44,347 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml 2020-03-23 21:32:44,348 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 21:32:44,366 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 21:32:44,367 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-03-23 21:32:44,367 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 21:45:18,946 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 5ed25693-8353-4051-ba41-bb2a338a3e6b 2020-03-23 21:45:18,947 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 5ed25693-8353-4051-ba41-bb2a338a3e6b 2020-03-23 21:45:18,947 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'5ed25693-8353-4051-ba41-bb2a338a3e6b'] 2020-03-23 21:45:20,033 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5ed25693-8353-4051-ba41-bb2a338a3e6b -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.558 | 0.727 | 1.109 | 1.255 | 1.401 | 0.831 | 100.0% | 10 | | neutron.update_network | 0.672 | 0.832 | 1.032 | 1.063 | 1.095 | 0.855 | 100.0% | 10 | | total | 1.291 | 1.567 | 2.197 | 2.312 | 2.426 | 1.685 | 100.0% | 10 | | -> duration | 1.291 | 1.567 | 2.197 | 2.312 | 2.426 | 1.685 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.030405 Full duration: 25.275365 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.158 | 1.44 | 3.258 | 4.199 | 5.139 | 1.93 | 100.0% | 10 | | neutron.update_port | 0.535 | 0.656 | 1.22 | 1.224 | 1.228 | 0.775 | 100.0% | 10 | | total | 1.723 | 2.076 | 4.478 | 5.423 | 6.367 | 2.706 | 100.0% | 10 | | -> duration | 1.723 | 2.076 | 4.478 | 5.423 | 6.367 | 2.706 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.937786 Full duration: 49.439787 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.483 | 0.792 | 0.898 | 0.983 | 1.069 | 0.768 | 100.0% | 10 | | neutron.create_subnet | 0.955 | 1.169 | 2.015 | 2.042 | 2.068 | 1.343 | 100.0% | 10 | | neutron.create_router | 4.537 | 6.167 | 7.94 | 8.51 | 9.079 | 6.375 | 100.0% | 10 | | neutron.add_interface_router | 2.211 | 2.724 | 4.39 | 4.413 | 4.435 | 3.037 | 100.0% | 10 | | neutron.update_router | 0.508 | 0.672 | 1.168 | 1.324 | 1.48 | 0.764 | 100.0% | 10 | | total | 9.308 | 11.203 | 15.996 | 16.521 | 17.047 | 12.288 | 100.0% | 10 | | -> duration | 9.308 | 11.203 | 15.996 | 16.521 | 17.047 | 12.288 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.247972 Full duration: 74.30765 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.4.0.0/16", "subnet_update_args": { "enable_dhcp": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.531 | 0.74 | 1.095 | 1.254 | 1.413 | 0.83 | 100.0% | 10 | | neutron.create_subnet | 0.894 | 1.337 | 2.13 | 2.139 | 2.149 | 1.453 | 100.0% | 10 | | neutron.update_subnet | 0.629 | 0.888 | 1.097 | 1.158 | 1.219 | 0.903 | 100.0% | 10 | | total | 2.36 | 2.958 | 4.212 | 4.309 | 4.406 | 3.186 | 100.0% | 10 | | -> duration | 2.36 | 2.958 | 4.212 | 4.309 | 4.406 | 3.186 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.065017 Full duration: 44.993522 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.573 | 0.909 | 1.204 | 1.436 | 1.667 | 0.948 | 100.0% | 10 | | neutron.delete_network | 0.676 | 0.931 | 1.054 | 1.059 | 1.063 | 0.911 | 100.0% | 10 | | total | 1.568 | 1.795 | 2.076 | 2.323 | 2.57 | 1.859 | 100.0% | 10 | | -> duration | 1.568 | 1.795 | 2.076 | 2.323 | 2.57 | 1.859 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.354225 Full duration: 26.108543 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.714 | 1.946 | 2.968 | 3.019 | 3.071 | 2.117 | 100.0% | 10 | | neutron.delete_port | 0.752 | 0.862 | 1.323 | 1.337 | 1.351 | 0.946 | 100.0% | 10 | | total | 2.522 | 2.805 | 4.291 | 4.356 | 4.422 | 3.063 | 100.0% | 10 | | -> duration | 2.522 | 2.805 | 4.291 | 4.356 | 4.422 | 3.063 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.742804 Full duration: 68.620688 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.613 | 0.897 | 1.167 | 1.227 | 1.286 | 0.893 | 100.0% | 10 | | neutron.create_subnet | 0.973 | 1.578 | 1.945 | 2.421 | 2.897 | 1.557 | 100.0% | 10 | | neutron.create_router | 2.562 | 6.386 | 11.332 | 11.502 | 11.672 | 7.079 | 100.0% | 10 | | neutron.add_interface_router | 2.159 | 2.849 | 4.301 | 4.539 | 4.778 | 3.14 | 100.0% | 10 | | neutron.remove_interface_router | 1.474 | 2.302 | 3.058 | 3.503 | 3.948 | 2.353 | 100.0% | 10 | | neutron.delete_router | 0.462 | 3.488 | 6.499 | 6.578 | 6.657 | 3.816 | 100.0% | 10 | | total | 10.437 | 17.125 | 25.655 | 27.148 | 28.641 | 18.838 | 100.0% | 10 | | -> duration | 10.437 | 17.125 | 25.655 | 27.148 | 28.641 | 18.838 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 55.249691 Full duration: 124.140693 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 0.999 | 1.462 | 3.437 | 3.598 | 3.76 | 2.086 | 100.0% | 10 | | neutron.delete_subnet | 0.61 | 0.989 | 1.758 | 2.412 | 3.065 | 1.257 | 100.0% | 10 | | total | 1.642 | 3.543 | 4.776 | 4.895 | 5.015 | 3.343 | 100.0% | 10 | | -> duration | 1.642 | 3.543 | 4.776 | 4.895 | 5.015 | 3.343 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.425391 Full duration: 44.152737 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.418 | 0.645 | 0.977 | 0.985 | 0.994 | 0.664 | 100.0% | 10 | | neutron.list_networks | 0.144 | 0.181 | 0.343 | 0.347 | 0.351 | 0.212 | 100.0% | 10 | | total | 0.599 | 0.851 | 1.153 | 1.183 | 1.213 | 0.876 | 100.0% | 10 | | -> duration | 0.599 | 0.851 | 1.153 | 1.183 | 1.213 | 0.876 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.438438 Full duration: 69.437461 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.406 | 2.868 | 3.461 | 4.911 | 6.361 | 3.057 | 100.0% | 10 | | neutron.list_ports | 0.093 | 0.113 | 0.316 | 0.339 | 0.361 | 0.154 | 100.0% | 10 | | total | 1.522 | 2.997 | 3.572 | 5.013 | 6.455 | 3.212 | 100.0% | 10 | | -> duration | 1.522 | 2.997 | 3.572 | 5.013 | 6.455 | 3.212 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.268526 Full duration: 67.727866 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.584 | 0.849 | 1.445 | 1.48 | 1.515 | 0.946 | 100.0% | 10 | | neutron.create_subnet | 1.045 | 1.186 | 2.2 | 2.248 | 2.297 | 1.419 | 100.0% | 10 | | neutron.create_router | 5.494 | 6.173 | 6.561 | 7.083 | 7.605 | 6.17 | 100.0% | 10 | | neutron.add_interface_router | 2.153 | 2.575 | 3.297 | 3.384 | 3.472 | 2.658 | 100.0% | 10 | | neutron.list_routers | 0.091 | 0.12 | 0.299 | 0.419 | 0.539 | 0.173 | 100.0% | 10 | | total | 9.915 | 11.052 | 12.675 | 12.934 | 13.193 | 11.365 | 100.0% | 10 | | -> duration | 9.915 | 11.052 | 12.675 | 12.934 | 13.193 | 11.365 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.722457 Full duration: 123.844002 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.062513 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.058093 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.063846 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.058821 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.062269 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.058611 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "router": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "ports_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.060563 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.05894 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5ed25693-8353-4051-ba41-bb2a338a3e6b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.062674 HINTS: * To plot HTML graphics with this data, run: rally task report 5ed25693-8353-4051-ba41-bb2a338a3e6b --out output.html * To generate a JUnit report, run: rally task export 5ed25693-8353-4051-ba41-bb2a338a3e6b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5ed25693-8353-4051-ba41-bb2a338a3e6b --json --out output.json At least one workload did not pass SLA criteria. 2020-03-23 21:45:20,034 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'5ed25693-8353-4051-ba41-bb2a338a3e6b', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json'] 2020-03-23 21:45:22,256 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5ed25693-8353-4051-ba41-bb2a338a3e6b --out /home/opnfv/functest/results/rally_full/neutron.json 2020-03-23 21:45:22,273 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2020-03-23 21:45:22,273 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml 2020-03-23 21:45:22,273 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 21:45:22,282 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 21:45:22,282 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-03-23 21:45:22,282 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 22:36:27,271 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 58aae21f-82bd-448e-a469-ce600e8290bd 2020-03-23 22:36:27,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 58aae21f-82bd-448e-a469-ce600e8290bd 2020-03-23 22:36:27,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'58aae21f-82bd-448e-a469-ce600e8290bd'] 2020-03-23 22:36:28,072 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 58aae21f-82bd-448e-a469-ce600e8290bd -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.46 | 0.831 | 1.06 | 1.122 | 1.184 | 0.827 | 100.0% | 10 | | nova.delete_keypair | 0.048 | 0.063 | 0.096 | 0.097 | 0.098 | 0.069 | 100.0% | 10 | | total | 0.522 | 0.91 | 1.115 | 1.175 | 1.235 | 0.896 | 100.0% | 10 | | -> duration | 0.522 | 0.91 | 1.115 | 1.175 | 1.235 | 0.896 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.447664 Full duration: 18.392923 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 58.038896 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.057474 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.561 | 71.708 | 179.845 | 196.024 | 212.203 | 93.235 | 100.0% | 10 | | nova.delete_server | 5.159 | 53.587 | 114.586 | 121.22 | 127.854 | 58.031 | 100.0% | 10 | | total | 44.135 | 142.007 | 230.905 | 245.449 | 259.993 | 151.267 | 100.0% | 10 | | -> duration | 43.135 | 141.007 | 229.905 | 244.449 | 258.993 | 150.267 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 440.559889 Full duration: 536.814857 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "detailed": true, "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 37.431 | 71.559 | 111.706 | 112.695 | 113.684 | 76.368 | 100.0% | 10 | | nova.list_servers | 0.351 | 0.418 | 10.841 | 13.626 | 16.411 | 2.994 | 100.0% | 10 | | total | 38.001 | 71.945 | 115.415 | 121.516 | 127.617 | 79.363 | 100.0% | 10 | | -> duration | 37.001 | 70.945 | 114.415 | 120.516 | 126.617 | 78.363 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 259.50481 Full duration: 529.876652 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "from_image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "to_image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 18.545 | 48.653 | 148.349 | 177.42 | 206.491 | 75.906 | 100.0% | 10 | | nova.rebuild_server | 30.02 | 48.624 | 67.354 | 86.429 | 105.504 | 50.582 | 100.0% | 10 | | nova.delete_server | 14.683 | 29.713 | 36.496 | 39.851 | 43.206 | 28.942 | 100.0% | 10 | | total | 90.104 | 127.727 | 251.645 | 253.669 | 255.694 | 155.43 | 100.0% | 10 | | -> duration | 88.104 | 125.727 | 249.645 | 251.669 | 253.694 | 153.43 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 438.496194 Full duration: 543.389782 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ], "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 69.016 | 124.775 | 214.875 | 239.024 | 263.173 | 138.476 | 100.0% | 10 | | nova.snapshot_server | 6.771 | 9.112 | 39.423 | 48.624 | 57.826 | 17.899 | 100.0% | 10 | | -> glance_v2.get_image | 0.078 | 0.091 | 0.097 | 0.097 | 0.097 | 0.089 | 100.0% | 10 | | -> glance.wait_for_image | 6.173 | 8.229 | 38.944 | 48.153 | 57.362 | 15.398 | 100.0% | 10 | | --> glance_v2.get_image (x5) | 0.191 | 0.225 | 0.228 | 0.228 | 0.228 | 0.217 | 100.0% | 5 | | --> glance_v2.get_image (x4) | 0.165 | 0.183 | 0.209 | 0.213 | 0.216 | 0.188 | 100.0% | 3 | | --> glance_v2.get_image (x19) | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | --> glance_v2.get_image (x29) | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 100.0% | 1 | | nova.delete_server (x2) | 22.469 | 93.268 | 119.676 | 144.97 | 170.264 | 88.023 | 100.0% | 10 | | nova.delete_image | 1.048 | 1.219 | 1.39 | 1.724 | 2.059 | 1.277 | 100.0% | 10 | | -> glance_v2.delete_image | 0.999 | 1.17 | 1.318 | 1.668 | 2.018 | 1.214 | 100.0% | 10 | | -> glance.wait_for_delete | 0.039 | 0.047 | 0.114 | 0.118 | 0.122 | 0.06 | 100.0% | 10 | | --> glance_v2.get_image | 0.038 | 0.047 | 0.114 | 0.118 | 0.122 | 0.06 | 0.0% | 10 | | total | 100.464 | 227.246 | 361.031 | 393.138 | 425.244 | 245.675 | 100.0% | 10 | | -> duration | 98.464 | 225.246 | 359.031 | 391.138 | 423.244 | 243.675 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 736.133206 Full duration: 862.616664 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "volume_size": 1, "flavor": { "name": "rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "image": { "name": "rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e" }, "nics": [ { "net-id": "9ad39e91-4cad-4615-9f92-9b0a3e42b42f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 58aae21f-82bd-448e-a469-ce600e8290bd has 3 error(s) -------------------------------------------------------------------------------- GetResourceFailure: Failed to get the resource : The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-16386742-d963-470e-a0ee-6a19a9fe61c3) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 362, in run **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 79, in _get_from_manager raise exceptions.GetResourceFailure(resource=resource, err=e) GetResourceFailure: Failed to get the resource : The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-16386742-d963-470e-a0ee-6a19a9fe61c3) -------------------------------------------------------------------------------- GetResourceFailure: Failed to get the resource : The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-9d1eb584-3d8a-46c6-b312-5582c24906c5) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 362, in run **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server check_interval=CONF.openstack.nova_server_boot_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 79, in _get_from_manager raise exceptions.GetResourceFailure(resource=resource, err=e) GetResourceFailure: Failed to get the resource : The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-9d1eb584-3d8a-46c6-b312-5582c24906c5) -------------------------------------------------------------------------------- AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod15.opnfv.org/v3 for user 'c_rally_e6ee07b2_fOMOa6Sk' in project 'c_rally_e6ee07b2_lOxfsSIu': [BadGateway] Bad Gateway (HTTP 502) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 358, in run volume_type=volume_type) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume multiattach=multiattach, backup_id=backup_id) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume multiattach=multiattach, backup_id=backup_id)) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 72, in create_volume volume = (self._get_client() File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_common.py", line 31, in _get_client return self._clients.cinder(self.version) File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 244, in __call__ self.cache[key] = self.create_client(*args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 525, in create_client endpoint_override=self._get_endpoint(service_type)) File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 199, in _get_endpoint api_url = self.keystone.service_catalog.url_for(**kw) File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 266, in service_catalog return self.auth_ref.service_catalog File "/usr/lib/python2.7/site-packages/rally_openstack/osclients.py", line 288, in auth_ref raise e AuthenticationFailed: Failed to authenticate to http://identity-airship.intel-pod15.opnfv.org/v3 for user 'c_rally_e6ee07b2_fOMOa6Sk' in project 'c_rally_e6ee07b2_lOxfsSIu': [BadGateway] Bad Gateway (HTTP 502) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.308 | 13.958 | 64.244 | 117.732 | 171.22 | 32.193 | 90.0% | 10 | | nova.boot_server | 19.496 | 80.989 | 142.34 | 153.348 | 164.356 | 83.313 | 77.8% | 9 | | total | 37.935 | 96.325 | 179.864 | 185.29 | 190.716 | 107.175 | 70.0% | 10 | | -> duration | 36.935 | 95.325 | 178.864 | 184.29 | 189.716 | 106.275 | 70.0% | 10 | | -> idle_duration | 0.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.9 | 70.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 368.386764 Full duration: 479.142624 HINTS: * To plot HTML graphics with this data, run: rally task report 58aae21f-82bd-448e-a469-ce600e8290bd --out output.html * To generate a JUnit report, run: rally task export 58aae21f-82bd-448e-a469-ce600e8290bd --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 58aae21f-82bd-448e-a469-ce600e8290bd --json --out output.json At least one workload did not pass SLA criteria. 2020-03-23 22:36:28,072 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'58aae21f-82bd-448e-a469-ce600e8290bd', '--out', u'/home/opnfv/functest/results/rally_full/nova.json'] 2020-03-23 22:36:30,321 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 58aae21f-82bd-448e-a469-ce600e8290bd --out /home/opnfv/functest/results/rally_full/nova.json 2020-03-23 22:36:30,350 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-03-23 22:36:30,350 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2020-03-23 22:36:30,350 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 22:36:30,370 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 22:36:30,371 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-03-23 22:36:30,371 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 22:38:06,648 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 2020-03-23 22:38:06,648 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 2020-03-23 22:38:06,649 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'cbc17fac-caa9-4ed8-80fa-cc0f35f75b75'] 2020-03-23 22:38:07,423 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 -------------------------------------------------------------------------------- Task cbc17fac-caa9-4ed8-80fa-cc0f35f75b75: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.547 | 0.773 | 0.875 | 0.88 | 0.884 | 0.742 | 100.0% | 10 | | quotas.delete_quotas | 0.03 | 0.092 | 0.226 | 0.228 | 0.23 | 0.122 | 100.0% | 10 | | total | 0.643 | 0.93 | 1.035 | 1.044 | 1.053 | 0.864 | 100.0% | 10 | | -> duration | 0.643 | 0.93 | 1.035 | 1.044 | 1.053 | 0.864 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.641572 Full duration: 9.730526 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.37 | 0.68 | 1.566 | 1.614 | 1.662 | 0.954 | 100.0% | 10 | | total | 0.37 | 0.68 | 1.567 | 1.614 | 1.662 | 0.954 | 100.0% | 10 | | -> duration | 0.37 | 0.68 | 1.567 | 1.614 | 1.662 | 0.954 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.547925 Full duration: 13.040287 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.488 | 1.226 | 1.344 | 1.351 | 1.358 | 1.105 | 100.0% | 10 | | total | 0.563 | 1.34 | 1.525 | 1.553 | 1.581 | 1.225 | 100.0% | 10 | | -> duration | 0.563 | 1.34 | 1.525 | 1.553 | 1.581 | 1.225 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.307001 Full duration: 9.722504 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.068 | 1.425 | 2.348 | 2.402 | 2.457 | 1.571 | 100.0% | 10 | | total | 1.068 | 1.425 | 2.348 | 2.402 | 2.457 | 1.571 | 100.0% | 10 | | -> duration | 1.068 | 1.425 | 2.348 | 2.402 | 2.457 | 1.571 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.224099 Full duration: 53.129819 HINTS: * To plot HTML graphics with this data, run: rally task report cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 --out output.html * To generate a JUnit report, run: rally task export cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 --json --out output.json 2020-03-23 22:38:07,423 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'cbc17fac-caa9-4ed8-80fa-cc0f35f75b75', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json'] 2020-03-23 22:38:09,608 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid cbc17fac-caa9-4ed8-80fa-cc0f35f75b75 --out /home/opnfv/functest/results/rally_full/quotas.json 2020-03-23 22:38:09,618 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-03-23 22:38:09,618 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml 2020-03-23 22:38:09,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-23 22:38:09,641 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-23 22:38:09,641 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-03-23 22:38:09,641 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': '9ad39e91-4cad-4615-9f92-9b0a3e42b42f', 'tenants_amount': 3, 'image_name': 'rally_full-img_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_78c3e855-4bea-4272-a41b-fcc798d8e98e', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-03-23 22:41:48,423 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 10b26834-1a1a-4197-ba0e-3125a2721da0 2020-03-23 22:41:48,423 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 10b26834-1a1a-4197-ba0e-3125a2721da0 2020-03-23 22:41:48,423 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'10b26834-1a1a-4197-ba0e-3125a2721da0'] 2020-03-23 22:41:49,455 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 10b26834-1a1a-4197-ba0e-3125a2721da0 -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 5120, "objects_per_container": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.239 | 0.453 | 0.822 | 0.834 | 0.846 | 0.487 | 100.0% | 10 | | swift.upload_object (x2) | 0.232 | 0.296 | 0.422 | 0.434 | 0.447 | 0.323 | 100.0% | 10 | | swift.list_objects | 0.232 | 0.329 | 0.424 | 0.528 | 0.633 | 0.35 | 100.0% | 10 | | total | 0.76 | 1.052 | 1.638 | 1.769 | 1.9 | 1.16 | 100.0% | 10 | | -> duration | 0.76 | 1.052 | 1.638 | 1.769 | 1.9 | 1.16 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.312799 Full duration: 84.521286 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "swift_objects": { "object_size": 1024, "containers_per_tenant": 1, "objects_per_container": 10 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 0.333 | 0.506 | 0.85 | 0.887 | 0.923 | 0.564 | 100.0% | 10 | | swift.list_objects | 0.248 | 0.31 | 0.34 | 0.355 | 0.371 | 0.309 | 100.0% | 10 | | total | 0.582 | 0.825 | 1.174 | 1.206 | 1.238 | 0.873 | 100.0% | 10 | | -> duration | 0.582 | 0.825 | 1.174 | 1.206 | 1.238 | 0.873 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.323893 Full duration: 14.718499 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 1024, "objects_per_container": 5 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.239 | 0.407 | 0.487 | 0.494 | 0.502 | 0.378 | 100.0% | 10 | | swift.upload_object (x5) | 0.723 | 0.786 | 0.828 | 0.86 | 0.893 | 0.789 | 100.0% | 10 | | swift.download_object (x5) | 0.677 | 0.797 | 0.887 | 0.916 | 0.944 | 0.797 | 100.0% | 10 | | total | 1.707 | 1.919 | 2.159 | 2.189 | 2.219 | 1.965 | 100.0% | 10 | | -> duration | 1.707 | 1.919 | 2.159 | 2.189 | 2.219 | 1.965 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.83833 Full duration: 27.350891 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 102400, "objects_per_container": 5 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.238 | 0.361 | 0.648 | 0.716 | 0.784 | 0.419 | 100.0% | 10 | | swift.upload_object (x5) | 0.795 | 0.889 | 0.948 | 0.965 | 0.982 | 0.885 | 100.0% | 10 | | swift.delete_object (x5) | 0.798 | 0.925 | 1.003 | 1.011 | 1.019 | 0.923 | 100.0% | 10 | | swift.delete_container | 0.168 | 0.202 | 0.223 | 0.244 | 0.266 | 0.201 | 100.0% | 10 | | total | 2.156 | 2.396 | 2.651 | 2.751 | 2.85 | 2.429 | 100.0% | 10 | | -> duration | 2.156 | 2.396 | 2.651 | 2.751 | 2.85 | 2.429 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.092017 Full duration: 50.457554 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "swift_objects": { "object_size": 10240, "containers_per_tenant": 2, "objects_per_container": 5 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 10b26834-1a1a-4197-ba0e-3125a2721da0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 0.382 | 0.457 | 0.584 | 0.604 | 0.624 | 0.471 | 100.0% | 10 | | swift.list_objects (x2) | 0.546 | 0.631 | 0.701 | 0.702 | 0.703 | 0.633 | 100.0% | 10 | | swift.download_object (x10) | 1.424 | 1.534 | 1.678 | 1.755 | 1.831 | 1.565 | 100.0% | 10 | | total | 2.353 | 2.663 | 2.934 | 2.958 | 2.983 | 2.669 | 100.0% | 10 | | -> duration | 2.353 | 2.663 | 2.934 | 2.958 | 2.983 | 2.669 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.725495 Full duration: 27.25428 HINTS: * To plot HTML graphics with this data, run: rally task report 10b26834-1a1a-4197-ba0e-3125a2721da0 --out output.html * To generate a JUnit report, run: rally task export 10b26834-1a1a-4197-ba0e-3125a2721da0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 10b26834-1a1a-4197-ba0e-3125a2721da0 --json --out output.json 2020-03-23 22:41:49,455 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'10b26834-1a1a-4197-ba0e-3125a2721da0', '--out', u'/home/opnfv/functest/results/rally_full/swift.json'] 2020-03-23 22:41:51,693 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 10b26834-1a1a-4197-ba0e-3125a2721da0 --out /home/opnfv/functest/results/rally_full/swift.json 2020-03-23 22:41:51,710 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-03-23 22:41:51,713 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:18 | 60 | 100.00% | | glance | 00:10:09 | 80 | 100.00% | | cinder | 00:00:00 | 0 | 0.00% | | heat | 00:28:45 | 130 | 100.00% | | keystone | 00:03:52 | 110 | 100.00% | | neutron | 00:11:58 | 110 | 100.00% | | nova | 00:50:28 | 60 | 95.00% | | quotas | 00:01:25 | 40 | 100.00% | | swift | 00:03:24 | 50 | 100.00% | | | | | | | TOTAL: | 01:51:22 | 640 | 99.53% | +----------------+------------+----------------+-----------+ 2020-03-23 22:41:51,713 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.53% in 6/9 modules 2020-03-23 22:41:51,713 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html'] 2020-03-23 22:41:54,911 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2020-03-23 22:41:54,911 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml'] 2020-03-23 22:41:57,536 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2020-03-23 22:41:57,536 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 115:32 | FAIL | +--------------------+------------------+------------------+----------------+ 2020-03-23 22:42:12,273 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)