2019-03-13 01:27:41,828 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | unknown | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | | +--------------------------------------+----------------------------------------------------------+ 2019-03-13 01:27:41,831 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.12.66/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_ID="default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 2019-03-13 01:27:41,831 - xtesting.ci.run_tests - DEBUG - Test args: rally_full 2019-03-13 01:27:41,840 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2019-03-13 01:27:42,486 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', u'tags': [], 'enabled': True, 'id': u'b6a82f9edcf647d08b4f7af32290ed88', 'parent_id': u'default', 'properties': Munch({u'tags': []}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_b16b135e-b525-4511-95ac-2b6b66194a64'}) 2019-03-13 01:27:42,597 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'3db7dc1cf087435d9a93b6a82db82e78', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_b16b135e-b525-4511-95ac-2b6b66194a64'}) 2019-03-13 01:27:43,083 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_b16b135e-b525-4511-95ac-2b6b66194a64', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'Default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'project_domain_id': 'default', u'key_manager_api_version': u'v1', 'password': 'NxYqXrn3Geajtt4KH6Jbrxw0YIYyFz', 'region_name': 'RegionOne', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_b16b135e-b525-4511-95ac-2b6b66194a64', 'project_id': u'b6a82f9edcf647d08b4f7af32290ed88', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://172.30.12.66/identity/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}} 2019-03-13 01:27:43,086 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_b16b135e-b525-4511-95ac-2b6b66194a64', 'password': 'NxYqXrn3Geajtt4KH6Jbrxw0YIYyFz', 'project_name': 'rally_full-project_b16b135e-b525-4511-95ac-2b6b66194a64', 'user_domain_name': 'Default', 'auth_url': 'http://172.30.12.66/identity/v3', 'project_id': 'b6a82f9edcf647d08b4f7af32290ed88', 'project_domain_id': 'default'} 2019-03-13 01:27:43,534 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2019-03-13 01:27:44,064 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'ipv6_address_scope': None, u'updated_at': u'2019-03-13T01:27:43Z', u'is_default': False, u'revision_number': 0, u'port_security_enabled': True, u'provider:network_type': u'vxlan', u'id': u'4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', u'provider:segmentation_id': 30, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_b16b135e-b525-4511-95ac-2b6b66194a64', u'admin_state_up': True, u'tenant_id': u'b6a82f9edcf647d08b4f7af32290ed88', u'created_at': u'2019-03-13T01:27:43Z', u'mtu': 1450, u'ipv4_address_scope': None, u'shared': True, u'project_id': u'b6a82f9edcf647d08b4f7af32290ed88'}) 2019-03-13 01:27:45,336 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2019-03-13T01:27:44Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 0, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'05690df8-d786-40dd-ba5d-e7aa667fd51c', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_b16b135e-b525-4511-95ac-2b6b66194a64', u'enable_dhcp': True, u'network_id': u'4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', u'tenant_id': u'b6a82f9edcf647d08b4f7af32290ed88', u'created_at': u'2019-03-13T01:27:44Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'b6a82f9edcf647d08b4f7af32290ed88'}) 2019-03-13 01:27:48,737 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2019-03-13T01:27:47Z', u'revision_number': 2, u'ha': False, u'id': u'1df6e0e7-85e5-423b-8933-e4523b7e7849', u'external_gateway_info': {u'network_id': u'059dcef9-4cf3-45a3-8163-4aa870ef5251', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'e1090bc1-ad1f-4eca-a62f-27729079cae0', u'ip_address': u'172.24.4.2'}, {u'subnet_id': u'f2fd7b26-9f38-4853-b63e-2b20e33c9958', u'ip_address': u'2001:db8::c'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_b16b135e-b525-4511-95ac-2b6b66194a64', u'admin_state_up': True, u'tenant_id': u'b6a82f9edcf647d08b4f7af32290ed88', u'created_at': u'2019-03-13T01:27:45Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'b6a82f9edcf647d08b4f7af32290ed88'}) 2019-03-13 01:27:53,282 - functest.core.singlevm - DEBUG - image: Munch({'minDisk': 0, 'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/95385c14-313b-40a7-af74-c182cfeae18a/file', 'owner': u'b6a82f9edcf647d08b4f7af32290ed88', 'id': u'95385c14-313b-40a7-af74-c182cfeae18a', 'size': 12716032, u'self': u'/v2/images/95385c14-313b-40a7-af74-c182cfeae18a', 'disk_format': u'qcow2', u'os_hash_algo': u'sha512', 'protected': False, 'location': Munch({'project': Munch({'domain_id': 'default', 'id': u'b6a82f9edcf647d08b4f7af32290ed88', 'name': 'rally_full-project_b16b135e-b525-4511-95ac-2b6b66194a64', 'domain_name': None}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-03-13T01:27:53Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2019-03-13T01:27:53Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'os_hash_value': u'6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', u'self': u'/v2/images/95385c14-313b-40a7-af74-c182cfeae18a', u'os_hidden': False, u'os_hash_algo': u'sha512', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'created': u'2019-03-13T01:27:53Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2019-03-13T01:27:53Z', u'os_hidden': False, 'is_protected': False, u'os_hash_value': u'6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', 'metadata': {u'os_hash_value': u'6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', u'self': u'/v2/images/95385c14-313b-40a7-af74-c182cfeae18a', u'os_hidden': False, u'os_hash_algo': u'sha512', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'schema': u'/v2/schemas/image'}}) 2019-03-13 01:27:53,426 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': 'default', 'id': u'f3e10ff4b9794d3a98792cb2e28bb908', 'name': 'demo', 'domain_name': None}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'936f21ae-99f1-475b-9d90-07fca3c84b46', 'swap': 0}) 2019-03-13 01:27:53,450 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2019-03-13 01:27:58,049 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | e6c78ce9-c57c-4469-aa5c-359353f3003d | 2019-03-13T01:27:57.622065 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: e6c78ce9-c57c-4469-aa5c-359353f3003d ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2019-03-13 01:28:00,563 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------------+-----------+ | __unknown__ | block-storage | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | tempest-type-1044270759 | Available | | __unknown__ | tempest-type-1084838619 | Available | | __unknown__ | tempest-type-1086022574 | Available | | __unknown__ | tempest-type-1287105000 | Available | | __unknown__ | tempest-type-1345340488 | Available | | __unknown__ | tempest-type-1470174445 | Available | | __unknown__ | tempest-type-1531133890 | Available | | __unknown__ | tempest-type-153206327 | Available | | __unknown__ | tempest-type-1628537628 | Available | | __unknown__ | tempest-type-1716426423 | Available | | __unknown__ | tempest-type-1724950760 | Available | | __unknown__ | tempest-type-1806822782 | Available | | __unknown__ | tempest-type-1873947988 | Available | | __unknown__ | tempest-type-1921484793 | Available | | __unknown__ | tempest-type-198412805 | Available | | __unknown__ | tempest-type-1998685492 | Available | | __unknown__ | tempest-type-2063055829 | Available | | __unknown__ | tempest-type-2090594724 | Available | | __unknown__ | tempest-type-2117845793 | Available | | __unknown__ | tempest-type-23614030 | Available | | __unknown__ | tempest-type-271899742 | Available | | __unknown__ | tempest-type-303696851 | Available | | __unknown__ | tempest-type-314341220 | Available | | __unknown__ | tempest-type-464463850 | Available | | __unknown__ | tempest-type-464955441 | Available | | __unknown__ | tempest-type-478858043 | Available | | __unknown__ | tempest-type-485696647 | Available | | __unknown__ | tempest-type-613422150 | Available | | __unknown__ | tempest-type-620558382 | Available | | __unknown__ | tempest-type-703962767 | Available | | __unknown__ | tempest-type-898826062 | Available | | __unknown__ | tempest-type-992367606 | Available | | cinder | volume | Available | | cinderv2 | volumev2 | Available | | cinderv3 | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+-------------------------+-----------+ 2019-03-13 01:28:01,313 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2019-03-13 01:28:01,442 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': 'default', 'id': u'f3e10ff4b9794d3a98792cb2e28bb908', 'name': 'demo', 'domain_name': None}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'40456094-a2d4-4972-9119-4f166a7c5137', 'swap': 0}) 2019-03-13 01:28:01,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': 'default', 'id': u'f3e10ff4b9794d3a98792cb2e28bb908', 'name': 'demo', 'domain_name': None}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'40456094-a2d4-4972-9119-4f166a7c5137', 'swap': 0}) 2019-03-13 01:28:01,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2019-03-13 01:28:01,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 01:28:01,534 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 01:28:01,536 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2019-03-13 01:28:01,536 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 01:29:08,955 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7b125725-bf73-4f01-a473-cdb622f3eb35 2019-03-13 01:29:08,956 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally_full does not exist, we create it. 2019-03-13 01:29:08,956 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '7b125725-bf73-4f01-a473-cdb622f3eb35'] 2019-03-13 01:29:09,811 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7b125725-bf73-4f01-a473-cdb622f3eb35 -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.052 | 0.133 | 0.151 | 0.153 | 0.155 | 0.113 | 100.0% | 10 | | total | 0.052 | 0.133 | 0.151 | 0.153 | 0.155 | 0.113 | 100.0% | 10 | | -> duration | 0.052 | 0.133 | 0.151 | 0.153 | 0.155 | 0.113 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.307039 Full duration: 5.073053 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.077 | 0.113 | 0.196 | 0.206 | 0.215 | 0.131 | 100.0% | 10 | | total | 0.14 | 0.256 | 0.421 | 0.439 | 0.457 | 0.289 | 100.0% | 10 | | -> duration | 0.14 | 0.256 | 0.421 | 0.439 | 0.457 | 0.289 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.804824 Full duration: 4.625056 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.122 | 0.168 | 0.226 | 0.227 | 0.229 | 0.179 | 100.0% | 10 | | total | 0.169 | 0.28 | 0.38 | 0.385 | 0.39 | 0.289 | 100.0% | 10 | | -> duration | 0.169 | 0.28 | 0.38 | 0.385 | 0.39 | 0.289 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.849609 Full duration: 8.54484 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.08 | 0.139 | 0.259 | 0.267 | 0.275 | 0.169 | 100.0% | 10 | | total | 0.141 | 0.275 | 0.399 | 0.416 | 0.434 | 0.293 | 100.0% | 10 | | -> duration | 0.141 | 0.275 | 0.399 | 0.416 | 0.434 | 0.293 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.816591 Full duration: 22.708137 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.215 | 0.518 | 0.62 | 0.649 | 0.679 | 0.455 | 100.0% | 10 | | total | 0.347 | 0.624 | 0.791 | 0.82 | 0.848 | 0.604 | 100.0% | 10 | | -> duration | 0.347 | 0.624 | 0.791 | 0.82 | 0.848 | 0.604 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.648875 Full duration: 5.91216 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7b125725-bf73-4f01-a473-cdb622f3eb35 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.123 | 0.161 | 0.222 | 0.227 | 0.231 | 0.171 | 100.0% | 10 | | total | 0.183 | 0.382 | 0.449 | 0.483 | 0.517 | 0.355 | 100.0% | 10 | | -> duration | 0.183 | 0.382 | 0.449 | 0.483 | 0.517 | 0.355 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.003191 Full duration: 7.107085 HINTS: * To plot HTML graphics with this data, run: rally task report 7b125725-bf73-4f01-a473-cdb622f3eb35 --out output.html * To generate a JUnit report, run: rally task export 7b125725-bf73-4f01-a473-cdb622f3eb35 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7b125725-bf73-4f01-a473-cdb622f3eb35 --json --out output.json 2019-03-13 01:29:09,811 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '7b125725-bf73-4f01-a473-cdb622f3eb35', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json'] 2019-03-13 01:29:11,910 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7b125725-bf73-4f01-a473-cdb622f3eb35 --out /home/opnfv/functest/results/rally_full/authenticate.json 2019-03-13 01:29:11.793 724 INFO rally.api [-] Building 'json' report for the following task(s): '7b125725-bf73-4f01-a473-cdb622f3eb35'. 2019-03-13 01:29:11.804 724 INFO rally.api [-] The report has been successfully built. 2019-03-13 01:29:11,917 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2019-03-13 01:29:11,917 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml 2019-03-13 01:29:11,917 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 01:29:11,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 01:29:11,928 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2019-03-13 01:29:11,928 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['glance'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 01:35:43,841 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a53a367c-7ac1-4d16-a97b-3d6ee5073115 2019-03-13 01:35:43,842 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'a53a367c-7ac1-4d16-a97b-3d6ee5073115'] 2019-03-13 01:35:44,706 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a53a367c-7ac1-4d16-a97b-3d6ee5073115 -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.528 | 2.822 | 2.849 | 2.863 | 2.876 | 2.762 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.041 | 0.057 | 0.076 | 0.078 | 0.08 | 0.06 | 100.0% | 10 | | -> glance_v2.upload_data | 0.323 | 0.533 | 0.605 | 0.615 | 0.625 | 0.515 | 100.0% | 10 | | glance_v2.delete_image | 0.289 | 0.336 | 0.365 | 0.381 | 0.397 | 0.336 | 100.0% | 10 | | total | 2.878 | 3.122 | 3.208 | 3.208 | 3.208 | 3.099 | 100.0% | 10 | | -> duration | 2.878 | 3.122 | 3.208 | 3.208 | 3.208 | 3.099 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.536029 Full duration: 16.056274 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.623 | 2.728 | 2.759 | 2.762 | 2.765 | 2.72 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.037 | 0.052 | 0.057 | 0.058 | 0.06 | 0.05 | 100.0% | 10 | | -> glance_v2.upload_data | 0.386 | 0.537 | 0.561 | 0.564 | 0.567 | 0.51 | 100.0% | 10 | | glance_v2.list_images | 0.043 | 0.057 | 0.087 | 0.091 | 0.096 | 0.061 | 100.0% | 10 | | total | 2.684 | 2.801 | 2.812 | 2.813 | 2.814 | 2.781 | 100.0% | 10 | | -> duration | 2.684 | 2.801 | 2.812 | 2.813 | 2.814 | 2.781 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.041478 Full duration: 20.125645 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.084 | 0.095 | 0.163 | 0.194 | 0.224 | 0.115 | 100.0% | 10 | | total | 0.084 | 0.095 | 0.163 | 0.194 | 0.225 | 0.116 | 100.0% | 10 | | -> duration | 0.084 | 0.095 | 0.163 | 0.194 | 0.225 | 0.116 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.564351 Full duration: 4.511619 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.002 | 3.564 | 5.014 | 5.261 | 5.508 | 3.813 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.042 | 0.071 | 0.547 | 0.663 | 0.779 | 0.182 | 100.0% | 10 | | -> glance_v2.upload_data | 0.684 | 1.129 | 2.27 | 2.382 | 2.493 | 1.304 | 100.0% | 10 | | nova.boot_servers | 34.098 | 44.177 | 124.579 | 134.811 | 145.042 | 66.136 | 100.0% | 10 | | total | 37.105 | 49.411 | 128.128 | 138.783 | 149.439 | 69.949 | 100.0% | 10 | | -> duration | 36.105 | 48.411 | 127.128 | 137.783 | 148.439 | 68.949 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 209.698941 Full duration: 249.013265 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.545 | 2.744 | 2.777 | 2.797 | 2.817 | 2.711 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.038 | 0.052 | 0.065 | 0.081 | 0.098 | 0.054 | 100.0% | 10 | | -> glance_v2.upload_data | 0.363 | 0.527 | 0.558 | 0.566 | 0.574 | 0.498 | 100.0% | 10 | | glance_v2.deactivate_image | 0.057 | 0.083 | 0.388 | 0.391 | 0.395 | 0.2 | 100.0% | 10 | | total | 2.602 | 2.865 | 3.15 | 3.152 | 3.154 | 2.911 | 100.0% | 10 | | -> duration | 2.602 | 2.865 | 3.15 | 3.152 | 3.154 | 2.911 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.811386 Full duration: 17.908563 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_download_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.623 | 2.796 | 2.844 | 2.857 | 2.87 | 2.773 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.05 | 0.054 | 0.062 | 0.062 | 0.063 | 0.055 | 100.0% | 10 | | -> glance_v2.upload_data | 0.421 | 0.558 | 0.591 | 0.591 | 0.591 | 0.54 | 100.0% | 10 | | glance_v2.download_image | 0.171 | 0.204 | 0.26 | 0.264 | 0.268 | 0.213 | 100.0% | 10 | | total | 2.795 | 3.013 | 3.049 | 3.08 | 3.111 | 2.986 | 100.0% | 10 | | -> duration | 2.795 | 3.013 | 3.049 | 3.08 | 3.111 | 2.986 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.476909 Full duration: 23.935101 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_get_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.603 | 2.759 | 2.872 | 2.901 | 2.93 | 2.775 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.047 | 0.062 | 0.074 | 0.076 | 0.078 | 0.062 | 100.0% | 10 | | -> glance_v2.upload_data | 0.4 | 0.518 | 0.614 | 0.616 | 0.619 | 0.53 | 100.0% | 10 | | glance_v2.get_image | 0.017 | 0.026 | 0.027 | 0.028 | 0.028 | 0.024 | 100.0% | 10 | | total | 2.621 | 2.785 | 2.899 | 2.927 | 2.954 | 2.799 | 100.0% | 10 | | -> duration | 2.621 | 2.785 | 2.899 | 2.927 | 2.954 | 2.799 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.69378 Full duration: 21.633513 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_update_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a53a367c-7ac1-4d16-a97b-3d6ee5073115 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.66 | 2.792 | 2.859 | 2.868 | 2.877 | 2.778 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.05 | 0.052 | 0.063 | 0.065 | 0.068 | 0.055 | 100.0% | 10 | | -> glance_v2.upload_data | 0.439 | 0.543 | 0.592 | 0.607 | 0.621 | 0.53 | 100.0% | 10 | | glance_v2.update_image | 0.118 | 0.167 | 0.197 | 0.204 | 0.211 | 0.168 | 100.0% | 10 | | total | 2.778 | 2.966 | 3.04 | 3.042 | 3.045 | 2.946 | 100.0% | 10 | | -> duration | 2.778 | 2.966 | 3.04 | 3.042 | 3.045 | 2.946 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.98532 Full duration: 18.988463 HINTS: * To plot HTML graphics with this data, run: rally task report a53a367c-7ac1-4d16-a97b-3d6ee5073115 --out output.html * To generate a JUnit report, run: rally task export a53a367c-7ac1-4d16-a97b-3d6ee5073115 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a53a367c-7ac1-4d16-a97b-3d6ee5073115 --json --out output.json 2019-03-13 01:35:44,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'a53a367c-7ac1-4d16-a97b-3d6ee5073115', '--out', u'/home/opnfv/functest/results/rally_full/glance.json'] 2019-03-13 01:35:46,821 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a53a367c-7ac1-4d16-a97b-3d6ee5073115 --out /home/opnfv/functest/results/rally_full/glance.json 2019-03-13 01:35:46.692 1841 INFO rally.api [-] Building 'json' report for the following task(s): 'a53a367c-7ac1-4d16-a97b-3d6ee5073115'. 2019-03-13 01:35:46.721 1841 INFO rally.api [-] The report has been successfully built. 2019-03-13 01:35:46,833 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2019-03-13 01:35:46,833 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml 2019-03-13 01:35:46,833 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 01:35:46,840 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 01:35:46,844 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2019-03-13 01:35:46,844 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 01:56:47,530 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 69901c5d-8c78-4a96-af91-4433a89a5bf0 2019-03-13 01:56:47,530 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '69901c5d-8c78-4a96-af91-4433a89a5bf0'] 2019-03-13 01:56:48,510 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 69901c5d-8c78-4a96-af91-4433a89a5bf0 -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.862 | 76.7 | 90.951 | 93.346 | 95.741 | 59.275 | 100.0% | 10 | | cinder_v3.create_volume | 2.493 | 2.584 | 2.689 | 2.769 | 2.85 | 2.606 | 100.0% | 10 | | nova.attach_volume | 4.984 | 7.32 | 7.657 | 7.775 | 7.893 | 6.564 | 100.0% | 10 | | nova.detach_volume | 2.57 | 2.701 | 4.824 | 4.885 | 4.946 | 3.313 | 100.0% | 10 | | cinder_v3.delete_volume | 2.197 | 2.236 | 2.607 | 3.465 | 4.323 | 2.462 | 100.0% | 10 | | nova.delete_server | 2.482 | 7.732 | 11.018 | 12.86 | 14.703 | 7.71 | 100.0% | 10 | | total | 37.505 | 95.157 | 110.402 | 112.196 | 113.99 | 81.93 | 100.0% | 10 | | -> duration | 36.505 | 94.157 | 109.402 | 111.196 | 112.99 | 80.93 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 252.79053 Full duration: 266.690935 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 2.313 | 2.539 | 2.565 | 2.571 | 2.576 | 2.504 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.02 | 0.029 | 0.038 | 0.041 | 0.044 | 0.03 | 100.0% | 10 | | total | 2.338 | 2.574 | 2.593 | 2.599 | 2.605 | 2.534 | 100.0% | 10 | | -> duration | 2.338 | 2.574 | 2.593 | 2.599 | 2.605 | 2.534 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.516917 Full duration: 41.771344 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.911 | 10.116 | 18.53 | 23.126 | 27.721 | 11.985 | 100.0% | 10 | | cinder_v3.list_volumes | 0.059 | 0.08 | 0.099 | 0.127 | 0.155 | 0.085 | 100.0% | 10 | | total | 4.992 | 10.231 | 18.609 | 23.194 | 27.78 | 12.07 | 100.0% | 10 | | -> duration | 4.992 | 10.231 | 18.609 | 23.194 | 27.78 | 12.07 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.018403 Full duration: 58.221352 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.734 | 2.968 | 4.812 | 4.935 | 5.057 | 3.484 | 100.0% | 10 | | cinder_v3.list_volumes | 0.062 | 0.101 | 0.157 | 0.179 | 0.202 | 0.112 | 100.0% | 10 | | total | 2.82 | 3.087 | 4.927 | 5.042 | 5.157 | 3.596 | 100.0% | 10 | | -> duration | 2.82 | 3.087 | 4.927 | 5.042 | 5.157 | 3.596 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.952343 Full duration: 36.576186 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "container_format": "bare", "force": false, "disk_format": "raw", "do_delete": true, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.522 | 2.738 | 4.703 | 4.749 | 4.795 | 3.272 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 13.101 | 24.106 | 28.211 | 28.235 | 28.259 | 22.761 | 100.0% | 10 | | cinder_v3.delete_volume | 2.268 | 3.312 | 11.164 | 11.21 | 11.257 | 4.872 | 100.0% | 10 | | glance_v2.delete_image | 0.319 | 0.429 | 0.494 | 0.496 | 0.498 | 0.422 | 100.0% | 10 | | total | 22.23 | 33.024 | 34.848 | 35.239 | 35.629 | 31.329 | 100.0% | 10 | | -> duration | 22.23 | 33.024 | 34.848 | 35.239 | 35.629 | 31.329 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 90.800063 Full duration: 100.410713 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "create_vm_params": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "nested_level": 1, "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.05 | 12.316 | 26.02 | 26.092 | 26.163 | 17.368 | 100.0% | 10 | | cinder_v3.create_volume | 2.416 | 2.656 | 4.641 | 4.642 | 4.642 | 3.028 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.322 | 4.442 | 6.369 | 6.428 | 6.487 | 4.464 | 100.0% | 10 | | nova.attach_volume | 4.787 | 7.56 | 10.202 | 10.476 | 10.751 | 7.937 | 100.0% | 10 | | nova.detach_volume | 2.437 | 2.579 | 4.708 | 4.778 | 4.848 | 3.405 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.133 | 2.149 | 2.395 | 3.28 | 4.166 | 2.353 | 100.0% | 10 | | cinder_v3.delete_volume | 2.194 | 4.246 | 4.333 | 4.342 | 4.351 | 3.456 | 100.0% | 10 | | nova.delete_server | 2.505 | 4.054 | 4.903 | 4.927 | 4.95 | 3.801 | 100.0% | 10 | | total | 30.443 | 41.804 | 61.311 | 61.475 | 61.639 | 45.814 | 100.0% | 10 | | -> duration | 29.443 | 40.804 | 60.311 | 60.475 | 60.639 | 44.814 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 130.858673 Full duration: 142.136515 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "create_vm_params": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.587 | 2.767 | 3.105 | 3.918 | 4.73 | 2.941 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.24 | 2.312 | 4.379 | 4.42 | 4.462 | 3.125 | 100.0% | 10 | | nova.boot_server | 22.174 | 26.06 | 29.959 | 30.852 | 31.745 | 26.746 | 100.0% | 10 | | nova.attach_volume | 5.025 | 6.241 | 7.382 | 7.41 | 7.438 | 6.247 | 100.0% | 10 | | nova.detach_volume | 2.575 | 2.79 | 4.889 | 4.919 | 4.949 | 3.553 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.148 | 2.206 | 4.518 | 5.426 | 6.333 | 3.028 | 100.0% | 10 | | cinder_v3.delete_volume | 2.243 | 4.268 | 4.699 | 5.519 | 6.339 | 3.754 | 100.0% | 10 | | nova.delete_server | 2.393 | 5.442 | 8.061 | 8.376 | 8.692 | 5.418 | 100.0% | 10 | | total | 49.492 | 54.409 | 58.831 | 60.584 | 62.337 | 54.813 | 100.0% | 10 | | -> duration | 48.492 | 53.409 | 57.831 | 59.584 | 61.337 | 53.813 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 158.077094 Full duration: 168.431711 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.612 | 2.798 | 4.745 | 4.82 | 4.895 | 3.171 | 100.0% | 10 | | total | 2.613 | 2.798 | 4.745 | 4.82 | 4.895 | 3.172 | 100.0% | 10 | | -> duration | 2.613 | 2.798 | 4.745 | 4.82 | 4.895 | 3.172 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.224167 Full duration: 29.756077 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.611 | 2.773 | 4.642 | 4.766 | 4.89 | 3.151 | 100.0% | 10 | | total | 2.611 | 2.774 | 4.642 | 4.766 | 4.89 | 3.152 | 100.0% | 10 | | -> duration | 2.611 | 2.774 | 4.642 | 4.766 | 4.89 | 3.152 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.929508 Full duration: 36.062784 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 4, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.159 | 0.203 | 0.294 | 0.299 | 0.304 | 0.224 | 100.0% | 10 | | total | 0.159 | 0.203 | 0.294 | 0.299 | 0.305 | 0.224 | 100.0% | 10 | | -> duration | 0.159 | 0.203 | 0.294 | 0.299 | 0.305 | 0.224 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.647483 Full duration: 50.266206 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 2.336 | 2.528 | 4.422 | 4.454 | 4.487 | 3.234 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.125 | 2.21 | 4.164 | 4.168 | 4.172 | 2.958 | 100.0% | 10 | | total | 4.561 | 6.521 | 8.59 | 8.62 | 8.65 | 6.193 | 100.0% | 10 | | -> duration | 4.561 | 6.521 | 8.59 | 8.62 | 8.65 | 6.193 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.725308 Full duration: 35.855334 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.605 | 2.763 | 4.802 | 4.831 | 4.86 | 3.346 | 100.0% | 10 | | cinder_v3.delete_volume | 2.231 | 4.331 | 4.561 | 5.476 | 6.391 | 4.113 | 100.0% | 10 | | total | 4.967 | 7.101 | 9.146 | 9.179 | 9.212 | 7.459 | 100.0% | 10 | | -> duration | 4.967 | 7.101 | 9.146 | 9.179 | 9.212 | 7.459 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.163868 Full duration: 27.372937 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.844 | 10.898 | 15.051 | 15.18 | 15.308 | 10.757 | 100.0% | 10 | | cinder_v3.delete_volume | 2.215 | 4.27 | 4.292 | 4.3 | 4.308 | 3.884 | 100.0% | 10 | | total | 9.105 | 14.184 | 19.31 | 19.463 | 19.617 | 14.641 | 100.0% | 10 | | -> duration | 9.105 | 14.184 | 19.31 | 19.463 | 19.617 | 14.641 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.54743 Full duration: 48.001796 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.53 | 2.77 | 4.84 | 4.841 | 4.842 | 3.144 | 100.0% | 10 | | cinder_v3.delete_volume | 2.234 | 4.278 | 4.301 | 4.312 | 4.323 | 3.877 | 100.0% | 10 | | total | 4.781 | 7.056 | 9.121 | 9.142 | 9.164 | 7.021 | 100.0% | 10 | | -> duration | 4.781 | 7.056 | 9.121 | 9.142 | 9.164 | 7.021 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.115924 Full duration: 26.077056 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.463 | 2.646 | 2.777 | 2.819 | 2.861 | 2.653 | 100.0% | 10 | | cinder_v3.extend_volume | 2.254 | 4.323 | 4.365 | 4.403 | 4.441 | 3.726 | 100.0% | 10 | | cinder_v3.delete_volume | 2.189 | 4.263 | 4.306 | 4.313 | 4.32 | 4.062 | 100.0% | 10 | | total | 7.21 | 11.122 | 11.321 | 11.331 | 11.34 | 10.442 | 100.0% | 10 | | -> duration | 7.21 | 11.122 | 11.321 | 11.331 | 11.34 | 10.442 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.72096 Full duration: 38.205967 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.777 | 6.942 | 12.908 | 13.101 | 13.295 | 8.284 | 100.0% | 10 | | cinder_v3.delete_volume | 2.177 | 6.313 | 8.369 | 8.43 | 8.492 | 5.717 | 100.0% | 10 | | total | 9.107 | 13.26 | 19.419 | 20.603 | 21.787 | 14.001 | 100.0% | 10 | | -> duration | 9.107 | 13.26 | 19.419 | 20.603 | 21.787 | 14.001 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.43093 Full duration: 56.257409 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.124 | 0.141 | 0.212 | 0.22 | 0.229 | 0.163 | 100.0% | 10 | | cinder_v3.get_qos | 0.012 | 0.016 | 0.02 | 0.022 | 0.024 | 0.017 | 100.0% | 10 | | total | 0.143 | 0.157 | 0.229 | 0.241 | 0.254 | 0.18 | 100.0% | 10 | | -> duration | 0.143 | 0.157 | 0.229 | 0.241 | 0.254 | 0.18 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.529602 Full duration: 6.716104 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.119 | 0.147 | 0.224 | 0.225 | 0.225 | 0.158 | 100.0% | 10 | | cinder_v3.list_qos | 0.015 | 0.019 | 0.038 | 0.039 | 0.039 | 0.023 | 100.0% | 10 | | total | 0.137 | 0.164 | 0.244 | 0.245 | 0.247 | 0.181 | 100.0% | 10 | | -> duration | 0.137 | 0.164 | 0.244 | 0.245 | 0.247 | 0.181 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.5085 Full duration: 7.204904 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "set_read_iops_sec": "1001", "set_consumer": "both", "read_iops_sec": "1000", "set_write_iops_sec": "11", "write_iops_sec": "10", "consumer": "back-end" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.123 | 0.136 | 0.203 | 0.204 | 0.206 | 0.157 | 100.0% | 10 | | cinder_v3.set_qos | 0.042 | 0.053 | 0.075 | 0.075 | 0.075 | 0.056 | 100.0% | 10 | | total | 0.168 | 0.195 | 0.273 | 0.277 | 0.281 | 0.213 | 100.0% | 10 | | -> duration | 0.168 | 0.195 | 0.273 | 0.277 | 0.281 | 0.213 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.623572 Full duration: 9.375744 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.127 | 0.137 | 0.232 | 0.232 | 0.232 | 0.165 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.013 | 0.016 | 0.022 | 0.022 | 0.022 | 0.017 | 100.0% | 10 | | total | 0.141 | 0.154 | 0.25 | 0.252 | 0.254 | 0.182 | 100.0% | 10 | | -> duration | 0.141 | 0.154 | 0.25 | 0.252 | 0.254 | 0.182 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.529221 Full duration: 7.30093 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.142 | 0.175 | 0.2 | 0.2 | 0.2 | 0.17 | 100.0% | 10 | | cinder_v3.list_types | 0.017 | 0.021 | 0.034 | 0.034 | 0.034 | 0.023 | 100.0% | 10 | | total | 0.159 | 0.204 | 0.221 | 0.221 | 0.222 | 0.194 | 100.0% | 10 | | -> duration | 0.159 | 0.204 | 0.221 | 0.221 | 0.222 | 0.194 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.559389 Full duration: 7.011115 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "test", "update_description": "test update" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.117 | 0.164 | 0.185 | 0.186 | 0.186 | 0.159 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.042 | 0.055 | 0.061 | 0.065 | 0.069 | 0.053 | 100.0% | 10 | | total | 0.172 | 0.218 | 0.24 | 0.241 | 0.242 | 0.212 | 100.0% | 10 | | -> duration | 0.172 | 0.218 | 0.24 | 0.241 | 0.242 | 0.212 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.616708 Full duration: 7.720788 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "control_location": "front-end", "cipher": "aes-xts-plain64", "description": "rally tests creating types", "key_size": 512, "provider": "LuksEncryptor" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.142 | 0.16 | 0.221 | 0.222 | 0.222 | 0.172 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.049 | 0.066 | 0.07 | 0.072 | 0.074 | 0.064 | 100.0% | 10 | | total | 0.2 | 0.226 | 0.291 | 0.291 | 0.291 | 0.237 | 100.0% | 10 | | -> duration | 0.2 | 0.226 | 0.291 | 0.291 | 0.291 | 0.237 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.691616 Full duration: 7.273908 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 69901c5d-8c78-4a96-af91-4433a89a5bf0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.119 | 0.159 | 0.187 | 0.194 | 0.201 | 0.155 | 100.0% | 10 | | cinder_v2.add_type_access | 0.037 | 0.046 | 0.059 | 0.06 | 0.061 | 0.048 | 100.0% | 10 | | cinder_v2.list_type_access | 0.014 | 0.016 | 0.019 | 0.019 | 0.02 | 0.016 | 100.0% | 10 | | total | 0.175 | 0.221 | 0.259 | 0.261 | 0.262 | 0.22 | 100.0% | 10 | | -> duration | 0.175 | 0.221 | 0.259 | 0.261 | 0.262 | 0.22 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.637142 Full duration: 6.684142 HINTS: * To plot HTML graphics with this data, run: rally task report 69901c5d-8c78-4a96-af91-4433a89a5bf0 --out output.html * To generate a JUnit report, run: rally task export 69901c5d-8c78-4a96-af91-4433a89a5bf0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 69901c5d-8c78-4a96-af91-4433a89a5bf0 --json --out output.json 2019-03-13 01:56:48,511 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '69901c5d-8c78-4a96-af91-4433a89a5bf0', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json'] 2019-03-13 01:56:50,736 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 69901c5d-8c78-4a96-af91-4433a89a5bf0 --out /home/opnfv/functest/results/rally_full/cinder.json 2019-03-13 01:56:50.580 6542 INFO rally.api [-] Building 'json' report for the following task(s): '69901c5d-8c78-4a96-af91-4433a89a5bf0'. 2019-03-13 01:56:50.641 6542 INFO rally.api [-] The report has been successfully built. 2019-03-13 01:56:50,799 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2019-03-13 01:56:50,799 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml 2019-03-13 01:56:50,799 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 01:56:50,812 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 01:56:50,816 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2019-03-13 01:56:50,816 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['heat'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 02:06:07,638 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 26869271-6eba-4662-9f6a-3a38cc3db86f 2019-03-13 02:06:07,639 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '26869271-6eba-4662-9f6a-3a38cc3db86f'] 2019-03-13 02:06:08,564 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 26869271-6eba-4662-9f6a-3a38cc3db86f -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.89 | 2.979 | 3.166 | 3.171 | 3.175 | 3.031 | 100.0% | 10 | | heat.delete_stack | 1.314 | 1.369 | 1.409 | 1.468 | 1.528 | 1.371 | 100.0% | 10 | | total | 4.205 | 4.426 | 4.536 | 4.542 | 4.547 | 4.403 | 100.0% | 10 | | -> duration | 2.205 | 2.426 | 2.536 | 2.542 | 2.547 | 2.403 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.154594 Full duration: 20.042811 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template", "parameters": { "image": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64", "public_net": "public", "flavor": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 14.124 | 21.812 | 23.148 | 23.628 | 24.108 | 20.215 | 100.0% | 10 | | heat.delete_stack | 8.886 | 10.538 | 12.222 | 12.229 | 12.236 | 10.741 | 100.0% | 10 | | total | 23.01 | 32.393 | 35.077 | 35.108 | 35.139 | 30.956 | 100.0% | 10 | | -> duration | 21.01 | 30.393 | 33.077 | 33.108 | 33.139 | 28.956 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 85.84244 Full duration: 94.811754 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_volume.yaml.template", "parameters": { "network_id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba", "image": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64", "flavor": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 18.344 | 20.567 | 29.899 | 30.85 | 31.802 | 22.482 | 100.0% | 10 | | heat.delete_stack | 7.715 | 9.878 | 10.774 | 10.855 | 10.936 | 9.658 | 100.0% | 10 | | total | 26.507 | 30.29 | 38.917 | 39.863 | 40.809 | 32.14 | 100.0% | 10 | | -> duration | 24.507 | 28.29 | 36.917 | 37.863 | 38.809 | 30.14 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 89.74729 Full duration: 99.377084 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.909 | 2.952 | 2.998 | 3.001 | 3.005 | 2.955 | 100.0% | 10 | | heat.list_stacks | 0.05 | 0.078 | 0.084 | 0.087 | 0.089 | 0.072 | 100.0% | 10 | | total | 2.962 | 3.033 | 3.052 | 3.068 | 3.085 | 3.027 | 100.0% | 10 | | -> duration | 0.962 | 1.033 | 1.052 | 1.068 | 1.085 | 1.027 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.088857 Full duration: 19.069867 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.759 | 2.926 | 3.043 | 3.06 | 3.078 | 2.92 | 100.0% | 10 | | heat.update_stack | 3.365 | 3.416 | 3.492 | 3.496 | 3.499 | 3.428 | 100.0% | 10 | | heat.delete_stack | 3.41 | 3.47 | 3.491 | 3.508 | 3.525 | 3.459 | 100.0% | 10 | | total | 9.569 | 9.785 | 9.945 | 10.0 | 10.056 | 9.807 | 100.0% | 10 | | -> duration | 5.569 | 5.785 | 5.945 | 6.0 | 6.056 | 5.807 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.374442 Full duration: 36.355964 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.024 | 3.083 | 3.172 | 3.215 | 3.259 | 3.095 | 100.0% | 10 | | heat.update_stack | 2.284 | 2.35 | 2.369 | 2.37 | 2.371 | 2.341 | 100.0% | 10 | | heat.delete_stack | 1.288 | 1.33 | 1.359 | 1.362 | 1.365 | 1.331 | 100.0% | 10 | | total | 6.703 | 6.781 | 6.814 | 6.831 | 6.848 | 6.768 | 100.0% | 10 | | -> duration | 2.703 | 2.781 | 2.814 | 2.831 | 2.848 | 2.768 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.371274 Full duration: 27.34027 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.944 | 4.115 | 4.138 | 4.142 | 4.147 | 4.086 | 100.0% | 10 | | heat.update_stack | 4.472 | 4.525 | 4.575 | 4.639 | 4.703 | 4.536 | 100.0% | 10 | | heat.delete_stack | 4.52 | 4.567 | 4.663 | 4.678 | 4.694 | 4.584 | 100.0% | 10 | | total | 13.133 | 13.206 | 13.24 | 13.301 | 13.362 | 13.206 | 100.0% | 10 | | -> duration | 9.133 | 9.206 | 9.24 | 9.301 | 9.362 | 9.206 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.550895 Full duration: 47.150512 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.073 | 4.161 | 4.226 | 4.266 | 4.306 | 4.167 | 100.0% | 10 | | heat.update_stack | 3.363 | 3.428 | 3.475 | 3.501 | 3.526 | 3.431 | 100.0% | 10 | | heat.delete_stack | 2.282 | 2.455 | 3.535 | 3.549 | 3.563 | 2.839 | 100.0% | 10 | | total | 9.821 | 10.175 | 11.099 | 11.115 | 11.13 | 10.437 | 100.0% | 10 | | -> duration | 5.821 | 6.175 | 7.099 | 7.115 | 7.13 | 6.437 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.187862 Full duration: 38.853038 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.057 | 4.132 | 4.274 | 4.287 | 4.3 | 4.153 | 100.0% | 10 | | heat.update_stack | 3.347 | 3.401 | 3.467 | 3.488 | 3.508 | 3.414 | 100.0% | 10 | | heat.delete_stack | 2.285 | 2.365 | 2.414 | 2.424 | 2.433 | 2.367 | 100.0% | 10 | | total | 9.777 | 9.936 | 9.999 | 10.001 | 10.004 | 9.933 | 100.0% | 10 | | -> duration | 5.777 | 5.936 | 5.999 | 6.001 | 6.004 | 5.933 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.839042 Full duration: 36.293818 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.864 | 2.995 | 3.055 | 3.096 | 3.138 | 2.993 | 100.0% | 10 | | heat.update_stack | 2.323 | 2.89 | 3.476 | 3.485 | 3.495 | 2.907 | 100.0% | 10 | | heat.delete_stack | 2.377 | 2.407 | 2.507 | 2.522 | 2.536 | 2.426 | 100.0% | 10 | | total | 7.591 | 8.283 | 8.924 | 8.973 | 9.021 | 8.326 | 100.0% | 10 | | -> duration | 3.591 | 4.283 | 4.924 | 4.973 | 5.021 | 4.326 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.39071 Full duration: 33.517573 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.776 | 3.083 | 3.112 | 3.144 | 3.177 | 3.042 | 100.0% | 10 | | heat.check_stack | 1.347 | 1.407 | 1.47 | 1.478 | 1.486 | 1.411 | 100.0% | 10 | | heat.delete_stack | 2.366 | 2.403 | 2.422 | 2.422 | 2.422 | 2.402 | 100.0% | 10 | | total | 6.489 | 6.912 | 6.964 | 6.969 | 6.973 | 6.855 | 100.0% | 10 | | -> duration | 4.489 | 4.912 | 4.964 | 4.969 | 4.973 | 4.855 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.498434 Full duration: 27.989618 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.836 | 2.98 | 3.017 | 3.042 | 3.067 | 2.956 | 100.0% | 10 | | heat.suspend_stack | 1.358 | 1.417 | 1.5 | 1.501 | 1.502 | 1.428 | 100.0% | 10 | | heat.resume_stack | 1.341 | 1.364 | 1.417 | 1.421 | 1.425 | 1.372 | 100.0% | 10 | | heat.delete_stack | 2.321 | 2.375 | 2.417 | 2.417 | 2.418 | 2.377 | 100.0% | 10 | | total | 7.969 | 8.115 | 8.282 | 8.298 | 8.314 | 8.133 | 100.0% | 10 | | -> duration | 5.969 | 6.115 | 6.282 | 6.298 | 6.314 | 6.133 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.32638 Full duration: 32.467964 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 26869271-6eba-4662-9f6a-3a38cc3db86f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.117 | 0.227 | 0.275 | 0.277 | 0.278 | 0.222 | 100.0% | 10 | | total | 0.117 | 0.227 | 0.275 | 0.277 | 0.278 | 0.222 | 100.0% | 10 | | -> duration | 0.117 | 0.227 | 0.275 | 0.277 | 0.278 | 0.222 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.630126 Full duration: 7.705493 HINTS: * To plot HTML graphics with this data, run: rally task report 26869271-6eba-4662-9f6a-3a38cc3db86f --out output.html * To generate a JUnit report, run: rally task export 26869271-6eba-4662-9f6a-3a38cc3db86f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 26869271-6eba-4662-9f6a-3a38cc3db86f --json --out output.json 2019-03-13 02:06:08,565 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '26869271-6eba-4662-9f6a-3a38cc3db86f', '--out', u'/home/opnfv/functest/results/rally_full/heat.json'] 2019-03-13 02:06:10,708 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 26869271-6eba-4662-9f6a-3a38cc3db86f --out /home/opnfv/functest/results/rally_full/heat.json 2019-03-13 02:06:10.583 9719 INFO rally.api [-] Building 'json' report for the following task(s): '26869271-6eba-4662-9f6a-3a38cc3db86f'. 2019-03-13 02:06:10.615 9719 INFO rally.api [-] The report has been successfully built. 2019-03-13 02:06:10,722 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2019-03-13 02:06:10,722 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2019-03-13 02:06:10,722 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 02:06:10,729 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 02:06:10,730 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2019-03-13 02:06:10,730 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 02:08:18,054 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ba30f4ee-1684-4179-bbe5-e892b91ba871 2019-03-13 02:08:18,054 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'ba30f4ee-1684-4179-bbe5-e892b91ba871'] 2019-03-13 02:08:19,043 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ba30f4ee-1684-4179-bbe5-e892b91ba871 -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.097 | 0.111 | 0.148 | 0.164 | 0.18 | 0.121 | 100.0% | 10 | | keystone_v3.add_role | 0.037 | 0.07 | 0.084 | 0.084 | 0.085 | 0.066 | 100.0% | 10 | | keystone_v3.revoke_role | 0.072 | 0.105 | 0.153 | 0.19 | 0.227 | 0.115 | 100.0% | 10 | | total | 0.231 | 0.301 | 0.353 | 0.38 | 0.406 | 0.302 | 100.0% | 10 | | -> duration | 0.231 | 0.301 | 0.353 | 0.38 | 0.406 | 0.302 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.24497 Full duration: 8.288579 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.091 | 0.108 | 0.114 | 0.122 | 0.129 | 0.106 | 100.0% | 10 | | keystone_v3.add_role | 0.046 | 0.055 | 0.086 | 0.096 | 0.106 | 0.063 | 100.0% | 10 | | keystone_v3.list_roles | 0.056 | 0.088 | 0.108 | 0.134 | 0.159 | 0.087 | 100.0% | 10 | | total | 0.201 | 0.267 | 0.294 | 0.303 | 0.311 | 0.257 | 100.0% | 10 | | -> duration | 0.201 | 0.267 | 0.294 | 0.303 | 0.311 | 0.257 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.053902 Full duration: 8.811895 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.166 | 0.174 | 0.183 | 0.189 | 0.195 | 0.176 | 100.0% | 10 | | keystone_v3.list_projects | 0.07 | 0.092 | 0.119 | 0.12 | 0.121 | 0.095 | 100.0% | 10 | | total | 0.241 | 0.267 | 0.294 | 0.303 | 0.313 | 0.271 | 100.0% | 10 | | -> duration | 0.241 | 0.267 | 0.294 | 0.303 | 0.313 | 0.271 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.171479 Full duration: 8.107276 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.095 | 0.109 | 0.129 | 0.132 | 0.135 | 0.111 | 100.0% | 10 | | keystone_v3.delete_role | 0.058 | 0.074 | 0.096 | 0.102 | 0.108 | 0.077 | 100.0% | 10 | | total | 0.152 | 0.189 | 0.203 | 0.209 | 0.215 | 0.188 | 100.0% | 10 | | -> duration | 0.152 | 0.189 | 0.203 | 0.209 | 0.215 | 0.188 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.98723 Full duration: 6.691983 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.093 | 0.117 | 0.142 | 0.149 | 0.155 | 0.119 | 100.0% | 10 | | keystone_v3.delete_service | 0.071 | 0.079 | 0.109 | 0.113 | 0.118 | 0.089 | 100.0% | 10 | | total | 0.17 | 0.195 | 0.249 | 0.261 | 0.274 | 0.208 | 100.0% | 10 | | -> duration | 0.17 | 0.195 | 0.249 | 0.261 | 0.274 | 0.208 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.91532 Full duration: 6.56746 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.154 | 0.16 | 0.197 | 0.205 | 0.213 | 0.169 | 100.0% | 10 | | keystone_v3.create_user | 0.21 | 0.265 | 0.332 | 0.334 | 0.336 | 0.273 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.022 | 0.025 | 0.031 | 0.038 | 0.044 | 0.028 | 100.0% | 10 | | -> keystone_v3.add_role | 0.053 | 0.075 | 0.085 | 0.086 | 0.086 | 0.073 | 100.0% | 10 | | keystone_v3.create_role | 0.058 | 0.082 | 0.108 | 0.111 | 0.115 | 0.083 | 100.0% | 10 | | keystone_v3.get_project | 0.02 | 0.024 | 0.026 | 0.029 | 0.032 | 0.024 | 100.0% | 10 | | keystone_v3.get_user | 0.022 | 0.025 | 0.027 | 0.028 | 0.028 | 0.025 | 100.0% | 10 | | keystone_v3.get_role | 0.019 | 0.024 | 0.027 | 0.03 | 0.032 | 0.024 | 100.0% | 10 | | keystone_v3.list_services | 0.027 | 0.034 | 0.038 | 0.041 | 0.043 | 0.034 | 100.0% | 10 | | keystone_v3.get_services | 0.018 | 0.024 | 0.027 | 0.027 | 0.028 | 0.023 | 100.0% | 10 | | total | 0.668 | 0.715 | 0.797 | 0.806 | 0.815 | 0.729 | 100.0% | 10 | | -> duration | 0.668 | 0.715 | 0.797 | 0.806 | 0.815 | 0.729 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.508371 Full duration: 13.363055 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.141 | 0.169 | 0.18 | 0.181 | 0.181 | 0.164 | 100.0% | 10 | | keystone_v3.update_project | 0.106 | 0.127 | 0.146 | 0.175 | 0.204 | 0.132 | 100.0% | 10 | | keystone_v3.delete_project | 0.108 | 0.131 | 0.182 | 0.197 | 0.212 | 0.141 | 100.0% | 10 | | total | 0.386 | 0.425 | 0.49 | 0.499 | 0.509 | 0.437 | 100.0% | 10 | | -> duration | 0.386 | 0.425 | 0.49 | 0.499 | 0.509 | 0.437 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.70425 Full duration: 7.227122 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.154 | 0.187 | 0.252 | 0.254 | 0.257 | 0.196 | 100.0% | 10 | | total | 0.187 | 0.229 | 0.302 | 0.308 | 0.313 | 0.242 | 100.0% | 10 | | -> duration | 0.187 | 0.229 | 0.302 | 0.308 | 0.313 | 0.242 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.967752 Full duration: 7.070493 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.155 | 0.177 | 0.189 | 0.192 | 0.194 | 0.177 | 100.0% | 10 | | total | 0.155 | 0.177 | 0.189 | 0.192 | 0.194 | 0.177 | 100.0% | 10 | | -> duration | 0.155 | 0.177 | 0.189 | 0.192 | 0.194 | 0.177 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.947404 Full duration: 6.985584 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.147 | 0.187 | 0.202 | 0.203 | 0.205 | 0.183 | 100.0% | 10 | | keystone_v3.list_users | 0.049 | 0.053 | 0.057 | 0.058 | 0.059 | 0.053 | 100.0% | 10 | | total | 0.234 | 0.278 | 0.298 | 0.3 | 0.302 | 0.275 | 100.0% | 10 | | -> duration | 0.234 | 0.278 | 0.298 | 0.3 | 0.302 | 0.275 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.122133 Full duration: 6.308917 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba30f4ee-1684-4179-bbe5-e892b91ba871 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.151 | 0.169 | 0.189 | 0.191 | 0.193 | 0.171 | 100.0% | 10 | | keystone_v3.create_users | 2.834 | 2.864 | 2.951 | 2.956 | 2.962 | 2.884 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 2.834 | 2.864 | 2.951 | 2.956 | 2.961 | 2.884 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.254 | 0.275 | 0.32 | 0.323 | 0.325 | 0.281 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 0.746 | 0.763 | 0.926 | 0.942 | 0.958 | 0.802 | 100.0% | 10 | | total | 3.305 | 3.332 | 3.391 | 3.396 | 3.4 | 3.344 | 100.0% | 10 | | -> duration | 3.305 | 3.332 | 3.391 | 3.396 | 3.4 | 3.344 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.29423 Full duration: 25.573479 HINTS: * To plot HTML graphics with this data, run: rally task report ba30f4ee-1684-4179-bbe5-e892b91ba871 --out output.html * To generate a JUnit report, run: rally task export ba30f4ee-1684-4179-bbe5-e892b91ba871 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ba30f4ee-1684-4179-bbe5-e892b91ba871 --json --out output.json 2019-03-13 02:08:19,043 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'ba30f4ee-1684-4179-bbe5-e892b91ba871', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json'] 2019-03-13 02:08:21,390 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ba30f4ee-1684-4179-bbe5-e892b91ba871 --out /home/opnfv/functest/results/rally_full/keystone.json 2019-03-13 02:08:21.269 11828 INFO rally.api [-] Building 'json' report for the following task(s): 'ba30f4ee-1684-4179-bbe5-e892b91ba871'. 2019-03-13 02:08:21.306 11828 INFO rally.api [-] The report has been successfully built. 2019-03-13 02:08:21,407 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2019-03-13 02:08:21,407 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml 2019-03-13 02:08:21,407 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 02:08:21,414 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 02:08:21,417 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2019-03-13 02:08:21,417 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 02:25:16,606 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0166e70e-26dc-40e7-8f78-d3090aa0aa29 2019-03-13 02:25:16,606 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '0166e70e-26dc-40e7-8f78-d3090aa0aa29'] 2019-03-13 02:25:17,497 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0166e70e-26dc-40e7-8f78-d3090aa0aa29 -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.339 | 0.719 | 1.541 | 1.648 | 1.754 | 0.795 | 100.0% | 10 | | neutron.update_network | 0.48 | 0.725 | 0.756 | 0.771 | 0.786 | 0.659 | 100.0% | 10 | | total | 1.09 | 1.233 | 2.11 | 2.196 | 2.282 | 1.454 | 100.0% | 10 | | -> duration | 1.09 | 1.233 | 2.11 | 2.196 | 2.282 | 1.454 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.882991 Full duration: 17.55551 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 0.896 | 1.92 | 3.155 | 3.186 | 3.217 | 1.999 | 100.0% | 10 | | neutron.update_port | 0.44 | 0.679 | 1.006 | 1.03 | 1.054 | 0.702 | 100.0% | 10 | | total | 1.337 | 2.601 | 4.151 | 4.155 | 4.16 | 2.701 | 100.0% | 10 | | -> duration | 1.337 | 2.601 | 4.151 | 4.155 | 4.16 | 2.701 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.367697 Full duration: 59.774703 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.3 | 0.5 | 0.654 | 0.657 | 0.66 | 0.508 | 100.0% | 10 | | neutron.create_subnet | 0.588 | 0.836 | 1.085 | 1.159 | 1.233 | 0.847 | 100.0% | 10 | | neutron.create_router | 0.126 | 0.196 | 0.522 | 0.535 | 0.547 | 0.275 | 100.0% | 10 | | neutron.add_interface_router | 1.614 | 2.872 | 4.143 | 4.174 | 4.205 | 2.904 | 100.0% | 10 | | neutron.update_router | 0.491 | 0.835 | 2.008 | 2.026 | 2.044 | 1.135 | 100.0% | 10 | | total | 3.395 | 4.895 | 8.005 | 8.008 | 8.012 | 5.669 | 100.0% | 10 | | -> duration | 3.395 | 4.895 | 8.005 | 8.008 | 8.012 | 5.669 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.125647 Full duration: 84.105428 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.4.0.0/16", "subnet_update_args": { "enable_dhcp": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.29 | 0.519 | 0.854 | 1.256 | 1.659 | 0.627 | 100.0% | 10 | | neutron.create_subnet | 0.54 | 0.803 | 1.556 | 1.571 | 1.586 | 0.973 | 100.0% | 10 | | neutron.update_subnet | 0.442 | 0.596 | 2.139 | 2.145 | 2.15 | 1.01 | 100.0% | 10 | | total | 1.287 | 2.214 | 4.416 | 4.418 | 4.419 | 2.61 | 100.0% | 10 | | -> duration | 1.287 | 2.214 | 4.416 | 4.418 | 4.419 | 2.61 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.077762 Full duration: 60.728214 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.362 | 0.583 | 0.964 | 1.442 | 1.919 | 0.703 | 100.0% | 10 | | neutron.delete_network | 0.537 | 0.933 | 1.163 | 1.395 | 1.628 | 0.975 | 100.0% | 10 | | total | 1.138 | 1.519 | 2.223 | 2.502 | 2.78 | 1.678 | 100.0% | 10 | | -> duration | 1.138 | 1.519 | 2.223 | 2.502 | 2.78 | 1.678 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.018978 Full duration: 14.410607 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 0.829 | 1.03 | 1.486 | 1.496 | 1.507 | 1.116 | 100.0% | 10 | | neutron.delete_port | 0.472 | 0.745 | 1.042 | 1.409 | 1.777 | 0.815 | 100.0% | 10 | | total | 1.35 | 1.827 | 2.483 | 2.65 | 2.817 | 1.931 | 100.0% | 10 | | -> duration | 1.35 | 1.827 | 2.483 | 2.65 | 2.817 | 1.931 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.205419 Full duration: 52.263409 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.324 | 0.487 | 0.703 | 1.251 | 1.798 | 0.602 | 100.0% | 10 | | neutron.create_subnet | 0.558 | 0.839 | 2.405 | 2.409 | 2.413 | 1.162 | 100.0% | 10 | | neutron.create_router | 0.122 | 0.164 | 0.594 | 1.084 | 1.573 | 0.338 | 100.0% | 10 | | neutron.add_interface_router | 1.542 | 3.828 | 5.293 | 5.313 | 5.333 | 3.706 | 100.0% | 10 | | neutron.remove_interface_router | 1.358 | 2.534 | 5.965 | 6.01 | 6.056 | 3.087 | 100.0% | 10 | | neutron.delete_router | 0.318 | 0.51 | 1.731 | 1.762 | 1.793 | 0.826 | 100.0% | 10 | | total | 5.526 | 9.66 | 13.908 | 13.992 | 14.076 | 9.721 | 100.0% | 10 | | -> duration | 5.526 | 9.66 | 13.908 | 13.992 | 14.076 | 9.721 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.078448 Full duration: 85.204745 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 0.707 | 1.187 | 2.648 | 2.854 | 3.059 | 1.541 | 100.0% | 10 | | neutron.delete_subnet | 0.488 | 1.085 | 2.466 | 2.656 | 2.845 | 1.317 | 100.0% | 10 | | total | 1.58 | 2.726 | 4.185 | 4.419 | 4.653 | 2.858 | 100.0% | 10 | | -> duration | 1.58 | 2.726 | 4.185 | 4.419 | 4.653 | 2.858 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.451377 Full duration: 52.928725 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.318 | 0.537 | 0.855 | 0.882 | 0.909 | 0.574 | 100.0% | 10 | | neutron.list_networks | 0.091 | 0.169 | 0.235 | 0.247 | 0.26 | 0.175 | 100.0% | 10 | | total | 0.409 | 0.706 | 1.101 | 1.105 | 1.109 | 0.75 | 100.0% | 10 | | -> duration | 0.409 | 0.706 | 1.101 | 1.105 | 1.109 | 0.75 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.210267 Full duration: 17.124707 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 0.746 | 1.047 | 1.514 | 1.68 | 1.846 | 1.107 | 100.0% | 10 | | neutron.list_ports | 0.057 | 0.082 | 0.123 | 0.124 | 0.124 | 0.086 | 100.0% | 10 | | total | 0.836 | 1.109 | 1.635 | 1.789 | 1.943 | 1.193 | 100.0% | 10 | | -> duration | 0.836 | 1.109 | 1.635 | 1.789 | 1.943 | 1.193 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.34244 Full duration: 55.954108 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.299 | 0.576 | 0.843 | 1.309 | 1.776 | 0.647 | 100.0% | 10 | | neutron.create_subnet | 0.591 | 0.78 | 1.146 | 1.16 | 1.174 | 0.841 | 100.0% | 10 | | neutron.create_router | 0.12 | 0.178 | 0.269 | 0.311 | 0.352 | 0.202 | 100.0% | 10 | | neutron.add_interface_router | 1.6 | 2.906 | 4.272 | 4.278 | 4.283 | 2.906 | 100.0% | 10 | | neutron.list_routers | 0.124 | 0.157 | 0.346 | 0.862 | 1.378 | 0.284 | 100.0% | 10 | | total | 2.797 | 4.535 | 6.614 | 6.88 | 7.146 | 4.881 | 100.0% | 10 | | -> duration | 2.797 | 4.535 | 6.614 | 6.88 | 7.146 | 4.881 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.79259 Full duration: 84.243498 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.327 | 0.446 | 0.55 | 0.571 | 0.592 | 0.448 | 100.0% | 10 | | neutron.create_subnet | 0.597 | 0.679 | 2.312 | 2.312 | 2.313 | 0.993 | 100.0% | 10 | | neutron.list_subnets | 0.07 | 0.085 | 0.098 | 0.1 | 0.102 | 0.086 | 100.0% | 10 | | total | 1.005 | 1.226 | 2.952 | 2.963 | 2.975 | 1.526 | 100.0% | 10 | | -> duration | 1.005 | 1.226 | 2.952 | 2.963 | 2.975 | 1.526 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.021902 Full duration: 62.845403 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.317 | 0.52 | 0.88 | 0.891 | 0.903 | 0.592 | 100.0% | 10 | | neutron.delete_security_group | 0.119 | 0.136 | 0.257 | 0.259 | 0.261 | 0.157 | 100.0% | 10 | | total | 0.448 | 0.65 | 1.137 | 1.151 | 1.164 | 0.749 | 100.0% | 10 | | -> duration | 0.448 | 0.65 | 1.137 | 1.151 | 1.164 | 0.749 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.114013 Full duration: 11.233794 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.274 | 0.411 | 0.518 | 0.539 | 0.561 | 0.412 | 100.0% | 10 | | neutron.create_security_group_rule | 0.18 | 0.203 | 0.272 | 0.283 | 0.293 | 0.213 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.07 | 0.086 | 0.105 | 0.105 | 0.105 | 0.087 | 100.0% | 10 | | neutron.delete_security_group | 0.1 | 0.13 | 0.172 | 0.179 | 0.185 | 0.136 | 100.0% | 10 | | total | 0.665 | 0.822 | 1.098 | 1.102 | 1.106 | 0.848 | 100.0% | 10 | | -> duration | 0.665 | 0.822 | 1.098 | 1.102 | 1.106 | 0.848 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.456468 Full duration: 11.545208 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.334 | 0.535 | 1.163 | 1.512 | 1.86 | 0.706 | 100.0% | 10 | | neutron.create_security_group_rule | 0.167 | 0.197 | 0.256 | 0.268 | 0.281 | 0.208 | 100.0% | 10 | | neutron.list_security_group_rules | 0.02 | 0.055 | 0.087 | 0.088 | 0.09 | 0.057 | 100.0% | 10 | | total | 0.547 | 0.83 | 1.433 | 1.776 | 2.118 | 0.971 | 100.0% | 10 | | -> duration | 0.547 | 0.83 | 1.433 | 1.776 | 2.118 | 0.971 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.760561 Full duration: 14.114682 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.258 | 0.357 | 0.647 | 0.69 | 0.734 | 0.451 | 100.0% | 10 | | neutron.show_security_group | 0.027 | 0.037 | 0.053 | 0.054 | 0.054 | 0.038 | 100.0% | 10 | | total | 0.289 | 0.387 | 0.689 | 0.732 | 0.776 | 0.49 | 100.0% | 10 | | -> duration | 0.289 | 0.387 | 0.689 | 0.732 | 0.776 | 0.49 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.443746 Full duration: 12.358938 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.318 | 0.617 | 0.905 | 0.925 | 0.945 | 0.636 | 100.0% | 10 | | neutron.create_router | 0.17 | 0.202 | 0.415 | 0.932 | 1.448 | 0.334 | 100.0% | 10 | | neutron.add_gateway_router | 1.742 | 3.517 | 4.691 | 4.849 | 5.006 | 3.264 | 100.0% | 10 | | neutron.remove_gateway_router | 0.944 | 2.972 | 3.416 | 3.496 | 3.576 | 2.65 | 100.0% | 10 | | total | 3.26 | 7.546 | 9.133 | 9.172 | 9.212 | 6.884 | 100.0% | 10 | | -> duration | 3.26 | 7.546 | 9.133 | 9.172 | 9.212 | 6.884 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.367984 Full duration: 38.485726 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "router": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "ports_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port (x2) | 1.374 | 2.981 | 5.831 | 6.024 | 6.216 | 3.522 | 100.0% | 10 | | neutron.show_port (x2) | 0.131 | 0.176 | 0.311 | 0.357 | 0.404 | 0.222 | 100.0% | 10 | | total | 1.52 | 3.146 | 6.102 | 6.31 | 6.517 | 3.744 | 100.0% | 10 | | -> duration | 1.52 | 3.146 | 6.102 | 6.31 | 6.517 | 3.744 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.829566 Full duration: 60.431497 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.272 | 0.492 | 0.81 | 1.131 | 1.452 | 0.588 | 100.0% | 10 | | neutron.create_subnet (x2) | 1.012 | 1.295 | 2.656 | 2.774 | 2.891 | 1.762 | 100.0% | 10 | | neutron.create_router (x2) | 0.299 | 0.341 | 0.689 | 0.784 | 0.879 | 0.445 | 100.0% | 10 | | neutron.add_interface_router (x2) | 3.285 | 5.195 | 11.954 | 12.037 | 12.119 | 7.111 | 100.0% | 10 | | neutron.show_router (x2) | 0.169 | 0.243 | 1.713 | 1.79 | 1.868 | 0.668 | 100.0% | 10 | | total | 6.319 | 8.514 | 17.749 | 17.776 | 17.804 | 10.574 | 100.0% | 10 | | -> duration | 6.319 | 8.514 | 17.749 | 17.776 | 17.804 | 10.574 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.706281 Full duration: 112.008507 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0166e70e-26dc-40e7-8f78-d3090aa0aa29 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 0.958 | 1.884 | 3.435 | 3.588 | 3.741 | 2.116 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.093 | 0.117 | 0.187 | 0.253 | 0.318 | 0.14 | 100.0% | 10 | | total | 1.088 | 2.02 | 3.537 | 3.691 | 3.845 | 2.256 | 100.0% | 10 | | -> duration | 1.088 | 2.02 | 3.537 | 3.691 | 3.845 | 2.256 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.047715 Full duration: 71.526764 HINTS: * To plot HTML graphics with this data, run: rally task report 0166e70e-26dc-40e7-8f78-d3090aa0aa29 --out output.html * To generate a JUnit report, run: rally task export 0166e70e-26dc-40e7-8f78-d3090aa0aa29 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0166e70e-26dc-40e7-8f78-d3090aa0aa29 --json --out output.json 2019-03-13 02:25:17,498 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '0166e70e-26dc-40e7-8f78-d3090aa0aa29', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json'] 2019-03-13 02:25:19,868 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0166e70e-26dc-40e7-8f78-d3090aa0aa29 --out /home/opnfv/functest/results/rally_full/neutron.json 2019-03-13 02:25:19.710 18051 INFO rally.api [-] Building 'json' report for the following task(s): '0166e70e-26dc-40e7-8f78-d3090aa0aa29'. 2019-03-13 02:25:19.765 18051 INFO rally.api [-] The report has been successfully built. 2019-03-13 02:25:19,896 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2019-03-13 02:25:19,896 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml 2019-03-13 02:25:19,896 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 02:25:19,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 02:25:19,907 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2019-03-13 02:25:19,907 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['nova'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 03:08:06,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a1913c00-4a5a-4d71-bf5e-6e1161f9cdba 2019-03-13 03:08:06,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'a1913c00-4a5a-4d71-bf5e-6e1161f9cdba'] 2019-03-13 03:08:07,698 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a1913c00-4a5a-4d71-bf5e-6e1161f9cdba -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba: finished -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.272 | 0.36 | 0.445 | 0.493 | 0.541 | 0.377 | 100.0% | 10 | | nova.delete_keypair | 0.032 | 0.045 | 0.07 | 0.077 | 0.083 | 0.051 | 100.0% | 10 | | total | 0.315 | 0.419 | 0.517 | 0.551 | 0.585 | 0.429 | 100.0% | 10 | | -> duration | 0.315 | 0.419 | 0.517 | 0.551 | 0.585 | 0.429 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.213673 Full duration: 7.915886 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.296 | 0.351 | 0.48 | 0.515 | 0.551 | 0.382 | 100.0% | 10 | | nova.list_keypairs | 0.012 | 0.016 | 0.024 | 0.026 | 0.027 | 0.017 | 100.0% | 10 | | total | 0.314 | 0.372 | 0.493 | 0.531 | 0.568 | 0.399 | 100.0% | 10 | | -> duration | 0.314 | 0.372 | 0.493 | 0.531 | 0.568 | 0.399 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.167264 Full duration: 10.515819 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 7.659 | 9.834 | 11.882 | 12.029 | 12.177 | 9.983 | 100.0% | 10 | | nova.reboot_server | 4.491 | 6.684 | 7.06 | 8.066 | 9.072 | 6.116 | 100.0% | 10 | | nova.soft_reboot_server | 123.587 | 125.42 | 126.439 | 126.679 | 126.919 | 125.318 | 100.0% | 10 | | nova.stop_and_start_server | 16.471 | 18.442 | 19.626 | 19.637 | 19.648 | 18.426 | 100.0% | 10 | | -> nova.stop_server | 13.722 | 15.125 | 15.732 | 15.741 | 15.749 | 15.002 | 100.0% | 10 | | -> nova.start_server | 2.635 | 3.321 | 4.058 | 4.517 | 4.976 | 3.424 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 20.188 | 21.259 | 23.407 | 23.957 | 24.506 | 21.727 | 100.0% | 10 | | -> nova.rescue_server | 15.656 | 16.625 | 18.905 | 19.37 | 19.835 | 17.144 | 100.0% | 10 | | -> nova.unrescue_server | 4.47 | 4.55 | 4.743 | 4.752 | 4.761 | 4.583 | 100.0% | 10 | | nova.delete_server | 2.383 | 2.469 | 2.576 | 2.584 | 2.593 | 2.482 | 100.0% | 10 | | total | 179.759 | 183.83 | 187.538 | 187.572 | 187.606 | 184.071 | 100.0% | 10 | | -> duration | 170.759 | 174.83 | 178.538 | 178.572 | 178.606 | 175.071 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 540.676358 Full duration: 594.76711 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.419 | 9.147 | 11.254 | 11.856 | 12.458 | 9.815 | 100.0% | 10 | | nova.delete_server | 2.383 | 2.453 | 4.514 | 4.557 | 4.6 | 2.978 | 100.0% | 10 | | total | 10.838 | 12.3 | 14.922 | 15.99 | 17.058 | 12.793 | 100.0% | 10 | | -> duration | 9.838 | 11.3 | 13.922 | 14.99 | 16.058 | 11.793 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.415984 Full duration: 81.85222 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "detailed": true, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.117 | 11.176 | 13.558 | 14.745 | 15.933 | 11.727 | 100.0% | 10 | | nova.list_servers | 0.19 | 0.258 | 0.722 | 1.04 | 1.358 | 0.404 | 100.0% | 10 | | total | 9.769 | 11.39 | 14.581 | 15.412 | 16.242 | 12.132 | 100.0% | 10 | | -> duration | 8.769 | 10.39 | 13.581 | 14.412 | 15.242 | 11.132 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.285088 Full duration: 93.616102 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "from_image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "to_image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 10.58 | 11.314 | 18.216 | 18.693 | 19.169 | 13.188 | 100.0% | 10 | | nova.rebuild_server | 16.96 | 18.737 | 20.874 | 21.002 | 21.13 | 18.624 | 100.0% | 10 | | nova.delete_server | 2.38 | 2.501 | 4.609 | 4.627 | 4.645 | 3.088 | 100.0% | 10 | | total | 31.929 | 33.509 | 39.198 | 41.929 | 44.66 | 34.901 | 100.0% | 10 | | -> duration | 29.929 | 31.509 | 37.198 | 39.929 | 42.66 | 32.901 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 97.822886 Full duration: 146.045935 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 17.077 | 19.459 | 26.868 | 27.475 | 28.082 | 21.077 | 100.0% | 10 | | nova.snapshot_server | 2.462 | 6.406 | 6.72 | 7.591 | 8.462 | 5.864 | 100.0% | 10 | | -> glance_v2.get_image | 0.028 | 0.036 | 0.043 | 0.046 | 0.05 | 0.036 | 100.0% | 10 | | -> glance.wait_for_image | 2.044 | 6.082 | 6.304 | 7.216 | 8.127 | 5.485 | 100.0% | 10 | | --> glance_v2.get_image (x4) | 0.067 | 0.086 | 0.093 | 0.094 | 0.095 | 0.083 | 100.0% | 6 | | --> glance_v2.get_image (x5) | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | --> glance_v2.get_image (x3) | 0.06 | 0.071 | 0.08 | 0.081 | 0.082 | 0.071 | 100.0% | 2 | | --> glance_v2.get_image (x2) | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 100.0% | 1 | | nova.delete_server (x2) | 4.858 | 5.131 | 9.193 | 9.423 | 9.653 | 6.365 | 100.0% | 10 | | nova.delete_image | 0.346 | 0.446 | 0.514 | 0.531 | 0.549 | 0.432 | 100.0% | 10 | | -> glance_v2.delete_image | 0.33 | 0.428 | 0.492 | 0.507 | 0.522 | 0.413 | 100.0% | 10 | | -> glance.wait_for_delete | 0.013 | 0.018 | 0.023 | 0.025 | 0.026 | 0.018 | 100.0% | 10 | | --> glance_v2.get_image | 0.013 | 0.018 | 0.023 | 0.024 | 0.026 | 0.018 | 0.0% | 10 | | total | 27.489 | 32.114 | 40.484 | 42.182 | 43.881 | 33.738 | 100.0% | 10 | | -> duration | 25.489 | 30.114 | 38.484 | 40.182 | 41.881 | 31.738 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 128.237866 Full duration: 173.531647 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "volume_size": 1, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.623 | 9.664 | 13.494 | 14.324 | 15.153 | 9.487 | 100.0% | 10 | | nova.boot_server | 8.89 | 11.072 | 12.389 | 14.323 | 16.257 | 11.501 | 100.0% | 10 | | total | 15.749 | 21.476 | 24.445 | 24.651 | 24.857 | 20.988 | 100.0% | 10 | | -> duration | 14.749 | 20.476 | 23.445 | 23.651 | 23.857 | 19.988 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 58.751627 Full duration: 81.615758 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 14.363 | 16.223 | 19.391 | 19.432 | 19.474 | 16.611 | 100.0% | 10 | | total | 14.363 | 16.223 | 19.391 | 19.432 | 19.474 | 16.611 | 100.0% | 10 | | -> duration | 13.363 | 15.223 | 18.391 | 18.432 | 18.474 | 15.611 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.290025 Full duration: 67.340973 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "network": {}, "users": { "users_per_tenant": 2, "tenants": 3 }, "servers": { "servers_per_tenant": 2, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "auto_assign_nic": true, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } } }, "args": { "detailed": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.list_servers | 0.259 | 0.331 | 0.486 | 0.504 | 0.522 | 0.354 | 100.0% | 10 | | total | 0.259 | 0.331 | 0.486 | 0.504 | 0.522 | 0.354 | 100.0% | 10 | | -> duration | 0.259 | 0.331 | 0.486 | 0.504 | 0.522 | 0.354 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.012835 Full duration: 90.125479 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "confirm": true, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "force_delete": false, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "to_flavor": { "name": "rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.322 | 12.885 | 17.927 | 18.88 | 19.833 | 13.541 | 100.0% | 10 | | nova.resize | 22.012 | 22.701 | 23.792 | 23.822 | 23.853 | 22.825 | 100.0% | 10 | | nova.resize_confirm | 2.443 | 2.658 | 4.785 | 5.029 | 5.273 | 3.104 | 100.0% | 10 | | nova.delete_server | 2.397 | 3.089 | 4.658 | 4.699 | 4.74 | 3.452 | 100.0% | 10 | | total | 38.792 | 40.906 | 50.495 | 50.698 | 50.902 | 42.923 | 100.0% | 10 | | -> duration | 37.792 | 39.906 | 49.495 | 49.698 | 49.902 | 41.923 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 123.154122 Full duration: 130.649402 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "server_kwargs": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.238 | 0.319 | 0.438 | 0.446 | 0.454 | 0.333 | 100.0% | 10 | | nova.boot_server | 9.438 | 12.62 | 18.067 | 18.501 | 18.936 | 13.348 | 100.0% | 10 | | nova.delete_server | 2.396 | 4.678 | 6.901 | 6.956 | 7.011 | 4.52 | 100.0% | 10 | | nova.delete_keypair | 0.033 | 0.046 | 0.073 | 0.154 | 0.235 | 0.063 | 100.0% | 10 | | total | 13.822 | 17.869 | 23.235 | 23.742 | 24.249 | 18.264 | 100.0% | 10 | | -> duration | 12.822 | 16.869 | 22.235 | 22.742 | 23.249 | 17.264 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.471944 Full duration: 94.205469 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 }, "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "volume_size": 1, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.599 | 6.793 | 11.52 | 13.383 | 15.247 | 7.705 | 100.0% | 10 | | nova.boot_server | 8.811 | 11.076 | 12.283 | 12.636 | 12.99 | 11.086 | 100.0% | 10 | | nova.delete_server | 4.526 | 4.795 | 6.788 | 6.846 | 6.904 | 5.211 | 100.0% | 10 | | total | 20.02 | 22.7 | 29.055 | 30.647 | 32.239 | 24.003 | 100.0% | 10 | | -> duration | 19.02 | 21.7 | 28.055 | 29.647 | 31.239 | 23.003 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.908772 Full duration: 117.282715 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "force_delete": false, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.907 | 12.158 | 18.366 | 18.829 | 19.291 | 13.335 | 100.0% | 10 | | nova.pause_server | 2.303 | 2.405 | 3.676 | 4.321 | 4.966 | 2.768 | 100.0% | 10 | | nova.unpause_server | 2.344 | 2.413 | 2.561 | 2.732 | 2.903 | 2.459 | 100.0% | 10 | | nova.delete_server | 2.421 | 3.625 | 4.958 | 4.992 | 5.026 | 3.69 | 100.0% | 10 | | total | 16.307 | 21.958 | 27.801 | 28.703 | 29.606 | 22.252 | 100.0% | 10 | | -> duration | 11.307 | 16.958 | 22.801 | 23.703 | 24.606 | 17.252 | 100.0% | 10 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.292274 Full duration: 108.525167 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "auto_assign_nic": true, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.147 | 13.267 | 17.142 | 18.465 | 19.787 | 13.586 | 100.0% | 10 | | nova.list_interfaces | 0.092 | 0.105 | 0.133 | 0.136 | 0.14 | 0.109 | 100.0% | 10 | | total | 9.279 | 13.388 | 17.241 | 18.562 | 19.884 | 13.695 | 100.0% | 10 | | -> duration | 8.279 | 12.388 | 16.241 | 17.562 | 18.884 | 12.695 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.879626 Full duration: 90.650929 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_get_console_url args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "console_type": "novnc", "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "auto_assign_nic": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 7.627 | 14.699 | 16.725 | 16.758 | 16.79 | 13.368 | 100.0% | 10 | | nova.get_console_url_server | 0.109 | 0.165 | 0.361 | 0.362 | 0.362 | 0.2 | 100.0% | 10 | | total | 7.988 | 14.847 | 17.056 | 17.068 | 17.08 | 13.569 | 100.0% | 10 | | -> duration | 6.988 | 13.847 | 16.056 | 16.068 | 16.08 | 12.569 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.483995 Full duration: 90.889121 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_attach_interface args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "network_create_args": {}, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "subnet_create_args": {}, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "boot_server_args": { "auto_assign_nic": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 0.672 | 1.019 | 1.999 | 2.394 | 2.789 | 1.223 | 100.0% | 10 | | nova.boot_server | 11.182 | 14.197 | 15.879 | 15.927 | 15.975 | 14.087 | 100.0% | 10 | | nova.attach_interface | 5.598 | 7.478 | 8.139 | 8.164 | 8.189 | 7.176 | 100.0% | 10 | | total | 17.81 | 22.875 | 25.293 | 25.33 | 25.367 | 22.486 | 100.0% | 10 | | -> duration | 16.81 | 21.875 | 24.293 | 24.33 | 24.367 | 21.486 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.940667 Full duration: 133.48315 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_volume_and_list_attachments args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "create_volume_kwargs": {}, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "volume_num": 1, "volume_size": 1, "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "boot_server_kwargs": { "auto_assign_nic": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.963 | 12.725 | 16.838 | 17.666 | 18.493 | 13.149 | 100.0% | 10 | | cinder_v3.create_volume | 2.442 | 2.579 | 3.173 | 4.123 | 5.074 | 2.865 | 100.0% | 10 | | nova.attach_volume | 5.025 | 7.287 | 7.866 | 7.921 | 7.976 | 6.808 | 100.0% | 10 | | nova.list_attachments | 0.046 | 0.06 | 0.082 | 0.09 | 0.098 | 0.065 | 100.0% | 10 | | total | 17.212 | 22.486 | 27.239 | 28.087 | 28.934 | 22.887 | 100.0% | 10 | | -> duration | 16.212 | 21.486 | 26.239 | 27.087 | 27.934 | 21.887 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.952698 Full duration: 136.840411 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_associate_and_dissociate_floating_ip args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "create_floating_ip_args": { "ext_network": "public" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.023 | 13.947 | 16.487 | 17.508 | 18.529 | 14.04 | 100.0% | 10 | | nova.associate_floating_ip | 2.632 | 4.399 | 5.375 | 5.572 | 5.769 | 4.28 | 100.0% | 10 | | -> neutron.list_ports | 0.046 | 0.06 | 0.105 | 0.134 | 0.164 | 0.075 | 100.0% | 10 | | -> neutron.list_floating_ips | 0.071 | 0.11 | 0.257 | 0.263 | 0.268 | 0.137 | 100.0% | 10 | | nova.dissociate_floating_ip | 2.196 | 4.554 | 5.835 | 6.425 | 7.015 | 4.137 | 100.0% | 10 | | -> neutron.list_floating_ips | 0.053 | 0.069 | 0.09 | 0.107 | 0.123 | 0.074 | 100.0% | 10 | | total | 18.379 | 24.054 | 28.846 | 28.886 | 28.926 | 24.652 | 100.0% | 10 | | -> duration | 17.379 | 23.054 | 27.846 | 27.886 | 27.926 | 23.652 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.925881 Full duration: 129.576098 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_associate_floating_ip args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "network": {} }, "args": { "nics": [ { "net-id": "4fbc06ba-d244-44a3-a5f7-3af2fddd8bba" } ], "flavor": { "name": "rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64" }, "image": { "name": "rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64" }, "create_floating_ip_args": { "ext_network": "public" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.378 | 11.542 | 16.718 | 17.425 | 18.133 | 12.553 | 100.0% | 10 | | nova.associate_floating_ip | 2.452 | 3.617 | 4.184 | 4.218 | 4.252 | 3.482 | 100.0% | 10 | | -> neutron.list_ports | 0.041 | 0.051 | 0.058 | 0.059 | 0.059 | 0.051 | 100.0% | 10 | | -> neutron.list_floating_ips | 0.079 | 0.112 | 0.178 | 0.258 | 0.337 | 0.137 | 100.0% | 10 | | total | 13.393 | 16.999 | 22.816 | 23.447 | 24.077 | 17.769 | 100.0% | 10 | | -> duration | 12.393 | 15.999 | 21.816 | 22.447 | 23.077 | 16.769 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.492187 Full duration: 116.813326 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.156 | 0.323 | 0.409 | 0.418 | 0.427 | 0.305 | 100.0% | 10 | | nova.delete_server_group | 0.045 | 0.065 | 0.072 | 0.072 | 0.072 | 0.061 | 100.0% | 10 | | total | 0.222 | 0.38 | 0.473 | 0.483 | 0.494 | 0.367 | 100.0% | 10 | | -> duration | 0.222 | 0.38 | 0.473 | 0.483 | 0.494 | 0.367 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.016816 Full duration: 5.967549 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_get_server_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.14 | 0.231 | 0.296 | 0.298 | 0.301 | 0.225 | 100.0% | 10 | | nova.get_server_group | 0.012 | 0.014 | 0.015 | 0.016 | 0.016 | 0.014 | 100.0% | 10 | | total | 0.152 | 0.247 | 0.312 | 0.313 | 0.314 | 0.239 | 100.0% | 10 | | -> duration | 0.152 | 0.247 | 0.312 | 0.313 | 0.314 | 0.239 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.667059 Full duration: 8.012239 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_list_server_groups args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "all_projects": false, "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a1913c00-4a5a-4d71-bf5e-6e1161f9cdba has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.155 | 0.257 | 0.334 | 0.342 | 0.35 | 0.254 | 100.0% | 10 | | nova.list_server_groups | 0.012 | 0.016 | 0.02 | 0.02 | 0.02 | 0.016 | 100.0% | 10 | | total | 0.167 | 0.274 | 0.351 | 0.36 | 0.369 | 0.27 | 100.0% | 10 | | -> duration | 0.167 | 0.274 | 0.351 | 0.36 | 0.369 | 0.27 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.769501 Full duration: 8.219838 HINTS: * To plot HTML graphics with this data, run: rally task report a1913c00-4a5a-4d71-bf5e-6e1161f9cdba --out output.html * To generate a JUnit report, run: rally task export a1913c00-4a5a-4d71-bf5e-6e1161f9cdba --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a1913c00-4a5a-4d71-bf5e-6e1161f9cdba --json --out output.json 2019-03-13 03:08:07,698 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'a1913c00-4a5a-4d71-bf5e-6e1161f9cdba', '--out', u'/home/opnfv/functest/results/rally_full/nova.json'] 2019-03-13 03:08:09,792 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a1913c00-4a5a-4d71-bf5e-6e1161f9cdba --out /home/opnfv/functest/results/rally_full/nova.json 2019-03-13 03:08:09.628 22366 INFO rally.api [-] Building 'json' report for the following task(s): 'a1913c00-4a5a-4d71-bf5e-6e1161f9cdba'. 2019-03-13 03:08:09.693 22366 INFO rally.api [-] The report has been successfully built. 2019-03-13 03:08:09,822 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2019-03-13 03:08:09,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2019-03-13 03:08:09,822 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-03-13 03:08:09,829 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'NovaServers.boot_and_live_migrate_server', u'Quotas.nova_update_and_delete', u'NovaServers.boot_server_from_volume_and_live_migrate', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_migrate_server', u'^NeutronTrunk'] 2019-03-13 03:08:09,830 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2019-03-13 03:08:09,830 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '4fbc06ba-d244-44a3-a5f7-3af2fddd8bba', 'tenants_amount': 3, 'image_name': 'rally_full-img_b16b135e-b525-4511-95ac-2b6b66194a64', 'flavor_name': 'rally_full-flavor_b16b135e-b525-4511-95ac-2b6b66194a64', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_b16b135e-b525-4511-95ac-2b6b66194a64', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2019-03-13 03:08:44,617 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d0d8ab0e-4211-46ea-87a1-5078a5073bca 2019-03-13 03:08:44,617 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'd0d8ab0e-4211-46ea-87a1-5078a5073bca'] 2019-03-13 03:08:45,400 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d0d8ab0e-4211-46ea-87a1-5078a5073bca -------------------------------------------------------------------------------- Task d0d8ab0e-4211-46ea-87a1-5078a5073bca: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d0d8ab0e-4211-46ea-87a1-5078a5073bca has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.234 | 0.268 | 0.366 | 0.367 | 0.367 | 0.295 | 100.0% | 10 | | quotas.delete_quotas | 0.011 | 0.041 | 0.047 | 0.051 | 0.055 | 0.034 | 100.0% | 10 | | total | 0.262 | 0.308 | 0.409 | 0.41 | 0.41 | 0.33 | 100.0% | 10 | | -> duration | 0.262 | 0.308 | 0.409 | 0.41 | 0.41 | 0.33 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.961644 Full duration: 5.079477 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d0d8ab0e-4211-46ea-87a1-5078a5073bca has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.23 | 0.282 | 0.384 | 0.413 | 0.441 | 0.307 | 100.0% | 10 | | total | 0.23 | 0.282 | 0.384 | 0.413 | 0.441 | 0.307 | 100.0% | 10 | | -> duration | 0.23 | 0.282 | 0.384 | 0.413 | 0.441 | 0.307 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.908553 Full duration: 5.882395 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d0d8ab0e-4211-46ea-87a1-5078a5073bca has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.38 | 0.409 | 0.433 | 0.44 | 0.447 | 0.411 | 100.0% | 10 | | total | 0.428 | 0.467 | 0.498 | 0.499 | 0.5 | 0.469 | 100.0% | 10 | | -> duration | 0.428 | 0.467 | 0.498 | 0.499 | 0.5 | 0.469 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.418507 Full duration: 6.094972 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d0d8ab0e-4211-46ea-87a1-5078a5073bca has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.59 | 0.844 | 0.911 | 0.911 | 0.912 | 0.786 | 100.0% | 10 | | total | 0.59 | 0.845 | 0.911 | 0.911 | 0.912 | 0.786 | 100.0% | 10 | | -> duration | 0.59 | 0.845 | 0.911 | 0.911 | 0.912 | 0.786 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.34354 Full duration: 6.609731 HINTS: * To plot HTML graphics with this data, run: rally task report d0d8ab0e-4211-46ea-87a1-5078a5073bca --out output.html * To generate a JUnit report, run: rally task export d0d8ab0e-4211-46ea-87a1-5078a5073bca --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d0d8ab0e-4211-46ea-87a1-5078a5073bca --json --out output.json 2019-03-13 03:08:45,400 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'd0d8ab0e-4211-46ea-87a1-5078a5073bca', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json'] 2019-03-13 03:08:47,379 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d0d8ab0e-4211-46ea-87a1-5078a5073bca --out /home/opnfv/functest/results/rally_full/quotas.json 2019-03-13 03:08:47.292 22947 INFO rally.api [-] Building 'json' report for the following task(s): 'd0d8ab0e-4211-46ea-87a1-5078a5073bca'. 2019-03-13 03:08:47.300 22947 INFO rally.api [-] The report has been successfully built. 2019-03-13 03:08:47,385 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2019-03-13 03:08:47,388 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:00:53 | 60 | 100.00% | | glance | 00:06:12 | 80 | 100.00% | | cinder | 00:20:21 | 240 | 100.00% | | heat | 00:08:40 | 130 | 100.00% | | keystone | 00:01:44 | 110 | 100.00% | | neutron | 00:16:18 | 200 | 100.00% | | nova | 00:41:58 | 230 | 100.00% | | quotas | 00:00:23 | 40 | 100.00% | | | | | | | TOTAL: | 01:36:34 | 1090 | 100.00% | +----------------+------------+----------------+-----------+ 2019-03-13 03:08:47,388 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 100.00% in 8/8 modules 2019-03-13 03:08:47,388 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html'] 2019-03-13 03:08:51,007 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2019-03-13 03:08:50.215 22949 INFO rally.api [-] Building 'html' report for the following task(s): '7b125725-bf73-4f01-a473-cdb622f3eb35', 'a53a367c-7ac1-4d16-a97b-3d6ee5073115', '69901c5d-8c78-4a96-af91-4433a89a5bf0', '26869271-6eba-4662-9f6a-3a38cc3db86f', 'ba30f4ee-1684-4179-bbe5-e892b91ba871', '0166e70e-26dc-40e7-8f78-d3090aa0aa29', 'a1913c00-4a5a-4d71-bf5e-6e1161f9cdba', 'd0d8ab0e-4211-46ea-87a1-5078a5073bca'. 2019-03-13 03:08:50.871 22949 INFO rally.api [-] The report has been successfully built. 2019-03-13 03:08:51,007 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml'] 2019-03-13 03:08:53,840 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2019-03-13 03:08:53.739 22951 INFO rally.api [-] Building 'junit-xml' report for the following task(s): '7b125725-bf73-4f01-a473-cdb622f3eb35', 'a53a367c-7ac1-4d16-a97b-3d6ee5073115', '69901c5d-8c78-4a96-af91-4433a89a5bf0', '26869271-6eba-4662-9f6a-3a38cc3db86f', 'ba30f4ee-1684-4179-bbe5-e892b91ba871', '0166e70e-26dc-40e7-8f78-d3090aa0aa29', 'a1913c00-4a5a-4d71-bf5e-6e1161f9cdba', 'd0d8ab0e-4211-46ea-87a1-5078a5073bca'. 2019-03-13 03:08:53.747 22951 INFO rally.api [-] The report has been successfully built. 2019-03-13 03:08:53,841 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 101:10 | PASS | +--------------------+------------------+------------------+----------------+ 2019-03-13 03:09:03,520 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK