2020-02-29 20:26:40,473 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/SCG04BIVGNCR/cntt-opnfv-functest-benchmarking-latest-rally_full-run-13 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | SCG04BIVGNCR | | DEBUG | true | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/SCG04BIVGNCR/cntt-opnfv-functest-benchmarking-latest-rally_full-run-13 | | NODE_NAME | intel-pod15 | +-------------------------+----------------------------------------------------------------------------------------------------------------+ 2020-02-29 20:26:40,477 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-02-29 20:26:40,477 - xtesting.ci.run_tests - DEBUG - Test args: rally_full 2020-02-29 20:26:40,486 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2020-02-29 20:26:41,274 - functest.core.tenantnetwork - DEBUG - password: N96Nr=55g+cbRyVXVIudWvS),pW@-^ 2020-02-29 20:26:41,388 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'5abb6be1fbab47498ee265742379ac71', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09'}) 2020-02-29 20:26:41,502 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'dd7d2e5364654d5d9f6cda16d26e9a90', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09'}) 2020-02-29 20:26:42,640 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod15', u'key_manager_api_version': u'v1', 'password': 'N96Nr=55g+cbRyVXVIudWvS),pW@-^', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'project_id': u'5abb6be1fbab47498ee265742379ac71', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}} 2020-02-29 20:26:42,644 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'password': 'N96Nr=55g+cbRyVXVIudWvS),pW@-^', 'project_name': 'rally_full-project_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', 'project_id': '5abb6be1fbab47498ee265742379ac71', 'project_domain_name': 'default'} 2020-02-29 20:26:42,953 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2020-02-29 20:26:43,729 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-02-29T20:26:43Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', u'provider:segmentation_id': 60, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'admin_state_up': True, u'tenant_id': u'5abb6be1fbab47498ee265742379ac71', u'created_at': u'2020-02-29T20:26:43Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'5abb6be1fbab47498ee265742379ac71'}) 2020-02-29 20:26:44,951 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-02-29T20:26:44Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'528cee1c-7530-4cc3-b3d7-e4888dd2330f', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'enable_dhcp': True, u'network_id': u'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', u'tenant_id': u'5abb6be1fbab47498ee265742379ac71', u'created_at': u'2020-02-29T20:26:44Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'5abb6be1fbab47498ee265742379ac71'}) 2020-02-29 20:26:50,959 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-02-29T20:26:46Z', u'revision_number': 6, u'ha': True, u'id': u'4fb92d32-2322-4acc-ac11-4afa233167fe', u'external_gateway_info': {u'network_id': u'47d945d2-b436-42a0-b363-f2c04071cc1d', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'446a4654-193b-46c8-b1c2-e83caf16d93b', u'ip_address': u'10.10.155.48'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'admin_state_up': True, u'tenant_id': u'5abb6be1fbab47498ee265742379ac71', u'created_at': u'2020-02-29T20:26:45Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'5abb6be1fbab47498ee265742379ac71'}) 2020-02-29 20:26:54,827 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/58ec03dc-a1e8-4d7c-8539-23ef0731f916/file', 'owner': u'5abb6be1fbab47498ee265742379ac71', 'id': u'58ec03dc-a1e8-4d7c-8539-23ef0731f916', 'size': 12716032, u'self': u'/v2/images/58ec03dc-a1e8-4d7c-8539-23ef0731f916', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'5abb6be1fbab47498ee265742379ac71', 'name': 'rally_full-project_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-02-29T20:26:54Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-02-29T20:26:54Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/58ec03dc-a1e8-4d7c-8539-23ef0731f916', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'created': u'2020-02-29T20:26:53Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-02-29T20:26:53Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/58ec03dc-a1e8-4d7c-8539-23ef0731f916', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}}) 2020-02-29 20:26:54,925 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'24d1482a8c6248fbbdff3ad22a13894f', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'1b3d76fc-af65-4645-a421-70e13afa64a0', 'swap': 0}) 2020-02-29 20:26:54,977 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-02-29 20:26:59,909 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | a8bb8ae5-f3e1-4409-9165-b62e6eba6037 | 2020-02-29T20:26:59.776748 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: a8bb8ae5-f3e1-4409-9165-b62e6eba6037 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-02-29 20:27:02,711 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-02-29 20:27:03,676 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-02-29 20:27:04,385 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'24d1482a8c6248fbbdff3ad22a13894f', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'd45e1e0c-b16b-4bd9-ba71-d8bd0f8357f7', 'swap': 0}) 2020-02-29 20:27:04,465 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'24d1482a8c6248fbbdff3ad22a13894f', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'd45e1e0c-b16b-4bd9-ba71-d8bd0f8357f7', 'swap': 0}) 2020-02-29 20:27:04,466 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2020-02-29 20:27:04,466 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 20:27:04,489 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 20:27:04,489 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 20:27:04,490 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-02-29 20:27:04,491 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 20:28:08,142 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 2020-02-29 20:28:08,143 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 2020-02-29 20:28:08,143 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'1d0b27f1-1a22-42e7-9266-85e72d6f9a87'] 2020-02-29 20:28:09,300 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.145 | 0.297 | 0.323 | 0.326 | 0.329 | 0.269 | 100.0% | 10 | | total | 0.145 | 0.297 | 0.323 | 0.326 | 0.329 | 0.269 | 100.0% | 10 | | -> duration | 0.145 | 0.297 | 0.323 | 0.326 | 0.329 | 0.269 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.757021 Full duration: 6.843806 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.135 | 0.202 | 0.283 | 0.299 | 0.315 | 0.208 | 100.0% | 10 | | total | 0.248 | 0.393 | 0.592 | 0.598 | 0.605 | 0.414 | 100.0% | 10 | | -> duration | 0.248 | 0.393 | 0.592 | 0.598 | 0.605 | 0.414 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.13455 Full duration: 10.569566 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.2 | 0.27 | 0.361 | 0.425 | 0.488 | 0.288 | 100.0% | 10 | | total | 0.305 | 0.486 | 0.626 | 0.673 | 0.721 | 0.483 | 100.0% | 10 | | -> duration | 0.305 | 0.486 | 0.626 | 0.673 | 0.721 | 0.483 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.470584 Full duration: 7.581292 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.164 | 0.211 | 0.336 | 0.339 | 0.343 | 0.23 | 100.0% | 10 | | total | 0.245 | 0.431 | 0.573 | 0.593 | 0.613 | 0.436 | 100.0% | 10 | | -> duration | 0.245 | 0.431 | 0.573 | 0.593 | 0.613 | 0.436 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.222582 Full duration: 7.685826 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.378 | 0.539 | 0.775 | 0.79 | 0.805 | 0.564 | 100.0% | 10 | | total | 0.455 | 0.683 | 1.001 | 1.002 | 1.004 | 0.717 | 100.0% | 10 | | -> duration | 0.455 | 0.683 | 1.001 | 1.002 | 1.004 | 0.717 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.94622 Full duration: 8.635405 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.209 | 0.29 | 0.369 | 0.371 | 0.373 | 0.3 | 100.0% | 10 | | total | 0.285 | 0.515 | 0.659 | 0.673 | 0.687 | 0.5 | 100.0% | 10 | | -> duration | 0.285 | 0.515 | 0.659 | 0.673 | 0.687 | 0.5 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.40634 Full duration: 9.521113 HINTS: * To plot HTML graphics with this data, run: rally task report 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 --out output.html * To generate a JUnit report, run: rally task export 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 --json --out output.json 2020-02-29 20:28:09,301 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'1d0b27f1-1a22-42e7-9266-85e72d6f9a87', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json'] 2020-02-29 20:28:11,498 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 1d0b27f1-1a22-42e7-9266-85e72d6f9a87 --out /home/opnfv/functest/results/rally_full/authenticate.json 2020-02-29 20:28:11,512 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-02-29 20:28:11,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml 2020-02-29 20:28:11,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 20:28:11,534 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 20:28:11,535 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 20:28:11,536 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-02-29 20:28:11,536 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 20:34:25,096 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 645098fe-52ad-4de4-a39b-380727bec2a0 2020-02-29 20:34:25,097 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 645098fe-52ad-4de4-a39b-380727bec2a0 2020-02-29 20:34:25,097 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'645098fe-52ad-4de4-a39b-380727bec2a0'] 2020-02-29 20:34:26,162 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 645098fe-52ad-4de4-a39b-380727bec2a0 -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.214 | 3.813 | 4.809 | 4.871 | 4.934 | 3.926 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.1 | 0.114 | 0.154 | 0.246 | 0.337 | 0.135 | 100.0% | 10 | | -> glance_v2.upload_data | 0.866 | 1.286 | 2.193 | 2.214 | 2.235 | 1.454 | 100.0% | 10 | | glance_v2.delete_image | 0.495 | 0.856 | 1.573 | 1.634 | 1.695 | 0.936 | 100.0% | 10 | | total | 3.969 | 4.883 | 5.372 | 5.4 | 5.429 | 4.862 | 100.0% | 10 | | -> duration | 3.969 | 4.883 | 5.372 | 5.4 | 5.429 | 4.862 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.885019 Full duration: 22.902649 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.422 | 4.376 | 4.872 | 4.899 | 4.926 | 4.305 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.107 | 0.128 | 0.132 | 0.135 | 0.111 | 100.0% | 10 | | -> glance_v2.upload_data | 1.006 | 2.013 | 2.334 | 2.351 | 2.368 | 1.834 | 100.0% | 10 | | glance_v2.list_images | 0.055 | 0.068 | 0.091 | 0.091 | 0.092 | 0.071 | 100.0% | 10 | | total | 3.506 | 4.435 | 4.942 | 4.967 | 4.991 | 4.377 | 100.0% | 10 | | -> duration | 3.506 | 4.435 | 4.942 | 4.967 | 4.991 | 4.377 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.867193 Full duration: 24.849376 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.141 | 0.227 | 0.315 | 0.332 | 0.349 | 0.233 | 100.0% | 10 | | total | 0.141 | 0.227 | 0.315 | 0.332 | 0.349 | 0.234 | 100.0% | 10 | | -> duration | 0.141 | 0.227 | 0.315 | 0.332 | 0.349 | 0.234 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.184542 Full duration: 8.322707 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.46 | 4.343 | 4.583 | 4.59 | 4.596 | 4.147 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.089 | 0.109 | 0.126 | 0.129 | 0.132 | 0.109 | 100.0% | 10 | | -> glance_v2.upload_data | 1.03 | 1.393 | 1.541 | 1.654 | 1.767 | 1.376 | 100.0% | 10 | | nova.boot_servers | 30.538 | 52.094 | 55.098 | 59.623 | 64.148 | 50.148 | 100.0% | 10 | | total | 34.477 | 55.823 | 59.55 | 64.037 | 68.524 | 54.295 | 100.0% | 10 | | -> duration | 33.477 | 54.823 | 58.55 | 63.037 | 67.524 | 53.295 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 157.126877 Full duration: 199.253896 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.216 | 3.662 | 4.554 | 4.675 | 4.797 | 3.8 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.104 | 0.112 | 0.116 | 0.121 | 0.104 | 100.0% | 10 | | -> glance_v2.upload_data | 0.855 | 0.985 | 1.304 | 1.326 | 1.349 | 1.06 | 100.0% | 10 | | glance_v2.deactivate_image | 0.146 | 0.252 | 0.978 | 0.991 | 1.004 | 0.403 | 100.0% | 10 | | total | 3.472 | 4.353 | 4.795 | 4.896 | 4.998 | 4.203 | 100.0% | 10 | | -> duration | 3.472 | 4.353 | 4.795 | 4.896 | 4.998 | 4.203 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.625656 Full duration: 30.134212 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_download_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.227 | 4.099 | 4.342 | 4.365 | 4.388 | 3.944 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.099 | 0.124 | 0.15 | 0.152 | 0.154 | 0.125 | 100.0% | 10 | | -> glance_v2.upload_data | 0.889 | 1.32 | 1.764 | 1.818 | 1.871 | 1.37 | 100.0% | 10 | | glance_v2.download_image | 0.278 | 0.297 | 0.371 | 0.392 | 0.413 | 0.315 | 100.0% | 10 | | total | 3.507 | 4.399 | 4.677 | 4.716 | 4.755 | 4.259 | 100.0% | 10 | | -> duration | 3.507 | 4.399 | 4.677 | 4.716 | 4.755 | 4.259 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.046144 Full duration: 24.072986 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_get_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.302 | 4.007 | 4.653 | 4.742 | 4.832 | 4.069 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.12 | 0.138 | 0.147 | 0.156 | 0.119 | 100.0% | 10 | | -> glance_v2.upload_data | 0.926 | 1.172 | 1.405 | 1.495 | 1.586 | 1.19 | 100.0% | 10 | | glance_v2.get_image | 0.03 | 0.041 | 0.057 | 0.062 | 0.067 | 0.044 | 100.0% | 10 | | total | 3.355 | 4.056 | 4.685 | 4.78 | 4.876 | 4.113 | 100.0% | 10 | | -> duration | 3.355 | 4.056 | 4.685 | 4.78 | 4.876 | 4.113 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.476836 Full duration: 23.478939 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_update_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 645098fe-52ad-4de4-a39b-380727bec2a0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.291 | 3.479 | 4.521 | 4.58 | 4.639 | 3.803 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.094 | 0.118 | 0.143 | 0.146 | 0.149 | 0.118 | 100.0% | 10 | | -> glance_v2.upload_data | 0.926 | 1.131 | 1.844 | 1.864 | 1.883 | 1.33 | 100.0% | 10 | | glance_v2.update_image | 0.224 | 0.241 | 0.356 | 0.361 | 0.365 | 0.28 | 100.0% | 10 | | total | 3.622 | 3.809 | 4.759 | 4.817 | 4.875 | 4.084 | 100.0% | 10 | | -> duration | 3.622 | 3.809 | 4.759 | 4.817 | 4.875 | 4.084 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.4535 Full duration: 22.425096 HINTS: * To plot HTML graphics with this data, run: rally task report 645098fe-52ad-4de4-a39b-380727bec2a0 --out output.html * To generate a JUnit report, run: rally task export 645098fe-52ad-4de4-a39b-380727bec2a0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 645098fe-52ad-4de4-a39b-380727bec2a0 --json --out output.json 2020-02-29 20:34:26,163 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'645098fe-52ad-4de4-a39b-380727bec2a0', '--out', u'/home/opnfv/functest/results/rally_full/glance.json'] 2020-02-29 20:34:28,140 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 645098fe-52ad-4de4-a39b-380727bec2a0 --out /home/opnfv/functest/results/rally_full/glance.json 2020-02-29 20:34:28,172 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-02-29 20:34:28,172 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml 2020-02-29 20:34:28,172 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 20:34:28,192 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 20:34:28,193 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 20:34:28,195 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-02-29 20:34:28,195 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 20:54:47,705 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: c3528c00-b160-45e3-99be-0de034d16e78 2020-02-29 20:54:47,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c3528c00-b160-45e3-99be-0de034d16e78 2020-02-29 20:54:47,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'c3528c00-b160-45e3-99be-0de034d16e78'] 2020-02-29 20:54:48,876 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c3528c00-b160-45e3-99be-0de034d16e78 -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 22.143 | 29.962 | 45.383 | 46.34 | 47.297 | 32.473 | 100.0% | 10 | | cinder_v3.create_volume | 2.6 | 3.182 | 4.631 | 6.816 | 9.0 | 3.777 | 100.0% | 10 | | nova.attach_volume | 2.941 | 5.491 | 7.334 | 7.496 | 7.658 | 5.179 | 100.0% | 10 | | nova.detach_volume | 2.878 | 3.172 | 5.117 | 5.291 | 5.465 | 3.621 | 100.0% | 10 | | cinder_v3.delete_volume | 2.273 | 2.463 | 3.151 | 3.356 | 3.56 | 2.646 | 100.0% | 10 | | nova.delete_server | 5.135 | 7.783 | 11.357 | 12.041 | 12.726 | 8.257 | 100.0% | 10 | | total | 39.643 | 54.416 | 69.929 | 73.42 | 76.91 | 55.953 | 100.0% | 10 | | -> duration | 38.643 | 53.416 | 68.929 | 72.42 | 75.91 | 54.953 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 154.300681 Full duration: 170.40175 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_snapshots args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 2.504 | 3.738 | 5.183 | 5.354 | 5.524 | 3.9 | 100.0% | 10 | | cinder_v3.list_snapshots | 0.038 | 0.048 | 0.082 | 0.085 | 0.089 | 0.056 | 100.0% | 10 | | total | 2.542 | 3.801 | 5.233 | 5.401 | 5.569 | 3.957 | 100.0% | 10 | | -> duration | 2.542 | 3.801 | 5.233 | 5.401 | 5.569 | 3.957 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.818436 Full duration: 43.590554 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.357 | 10.347 | 12.508 | 12.687 | 12.867 | 10.746 | 100.0% | 10 | | cinder_v3.list_volumes | 0.08 | 0.101 | 0.157 | 0.157 | 0.158 | 0.11 | 100.0% | 10 | | total | 9.469 | 10.441 | 12.6 | 12.774 | 12.947 | 10.856 | 100.0% | 10 | | -> duration | 9.469 | 10.441 | 12.6 | 12.774 | 12.947 | 10.856 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.248846 Full duration: 51.610645 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_list_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.954 | 3.421 | 4.342 | 4.386 | 4.431 | 3.592 | 100.0% | 10 | | cinder_v3.list_volumes | 0.072 | 0.1 | 0.142 | 0.142 | 0.143 | 0.106 | 100.0% | 10 | | total | 3.082 | 3.499 | 4.435 | 4.499 | 4.562 | 3.699 | 100.0% | 10 | | -> duration | 3.082 | 3.499 | 4.435 | 4.499 | 4.562 | 3.699 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.213597 Full duration: 26.375108 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_upload_volume_to_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "container_format": "bare", "force": false, "disk_format": "raw", "do_delete": true, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.739 | 3.24 | 3.54 | 3.572 | 3.603 | 3.214 | 100.0% | 10 | | cinder_v3.upload_volume_to_image | 13.335 | 19.584 | 21.745 | 22.05 | 22.354 | 19.203 | 100.0% | 10 | | cinder_v3.delete_volume | 2.341 | 2.639 | 2.772 | 3.093 | 3.414 | 2.621 | 100.0% | 10 | | glance_v2.delete_image | 1.452 | 1.838 | 3.323 | 3.332 | 3.342 | 2.108 | 100.0% | 10 | | total | 20.241 | 27.081 | 31.085 | 31.126 | 31.168 | 27.146 | 100.0% | 10 | | -> duration | 20.241 | 27.081 | 31.085 | 31.126 | 31.168 | 27.146 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.709908 Full duration: 90.624591 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_nested_snapshots_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "create_vm_params": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ] }, "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "nested_level": 1, "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.491 | 28.825 | 39.658 | 40.9 | 42.141 | 30.559 | 100.0% | 10 | | cinder_v3.create_volume | 2.52 | 2.969 | 4.279 | 5.278 | 6.278 | 3.282 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.431 | 3.197 | 3.858 | 3.962 | 4.066 | 3.193 | 100.0% | 10 | | nova.attach_volume | 3.157 | 4.105 | 5.715 | 5.841 | 5.968 | 4.385 | 100.0% | 10 | | nova.detach_volume | 2.907 | 2.985 | 3.199 | 3.446 | 3.692 | 3.071 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.222 | 2.367 | 2.54 | 2.907 | 3.273 | 2.427 | 100.0% | 10 | | cinder_v3.delete_volume | 2.294 | 2.563 | 3.117 | 3.147 | 3.177 | 2.64 | 100.0% | 10 | | nova.delete_server | 5.112 | 7.854 | 9.208 | 9.494 | 9.779 | 7.298 | 100.0% | 10 | | total | 45.177 | 56.532 | 64.237 | 65.885 | 67.533 | 56.856 | 100.0% | 10 | | -> duration | 44.177 | 55.532 | 63.237 | 64.885 | 66.533 | 55.856 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 161.728153 Full duration: 175.670075 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_snapshot_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "create_vm_params": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ] }, "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.814 | 3.113 | 3.769 | 3.801 | 3.833 | 3.236 | 100.0% | 10 | | cinder_v3.create_snapshot | 2.388 | 2.951 | 4.401 | 4.407 | 4.413 | 3.223 | 100.0% | 10 | | nova.boot_server | 18.468 | 26.615 | 41.084 | 41.134 | 41.183 | 29.153 | 100.0% | 10 | | nova.attach_volume | 2.957 | 3.227 | 4.375 | 4.885 | 5.396 | 3.502 | 100.0% | 10 | | nova.detach_volume | 2.835 | 2.972 | 3.509 | 3.631 | 3.754 | 3.095 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.206 | 2.345 | 2.918 | 3.102 | 3.286 | 2.47 | 100.0% | 10 | | cinder_v3.delete_volume | 2.328 | 2.596 | 3.094 | 4.208 | 5.322 | 2.835 | 100.0% | 10 | | nova.delete_server | 5.36 | 7.407 | 8.384 | 10.64 | 12.895 | 7.385 | 100.0% | 10 | | total | 44.575 | 51.673 | 67.407 | 67.469 | 67.532 | 54.899 | 100.0% | 10 | | -> duration | 43.575 | 50.673 | 66.407 | 66.469 | 66.532 | 53.899 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 156.534731 Full duration: 171.933575 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.715 | 3.327 | 4.736 | 5.086 | 5.435 | 3.639 | 100.0% | 10 | | total | 2.715 | 3.327 | 4.737 | 5.086 | 5.435 | 3.64 | 100.0% | 10 | | -> duration | 2.715 | 3.327 | 4.737 | 5.086 | 5.435 | 3.64 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.990727 Full duration: 23.619222 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.065 | 3.558 | 4.174 | 4.211 | 4.248 | 3.593 | 100.0% | 10 | | total | 3.065 | 3.558 | 4.174 | 4.211 | 4.248 | 3.594 | 100.0% | 10 | | -> duration | 3.065 | 3.558 | 4.174 | 4.211 | 4.248 | 3.594 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.638066 Full duration: 27.691161 -------------------------------------------------------------------------------- test scenario CinderVolumes.list_volumes args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 4, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "detailed": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.list_volumes | 0.233 | 0.275 | 0.424 | 0.427 | 0.429 | 0.309 | 100.0% | 10 | | total | 0.233 | 0.275 | 0.425 | 0.427 | 0.43 | 0.31 | 100.0% | 10 | | -> duration | 0.233 | 0.275 | 0.425 | 0.427 | 0.43 | 0.31 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.944865 Full duration: 52.629523 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 2.751 | 6.179 | 10.12 | 10.226 | 10.333 | 6.161 | 100.0% | 10 | | cinder_v3.delete_snapshot | 2.238 | 2.336 | 4.459 | 4.687 | 4.915 | 2.783 | 100.0% | 10 | | total | 5.075 | 8.799 | 12.523 | 12.548 | 12.574 | 8.945 | 100.0% | 10 | | -> duration | 5.075 | 8.799 | 12.523 | 12.548 | 12.574 | 8.945 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.599818 Full duration: 48.496984 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.836 | 3.728 | 5.04 | 5.198 | 5.356 | 3.814 | 100.0% | 10 | | cinder_v3.delete_volume | 2.294 | 2.476 | 2.714 | 2.737 | 2.76 | 2.503 | 100.0% | 10 | | total | 5.333 | 6.153 | 7.479 | 7.564 | 7.65 | 6.317 | 100.0% | 10 | | -> duration | 5.333 | 6.153 | 7.479 | 7.564 | 7.65 | 6.317 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.298063 Full duration: 29.142858 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.725 | 11.512 | 12.651 | 12.687 | 12.723 | 11.382 | 100.0% | 10 | | cinder_v3.delete_volume | 2.319 | 2.47 | 4.69 | 4.842 | 4.994 | 3.097 | 100.0% | 10 | | total | 12.229 | 13.909 | 17.209 | 17.463 | 17.718 | 14.479 | 100.0% | 10 | | -> duration | 12.229 | 13.909 | 17.209 | 17.463 | 17.718 | 14.479 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.534717 Full duration: 54.74837 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.324 | 4.487 | 5.286 | 5.306 | 5.326 | 4.345 | 100.0% | 10 | | cinder_v3.delete_volume | 2.325 | 2.822 | 3.759 | 3.779 | 3.8 | 2.946 | 100.0% | 10 | | total | 6.802 | 7.288 | 7.836 | 7.843 | 7.85 | 7.292 | 100.0% | 10 | | -> duration | 6.802 | 7.288 | 7.836 | 7.843 | 7.85 | 7.292 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.78808 Full duration: 33.532418 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.701 | 3.323 | 3.814 | 3.911 | 4.008 | 3.316 | 100.0% | 10 | | cinder_v3.extend_volume | 2.418 | 2.55 | 2.99 | 3.009 | 3.029 | 2.633 | 100.0% | 10 | | cinder_v3.delete_volume | 2.311 | 2.458 | 2.628 | 2.634 | 2.641 | 2.465 | 100.0% | 10 | | total | 7.567 | 8.316 | 9.413 | 9.416 | 9.419 | 8.414 | 100.0% | 10 | | -> duration | 7.567 | 8.316 | 9.413 | 9.416 | 9.419 | 8.414 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.360807 Full duration: 38.673777 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.336 | 4.387 | 5.508 | 5.715 | 5.922 | 4.458 | 100.0% | 10 | | cinder_v3.delete_volume | 2.286 | 2.478 | 3.054 | 3.28 | 3.505 | 2.593 | 100.0% | 10 | | total | 5.722 | 6.912 | 8.271 | 8.549 | 8.828 | 7.051 | 100.0% | 10 | | -> duration | 5.722 | 6.912 | 8.271 | 8.549 | 8.828 | 7.051 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.663148 Full duration: 43.461532 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_get_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.251 | 0.739 | 1.608 | 1.643 | 1.678 | 0.864 | 100.0% | 10 | | cinder_v3.get_qos | 0.03 | 0.041 | 0.055 | 0.057 | 0.059 | 0.042 | 100.0% | 10 | | total | 0.292 | 0.776 | 1.645 | 1.683 | 1.721 | 0.906 | 100.0% | 10 | | -> duration | 0.292 | 0.776 | 1.645 | 1.683 | 1.721 | 0.906 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.583272 Full duration: 12.302421 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.191 | 0.354 | 0.406 | 0.409 | 0.413 | 0.328 | 100.0% | 10 | | cinder_v3.list_qos | 0.035 | 0.044 | 0.073 | 0.076 | 0.078 | 0.051 | 100.0% | 10 | | total | 0.263 | 0.399 | 0.446 | 0.459 | 0.472 | 0.38 | 100.0% | 10 | | -> duration | 0.263 | 0.399 | 0.446 | 0.459 | 0.472 | 0.38 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.077557 Full duration: 12.569265 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "set_read_iops_sec": "1001", "set_consumer": "both", "read_iops_sec": "1000", "set_write_iops_sec": "11", "write_iops_sec": "10", "consumer": "back-end" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.336 | 0.503 | 0.672 | 0.749 | 0.827 | 0.525 | 100.0% | 10 | | cinder_v3.set_qos | 0.132 | 0.315 | 0.486 | 0.529 | 0.571 | 0.338 | 100.0% | 10 | | total | 0.64 | 0.838 | 1.05 | 1.139 | 1.228 | 0.863 | 100.0% | 10 | | -> duration | 0.64 | 0.838 | 1.05 | 1.139 | 1.228 | 0.863 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.349855 Full duration: 12.006663 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_get_volume_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.309 | 0.417 | 0.521 | 0.521 | 0.521 | 0.413 | 100.0% | 10 | | cinder_v3.get_volume_type | 0.034 | 0.041 | 0.046 | 0.049 | 0.052 | 0.042 | 100.0% | 10 | | total | 0.349 | 0.461 | 0.56 | 0.56 | 0.561 | 0.455 | 100.0% | 10 | | -> duration | 0.349 | 0.461 | 0.56 | 0.56 | 0.561 | 0.455 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.301323 Full duration: 10.966243 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.281 | 0.4 | 0.594 | 0.639 | 0.685 | 0.437 | 100.0% | 10 | | cinder_v3.list_types | 0.049 | 0.081 | 0.108 | 0.112 | 0.117 | 0.081 | 100.0% | 10 | | total | 0.398 | 0.482 | 0.654 | 0.703 | 0.751 | 0.518 | 100.0% | 10 | | -> duration | 0.398 | 0.482 | 0.654 | 0.703 | 0.751 | 0.518 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.497984 Full duration: 10.87577 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_update_volume_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "test", "update_description": "test update" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.284 | 0.405 | 0.58 | 0.592 | 0.605 | 0.411 | 100.0% | 10 | | cinder_v2.update_volume_type | 0.114 | 0.221 | 0.242 | 0.286 | 0.33 | 0.201 | 100.0% | 10 | | total | 0.397 | 0.595 | 0.812 | 0.822 | 0.832 | 0.612 | 100.0% | 10 | | -> duration | 0.397 | 0.595 | 0.812 | 0.822 | 0.832 | 0.612 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.825968 Full duration: 12.010651 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "control_location": "front-end", "cipher": "aes-xts-plain64", "description": "rally tests creating types", "key_size": 512, "provider": "LuksEncryptor" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.233 | 0.415 | 0.86 | 0.896 | 0.933 | 0.487 | 100.0% | 10 | | cinder_v3.create_encryption_type | 0.095 | 0.212 | 0.759 | 0.802 | 0.844 | 0.298 | 100.0% | 10 | | total | 0.328 | 0.727 | 1.164 | 1.183 | 1.203 | 0.785 | 100.0% | 10 | | -> duration | 0.328 | 0.727 | 1.164 | 1.183 | 1.203 | 0.785 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.208111 Full duration: 12.656048 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_add_and_list_type_access args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3528c00-b160-45e3-99be-0de034d16e78 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.234 | 0.446 | 0.499 | 0.529 | 0.56 | 0.425 | 100.0% | 10 | | cinder_v2.add_type_access | 0.142 | 0.196 | 0.387 | 0.387 | 0.387 | 0.237 | 100.0% | 10 | | cinder_v2.list_type_access | 0.04 | 0.047 | 0.068 | 0.074 | 0.079 | 0.053 | 100.0% | 10 | | total | 0.49 | 0.722 | 0.888 | 0.911 | 0.934 | 0.714 | 100.0% | 10 | | -> duration | 0.49 | 0.722 | 0.888 | 0.911 | 0.934 | 0.714 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.132936 Full duration: 12.625515 HINTS: * To plot HTML graphics with this data, run: rally task report c3528c00-b160-45e3-99be-0de034d16e78 --out output.html * To generate a JUnit report, run: rally task export c3528c00-b160-45e3-99be-0de034d16e78 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c3528c00-b160-45e3-99be-0de034d16e78 --json --out output.json 2020-02-29 20:54:48,879 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'c3528c00-b160-45e3-99be-0de034d16e78', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json'] 2020-02-29 20:54:51,581 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c3528c00-b160-45e3-99be-0de034d16e78 --out /home/opnfv/functest/results/rally_full/cinder.json 2020-02-29 20:54:51,649 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-02-29 20:54:51,650 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml 2020-02-29 20:54:51,650 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 20:54:51,667 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 20:54:51,667 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 20:54:51,668 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-02-29 20:54:51,668 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 21:15:19,317 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 11746554-103d-4219-b7bd-d46117c258ff 2020-02-29 21:15:19,318 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 11746554-103d-4219-b7bd-d46117c258ff 2020-02-29 21:15:19,318 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'11746554-103d-4219-b7bd-d46117c258ff'] 2020-02-29 21:15:20,379 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 11746554-103d-4219-b7bd-d46117c258ff -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.186 | 4.53 | 5.739 | 5.832 | 5.925 | 4.869 | 100.0% | 10 | | heat.delete_stack | 1.216 | 1.251 | 2.307 | 2.325 | 2.343 | 1.462 | 100.0% | 10 | | total | 5.439 | 6.576 | 6.984 | 7.079 | 7.175 | 6.331 | 100.0% | 10 | | -> duration | 3.439 | 4.576 | 4.984 | 5.079 | 5.175 | 4.331 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.240109 Full duration: 31.45162 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template", "parameters": { "image": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09", "public_net": "public", "flavor": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 47.109 | 77.588 | 82.85 | 83.338 | 83.825 | 73.014 | 100.0% | 10 | | heat.delete_stack | 22.026 | 32.39 | 37.794 | 38.667 | 39.539 | 31.697 | 100.0% | 10 | | total | 72.466 | 110.839 | 118.992 | 121.178 | 123.365 | 104.711 | 100.0% | 10 | | -> duration | 70.466 | 108.839 | 116.992 | 119.178 | 121.365 | 102.711 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 302.777516 Full duration: 320.569828 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_volume.yaml.template", "parameters": { "network_id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c", "image": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09", "flavor": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 32.766 | 48.045 | 57.15 | 58.053 | 58.956 | 48.165 | 100.0% | 10 | | heat.delete_stack | 11.059 | 15.472 | 26.679 | 27.656 | 28.633 | 18.101 | 100.0% | 10 | | total | 46.068 | 63.235 | 83.83 | 85.71 | 87.59 | 66.266 | 100.0% | 10 | | -> duration | 44.068 | 61.235 | 81.83 | 83.71 | 85.59 | 64.266 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 188.122551 Full duration: 202.663464 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.29 | 3.958 | 6.77 | 6.89 | 7.009 | 4.87 | 100.0% | 10 | | heat.list_stacks | 0.044 | 0.06 | 0.068 | 0.071 | 0.074 | 0.06 | 100.0% | 10 | | total | 3.334 | 4.017 | 6.843 | 6.955 | 7.068 | 4.93 | 100.0% | 10 | | -> duration | 1.334 | 2.017 | 4.843 | 4.955 | 5.068 | 2.93 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.949563 Full duration: 30.290955 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.657 | 8.242 | 12.113 | 12.276 | 12.44 | 8.776 | 100.0% | 10 | | heat.update_stack | 5.721 | 7.596 | 15.007 | 15.231 | 15.455 | 9.285 | 100.0% | 10 | | heat.delete_stack | 5.665 | 7.822 | 10.063 | 10.602 | 11.142 | 8.15 | 100.0% | 10 | | total | 19.264 | 22.024 | 35.734 | 35.826 | 35.917 | 26.211 | 100.0% | 10 | | -> duration | 15.264 | 18.024 | 31.734 | 31.826 | 31.917 | 22.211 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.564555 Full duration: 87.901616 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.622 | 9.513 | 10.232 | 10.491 | 10.75 | 9.474 | 100.0% | 10 | | heat.update_stack | 2.481 | 4.563 | 4.729 | 5.029 | 5.328 | 4.24 | 100.0% | 10 | | heat.delete_stack | 3.411 | 3.437 | 3.445 | 3.448 | 3.45 | 3.435 | 100.0% | 10 | | total | 15.973 | 16.747 | 18.303 | 18.505 | 18.707 | 17.15 | 100.0% | 10 | | -> duration | 11.973 | 12.747 | 14.303 | 14.505 | 14.707 | 13.15 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.314787 Full duration: 62.881482 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.943 | 11.578 | 12.637 | 13.604 | 14.572 | 11.917 | 100.0% | 10 | | heat.update_stack | 7.821 | 9.288 | 11.378 | 11.772 | 12.165 | 9.551 | 100.0% | 10 | | heat.delete_stack | 5.618 | 9.995 | 13.398 | 13.884 | 14.369 | 9.776 | 100.0% | 10 | | total | 25.421 | 32.219 | 34.209 | 34.353 | 34.498 | 31.244 | 100.0% | 10 | | -> duration | 21.421 | 28.219 | 30.209 | 30.353 | 30.498 | 27.244 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 87.395782 Full duration: 101.715533 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.285 | 11.009 | 13.242 | 13.244 | 13.245 | 10.461 | 100.0% | 10 | | heat.update_stack | 4.553 | 6.9 | 10.39 | 10.416 | 10.442 | 7.735 | 100.0% | 10 | | heat.delete_stack | 5.587 | 5.632 | 8.042 | 9.036 | 10.029 | 6.496 | 100.0% | 10 | | total | 15.458 | 25.763 | 29.387 | 30.95 | 32.513 | 24.692 | 100.0% | 10 | | -> duration | 11.458 | 21.763 | 25.387 | 26.95 | 28.513 | 20.692 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.805485 Full duration: 80.020914 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 11.364 | 12.163 | 16.779 | 16.794 | 16.809 | 13.536 | 100.0% | 10 | | heat.update_stack | 4.499 | 9.207 | 11.414 | 11.945 | 12.477 | 8.374 | 100.0% | 10 | | heat.delete_stack | 3.443 | 8.892 | 11.203 | 11.685 | 12.168 | 8.257 | 100.0% | 10 | | total | 20.108 | 32.108 | 35.826 | 35.928 | 36.029 | 30.168 | 100.0% | 10 | | -> duration | 16.108 | 28.108 | 31.826 | 31.928 | 32.029 | 26.168 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.864762 Full duration: 95.137941 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.512 | 7.454 | 8.549 | 8.606 | 8.662 | 6.825 | 100.0% | 10 | | heat.update_stack | 3.629 | 6.482 | 9.112 | 9.223 | 9.334 | 6.811 | 100.0% | 10 | | heat.delete_stack | 2.378 | 4.527 | 4.693 | 5.176 | 5.66 | 4.007 | 100.0% | 10 | | total | 9.519 | 17.433 | 22.255 | 22.955 | 23.656 | 17.644 | 100.0% | 10 | | -> duration | 5.519 | 13.433 | 18.255 | 18.955 | 19.656 | 13.644 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.237363 Full duration: 61.576774 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.315 | 6.167 | 6.952 | 6.999 | 7.046 | 5.962 | 100.0% | 10 | | heat.check_stack | 1.29 | 1.917 | 2.737 | 2.739 | 2.74 | 1.945 | 100.0% | 10 | | heat.delete_stack | 2.339 | 3.457 | 4.534 | 4.549 | 4.565 | 3.656 | 100.0% | 10 | | total | 7.97 | 11.62 | 13.832 | 13.913 | 13.994 | 11.563 | 100.0% | 10 | | -> duration | 5.97 | 9.62 | 11.832 | 11.913 | 11.994 | 9.563 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.446236 Full duration: 44.487284 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.732 | 6.282 | 10.435 | 10.477 | 10.518 | 7.51 | 100.0% | 10 | | heat.suspend_stack | 2.434 | 3.561 | 4.688 | 4.689 | 4.69 | 3.52 | 100.0% | 10 | | heat.resume_stack | 1.462 | 2.494 | 3.621 | 3.668 | 3.715 | 2.569 | 100.0% | 10 | | heat.delete_stack | 3.409 | 3.445 | 4.516 | 4.525 | 4.534 | 3.66 | 100.0% | 10 | | total | 13.763 | 18.462 | 19.086 | 19.148 | 19.209 | 17.259 | 100.0% | 10 | | -> duration | 11.763 | 16.462 | 17.086 | 17.148 | 17.209 | 15.259 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.123221 Full duration: 61.520034 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 11746554-103d-4219-b7bd-d46117c258ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.184 | 0.319 | 0.441 | 0.459 | 0.477 | 0.337 | 100.0% | 10 | | total | 0.185 | 0.319 | 0.441 | 0.459 | 0.477 | 0.337 | 100.0% | 10 | | -> duration | 0.185 | 0.319 | 0.441 | 0.459 | 0.477 | 0.337 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.944307 Full duration: 10.132591 HINTS: * To plot HTML graphics with this data, run: rally task report 11746554-103d-4219-b7bd-d46117c258ff --out output.html * To generate a JUnit report, run: rally task export 11746554-103d-4219-b7bd-d46117c258ff --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 11746554-103d-4219-b7bd-d46117c258ff --json --out output.json 2020-02-29 21:15:20,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'11746554-103d-4219-b7bd-d46117c258ff', '--out', u'/home/opnfv/functest/results/rally_full/heat.json'] 2020-02-29 21:15:22,625 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 11746554-103d-4219-b7bd-d46117c258ff --out /home/opnfv/functest/results/rally_full/heat.json 2020-02-29 21:15:22,660 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-02-29 21:15:22,660 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2020-02-29 21:15:22,661 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 21:15:22,679 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 21:15:22,679 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 21:15:22,680 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-02-29 21:15:22,680 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 21:18:40,223 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: a4f96ded-ccec-408a-8723-0b1a31e2b4c1 2020-02-29 21:18:40,223 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a4f96ded-ccec-408a-8723-0b1a31e2b4c1 2020-02-29 21:18:40,224 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a4f96ded-ccec-408a-8723-0b1a31e2b4c1'] 2020-02-29 21:18:41,296 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a4f96ded-ccec-408a-8723-0b1a31e2b4c1 -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.055 | 0.113 | 0.216 | 0.223 | 0.23 | 0.125 | 100.0% | 10 | | keystone_v3.add_role | 0.051 | 0.097 | 0.205 | 0.248 | 0.291 | 0.122 | 100.0% | 10 | | keystone_v3.revoke_role | 0.067 | 0.136 | 0.227 | 0.259 | 0.29 | 0.15 | 100.0% | 10 | | total | 0.265 | 0.395 | 0.508 | 0.582 | 0.656 | 0.397 | 100.0% | 10 | | -> duration | 0.265 | 0.395 | 0.508 | 0.582 | 0.656 | 0.397 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.661557 Full duration: 15.021231 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.07 | 0.134 | 0.205 | 0.239 | 0.273 | 0.144 | 100.0% | 10 | | keystone_v3.add_role | 0.047 | 0.071 | 0.192 | 0.221 | 0.25 | 0.103 | 100.0% | 10 | | keystone_v3.list_roles | 0.031 | 0.032 | 0.038 | 0.039 | 0.039 | 0.033 | 100.0% | 10 | | total | 0.184 | 0.258 | 0.448 | 0.453 | 0.458 | 0.281 | 100.0% | 10 | | -> duration | 0.184 | 0.258 | 0.448 | 0.453 | 0.458 | 0.281 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.226598 Full duration: 17.687138 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.132 | 0.2 | 0.276 | 0.282 | 0.287 | 0.204 | 100.0% | 10 | | keystone_v3.list_projects | 0.026 | 0.031 | 0.039 | 0.057 | 0.076 | 0.035 | 100.0% | 10 | | total | 0.159 | 0.237 | 0.303 | 0.311 | 0.319 | 0.239 | 100.0% | 10 | | -> duration | 0.159 | 0.237 | 0.303 | 0.311 | 0.319 | 0.239 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.723764 Full duration: 13.563595 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.096 | 0.316 | 0.745 | 0.862 | 0.978 | 0.385 | 100.0% | 10 | | keystone_v3.delete_role | 0.117 | 0.264 | 0.419 | 0.448 | 0.476 | 0.292 | 100.0% | 10 | | total | 0.338 | 0.61 | 0.991 | 1.043 | 1.096 | 0.677 | 100.0% | 10 | | -> duration | 0.338 | 0.61 | 0.991 | 1.043 | 1.096 | 0.677 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.473604 Full duration: 12.841311 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.051 | 0.141 | 0.351 | 0.878 | 1.404 | 0.254 | 100.0% | 10 | | keystone_v3.delete_service | 0.067 | 0.114 | 0.345 | 0.606 | 0.867 | 0.202 | 100.0% | 10 | | total | 0.119 | 0.25 | 1.082 | 1.387 | 1.692 | 0.456 | 100.0% | 10 | | -> duration | 0.119 | 0.25 | 1.082 | 1.387 | 1.692 | 0.456 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.311208 Full duration: 12.232844 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.12 | 0.19 | 0.311 | 0.325 | 0.338 | 0.209 | 100.0% | 10 | | keystone_v3.create_user | 0.208 | 0.272 | 0.541 | 0.56 | 0.579 | 0.331 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.025 | 0.03 | 0.036 | 0.041 | 0.047 | 0.031 | 100.0% | 10 | | -> keystone_v3.add_role | 0.068 | 0.081 | 0.12 | 0.144 | 0.168 | 0.092 | 100.0% | 10 | | keystone_v3.create_role | 0.047 | 0.068 | 0.173 | 0.175 | 0.176 | 0.095 | 100.0% | 10 | | keystone_v3.get_project | 0.02 | 0.024 | 0.03 | 0.03 | 0.03 | 0.025 | 100.0% | 10 | | keystone_v3.get_user | 0.021 | 0.026 | 0.08 | 0.088 | 0.096 | 0.037 | 100.0% | 10 | | keystone_v3.get_role | 0.017 | 0.023 | 0.037 | 0.066 | 0.095 | 0.03 | 100.0% | 10 | | keystone_v3.list_services | 0.023 | 0.026 | 0.039 | 0.056 | 0.073 | 0.031 | 100.0% | 10 | | keystone_v3.get_services | 0.017 | 0.036 | 0.114 | 0.168 | 0.222 | 0.062 | 100.0% | 10 | | total | 0.595 | 0.732 | 1.146 | 1.19 | 1.234 | 0.844 | 100.0% | 10 | | -> duration | 0.595 | 0.732 | 1.146 | 1.19 | 1.234 | 0.844 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.366781 Full duration: 21.858837 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.123 | 0.255 | 0.557 | 0.636 | 0.714 | 0.314 | 100.0% | 10 | | keystone_v3.update_project | 0.078 | 0.117 | 0.279 | 0.306 | 0.333 | 0.156 | 100.0% | 10 | | keystone_v3.delete_project | 0.138 | 0.293 | 0.493 | 0.558 | 0.623 | 0.339 | 100.0% | 10 | | total | 0.589 | 0.709 | 1.126 | 1.292 | 1.458 | 0.81 | 100.0% | 10 | | -> duration | 0.589 | 0.709 | 1.126 | 1.292 | 1.458 | 0.81 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.799981 Full duration: 13.358127 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.124 | 0.217 | 0.366 | 0.434 | 0.502 | 0.251 | 100.0% | 10 | | total | 0.177 | 0.301 | 0.428 | 0.491 | 0.553 | 0.31 | 100.0% | 10 | | -> duration | 0.177 | 0.301 | 0.428 | 0.491 | 0.553 | 0.31 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.84877 Full duration: 10.387502 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.118 | 0.238 | 0.338 | 0.411 | 0.484 | 0.244 | 100.0% | 10 | | total | 0.118 | 0.238 | 0.338 | 0.411 | 0.484 | 0.244 | 100.0% | 10 | | -> duration | 0.118 | 0.238 | 0.338 | 0.411 | 0.484 | 0.244 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.720236 Full duration: 9.39779 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.114 | 0.206 | 0.302 | 0.323 | 0.343 | 0.218 | 100.0% | 10 | | keystone_v3.list_users | 0.049 | 0.057 | 0.065 | 0.068 | 0.07 | 0.059 | 100.0% | 10 | | total | 0.226 | 0.33 | 0.421 | 0.432 | 0.444 | 0.346 | 100.0% | 10 | | -> duration | 0.226 | 0.33 | 0.421 | 0.432 | 0.444 | 0.346 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.059084 Full duration: 9.631373 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a4f96ded-ccec-408a-8723-0b1a31e2b4c1 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.131 | 0.188 | 1.125 | 1.215 | 1.304 | 0.524 | 100.0% | 10 | | keystone_v3.create_users | 3.571 | 4.367 | 5.076 | 5.097 | 5.119 | 4.257 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 3.571 | 4.367 | 5.076 | 5.097 | 5.118 | 4.257 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.272 | 0.302 | 0.628 | 0.8 | 0.972 | 0.441 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 1.345 | 1.565 | 1.837 | 1.858 | 1.878 | 1.604 | 100.0% | 10 | | total | 3.958 | 5.498 | 5.924 | 5.936 | 5.948 | 5.077 | 100.0% | 10 | | -> duration | 3.958 | 5.498 | 5.924 | 5.936 | 5.948 | 5.077 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.342873 Full duration: 43.623567 HINTS: * To plot HTML graphics with this data, run: rally task report a4f96ded-ccec-408a-8723-0b1a31e2b4c1 --out output.html * To generate a JUnit report, run: rally task export a4f96ded-ccec-408a-8723-0b1a31e2b4c1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a4f96ded-ccec-408a-8723-0b1a31e2b4c1 --json --out output.json 2020-02-29 21:18:41,298 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a4f96ded-ccec-408a-8723-0b1a31e2b4c1', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json'] 2020-02-29 21:18:43,557 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a4f96ded-ccec-408a-8723-0b1a31e2b4c1 --out /home/opnfv/functest/results/rally_full/keystone.json 2020-02-29 21:18:43,599 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-02-29 21:18:43,599 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml 2020-02-29 21:18:43,600 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 21:18:43,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 21:18:43,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 21:18:43,621 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-02-29 21:18:43,621 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 21:35:39,816 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 155c2ab3-af18-4ff7-b904-620e91605330 2020-02-29 21:35:39,816 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 155c2ab3-af18-4ff7-b904-620e91605330 2020-02-29 21:35:39,817 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'155c2ab3-af18-4ff7-b904-620e91605330'] 2020-02-29 21:35:40,982 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 155c2ab3-af18-4ff7-b904-620e91605330 -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.743 | 1.006 | 1.946 | 1.959 | 1.973 | 1.263 | 100.0% | 10 | | neutron.update_network | 0.699 | 0.829 | 1.109 | 1.148 | 1.187 | 0.882 | 100.0% | 10 | | total | 1.442 | 1.83 | 2.933 | 3.046 | 3.16 | 2.146 | 100.0% | 10 | | -> duration | 1.442 | 1.83 | 2.933 | 3.046 | 3.16 | 2.146 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.298783 Full duration: 23.806582 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.446 | 2.389 | 2.666 | 2.718 | 2.77 | 2.237 | 100.0% | 10 | | neutron.update_port | 0.513 | 0.775 | 1.346 | 1.358 | 1.37 | 0.853 | 100.0% | 10 | | total | 2.059 | 3.136 | 3.96 | 3.962 | 3.964 | 3.09 | 100.0% | 10 | | -> duration | 2.059 | 3.136 | 3.96 | 3.962 | 3.964 | 3.09 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.445017 Full duration: 44.418509 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.528 | 0.951 | 1.05 | 1.082 | 1.115 | 0.881 | 100.0% | 10 | | neutron.create_subnet | 1.024 | 2.045 | 3.84 | 3.924 | 4.008 | 2.265 | 100.0% | 10 | | neutron.create_router | 4.447 | 6.352 | 9.832 | 10.113 | 10.393 | 7.341 | 100.0% | 10 | | neutron.add_interface_router | 2.132 | 3.236 | 6.055 | 6.152 | 6.249 | 3.524 | 100.0% | 10 | | neutron.update_router | 0.547 | 0.749 | 1.634 | 1.82 | 2.006 | 0.959 | 100.0% | 10 | | total | 10.335 | 12.092 | 21.358 | 21.544 | 21.73 | 14.973 | 100.0% | 10 | | -> duration | 10.335 | 12.092 | 21.358 | 21.544 | 21.73 | 14.973 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.889463 Full duration: 85.551697 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.4.0.0/16", "subnet_update_args": { "enable_dhcp": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.676 | 1.304 | 1.718 | 1.85 | 1.983 | 1.235 | 100.0% | 10 | | neutron.create_subnet | 0.828 | 1.213 | 1.356 | 1.502 | 1.649 | 1.175 | 100.0% | 10 | | neutron.update_subnet | 0.578 | 0.836 | 2.318 | 2.324 | 2.33 | 1.207 | 100.0% | 10 | | total | 2.467 | 3.234 | 5.123 | 5.124 | 5.125 | 3.617 | 100.0% | 10 | | -> duration | 2.467 | 3.234 | 5.123 | 5.124 | 5.125 | 3.617 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.409375 Full duration: 38.708299 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.516 | 0.796 | 1.994 | 2.012 | 2.03 | 1.163 | 100.0% | 10 | | neutron.delete_network | 0.612 | 0.755 | 0.832 | 0.866 | 0.901 | 0.748 | 100.0% | 10 | | total | 1.276 | 1.607 | 2.618 | 2.688 | 2.758 | 1.91 | 100.0% | 10 | | -> duration | 1.276 | 1.607 | 2.618 | 2.688 | 2.758 | 1.91 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.601856 Full duration: 19.447317 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.144 | 1.544 | 2.249 | 2.255 | 2.261 | 1.662 | 100.0% | 10 | | neutron.delete_port | 0.627 | 0.8 | 1.179 | 1.183 | 1.188 | 0.871 | 100.0% | 10 | | total | 1.905 | 2.337 | 3.428 | 3.439 | 3.449 | 2.533 | 100.0% | 10 | | -> duration | 1.905 | 2.337 | 3.428 | 3.439 | 3.449 | 2.533 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.424036 Full duration: 44.785036 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.571 | 1.049 | 1.632 | 1.795 | 1.958 | 1.164 | 100.0% | 10 | | neutron.create_subnet | 0.705 | 1.185 | 1.651 | 2.125 | 2.598 | 1.333 | 100.0% | 10 | | neutron.create_router | 4.098 | 6.01 | 7.736 | 8.167 | 8.599 | 6.195 | 100.0% | 10 | | neutron.add_interface_router | 1.938 | 3.018 | 3.922 | 3.953 | 3.985 | 2.948 | 100.0% | 10 | | neutron.remove_interface_router | 1.569 | 2.54 | 2.964 | 2.997 | 3.031 | 2.432 | 100.0% | 10 | | neutron.delete_router | 2.53 | 3.349 | 4.214 | 4.948 | 5.683 | 3.579 | 100.0% | 10 | | total | 13.835 | 17.736 | 20.563 | 20.614 | 20.665 | 17.651 | 100.0% | 10 | | -> duration | 13.835 | 17.736 | 20.563 | 20.614 | 20.665 | 17.651 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.763294 Full duration: 80.205363 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 0.928 | 1.54 | 2.072 | 2.19 | 2.309 | 1.538 | 100.0% | 10 | | neutron.delete_subnet | 0.696 | 1.733 | 4.289 | 7.112 | 9.936 | 2.561 | 100.0% | 10 | | total | 1.744 | 3.436 | 5.729 | 8.297 | 10.864 | 4.099 | 100.0% | 10 | | -> duration | 1.744 | 3.436 | 5.729 | 8.297 | 10.864 | 4.099 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.413075 Full duration: 53.441798 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.667 | 1.57 | 2.222 | 2.381 | 2.539 | 1.566 | 100.0% | 10 | | neutron.list_networks | 0.166 | 0.196 | 0.395 | 0.402 | 0.41 | 0.24 | 100.0% | 10 | | total | 0.85 | 1.766 | 2.461 | 2.586 | 2.711 | 1.806 | 100.0% | 10 | | -> duration | 0.85 | 1.766 | 2.461 | 2.586 | 2.711 | 1.806 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.970603 Full duration: 25.487089 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.75 | 2.429 | 2.918 | 2.92 | 2.922 | 2.359 | 100.0% | 10 | | neutron.list_ports | 0.094 | 0.11 | 0.212 | 0.258 | 0.303 | 0.137 | 100.0% | 10 | | total | 1.866 | 2.536 | 3.055 | 3.09 | 3.124 | 2.497 | 100.0% | 10 | | -> duration | 1.866 | 2.536 | 3.055 | 3.09 | 3.124 | 2.497 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.328913 Full duration: 46.901495 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.818 | 1.376 | 1.653 | 1.948 | 2.243 | 1.4 | 100.0% | 10 | | neutron.create_subnet | 0.865 | 2.364 | 3.352 | 3.357 | 3.363 | 2.208 | 100.0% | 10 | | neutron.create_router | 4.029 | 8.936 | 11.297 | 13.199 | 15.1 | 8.812 | 100.0% | 10 | | neutron.add_interface_router | 2.147 | 5.017 | 6.996 | 7.08 | 7.163 | 4.77 | 100.0% | 10 | | neutron.list_routers | 0.091 | 0.111 | 0.161 | 0.203 | 0.246 | 0.123 | 100.0% | 10 | | total | 7.991 | 19.042 | 21.177 | 21.894 | 22.611 | 17.313 | 100.0% | 10 | | -> duration | 7.991 | 19.042 | 21.177 | 21.894 | 22.611 | 17.313 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.391393 Full duration: 91.047778 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.624 | 0.918 | 1.884 | 1.966 | 2.048 | 1.088 | 100.0% | 10 | | neutron.create_subnet | 0.89 | 1.431 | 2.125 | 2.274 | 2.423 | 1.428 | 100.0% | 10 | | neutron.list_subnets | 0.087 | 0.11 | 0.274 | 0.38 | 0.486 | 0.172 | 100.0% | 10 | | total | 1.927 | 2.589 | 3.173 | 3.528 | 3.883 | 2.688 | 100.0% | 10 | | -> duration | 1.927 | 2.589 | 3.173 | 3.528 | 3.883 | 2.688 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.512988 Full duration: 28.825121 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.529 | 1.135 | 1.29 | 1.311 | 1.332 | 1.042 | 100.0% | 10 | | neutron.delete_security_group | 0.175 | 0.209 | 0.242 | 0.25 | 0.259 | 0.209 | 100.0% | 10 | | total | 0.746 | 1.331 | 1.528 | 1.534 | 1.541 | 1.25 | 100.0% | 10 | | -> duration | 0.746 | 1.331 | 1.528 | 1.534 | 1.541 | 1.25 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.514334 Full duration: 22.067116 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.371 | 0.552 | 0.737 | 0.779 | 0.822 | 0.581 | 100.0% | 10 | | neutron.create_security_group_rule | 0.239 | 0.48 | 1.332 | 1.35 | 1.368 | 0.723 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.119 | 0.183 | 0.277 | 0.318 | 0.358 | 0.201 | 100.0% | 10 | | neutron.delete_security_group | 0.172 | 0.334 | 0.529 | 0.579 | 0.629 | 0.336 | 100.0% | 10 | | total | 1.129 | 1.763 | 2.601 | 2.656 | 2.712 | 1.841 | 100.0% | 10 | | -> duration | 1.129 | 1.763 | 2.601 | 2.656 | 2.712 | 1.841 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.404354 Full duration: 21.872489 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.35 | 1.523 | 2.59 | 2.594 | 2.599 | 1.546 | 100.0% | 10 | | neutron.create_security_group_rule | 0.266 | 0.329 | 0.77 | 0.88 | 0.989 | 0.427 | 100.0% | 10 | | neutron.list_security_group_rules | 0.066 | 0.099 | 0.203 | 0.375 | 0.546 | 0.147 | 100.0% | 10 | | total | 0.759 | 2.175 | 2.971 | 2.978 | 2.985 | 2.12 | 100.0% | 10 | | -> duration | 0.759 | 2.175 | 2.971 | 2.978 | 2.985 | 2.12 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.83909 Full duration: 21.151935 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.3 | 0.562 | 1.645 | 1.645 | 1.646 | 0.9 | 100.0% | 10 | | neutron.show_security_group | 0.051 | 0.07 | 0.102 | 0.102 | 0.102 | 0.073 | 100.0% | 10 | | total | 0.383 | 0.624 | 1.747 | 1.747 | 1.748 | 0.972 | 100.0% | 10 | | -> duration | 0.383 | 0.624 | 1.747 | 1.747 | 1.748 | 0.972 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.672111 Full duration: 18.195548 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.707 | 0.987 | 1.098 | 1.102 | 1.105 | 0.979 | 100.0% | 10 | | neutron.create_router | 5.06 | 7.98 | 11.282 | 12.325 | 13.367 | 8.678 | 100.0% | 10 | | neutron.add_gateway_router | 2.254 | 4.062 | 6.553 | 6.629 | 6.704 | 4.416 | 100.0% | 10 | | neutron.remove_gateway_router | 1.368 | 1.884 | 2.472 | 3.104 | 3.736 | 2.089 | 100.0% | 10 | | total | 10.884 | 15.64 | 20.252 | 20.256 | 20.26 | 16.162 | 100.0% | 10 | | -> duration | 10.884 | 15.64 | 20.252 | 20.256 | 20.26 | 16.162 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.556979 Full duration: 78.572721 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "router": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "ports_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port (x2) | 2.725 | 2.931 | 4.147 | 4.247 | 4.347 | 3.293 | 100.0% | 10 | | neutron.show_port (x2) | 0.198 | 0.248 | 0.287 | 0.322 | 0.357 | 0.251 | 100.0% | 10 | | total | 2.923 | 3.171 | 4.365 | 4.493 | 4.621 | 3.545 | 100.0% | 10 | | -> duration | 2.923 | 3.171 | 4.365 | 4.493 | 4.621 | 3.545 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.613411 Full duration: 52.172212 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.548 | 0.779 | 1.159 | 1.569 | 1.978 | 0.902 | 100.0% | 10 | | neutron.create_subnet (x2) | 1.618 | 2.334 | 3.392 | 3.793 | 4.194 | 2.609 | 100.0% | 10 | | neutron.create_router (x2) | 9.343 | 10.699 | 15.074 | 15.881 | 16.689 | 11.777 | 100.0% | 10 | | neutron.add_interface_router (x2) | 4.217 | 5.47 | 6.97 | 7.486 | 8.002 | 5.583 | 100.0% | 10 | | neutron.show_router (x2) | 0.178 | 0.224 | 0.4 | 0.499 | 0.599 | 0.273 | 100.0% | 10 | | total | 16.696 | 20.005 | 25.267 | 26.031 | 26.795 | 21.145 | 100.0% | 10 | | -> duration | 16.696 | 20.005 | 25.267 | 26.031 | 26.795 | 21.145 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 61.989066 Full duration: 123.829966 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 155c2ab3-af18-4ff7-b904-620e91605330 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 2.11 | 2.93 | 3.961 | 4.049 | 4.137 | 3.075 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.169 | 0.198 | 0.336 | 0.358 | 0.379 | 0.231 | 100.0% | 10 | | total | 2.489 | 3.117 | 4.177 | 4.258 | 4.339 | 3.306 | 100.0% | 10 | | -> duration | 2.489 | 3.117 | 4.177 | 4.258 | 4.339 | 3.306 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.729439 Full duration: 64.650162 HINTS: * To plot HTML graphics with this data, run: rally task report 155c2ab3-af18-4ff7-b904-620e91605330 --out output.html * To generate a JUnit report, run: rally task export 155c2ab3-af18-4ff7-b904-620e91605330 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 155c2ab3-af18-4ff7-b904-620e91605330 --json --out output.json 2020-02-29 21:35:40,985 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'155c2ab3-af18-4ff7-b904-620e91605330', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json'] 2020-02-29 21:35:43,056 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 155c2ab3-af18-4ff7-b904-620e91605330 --out /home/opnfv/functest/results/rally_full/neutron.json 2020-02-29 21:35:43,117 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-02-29 21:35:43,117 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml 2020-02-29 21:35:43,117 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 21:35:43,135 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 21:35:43,135 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 21:35:43,137 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-02-29 21:35:43,138 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 22:18:57,797 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: f2660db1-d80e-41ea-bd3e-f0aef8bebda6 2020-02-29 22:18:57,798 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f2660db1-d80e-41ea-bd3e-f0aef8bebda6 2020-02-29 22:18:57,798 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'f2660db1-d80e-41ea-bd3e-f0aef8bebda6'] 2020-02-29 22:18:58,871 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f2660db1-d80e-41ea-bd3e-f0aef8bebda6 -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.333 | 0.777 | 1.071 | 1.104 | 1.137 | 0.772 | 100.0% | 10 | | nova.delete_keypair | 0.047 | 0.113 | 0.213 | 0.258 | 0.302 | 0.132 | 100.0% | 10 | | total | 0.4 | 0.89 | 1.22 | 1.224 | 1.227 | 0.904 | 100.0% | 10 | | -> duration | 0.4 | 0.89 | 1.22 | 1.224 | 1.227 | 0.904 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.521516 Full duration: 18.027993 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.387 | 0.582 | 0.751 | 0.863 | 0.976 | 0.605 | 100.0% | 9 | | nova.list_keypairs | 0.038 | 0.053 | 0.097 | 0.153 | 0.21 | 0.069 | 100.0% | 9 | | total | 0.426 | 0.637 | 0.9 | 0.959 | 1.017 | 0.674 | 100.0% | 9 | | -> duration | 0.426 | 0.637 | 0.9 | 0.959 | 1.017 | 0.674 | 100.0% | 9 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 9 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.250239 Full duration: 15.246409 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 16.202 | 24.481 | 44.813 | 45.811 | 46.809 | 27.778 | 100.0% | 10 | | nova.reboot_server | 9.925 | 13.451 | 17.431 | 18.448 | 19.464 | 13.902 | 100.0% | 10 | | nova.soft_reboot_server | 132.039 | 133.903 | 134.989 | 135.931 | 136.874 | 133.808 | 100.0% | 10 | | nova.stop_and_start_server | 25.416 | 73.46 | 79.441 | 79.599 | 79.758 | 65.629 | 100.0% | 10 | | -> nova.stop_server | 14.632 | 62.078 | 64.557 | 64.764 | 64.972 | 53.427 | 100.0% | 10 | | -> nova.start_server | 9.976 | 11.129 | 15.636 | 16.479 | 17.323 | 12.202 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 19.431 | 69.781 | 72.722 | 73.038 | 73.354 | 65.053 | 100.0% | 10 | | -> nova.rescue_server | 16.846 | 66.508 | 67.226 | 67.304 | 67.383 | 61.147 | 100.0% | 10 | | -> nova.unrescue_server | 2.581 | 2.885 | 6.01 | 6.184 | 6.358 | 3.906 | 100.0% | 10 | | nova.delete_server | 5.068 | 5.445 | 7.842 | 8.604 | 9.366 | 6.172 | 100.0% | 10 | | total | 222.712 | 318.753 | 346.843 | 351.272 | 355.7 | 312.379 | 100.0% | 10 | | -> duration | 213.712 | 309.753 | 337.843 | 342.272 | 346.7 | 303.379 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 891.039681 Full duration: 994.098828 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 21.767 | 32.514 | 47.146 | 48.017 | 48.887 | 33.514 | 100.0% | 10 | | nova.delete_server | 5.065 | 5.57 | 6.727 | 7.066 | 7.404 | 5.899 | 100.0% | 10 | | total | 27.222 | 38.46 | 52.445 | 54.368 | 56.291 | 39.413 | 100.0% | 10 | | -> duration | 26.222 | 37.46 | 51.445 | 53.368 | 55.291 | 38.413 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 112.058583 Full duration: 202.05632 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "detailed": true, "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 18.095 | 28.51 | 38.033 | 38.373 | 38.714 | 28.954 | 100.0% | 10 | | nova.list_servers | 0.362 | 0.422 | 0.528 | 0.571 | 0.615 | 0.446 | 100.0% | 10 | | total | 18.481 | 28.914 | 38.543 | 38.847 | 39.15 | 29.401 | 100.0% | 10 | | -> duration | 17.481 | 27.914 | 37.543 | 37.847 | 38.15 | 28.401 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 81.511212 Full duration: 192.420349 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "from_image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "to_image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.486 | 26.148 | 43.176 | 44.383 | 45.59 | 29.089 | 100.0% | 10 | | nova.rebuild_server | 23.509 | 31.611 | 39.783 | 40.045 | 40.307 | 32.558 | 100.0% | 10 | | nova.delete_server | 5.195 | 5.944 | 7.514 | 7.6 | 7.687 | 6.251 | 100.0% | 10 | | total | 55.962 | 61.43 | 90.518 | 91.411 | 92.305 | 67.899 | 100.0% | 10 | | -> duration | 53.962 | 59.43 | 88.518 | 89.411 | 90.305 | 65.899 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 195.424491 Full duration: 287.700083 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 40.584 | 57.692 | 70.951 | 71.656 | 72.36 | 59.476 | 100.0% | 10 | | nova.snapshot_server | 6.626 | 6.883 | 8.778 | 8.803 | 8.828 | 7.548 | 100.0% | 10 | | -> glance_v2.get_image | 0.075 | 0.085 | 0.092 | 0.093 | 0.094 | 0.085 | 100.0% | 10 | | -> glance.wait_for_image | 6.162 | 6.189 | 8.235 | 8.237 | 8.239 | 6.996 | 100.0% | 10 | | --> glance_v2.get_image (x5) | 0.207 | 0.218 | 0.228 | 0.228 | 0.229 | 0.218 | 100.0% | 4 | | --> glance_v2.get_image (x4) | 0.155 | 0.167 | 0.181 | 0.186 | 0.191 | 0.168 | 100.0% | 6 | | nova.delete_server (x2) | 10.447 | 12.474 | 14.668 | 15.062 | 15.456 | 12.462 | 100.0% | 10 | | nova.delete_image | 0.937 | 1.174 | 1.524 | 1.67 | 1.815 | 1.264 | 100.0% | 10 | | -> glance_v2.delete_image | 0.899 | 1.14 | 1.49 | 1.634 | 1.777 | 1.229 | 100.0% | 10 | | -> glance.wait_for_delete | 0.028 | 0.034 | 0.037 | 0.037 | 0.038 | 0.033 | 100.0% | 10 | | --> glance_v2.get_image | 0.027 | 0.033 | 0.037 | 0.037 | 0.037 | 0.033 | 0.0% | 10 | | total | 61.057 | 79.602 | 95.233 | 95.259 | 95.284 | 80.75 | 100.0% | 10 | | -> duration | 59.057 | 77.602 | 93.233 | 93.259 | 93.284 | 78.75 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 229.485994 Full duration: 320.889073 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "volume_size": 1, "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.288 | 10.942 | 13.196 | 13.498 | 13.8 | 11.225 | 100.0% | 10 | | nova.boot_server | 17.09 | 32.434 | 39.395 | 41.816 | 44.236 | 30.913 | 100.0% | 10 | | total | 28.519 | 43.013 | 51.243 | 53.177 | 55.112 | 42.139 | 100.0% | 10 | | -> duration | 27.519 | 42.013 | 50.243 | 52.177 | 54.112 | 41.139 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 121.026245 Full duration: 158.386381 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 18.986 | 26.033 | 41.14 | 41.545 | 41.949 | 29.206 | 100.0% | 10 | | total | 18.986 | 26.033 | 41.14 | 41.545 | 41.95 | 29.207 | 100.0% | 10 | | -> duration | 17.986 | 25.033 | 40.14 | 40.545 | 40.95 | 28.207 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 81.020889 Full duration: 110.682536 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "network": {}, "users": { "users_per_tenant": 2, "tenants": 3 }, "servers": { "servers_per_tenant": 2, "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "auto_assign_nic": true, "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } } }, "args": { "detailed": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.list_servers | 0.528 | 0.787 | 0.903 | 0.921 | 0.939 | 0.744 | 100.0% | 10 | | total | 0.528 | 0.787 | 0.904 | 0.921 | 0.939 | 0.745 | 100.0% | 10 | | -> duration | 0.528 | 0.787 | 0.904 | 0.921 | 0.939 | 0.745 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.129988 Full duration: 179.560791 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "confirm": true, "nics": [ { "net-id": "d1063f3e-d35b-4aa2-bde4-bdf881d6194c" } ], "image": { "name": "rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "force_delete": false, "flavor": { "name": "rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" }, "to_flavor": { "name": "rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f2660db1-d80e-41ea-bd3e-f0aef8bebda6 has 5 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:25Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:25Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:30Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:30Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:06Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:06Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:27Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:27Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:34Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-02-29T22:18:34Z'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.602 | 38.869 | 41.327 | 41.453 | 41.58 | 32.553 | 100.0% | 5 | | nova.resize | 6.406 | 6.559 | 6.911 | 6.935 | 6.959 | 6.655 | 0.0% | 5 | | total | 27.115 | 45.828 | 48.054 | 48.236 | 48.419 | 39.209 | 0.0% | 5 | | -> duration | 26.115 | 44.828 | 47.054 | 47.236 | 47.419 | 38.209 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 53.311744 Full duration: 75.476849 HINTS: * To plot HTML graphics with this data, run: rally task report f2660db1-d80e-41ea-bd3e-f0aef8bebda6 --out output.html * To generate a JUnit report, run: rally task export f2660db1-d80e-41ea-bd3e-f0aef8bebda6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f2660db1-d80e-41ea-bd3e-f0aef8bebda6 --json --out output.json At least one workload did not pass SLA criteria. 2020-02-29 22:18:58,873 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'f2660db1-d80e-41ea-bd3e-f0aef8bebda6', '--out', u'/home/opnfv/functest/results/rally_full/nova.json'] 2020-02-29 22:19:01,129 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f2660db1-d80e-41ea-bd3e-f0aef8bebda6 --out /home/opnfv/functest/results/rally_full/nova.json 2020-02-29 22:19:01,254 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-02-29 22:19:01,255 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2020-02-29 22:19:01,255 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 22:19:01,269 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 22:19:01,269 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 22:19:01,269 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-02-29 22:19:01,269 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 22:20:01,459 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 36740d97-fa87-4a7c-a8e4-d64b22849d20 2020-02-29 22:20:01,460 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 36740d97-fa87-4a7c-a8e4-d64b22849d20 2020-02-29 22:20:01,460 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'36740d97-fa87-4a7c-a8e4-d64b22849d20'] 2020-02-29 22:20:02,479 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 36740d97-fa87-4a7c-a8e4-d64b22849d20 -------------------------------------------------------------------------------- Task 36740d97-fa87-4a7c-a8e4-d64b22849d20: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36740d97-fa87-4a7c-a8e4-d64b22849d20 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.481 | 0.843 | 1.437 | 1.439 | 1.441 | 0.974 | 100.0% | 10 | | quotas.delete_quotas | 0.031 | 0.081 | 0.188 | 0.191 | 0.194 | 0.096 | 100.0% | 10 | | total | 0.576 | 1.034 | 1.469 | 1.477 | 1.484 | 1.07 | 100.0% | 10 | | -> duration | 0.576 | 1.034 | 1.469 | 1.477 | 1.484 | 1.07 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.871229 Full duration: 9.89441 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36740d97-fa87-4a7c-a8e4-d64b22849d20 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.691 | 0.933 | 2.401 | 2.433 | 2.464 | 1.409 | 100.0% | 10 | | total | 0.691 | 0.933 | 2.401 | 2.433 | 2.465 | 1.409 | 100.0% | 10 | | -> duration | 0.691 | 0.933 | 2.401 | 2.433 | 2.465 | 1.409 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.796378 Full duration: 11.562887 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36740d97-fa87-4a7c-a8e4-d64b22849d20 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.752 | 1.245 | 1.621 | 1.657 | 1.692 | 1.198 | 100.0% | 10 | | total | 0.842 | 1.334 | 1.83 | 1.839 | 1.849 | 1.322 | 100.0% | 10 | | -> duration | 0.842 | 1.334 | 1.83 | 1.839 | 1.849 | 1.322 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.432724 Full duration: 11.755458 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36740d97-fa87-4a7c-a8e4-d64b22849d20 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.691 | 1.775 | 2.976 | 2.979 | 2.983 | 1.986 | 100.0% | 10 | | total | 0.691 | 1.775 | 2.976 | 2.979 | 2.983 | 1.987 | 100.0% | 10 | | -> duration | 0.691 | 1.775 | 2.976 | 2.979 | 2.983 | 1.987 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.275084 Full duration: 14.837266 HINTS: * To plot HTML graphics with this data, run: rally task report 36740d97-fa87-4a7c-a8e4-d64b22849d20 --out output.html * To generate a JUnit report, run: rally task export 36740d97-fa87-4a7c-a8e4-d64b22849d20 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 36740d97-fa87-4a7c-a8e4-d64b22849d20 --json --out output.json 2020-02-29 22:20:02,480 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'36740d97-fa87-4a7c-a8e4-d64b22849d20', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json'] 2020-02-29 22:20:04,679 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 36740d97-fa87-4a7c-a8e4-d64b22849d20 --out /home/opnfv/functest/results/rally_full/quotas.json 2020-02-29 22:20:04,689 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-02-29 22:20:04,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml 2020-02-29 22:20:04,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-02-29 22:20:04,713 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-02-29 22:20:04,713 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'^NeutronTrunk'] 2020-02-29 22:20:04,714 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-02-29 22:20:04,714 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': 'd1063f3e-d35b-4aa2-bde4-bdf881d6194c', 'tenants_amount': 3, 'image_name': 'rally_full-img_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_3b28a953-1f8e-4774-9ed1-d2d0c3d3ba09', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-02-29 22:21:39,068 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: f5f167e8-be5c-4266-9ef0-659866f2f7ca 2020-02-29 22:21:39,068 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f5f167e8-be5c-4266-9ef0-659866f2f7ca 2020-02-29 22:21:39,068 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'f5f167e8-be5c-4266-9ef0-659866f2f7ca'] 2020-02-29 22:21:40,105 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f5f167e8-be5c-4266-9ef0-659866f2f7ca -------------------------------------------------------------------------------- Task f5f167e8-be5c-4266-9ef0-659866f2f7ca: aborted -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 5120, "objects_per_container": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5f167e8-be5c-4266-9ef0-659866f2f7ca has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.207 | 0.415 | 0.618 | 0.619 | 0.619 | 0.432 | 100.0% | 10 | | swift.upload_object (x2) | 0.255 | 0.297 | 0.328 | 0.33 | 0.332 | 0.298 | 100.0% | 10 | | swift.list_objects | 0.23 | 0.299 | 0.341 | 0.354 | 0.366 | 0.3 | 100.0% | 10 | | total | 0.809 | 0.938 | 1.283 | 1.298 | 1.313 | 1.032 | 100.0% | 10 | | -> duration | 0.809 | 0.938 | 1.283 | 1.298 | 1.313 | 1.032 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.027209 Full duration: 23.206616 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "swift_objects": { "object_size": 1024, "containers_per_tenant": 1, "objects_per_container": 10 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5f167e8-be5c-4266-9ef0-659866f2f7ca has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 0.364 | 0.426 | 0.491 | 0.5 | 0.51 | 0.435 | 100.0% | 10 | | swift.list_objects | 0.17 | 0.281 | 0.302 | 0.322 | 0.342 | 0.275 | 100.0% | 10 | | total | 0.649 | 0.705 | 0.752 | 0.755 | 0.758 | 0.71 | 100.0% | 10 | | -> duration | 0.649 | 0.705 | 0.752 | 0.755 | 0.758 | 0.71 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.142082 Full duration: 15.35253 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 1024, "objects_per_container": 5 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5f167e8-be5c-4266-9ef0-659866f2f7ca has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.285 | 0.433 | 0.466 | 0.482 | 0.498 | 0.42 | 100.0% | 10 | | swift.upload_object (x5) | 0.705 | 0.818 | 0.88 | 0.884 | 0.888 | 0.806 | 100.0% | 10 | | swift.download_object (x5) | 0.711 | 0.806 | 0.854 | 0.885 | 0.916 | 0.806 | 100.0% | 10 | | total | 1.861 | 2.04 | 2.159 | 2.171 | 2.183 | 2.034 | 100.0% | 10 | | -> duration | 1.861 | 2.04 | 2.159 | 2.171 | 2.183 | 2.034 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.992958 Full duration: 27.201523 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 102400, "objects_per_container": 5 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f5f167e8-be5c-4266-9ef0-659866f2f7ca has 1 error(s) -------------------------------------------------------------------------------- ClientException: Container PUT failed: http://object-store-airship.intel-pod15.opnfv.org:80/swift/v1/KEY_21fbf7d02703443eaab283128e8a8d4b/s_rally_06d833d6_cauTRyvW 409 Conflict BucketAlreadyExists Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/objects.py", line 74, in run container_name = self._create_container(**kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/utils.py", line 51, in _create_container self.clients("swift").put_container(container_name, **kwargs) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1808, in put_container query_string=query_string) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1722, in _retry service_token=self.service_token, **kwargs) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1061, in put_container raise ClientException.from_response(resp, 'Container PUT failed', body) ClientException: Container PUT failed: http://object-store-airship.intel-pod15.opnfv.org:80/swift/v1/KEY_21fbf7d02703443eaab283128e8a8d4b/s_rally_06d833d6_cauTRyvW 409 Conflict BucketAlreadyExists -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.399 | 0.571 | 0.574 | 0.574 | 0.574 | 0.521 | 80.0% | 5 | | swift.upload_object (x5) | 0.725 | 0.905 | 1.08 | 1.098 | 1.117 | 0.913 | 100.0% | 4 | | swift.delete_object (x5) | 0.868 | 0.899 | 0.907 | 0.907 | 0.908 | 0.893 | 100.0% | 4 | | swift.delete_container | 0.172 | 0.203 | 0.223 | 0.226 | 0.229 | 0.202 | 100.0% | 4 | | total | 0.577 | 2.432 | 2.645 | 2.696 | 2.747 | 2.13 | 80.0% | 5 | | -> duration | 0.577 | 2.432 | 2.645 | 2.696 | 2.747 | 2.13 | 80.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 80.0% | 5 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.027826 Full duration: 16.40373 HINTS: * To plot HTML graphics with this data, run: rally task report f5f167e8-be5c-4266-9ef0-659866f2f7ca --out output.html * To generate a JUnit report, run: rally task export f5f167e8-be5c-4266-9ef0-659866f2f7ca --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f5f167e8-be5c-4266-9ef0-659866f2f7ca --json --out output.json At least one workload did not pass SLA criteria. 2020-02-29 22:21:40,106 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'f5f167e8-be5c-4266-9ef0-659866f2f7ca', '--out', u'/home/opnfv/functest/results/rally_full/swift.json'] 2020-02-29 22:21:42,301 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f5f167e8-be5c-4266-9ef0-659866f2f7ca --out /home/opnfv/functest/results/rally_full/swift.json 2020-02-29 22:21:42,315 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" Failed. 2020-02-29 22:21:42,319 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:00:50 | 60 | 100.00% | | glance | 00:05:55 | 80 | 100.00% | | cinder | 00:19:38 | 240 | 100.00% | | heat | 00:19:50 | 130 | 100.00% | | keystone | 00:02:59 | 110 | 100.00% | | neutron | 00:16:25 | 200 | 100.00% | | nova | 00:42:34 | 104 | 95.19% | | quotas | 00:00:48 | 40 | 100.00% | | swift | 00:01:22 | 35 | 97.14% | | | | | | | TOTAL: | 01:50:24 | 999 | 99.40% | +----------------+------------+----------------+-----------+ 2020-02-29 22:21:42,319 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 99.40% in 7/9 modules 2020-02-29 22:21:42,319 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html'] 2020-02-29 22:21:45,897 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2020-02-29 22:21:45,897 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml'] 2020-02-29 22:21:48,659 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2020-02-29 22:21:48,660 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 115:06 | FAIL | +--------------------+------------------+------------------+----------------+ 2020-02-29 22:22:04,499 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)