2020-04-12 22:53:50,386 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0FLC7ZSQ1U3P | | NODE_NAME | lf-pod4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0FLC7ZSQ1U3P/functest-opnfv-functest-smoke-jerma-rally_sanity-run-180 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0FLC7ZSQ1U3P/functest-opnfv-functest-smoke-jerma-rally_sanity-run-180 | +-------------------------+-------------------------------------------------------------------------------------------------------------------+ 2020-04-12 22:53:50,391 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.12.83/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_NAME="Default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 2020-04-12 22:53:50,391 - xtesting.ci.run_tests - DEBUG - Test args: rally_sanity 2020-04-12 22:53:50,458 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-04-12 22:53:51,645 - functest.core.tenantnetwork - DEBUG - password: zo>b=I_w)D~oy=oC4q7NnWD=4|>~Gn 2020-04-12 22:53:51,938 - functest.core.tenantnetwork - DEBUG - project: Munch({'location': Munch({'cloud': 'envvars', 'region_name': None, 'zone': None, 'project': Munch({'id': 'default', 'name': None, 'domain_id': 'default', 'domain_name': None})}), 'id': 'eb1270d0e26b442e948696859c0141e9', 'name': 'rally_sanity-project_9fbed579-95a1-4fe3-8082-63dd7543b348', 'description': 'Created by OPNFV Functest: rally_sanity', 'is_enabled': True, 'is_domain': False, 'domain_id': 'default', 'properties': Munch({'tags': [], 'options': Munch({})}), 'enabled': True, 'parent_id': 'default', 'tags': [], 'options': Munch({})}) 2020-04-12 22:53:52,085 - functest.core.tenantnetwork - DEBUG - user: Munch({'id': 'c36dd8ef233e4ef6890078116dcba60e', 'email': None, 'name': 'rally_sanity-user_9fbed579-95a1-4fe3-8082-63dd7543b348', 'username': None, 'default_project_id': None, 'domain_id': 'default', 'enabled': True, 'description': None}) 2020-04-12 22:53:52,833 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {'api_timeout': None, 'verify': True, 'cacert': None, 'cert': None, 'key': None, 'application_catalog_api_version': '1', 'auth_type': 'password', 'baremetal_api_version': '1', 'container_api_version': '1', 'container_infra_api_version': '1', 'compute_api_version': '2', 'database_api_version': '1.0', 'disable_vendor_agent': {}, 'dns_api_version': '2', 'interface': 'public', 'floating_ip_source': 'neutron', 'identity_api_version': '3', 'image_api_use_tasks': False, 'image_api_version': '2', 'image_format': 'qcow2', 'key_manager_api_version': 'v1', 'message': '', 'metering_api_version': '2', 'network_api_version': '2', 'object_store_api_version': '1', 'orchestration_api_version': '1', 'secgroup_source': 'neutron', 'status': 'active', 'volume_api_version': '2', 'workflow_api_version': '2', 'auth_url': 'http://172.30.12.83/identity/v3', 'project_name': 'rally_sanity-project_9fbed579-95a1-4fe3-8082-63dd7543b348', 'user_domain_name': 'Default', 'project_domain_name': 'Default', 'username': 'rally_sanity-user_9fbed579-95a1-4fe3-8082-63dd7543b348', 'password': 'zo>b=I_w)D~oy=oC4q7NnWD=4|>~Gn', 'region_name': 'RegionOne', 'project_id': 'eb1270d0e26b442e948696859c0141e9'}}} 2020-04-12 22:53:52,837 - functest.core.tenantnetwork - DEBUG - new cloud {'auth_url': 'http://172.30.12.83/identity/v3', 'project_id': 'eb1270d0e26b442e948696859c0141e9', 'project_name': 'rally_sanity-project_9fbed579-95a1-4fe3-8082-63dd7543b348', 'project_domain_name': 'Default', 'username': 'rally_sanity-user_9fbed579-95a1-4fe3-8082-63dd7543b348', 'user_domain_name': 'Default', 'password': 'zo>b=I_w)D~oy=oC4q7NnWD=4|>~Gn'} 2020-04-12 22:53:53,328 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-04-12 22:53:54,185 - functest.core.tenantnetwork - DEBUG - network: Munch({'id': '1ba26ef4-ad4d-4188-97d5-79d79b73243d', 'name': 'rally_sanity-net_9fbed579-95a1-4fe3-8082-63dd7543b348', 'tenant_id': 'eb1270d0e26b442e948696859c0141e9', 'admin_state_up': True, 'mtu': 1400, 'status': 'ACTIVE', 'subnets': [], 'shared': True, 'project_id': 'eb1270d0e26b442e948696859c0141e9', 'port_security_enabled': True, 'qos_policy_id': None, 'dns_domain': '', 'router:external': False, 'provider:network_type': 'vxlan', 'provider:physical_network': None, 'provider:segmentation_id': 5, 'availability_zone_hints': [], 'is_default': False, 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'description': '', 'l2_adjacency': True, 'tags': [], 'created_at': '2020-04-12T22:53:54Z', 'updated_at': '2020-04-12T22:53:54Z', 'revision_number': 1}) 2020-04-12 22:53:55,829 - functest.core.tenantnetwork - DEBUG - subnet: Munch({'id': '24827af0-451b-4774-9ad7-0df54f18e1ee', 'name': 'rally_sanity-subnet_9fbed579-95a1-4fe3-8082-63dd7543b348', 'tenant_id': 'eb1270d0e26b442e948696859c0141e9', 'network_id': '1ba26ef4-ad4d-4188-97d5-79d79b73243d', 'ip_version': 4, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'gateway_ip': '192.168.120.1', 'cidr': '192.168.120.0/24', 'allocation_pools': [{'start': '192.168.120.2', 'end': '192.168.120.254'}], 'host_routes': [], 'dns_nameservers': ['8.8.8.8'], 'description': '', 'service_types': [], 'segment_id': None, 'tags': [], 'created_at': '2020-04-12T22:53:54Z', 'updated_at': '2020-04-12T22:53:54Z', 'revision_number': 0, 'project_id': 'eb1270d0e26b442e948696859c0141e9'}) 2020-04-12 22:53:57,088 - functest.core.tenantnetwork - DEBUG - router: Munch({'id': '5fb8f411-313d-4d8d-bf0e-fa91f1a468cd', 'name': 'rally_sanity-router_9fbed579-95a1-4fe3-8082-63dd7543b348', 'tenant_id': 'eb1270d0e26b442e948696859c0141e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ca57b3f0-e617-4fe5-9756-6cd6809ba761', 'external_fixed_ips': [{'subnet_id': '0b0ac279-ba73-4e17-b7f9-0220fa78668d', 'ip_address': '172.24.4.141'}, {'subnet_id': 'a3acc304-20ee-480c-b1af-9552eb9eb8fe', 'ip_address': '2001:db8::2a3'}], 'enable_snat': True}, 'description': '', 'availability_zones': [], 'distributed': False, 'ha': False, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2020-04-12T22:53:55Z', 'updated_at': '2020-04-12T22:53:56Z', 'revision_number': 3, 'project_id': 'eb1270d0e26b442e948696859c0141e9'}) 2020-04-12 22:54:00,338 - functest.core.singlevm - DEBUG - image: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'eb1270d0e26b442e948696859c0141e9', 'name': 'rally_sanity-project_9fbed579-95a1-4fe3-8082-63dd7543b348', 'domain_id': None, 'domain_name': 'Default'})}), 'created_at': '2020-04-12T22:54:00Z', 'updated_at': '2020-04-12T22:54:00Z', 'checksum': '443b7623e27ecf03dc9e01ee93f67afe', 'container_format': 'bare', 'direct_url': None, 'disk_format': 'qcow2', 'file': '/v2/images/87284a65-8e3a-47d1-a0c8-edf66f82c00e/file', 'id': '87284a65-8e3a-47d1-a0c8-edf66f82c00e', 'name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'owner': 'eb1270d0e26b442e948696859c0141e9', 'tags': [], 'status': 'active', 'min_ram': 0, 'min_disk': 0, 'size': 12716032, 'virtual_size': 0, 'is_protected': False, 'locations': [], 'properties': {'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi', 'owner_specified.shade.md5': '443b7623e27ecf03dc9e01ee93f67afe', 'owner_specified.shade.object': 'images/rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'owner_specified.shade.sha256': 'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', 'self': '/v2/images/87284a65-8e3a-47d1-a0c8-edf66f82c00e', 'schema': '/v2/schemas/image'}, 'is_public': True, 'visibility': 'public', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi', 'owner_specified.shade.md5': '443b7623e27ecf03dc9e01ee93f67afe', 'owner_specified.shade.object': 'images/rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'owner_specified.shade.sha256': 'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', 'self': '/v2/images/87284a65-8e3a-47d1-a0c8-edf66f82c00e', 'schema': '/v2/schemas/image', 'protected': False, 'metadata': {'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi', 'owner_specified.shade.md5': '443b7623e27ecf03dc9e01ee93f67afe', 'owner_specified.shade.object': 'images/rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'owner_specified.shade.sha256': 'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6513f21e44aa3da349f248188a44bc304a3653a04122d8fb4535423c8e1d14cd6a153f735bb0982e2161b5b5186106570c17a9e58b64dd39390617cd5a350f78', 'self': '/v2/images/87284a65-8e3a-47d1-a0c8-edf66f82c00e', 'schema': '/v2/schemas/image'}, 'created': '2020-04-12T22:54:00Z', 'updated': '2020-04-12T22:54:00Z', 'minDisk': 0, 'minRam': 0}) 2020-04-12 22:54:00,392 - functest.core.singlevm - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'd5571fad9d124116ae0de9e710ef632d', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '4b1b9afb-f4bf-4bbe-8b1e-eb10dccdb87d', 'name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'is_public': True, 'is_disabled': False, 'ram': 512, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}), 'extra_specs': Munch({}), 'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}) 2020-04-12 22:54:00,428 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-04-12 22:54:07,938 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 14569e90-fd05-4875-b778-990165e3da75 | 2020-04-12T22:54:07.642973 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 14569e90-fd05-4875-b778-990165e3da75 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-04-12 22:54:12,059 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-04-12 22:54:13,424 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-04-12 22:54:13,553 - functest.core.singlevm - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'd5571fad9d124116ae0de9e710ef632d', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': 'c2c49ce6-8310-4f92-ad54-1369a42aa9a4', 'name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}), 'extra_specs': Munch({}), 'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}) 2020-04-12 22:54:13,654 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'd5571fad9d124116ae0de9e710ef632d', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': 'c2c49ce6-8310-4f92-ad54-1369a42aa9a4', 'name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}), 'extra_specs': Munch({}), 'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}) 2020-04-12 22:54:13,655 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2020-04-12 22:54:13,655 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 22:54:13,675 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 22:54:13,676 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-04-12 22:54:13,676 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['authenticate'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 22:54:47,129 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: d7f84019-fb57-4a27-bad6-ab0b3b60b941 2020-04-12 22:54:47,129 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d7f84019-fb57-4a27-bad6-ab0b3b60b941 2020-04-12 22:54:47,130 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'd7f84019-fb57-4a27-bad6-ab0b3b60b941'] 2020-04-12 22:54:48,674 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d7f84019-fb57-4a27-bad6-ab0b3b60b941 -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | -> duration | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.279754 Full duration: 2.833405 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 100.0% | 1 | | total | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 100.0% | 1 | | -> duration | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.571202 Full duration: 3.774597 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 100.0% | 1 | | total | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 100.0% | 1 | | -> duration | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.545713 Full duration: 2.906251 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.272 | 0.272 | 0.272 | 0.272 | 0.272 | 0.272 | 100.0% | 1 | | total | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 100.0% | 1 | | -> duration | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.422079 Full duration: 3.086303 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.441 | 0.441 | 0.441 | 0.441 | 0.441 | 0.441 | 100.0% | 1 | | total | 0.691 | 0.691 | 0.691 | 0.691 | 0.691 | 0.691 | 100.0% | 1 | | -> duration | 0.691 | 0.691 | 0.691 | 0.691 | 0.691 | 0.691 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.690596 Full duration: 3.00904 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d7f84019-fb57-4a27-bad6-ab0b3b60b941 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | total | 0.541 | 0.541 | 0.541 | 0.541 | 0.541 | 0.541 | 100.0% | 1 | | -> duration | 0.541 | 0.541 | 0.541 | 0.541 | 0.541 | 0.541 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.540627 Full duration: 3.515294 HINTS: * To plot HTML graphics with this data, run: rally task report d7f84019-fb57-4a27-bad6-ab0b3b60b941 --out output.html * To generate a JUnit report, run: rally task export d7f84019-fb57-4a27-bad6-ab0b3b60b941 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report d7f84019-fb57-4a27-bad6-ab0b3b60b941 --json --out output.json 2020-04-12 22:54:48,675 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'd7f84019-fb57-4a27-bad6-ab0b3b60b941', '--out', '/home/opnfv/functest/results/rally_sanity/authenticate.json'] 2020-04-12 22:54:52,186 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d7f84019-fb57-4a27-bad6-ab0b3b60b941 --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-04-12 22:54:52,191 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-04-12 22:54:52,192 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2020-04-12 22:54:52,192 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 22:54:52,215 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 22:54:52,215 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-04-12 22:54:52,216 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['glance'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 22:55:46,724 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 3eee4bf9-16e7-4e9c-882f-c945cbba6721 2020-04-12 22:55:46,725 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 3eee4bf9-16e7-4e9c-882f-c945cbba6721 2020-04-12 22:55:46,725 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '3eee4bf9-16e7-4e9c-882f-c945cbba6721'] 2020-04-12 22:55:48,146 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3eee4bf9-16e7-4e9c-882f-c945cbba6721 -------------------------------------------------------------------------------- Task 3eee4bf9-16e7-4e9c-882f-c945cbba6721: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eee4bf9-16e7-4e9c-882f-c945cbba6721 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 100.0% | 1 | | -> glance_v2.upload_data | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 100.0% | 1 | | glance_v2.delete_image | 0.419 | 0.419 | 0.419 | 0.419 | 0.419 | 0.419 | 100.0% | 1 | | total | 3.364 | 3.364 | 3.364 | 3.364 | 3.364 | 3.364 | 100.0% | 1 | | -> duration | 3.364 | 3.364 | 3.364 | 3.364 | 3.364 | 3.364 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.364344 Full duration: 7.549793 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eee4bf9-16e7-4e9c-882f-c945cbba6721 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.92 | 2.92 | 2.92 | 2.92 | 2.92 | 2.92 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 100.0% | 1 | | -> glance_v2.upload_data | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 100.0% | 1 | | glance_v2.list_images | 0.166 | 0.166 | 0.166 | 0.166 | 0.166 | 0.166 | 100.0% | 1 | | total | 3.087 | 3.087 | 3.087 | 3.087 | 3.087 | 3.087 | 100.0% | 1 | | -> duration | 3.087 | 3.087 | 3.087 | 3.087 | 3.087 | 3.087 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.087164 Full duration: 7.446926 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eee4bf9-16e7-4e9c-882f-c945cbba6721 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | total | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | -> duration | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.231763 Full duration: 3.035485 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eee4bf9-16e7-4e9c-882f-c945cbba6721 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.846 | 2.846 | 2.846 | 2.846 | 2.846 | 2.846 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | -> glance_v2.upload_data | 0.49 | 0.49 | 0.49 | 0.49 | 0.49 | 0.49 | 100.0% | 1 | | nova.boot_servers | 10.804 | 10.804 | 10.804 | 10.804 | 10.804 | 10.804 | 100.0% | 1 | | total | 13.65 | 13.65 | 13.65 | 13.65 | 13.65 | 13.65 | 100.0% | 1 | | -> duration | 12.65 | 12.65 | 12.65 | 12.65 | 12.65 | 12.65 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.650395 Full duration: 24.039834 HINTS: * To plot HTML graphics with this data, run: rally task report 3eee4bf9-16e7-4e9c-882f-c945cbba6721 --out output.html * To generate a JUnit report, run: rally task export 3eee4bf9-16e7-4e9c-882f-c945cbba6721 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 3eee4bf9-16e7-4e9c-882f-c945cbba6721 --json --out output.json 2020-04-12 22:55:48,147 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '3eee4bf9-16e7-4e9c-882f-c945cbba6721', '--out', '/home/opnfv/functest/results/rally_sanity/glance.json'] 2020-04-12 22:55:51,529 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3eee4bf9-16e7-4e9c-882f-c945cbba6721 --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-04-12 22:55:51,534 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-04-12 22:55:51,534 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2020-04-12 22:55:51,534 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 22:55:51,556 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 22:55:51,565 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-04-12 22:55:51,565 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['cinder'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 22:57:43,955 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 873645e8-50cf-47ed-abb9-48fa511dce71 2020-04-12 22:57:43,956 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 873645e8-50cf-47ed-abb9-48fa511dce71 2020-04-12 22:57:43,956 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '873645e8-50cf-47ed-abb9-48fa511dce71'] 2020-04-12 22:57:45,478 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 873645e8-50cf-47ed-abb9-48fa511dce71 -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 2.536 | 2.536 | 2.536 | 2.536 | 2.536 | 2.536 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.168 | 2.168 | 2.168 | 2.168 | 2.168 | 2.168 | 100.0% | 1 | | total | 4.704 | 4.704 | 4.704 | 4.704 | 4.704 | 4.704 | 100.0% | 1 | | -> duration | 4.704 | 4.704 | 4.704 | 4.704 | 4.704 | 4.704 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.704046 Full duration: 14.137528 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.528 | 2.528 | 2.528 | 2.528 | 2.528 | 2.528 | 100.0% | 1 | | cinder_v3.delete_volume | 2.206 | 2.206 | 2.206 | 2.206 | 2.206 | 2.206 | 100.0% | 1 | | total | 4.735 | 4.735 | 4.735 | 4.735 | 4.735 | 4.735 | 100.0% | 1 | | -> duration | 4.735 | 4.735 | 4.735 | 4.735 | 4.735 | 4.735 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.734886 Full duration: 8.444411 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.902 | 6.902 | 6.902 | 6.902 | 6.902 | 6.902 | 100.0% | 1 | | cinder_v3.delete_volume | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 100.0% | 1 | | total | 9.132 | 9.132 | 9.132 | 9.132 | 9.132 | 9.132 | 100.0% | 1 | | -> duration | 9.132 | 9.132 | 9.132 | 9.132 | 9.132 | 9.132 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.13233 Full duration: 13.526745 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.601 | 2.601 | 2.601 | 2.601 | 2.601 | 2.601 | 100.0% | 1 | | cinder_v3.delete_volume | 2.2 | 2.2 | 2.2 | 2.2 | 2.2 | 2.2 | 100.0% | 1 | | total | 4.801 | 4.801 | 4.801 | 4.801 | 4.801 | 4.801 | 100.0% | 1 | | -> duration | 4.801 | 4.801 | 4.801 | 4.801 | 4.801 | 4.801 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.801118 Full duration: 8.814449 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.562 | 2.562 | 2.562 | 2.562 | 2.562 | 2.562 | 100.0% | 1 | | cinder_v3.extend_volume | 2.278 | 2.278 | 2.278 | 2.278 | 2.278 | 2.278 | 100.0% | 1 | | cinder_v3.delete_volume | 2.213 | 2.213 | 2.213 | 2.213 | 2.213 | 2.213 | 100.0% | 1 | | total | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 100.0% | 1 | | -> duration | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 7.054 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.053668 Full duration: 11.11891 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 2.595 | 2.595 | 2.595 | 2.595 | 2.595 | 2.595 | 100.0% | 1 | | cinder_v3.delete_volume | 2.211 | 2.211 | 2.211 | 2.211 | 2.211 | 2.211 | 100.0% | 1 | | total | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 100.0% | 1 | | -> duration | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 4.806 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.806332 Full duration: 13.391981 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 | | cinder_v3.list_qos | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | 100.0% | 1 | | total | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 100.0% | 1 | | -> duration | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.286031 Full duration: 5.140189 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 100.0% | 1 | | cinder_v3.set_qos | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 100.0% | 1 | | total | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | -> duration | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.344757 Full duration: 5.35879 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 100.0% | 1 | | cinder_v3.list_types | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 100.0% | 1 | | total | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 100.0% | 1 | | -> duration | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.266844 Full duration: 5.295269 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 873645e8-50cf-47ed-abb9-48fa511dce71 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.266 | 0.266 | 0.266 | 0.266 | 0.266 | 0.266 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | total | 0.325 | 0.325 | 0.325 | 0.325 | 0.325 | 0.325 | 100.0% | 1 | | -> duration | 0.325 | 0.325 | 0.325 | 0.325 | 0.325 | 0.325 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.325133 Full duration: 5.447143 HINTS: * To plot HTML graphics with this data, run: rally task report 873645e8-50cf-47ed-abb9-48fa511dce71 --out output.html * To generate a JUnit report, run: rally task export 873645e8-50cf-47ed-abb9-48fa511dce71 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 873645e8-50cf-47ed-abb9-48fa511dce71 --json --out output.json 2020-04-12 22:57:45,478 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '873645e8-50cf-47ed-abb9-48fa511dce71', '--out', '/home/opnfv/functest/results/rally_sanity/cinder.json'] 2020-04-12 22:57:49,209 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 873645e8-50cf-47ed-abb9-48fa511dce71 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-04-12 22:57:49,219 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-04-12 22:57:49,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2020-04-12 22:57:49,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 22:57:49,240 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 22:57:49,243 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-04-12 22:57:49,243 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['heat'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 22:58:42,927 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 2020-04-12 22:58:42,928 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 2020-04-12 22:58:42,928 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '6d16dca7-01a4-4e59-b131-8e909f6e4ec8'] 2020-04-12 22:58:44,505 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 -------------------------------------------------------------------------------- Task 6d16dca7-01a4-4e59-b131-8e909f6e4ec8: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.067 | 3.067 | 3.067 | 3.067 | 3.067 | 3.067 | 100.0% | 1 | | heat.update_stack | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 100.0% | 1 | | heat.delete_stack | 2.297 | 2.297 | 2.297 | 2.297 | 2.297 | 2.297 | 100.0% | 1 | | total | 7.564 | 7.564 | 7.564 | 7.564 | 7.564 | 7.564 | 100.0% | 1 | | -> duration | 3.564 | 3.564 | 3.564 | 3.564 | 3.564 | 3.564 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.563873 Full duration: 11.627642 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.063 | 3.063 | 3.063 | 3.063 | 3.063 | 3.063 | 100.0% | 1 | | heat.check_stack | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 0.186 | 100.0% | 1 | | heat.delete_stack | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 2.268 | 100.0% | 1 | | total | 5.517 | 5.517 | 5.517 | 5.517 | 5.517 | 5.517 | 100.0% | 1 | | -> duration | 3.517 | 3.517 | 3.517 | 3.517 | 3.517 | 3.517 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.516892 Full duration: 9.811545 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 2.921 | 2.921 | 2.921 | 2.921 | 2.921 | 2.921 | 100.0% | 1 | | heat.suspend_stack | 1.275 | 1.275 | 1.275 | 1.275 | 1.275 | 1.275 | 100.0% | 1 | | heat.resume_stack | 1.249 | 1.249 | 1.249 | 1.249 | 1.249 | 1.249 | 100.0% | 1 | | heat.delete_stack | 1.2 | 1.2 | 1.2 | 1.2 | 1.2 | 1.2 | 100.0% | 1 | | total | 6.646 | 6.646 | 6.646 | 6.646 | 6.646 | 6.646 | 100.0% | 1 | | -> duration | 4.646 | 4.646 | 4.646 | 4.646 | 4.646 | 4.646 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.645903 Full duration: 11.044427 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | total | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | -> duration | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.364907 Full duration: 4.3661 HINTS: * To plot HTML graphics with this data, run: rally task report 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 --out output.html * To generate a JUnit report, run: rally task export 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 --json --out output.json 2020-04-12 22:58:44,506 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '6d16dca7-01a4-4e59-b131-8e909f6e4ec8', '--out', '/home/opnfv/functest/results/rally_sanity/heat.json'] 2020-04-12 22:58:48,021 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6d16dca7-01a4-4e59-b131-8e909f6e4ec8 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-04-12 22:58:48,026 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-04-12 22:58:48,026 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2020-04-12 22:58:48,026 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 22:58:48,048 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 22:58:48,050 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-04-12 22:58:48,051 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['keystone'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:00:17,639 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 2f644f32-9684-45dc-85fe-4ded44a4046d 2020-04-12 23:00:17,640 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 2f644f32-9684-45dc-85fe-4ded44a4046d 2020-04-12 23:00:17,640 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '2f644f32-9684-45dc-85fe-4ded44a4046d'] 2020-04-12 23:00:19,114 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2f644f32-9684-45dc-85fe-4ded44a4046d -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | keystone_v3.add_role | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 100.0% | 1 | | keystone_v3.revoke_role | 0.143 | 0.143 | 0.143 | 0.143 | 0.143 | 0.143 | 100.0% | 1 | | total | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 100.0% | 1 | | -> duration | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.284902 Full duration: 5.876546 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | keystone_v3.add_role | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | keystone_v3.list_roles | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | total | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 100.0% | 1 | | -> duration | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.249287 Full duration: 5.959855 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | keystone_v3.list_projects | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | total | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 100.0% | 1 | | -> duration | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.359808 Full duration: 5.978823 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.19 | 0.19 | 0.19 | 0.19 | 0.19 | 0.19 | 100.0% | 1 | | keystone_v3.delete_role | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | total | 0.268 | 0.268 | 0.268 | 0.268 | 0.268 | 0.268 | 100.0% | 1 | | -> duration | 0.268 | 0.268 | 0.268 | 0.268 | 0.268 | 0.268 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.268348 Full duration: 5.100301 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.133 | 0.133 | 0.133 | 0.133 | 0.133 | 0.133 | 100.0% | 1 | | keystone_v3.delete_service | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | total | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 100.0% | 1 | | -> duration | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.21827 Full duration: 5.393473 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.225 | 0.225 | 0.225 | 0.225 | 0.225 | 0.225 | 100.0% | 1 | | keystone_v3.create_user | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 100.0% | 1 | | -> keystone_v3.add_role | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | keystone_v3.create_role | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 100.0% | 1 | | keystone_v3.get_project | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 100.0% | 1 | | keystone_v3.get_user | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | keystone_v3.get_role | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | keystone_v3.list_services | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | keystone_v3.get_services | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 100.0% | 1 | | total | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | -> duration | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.98908 Full duration: 9.886711 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 100.0% | 1 | | keystone_v3.update_project | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | keystone_v3.delete_project | 0.139 | 0.139 | 0.139 | 0.139 | 0.139 | 0.139 | 100.0% | 1 | | total | 0.483 | 0.483 | 0.483 | 0.483 | 0.483 | 0.483 | 100.0% | 1 | | -> duration | 0.483 | 0.483 | 0.483 | 0.483 | 0.483 | 0.483 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.483173 Full duration: 5.109301 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | total | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 100.0% | 1 | | -> duration | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.298 Full duration: 6.08549 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | total | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | -> duration | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.231127 Full duration: 5.93927 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 0.218 | 100.0% | 1 | | keystone_v3.list_users | 0.069 | 0.069 | 0.069 | 0.069 | 0.069 | 0.069 | 100.0% | 1 | | total | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | -> duration | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.350745 Full duration: 6.047446 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2f644f32-9684-45dc-85fe-4ded44a4046d has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.248 | 0.248 | 0.248 | 0.248 | 0.248 | 0.248 | 100.0% | 1 | | keystone_v3.create_users | 3.983 | 3.983 | 3.983 | 3.983 | 3.983 | 3.983 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 3.982 | 3.982 | 3.982 | 3.982 | 3.982 | 3.982 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 100.0% | 1 | | total | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 100.0% | 1 | | -> duration | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.789316 Full duration: 12.719697 HINTS: * To plot HTML graphics with this data, run: rally task report 2f644f32-9684-45dc-85fe-4ded44a4046d --out output.html * To generate a JUnit report, run: rally task export 2f644f32-9684-45dc-85fe-4ded44a4046d --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 2f644f32-9684-45dc-85fe-4ded44a4046d --json --out output.json 2020-04-12 23:00:19,115 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '2f644f32-9684-45dc-85fe-4ded44a4046d', '--out', '/home/opnfv/functest/results/rally_sanity/keystone.json'] 2020-04-12 23:00:22,695 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2f644f32-9684-45dc-85fe-4ded44a4046d --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-04-12 23:00:22,705 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-04-12 23:00:22,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2020-04-12 23:00:22,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 23:00:22,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 23:00:22,733 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-04-12 23:00:22,733 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['neutron'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:02:48,361 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 450e1955-eb3d-435a-ab4a-9bf95ceca30f 2020-04-12 23:02:48,361 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 450e1955-eb3d-435a-ab4a-9bf95ceca30f 2020-04-12 23:02:48,362 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '450e1955-eb3d-435a-ab4a-9bf95ceca30f'] 2020-04-12 23:02:49,932 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 450e1955-eb3d-435a-ab4a-9bf95ceca30f -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.556 | 0.556 | 0.556 | 0.556 | 0.556 | 0.556 | 100.0% | 1 | | neutron.delete_network | 1.129 | 1.129 | 1.129 | 1.129 | 1.129 | 1.129 | 100.0% | 1 | | total | 1.685 | 1.685 | 1.685 | 1.685 | 1.685 | 1.685 | 100.0% | 1 | | -> duration | 1.685 | 1.685 | 1.685 | 1.685 | 1.685 | 1.685 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.685149 Full duration: 6.120642 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.328 | 1.328 | 1.328 | 1.328 | 1.328 | 1.328 | 100.0% | 1 | | neutron.delete_port | 0.565 | 0.565 | 0.565 | 0.565 | 0.565 | 0.565 | 100.0% | 1 | | total | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> duration | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.892787 Full duration: 10.522088 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 100.0% | 1 | | neutron.create_subnet | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 100.0% | 1 | | neutron.create_router | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | neutron.add_interface_router | 2.125 | 2.125 | 2.125 | 2.125 | 2.125 | 2.125 | 100.0% | 1 | | neutron.remove_interface_router | 2.934 | 2.934 | 2.934 | 2.934 | 2.934 | 2.934 | 100.0% | 1 | | neutron.delete_router | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 100.0% | 1 | | total | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 100.0% | 1 | | -> duration | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.427132 Full duration: 17.801606 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 1.069 | 100.0% | 1 | | neutron.delete_subnet | 0.531 | 0.531 | 0.531 | 0.531 | 0.531 | 0.531 | 100.0% | 1 | | total | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 100.0% | 1 | | -> duration | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.600636 Full duration: 10.094118 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 100.0% | 1 | | neutron.list_networks | 0.142 | 0.142 | 0.142 | 0.142 | 0.142 | 0.142 | 100.0% | 1 | | total | 1.093 | 1.093 | 1.093 | 1.093 | 1.093 | 1.093 | 100.0% | 1 | | -> duration | 1.093 | 1.093 | 1.093 | 1.093 | 1.093 | 1.093 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.092934 Full duration: 8.604742 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.231 | 1.231 | 1.231 | 1.231 | 1.231 | 1.231 | 100.0% | 1 | | neutron.list_ports | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 100.0% | 1 | | total | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 100.0% | 1 | | -> duration | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.295808 Full duration: 11.389487 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 100.0% | 1 | | neutron.create_subnet | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 100.0% | 1 | | neutron.create_router | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 100.0% | 1 | | neutron.add_interface_router | 2.524 | 2.524 | 2.524 | 2.524 | 2.524 | 2.524 | 100.0% | 1 | | neutron.list_routers | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 100.0% | 1 | | total | 3.977 | 3.977 | 3.977 | 3.977 | 3.977 | 3.977 | 100.0% | 1 | | -> duration | 3.977 | 3.977 | 3.977 | 3.977 | 3.977 | 3.977 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.977039 Full duration: 19.574505 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | neutron.create_subnet | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 100.0% | 1 | | neutron.list_subnets | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 100.0% | 1 | | total | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 100.0% | 1 | | -> duration | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.463115 Full duration: 11.714881 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.308 | 1.308 | 1.308 | 1.308 | 1.308 | 1.308 | 100.0% | 1 | | neutron.delete_security_group | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | total | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 100.0% | 1 | | -> duration | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.403844 Full duration: 6.342798 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.884 | 0.884 | 0.884 | 0.884 | 0.884 | 0.884 | 100.0% | 1 | | neutron.create_security_group_rule | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 100.0% | 1 | | neutron.delete_security_group | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 100.0% | 1 | | total | 1.165 | 1.165 | 1.165 | 1.165 | 1.165 | 1.165 | 100.0% | 1 | | -> duration | 1.165 | 1.165 | 1.165 | 1.165 | 1.165 | 1.165 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.164552 Full duration: 6.27147 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "args": { "network_create_args": { "router:external": true } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 450e1955-eb3d-435a-ab4a-9bf95ceca30f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | neutron.create_router | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 100.0% | 1 | | neutron.add_gateway_router | 1.142 | 1.142 | 1.142 | 1.142 | 1.142 | 1.142 | 100.0% | 1 | | neutron.remove_gateway_router | 1.689 | 1.689 | 1.689 | 1.689 | 1.689 | 1.689 | 100.0% | 1 | | total | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 100.0% | 1 | | -> duration | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.981309 Full duration: 13.330167 HINTS: * To plot HTML graphics with this data, run: rally task report 450e1955-eb3d-435a-ab4a-9bf95ceca30f --out output.html * To generate a JUnit report, run: rally task export 450e1955-eb3d-435a-ab4a-9bf95ceca30f --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 450e1955-eb3d-435a-ab4a-9bf95ceca30f --json --out output.json 2020-04-12 23:02:49,933 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '450e1955-eb3d-435a-ab4a-9bf95ceca30f', '--out', '/home/opnfv/functest/results/rally_sanity/neutron.json'] 2020-04-12 23:02:53,597 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 450e1955-eb3d-435a-ab4a-9bf95ceca30f --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-04-12 23:02:53,614 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-04-12 23:02:53,615 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2020-04-12 23:02:53,616 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 23:02:53,634 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 23:02:53,634 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-04-12 23:02:53,635 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['nova'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:08:28,679 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: f37890f3-701e-4bf4-9526-dd5f9838f529 2020-04-12 23:08:28,680 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f37890f3-701e-4bf4-9526-dd5f9838f529 2020-04-12 23:08:28,681 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'f37890f3-701e-4bf4-9526-dd5f9838f529'] 2020-04-12 23:08:30,129 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f37890f3-701e-4bf4-9526-dd5f9838f529 -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529: finished -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "block_migration": false, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.579 | 11.579 | 11.579 | 11.579 | 11.579 | 11.579 | 100.0% | 1 | | nova.live_migrate | 11.784 | 11.784 | 11.784 | 11.784 | 11.784 | 11.784 | 100.0% | 1 | | -> nova.list_hypervisors | 0.212 | 0.212 | 0.212 | 0.212 | 0.212 | 0.212 | 100.0% | 1 | | nova.delete_server | 2.475 | 2.475 | 2.475 | 2.475 | 2.475 | 2.475 | 100.0% | 1 | | total | 25.84 | 25.84 | 25.84 | 25.84 | 25.84 | 25.84 | 100.0% | 1 | | -> duration | 24.84 | 24.84 | 24.84 | 24.84 | 24.84 | 24.84 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.839816 Full duration: 29.886837 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "size": 10, "block_migration": false, "boot_server_kwargs": { "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.358 | 9.358 | 9.358 | 9.358 | 9.358 | 9.358 | 100.0% | 1 | | cinder_v3.create_volume | 2.48 | 2.48 | 2.48 | 2.48 | 2.48 | 2.48 | 100.0% | 1 | | nova.attach_volume | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | nova.live_migrate | 12.282 | 12.282 | 12.282 | 12.282 | 12.282 | 12.282 | 100.0% | 1 | | -> nova.list_hypervisors | 0.381 | 0.381 | 0.381 | 0.381 | 0.381 | 0.381 | 100.0% | 1 | | nova.detach_volume | 2.806 | 2.806 | 2.806 | 2.806 | 2.806 | 2.806 | 100.0% | 1 | | cinder_v3.delete_volume | 2.194 | 2.194 | 2.194 | 2.194 | 2.194 | 2.194 | 100.0% | 1 | | nova.delete_server | 2.418 | 2.418 | 2.418 | 2.418 | 2.418 | 2.418 | 100.0% | 1 | | total | 34.512 | 34.512 | 34.512 | 34.512 | 34.512 | 34.512 | 100.0% | 1 | | -> duration | 33.512 | 33.512 | 33.512 | 33.512 | 33.512 | 33.512 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.511894 Full duration: 39.168082 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "block_migration": false, "volume_size": 1, "force_delete": false, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.896 | 4.896 | 4.896 | 4.896 | 4.896 | 4.896 | 100.0% | 1 | | nova.boot_server | 9.99 | 9.99 | 9.99 | 9.99 | 9.99 | 9.99 | 100.0% | 1 | | nova.live_migrate | 11.66 | 11.66 | 11.66 | 11.66 | 11.66 | 11.66 | 100.0% | 1 | | -> nova.list_hypervisors | 0.29 | 0.29 | 0.29 | 0.29 | 0.29 | 0.29 | 100.0% | 1 | | nova.delete_server | 2.442 | 2.442 | 2.442 | 2.442 | 2.442 | 2.442 | 100.0% | 1 | | total | 28.99 | 28.99 | 28.99 | 28.99 | 28.99 | 28.99 | 100.0% | 1 | | -> duration | 27.99 | 27.99 | 27.99 | 27.99 | 27.99 | 27.99 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.990379 Full duration: 35.862692 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "boot_server_kwargs": { "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.45 | 0.45 | 0.45 | 0.45 | 0.45 | 0.45 | 100.0% | 1 | | nova.boot_server | 8.976 | 8.976 | 8.976 | 8.976 | 8.976 | 8.976 | 100.0% | 1 | | nova.delete_server | 2.43 | 2.43 | 2.43 | 2.43 | 2.43 | 2.43 | 100.0% | 1 | | nova.delete_keypair | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 100.0% | 1 | | total | 11.891 | 11.891 | 11.891 | 11.891 | 11.891 | 11.891 | 100.0% | 1 | | -> duration | 10.891 | 10.891 | 10.891 | 10.891 | 10.891 | 10.891 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.891232 Full duration: 27.939903 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "volume_size": 1, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 }, "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.953 | 4.953 | 4.953 | 4.953 | 4.953 | 4.953 | 100.0% | 1 | | nova.boot_server | 9.461 | 9.461 | 9.461 | 9.461 | 9.461 | 9.461 | 100.0% | 1 | | nova.delete_server | 2.398 | 2.398 | 2.398 | 2.398 | 2.398 | 2.398 | 100.0% | 1 | | total | 16.813 | 16.813 | 16.813 | 16.813 | 16.813 | 16.813 | 100.0% | 1 | | -> duration | 15.813 | 15.813 | 15.813 | 15.813 | 15.813 | 15.813 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.812983 Full duration: 37.784338 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "force_delete": false, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.269 | 11.269 | 11.269 | 11.269 | 11.269 | 11.269 | 100.0% | 1 | | nova.pause_server | 2.331 | 2.331 | 2.331 | 2.331 | 2.331 | 2.331 | 100.0% | 1 | | nova.unpause_server | 2.349 | 2.349 | 2.349 | 2.349 | 2.349 | 2.349 | 100.0% | 1 | | nova.delete_server | 2.784 | 2.784 | 2.784 | 2.784 | 2.784 | 2.784 | 100.0% | 1 | | total | 18.735 | 18.735 | 18.735 | 18.735 | 18.735 | 18.735 | 100.0% | 1 | | -> duration | 13.735 | 13.735 | 13.735 | 13.735 | 13.735 | 13.735 | 100.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.735038 Full duration: 33.591596 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.472 | 9.472 | 9.472 | 9.472 | 9.472 | 9.472 | 100.0% | 1 | | nova.migrate | 11.519 | 11.519 | 11.519 | 11.519 | 11.519 | 11.519 | 100.0% | 1 | | -> nova.list_hypervisors | 0.26 | 0.26 | 0.26 | 0.26 | 0.26 | 0.26 | 100.0% | 1 | | nova.resize_confirm | 4.825 | 4.825 | 4.825 | 4.825 | 4.825 | 4.825 | 100.0% | 1 | | nova.delete_server | 2.54 | 2.54 | 2.54 | 2.54 | 2.54 | 2.54 | 100.0% | 1 | | total | 28.357 | 28.357 | 28.357 | 28.357 | 28.357 | 28.357 | 100.0% | 1 | | -> duration | 27.357 | 27.357 | 27.357 | 27.357 | 27.357 | 27.357 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.357233 Full duration: 31.94573 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "auto_assign_nic": true }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.651 | 9.651 | 9.651 | 9.651 | 9.651 | 9.651 | 100.0% | 1 | | nova.list_interfaces | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 100.0% | 1 | | total | 9.81 | 9.81 | 9.81 | 9.81 | 9.81 | 9.81 | 100.0% | 1 | | -> duration | 8.81 | 8.81 | 8.81 | 8.81 | 8.81 | 8.81 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.810308 Full duration: 29.181595 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_associate_and_dissociate_floating_ip args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "image": { "name": "rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348" }, "create_floating_ip_args": { "ext_network": "public" }, "nics": [ { "net-id": "1ba26ef4-ad4d-4188-97d5-79d79b73243d" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.978 | 8.978 | 8.978 | 8.978 | 8.978 | 8.978 | 100.0% | 1 | | nova.associate_floating_ip | 4.714 | 4.714 | 4.714 | 4.714 | 4.714 | 4.714 | 100.0% | 1 | | -> neutron.list_ports | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 100.0% | 1 | | -> neutron.list_floating_ips | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 100.0% | 1 | | nova.dissociate_floating_ip | 3.659 | 3.659 | 3.659 | 3.659 | 3.659 | 3.659 | 100.0% | 1 | | -> neutron.list_floating_ips | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | total | 19.066 | 19.066 | 19.066 | 19.066 | 19.066 | 19.066 | 100.0% | 1 | | -> duration | 18.066 | 18.066 | 18.066 | 18.066 | 18.066 | 18.066 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.066267 Full duration: 41.198018 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "args": { "policies": [ "affinity" ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f37890f3-701e-4bf4-9526-dd5f9838f529 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 100.0% | 1 | | nova.delete_server_group | 0.069 | 0.069 | 0.069 | 0.069 | 0.069 | 0.069 | 100.0% | 1 | | total | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | -> duration | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.498987 Full duration: 4.25471 HINTS: * To plot HTML graphics with this data, run: rally task report f37890f3-701e-4bf4-9526-dd5f9838f529 --out output.html * To generate a JUnit report, run: rally task export f37890f3-701e-4bf4-9526-dd5f9838f529 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report f37890f3-701e-4bf4-9526-dd5f9838f529 --json --out output.json 2020-04-12 23:08:30,130 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'f37890f3-701e-4bf4-9526-dd5f9838f529', '--out', '/home/opnfv/functest/results/rally_sanity/nova.json'] 2020-04-12 23:08:33,918 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f37890f3-701e-4bf4-9526-dd5f9838f529 --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-04-12 23:08:33,932 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2020-04-12 23:08:33,932 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2020-04-12 23:08:33,932 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 23:08:33,951 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 23:08:33,957 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-04-12 23:08:33,957 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['quotas'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:08:59,735 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 2420be12-16a4-4954-8971-2c031c9b7962 2020-04-12 23:08:59,735 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 2420be12-16a4-4954-8971-2c031c9b7962 2020-04-12 23:08:59,736 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '2420be12-16a4-4954-8971-2c031c9b7962'] 2020-04-12 23:09:01,307 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2420be12-16a4-4954-8971-2c031c9b7962 -------------------------------------------------------------------------------- Task 2420be12-16a4-4954-8971-2c031c9b7962: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2420be12-16a4-4954-8971-2c031c9b7962 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 100.0% | 1 | | quotas.delete_quotas | 0.024 | 0.024 | 0.024 | 0.024 | 0.024 | 0.024 | 100.0% | 1 | | total | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 100.0% | 1 | | -> duration | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.390175 Full duration: 3.425578 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2420be12-16a4-4954-8971-2c031c9b7962 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | total | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | -> duration | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.391803 Full duration: 3.048304 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2420be12-16a4-4954-8971-2c031c9b7962 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 0.341 | 100.0% | 1 | | total | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 100.0% | 1 | | -> duration | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.410474 Full duration: 3.434959 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2420be12-16a4-4954-8971-2c031c9b7962 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 100.0% | 1 | | total | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 100.0% | 1 | | -> duration | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 0.546 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.546455 Full duration: 3.348229 HINTS: * To plot HTML graphics with this data, run: rally task report 2420be12-16a4-4954-8971-2c031c9b7962 --out output.html * To generate a JUnit report, run: rally task export 2420be12-16a4-4954-8971-2c031c9b7962 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 2420be12-16a4-4954-8971-2c031c9b7962 --json --out output.json 2020-04-12 23:09:01,308 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '2420be12-16a4-4954-8971-2c031c9b7962', '--out', '/home/opnfv/functest/results/rally_sanity/quotas.json'] 2020-04-12 23:09:04,964 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2420be12-16a4-4954-8971-2c031c9b7962 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-04-12 23:09:04,969 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-04-12 23:09:04,969 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml 2020-04-12 23:09:04,969 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 23:09:04,992 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 23:09:04,993 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-04-12 23:09:04,993 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['swift'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:09:49,846 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 6f520332-9cfe-4ba2-a14f-a29181835170 2020-04-12 23:09:49,847 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 6f520332-9cfe-4ba2-a14f-a29181835170 2020-04-12 23:09:49,847 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '6f520332-9cfe-4ba2-a14f-a29181835170'] 2020-04-12 23:09:51,271 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6f520332-9cfe-4ba2-a14f-a29181835170 -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 0.285 | 100.0% | 1 | | swift.upload_object (x2) | 0.026 | 0.026 | 0.026 | 0.026 | 0.026 | 0.026 | 100.0% | 1 | | swift.list_objects | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | total | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 100.0% | 1 | | -> duration | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.416065 Full duration: 7.338266 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 0.167 | 0.167 | 0.167 | 0.167 | 0.167 | 0.167 | 100.0% | 1 | | swift.list_objects | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | total | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 100.0% | 1 | | -> duration | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.275009 Full duration: 5.37925 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 100.0% | 1 | | swift.upload_object (x5) | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 100.0% | 1 | | swift.download_object (x5) | 0.259 | 0.259 | 0.259 | 0.259 | 0.259 | 0.259 | 100.0% | 1 | | total | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 100.0% | 1 | | -> duration | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 0.676 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.67559 Full duration: 7.704085 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.299 | 0.299 | 0.299 | 0.299 | 0.299 | 0.299 | 100.0% | 1 | | swift.upload_object (x5) | 0.189 | 0.189 | 0.189 | 0.189 | 0.189 | 0.189 | 100.0% | 1 | | swift.delete_object (x5) | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 100.0% | 1 | | swift.delete_container | 0.013 | 0.013 | 0.013 | 0.013 | 0.013 | 0.013 | 100.0% | 1 | | total | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 100.0% | 1 | | -> duration | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 0.548 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.547857 Full duration: 4.329526 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f520332-9cfe-4ba2-a14f-a29181835170 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 0.183 | 0.183 | 0.183 | 0.183 | 0.183 | 0.183 | 100.0% | 1 | | swift.list_objects | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | swift.download_object (x5) | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 100.0% | 1 | | total | 0.324 | 0.324 | 0.324 | 0.324 | 0.324 | 0.324 | 100.0% | 1 | | -> duration | 0.324 | 0.324 | 0.324 | 0.324 | 0.324 | 0.324 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.324314 Full duration: 4.868445 HINTS: * To plot HTML graphics with this data, run: rally task report 6f520332-9cfe-4ba2-a14f-a29181835170 --out output.html * To generate a JUnit report, run: rally task export 6f520332-9cfe-4ba2-a14f-a29181835170 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 6f520332-9cfe-4ba2-a14f-a29181835170 --json --out output.json 2020-04-12 23:09:51,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '6f520332-9cfe-4ba2-a14f-a29181835170', '--out', '/home/opnfv/functest/results/rally_sanity/swift.json'] 2020-04-12 23:09:54,919 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6f520332-9cfe-4ba2-a14f-a29181835170 --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-04-12 23:09:54,926 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-04-12 23:09:54,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-barbican.yaml 2020-04-12 23:09:54,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-12 23:09:54,948 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-12 23:09:54,949 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "barbican" ... 2020-04-12 23:09:54,949 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'barbican', '--abort-on-sla-failure', '--task', '/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'service_list': ['barbican'], 'image_name': 'rally_sanity-img_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_name': 'rally_sanity-flavor_9fbed579-95a1-4fe3-8082-63dd7543b348', 'flavor_alt_name': 'rally_sanity-flavor_alt_9fbed579-95a1-4fe3-8082-63dd7543b348', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'glance_image_format': 'qcow2', 'tmpl_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'sup_dir': '/usr/lib/python3.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'users_amount': 2, 'tenants_amount': 3, 'use_existing_users': False, 'iterations': 10, 'concurrency': 4, 'smoke': True, 'volume_version': 3, 'volume_service_type': 'volumev3', 'block_migration': 'false', 'floating_network': 'public', 'netid': '1ba26ef4-ad4d-4188-97d5-79d79b73243d'}"] 2020-04-12 23:10:58,314 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag barbican --uuids-only: f711616c-e35c-4a55-8f28-27b112d0af39 2020-04-12 23:10:58,314 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f711616c-e35c-4a55-8f28-27b112d0af39 2020-04-12 23:10:58,315 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'f711616c-e35c-4a55-8f28-27b112d0af39'] 2020-04-12 23:10:59,832 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f711616c-e35c-4a55-8f28-27b112d0af39 -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39: finished -------------------------------------------------------------------------------- test scenario BarbicanContainers.create_and_add args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 100.0% | 1 | | barbican.container_create | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 100.0% | 1 | | barbican.container_delete | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 100.0% | 1 | | total | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | -> duration | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.555488 Full duration: 3.278479 -------------------------------------------------------------------------------- test scenario BarbicanContainers.create_certificate_and_delete args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_certificate_container | 0.414 | 0.414 | 0.414 | 0.414 | 0.414 | 0.414 | 100.0% | 1 | | barbican.container_delete | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 100.0% | 1 | | total | 0.464 | 0.464 | 0.464 | 0.464 | 0.464 | 0.464 | 100.0% | 1 | | -> duration | 0.464 | 0.464 | 0.464 | 0.464 | 0.464 | 0.464 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.464194 Full duration: 3.01032 -------------------------------------------------------------------------------- test scenario BarbicanContainers.create_and_delete args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.container_create | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 100.0% | 1 | | barbican.container_delete | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 100.0% | 1 | | total | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 100.0% | 1 | | -> duration | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.460226 Full duration: 3.189832 -------------------------------------------------------------------------------- test scenario BarbicanContainers.create_rsa_and_delete args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_rsa_container | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 100.0% | 1 | | barbican.container_delete | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 100.0% | 1 | | total | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 100.0% | 1 | | -> duration | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.362684 Full duration: 2.92809 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.create_and_delete args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.304 | 0.304 | 0.304 | 0.304 | 0.304 | 0.304 | 100.0% | 1 | | barbican.delete_secret | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | total | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | -> duration | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.351322 Full duration: 3.844889 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.create_and_get args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.262 | 0.262 | 0.262 | 0.262 | 0.262 | 0.262 | 100.0% | 1 | | barbican.get_secret | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 100.0% | 1 | | total | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 100.0% | 1 | | -> duration | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.295852 Full duration: 5.354353 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.create_and_list args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.477 | 0.477 | 0.477 | 0.477 | 0.477 | 0.477 | 100.0% | 1 | | barbican.list_secrets | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 0.052 | 100.0% | 1 | | total | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 100.0% | 1 | | -> duration | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.528814 Full duration: 5.659787 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.create args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 100.0% | 1 | | total | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 100.0% | 1 | | -> duration | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.286865 Full duration: 4.90778 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.get args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.create_secret | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | barbican.get_secret | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | total | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 100.0% | 1 | | -> duration | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 0.317 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.316806 Full duration: 4.571284 -------------------------------------------------------------------------------- test scenario BarbicanContainers.list args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.list_container | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | total | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | -> duration | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.300395 Full duration: 3.277697 -------------------------------------------------------------------------------- test scenario BarbicanSecrets.list args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f711616c-e35c-4a55-8f28-27b112d0af39 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | barbican.list_secrets | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 100.0% | 1 | | total | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 100.0% | 1 | | -> duration | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 0.279 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.278889 Full duration: 3.080488 HINTS: * To plot HTML graphics with this data, run: rally task report f711616c-e35c-4a55-8f28-27b112d0af39 --out output.html * To generate a JUnit report, run: rally task export f711616c-e35c-4a55-8f28-27b112d0af39 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report f711616c-e35c-4a55-8f28-27b112d0af39 --json --out output.json 2020-04-12 23:10:59,833 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'f711616c-e35c-4a55-8f28-27b112d0af39', '--out', '/home/opnfv/functest/results/rally_sanity/barbican.json'] 2020-04-12 23:11:03,520 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f711616c-e35c-4a55-8f28-27b112d0af39 --out /home/opnfv/functest/results/rally_sanity/barbican.json 2020-04-12 23:11:03,529 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "barbican" OK. 2020-04-12 23:11:03,535 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:00:19 | 6 | 100.00% | | glance | 00:00:42 | 4 | 100.00% | | cinder | 00:01:30 | 10 | 100.00% | | heat | 00:00:36 | 4 | 100.00% | | keystone | 00:01:14 | 11 | 100.00% | | neutron | 00:02:01 | 11 | 100.00% | | nova | 00:05:10 | 10 | 100.00% | | quotas | 00:00:13 | 4 | 100.00% | | swift | 00:00:29 | 5 | 100.00% | | barbican | 00:00:43 | 11 | 100.00% | | | | | | | TOTAL: | 00:13:01 | 76 | 100.00% | +----------------+------------+----------------+-----------+ 2020-04-12 23:11:03,536 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% in 10/10 modules 2020-04-12 23:11:03,536 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_sanity/rally_sanity.html'] 2020-04-12 23:11:07,896 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-04-12 23:11:07,897 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_sanity/rally_sanity.xml'] 2020-04-12 23:11:12,054 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-04-12 23:11:12,055 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 17:19 | PASS | +----------------------+------------------+------------------+----------------+ 2020-04-12 23:11:21,416 - functest.core.singlevm - DEBUG - Cleaning security group 2ea32495-cdcf-4c0c-a626-3ecc7483382d 2020-04-12 23:11:24,227 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)