2020-04-07 20:22:29,285 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/K02XTGARDQ3J/cntt-opnfv-functest-benchmarking-latest-rally_full-run-50 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | K02XTGARDQ3J | | DEBUG | false | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/K02XTGARDQ3J/cntt-opnfv-functest-benchmarking-latest-rally_full-run-50 | | NODE_NAME | intel-pod15 | +-------------------------+----------------------------------------------------------------------------------------------------------------+ 2020-04-07 20:22:29,289 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-04-07 20:22:29,289 - xtesting.ci.run_tests - DEBUG - Test args: rally_full 2020-04-07 20:22:29,303 - xtesting.ci.run_tests - INFO - Loading test case 'rally_full'... 2020-04-07 20:22:30,070 - functest.core.tenantnetwork - DEBUG - password: vU]R.ITAIxbO^u~]hYlKu~(eDEi+pw 2020-04-07 20:22:30,277 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: rally_full', 'enabled': True, 'id': u'a8af26728c1741ea8535788ee02b4c8b', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'rally_full-project_346131ef-a87f-4291-a333-88b3f583c266'}) 2020-04-07 20:22:30,350 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'ee79923472744e29b8f3952f12f5b3da', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'rally_full-user_346131ef-a87f-4291-a333-88b3f583c266'}) 2020-04-07 20:22:30,691 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'rally_full-project_346131ef-a87f-4291-a333-88b3f583c266', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod15', u'key_manager_api_version': u'v1', 'password': 'vU]R.ITAIxbO^u~]hYlKu~(eDEi+pw', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'rally_full-user_346131ef-a87f-4291-a333-88b3f583c266', 'project_id': u'a8af26728c1741ea8535788ee02b4c8b', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}} 2020-04-07 20:22:30,695 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'rally_full-user_346131ef-a87f-4291-a333-88b3f583c266', 'password': 'vU]R.ITAIxbO^u~]hYlKu~(eDEi+pw', 'project_name': 'rally_full-project_346131ef-a87f-4291-a333-88b3f583c266', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod15.opnfv.org/v3', 'project_id': 'a8af26728c1741ea8535788ee02b4c8b', 'project_domain_name': 'default'} 2020-04-07 20:22:32,856 - xtesting.ci.run_tests - INFO - Running test case 'rally_full'... 2020-04-07 20:22:34,132 - functest.core.tenantnetwork - DEBUG - network: Munch({u'status': u'ACTIVE', u'subnets': [], u'description': u'', u'provider:physical_network': None, u'tags': [], u'updated_at': u'2020-04-07T20:22:33Z', u'ipv6_address_scope': None, u'revision_number': 3, u'port_security_enabled': True, u'mtu': 1450, u'id': u'26633733-3fd7-4d03-98bc-47db7ab97cce', u'provider:segmentation_id': 94, u'router:external': False, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-net_346131ef-a87f-4291-a333-88b3f583c266', u'admin_state_up': True, u'tenant_id': u'a8af26728c1741ea8535788ee02b4c8b', u'created_at': u'2020-04-07T20:22:33Z', u'provider:network_type': u'vxlan', u'ipv4_address_scope': None, u'shared': True, u'project_id': u'a8af26728c1741ea8535788ee02b4c8b'}) 2020-04-07 20:22:36,348 - functest.core.tenantnetwork - DEBUG - subnet: Munch({u'description': u'', u'tags': [], u'updated_at': u'2020-04-07T20:22:35Z', u'ipv6_ra_mode': None, u'allocation_pools': [{u'start': u'192.168.120.2', u'end': u'192.168.120.254'}], u'host_routes': [], u'revision_number': 2, u'ipv6_address_mode': None, u'cidr': u'192.168.120.0/24', u'id': u'0d5df667-e61f-450a-a797-b9264440eee4', u'subnetpool_id': None, u'service_types': [], u'name': u'rally_full-subnet_346131ef-a87f-4291-a333-88b3f583c266', u'enable_dhcp': True, u'network_id': u'26633733-3fd7-4d03-98bc-47db7ab97cce', u'tenant_id': u'a8af26728c1741ea8535788ee02b4c8b', u'created_at': u'2020-04-07T20:22:34Z', u'dns_nameservers': [u'8.8.8.8'], u'gateway_ip': u'192.168.120.1', u'ip_version': 4, u'project_id': u'a8af26728c1741ea8535788ee02b4c8b'}) 2020-04-07 20:22:45,813 - functest.core.tenantnetwork - DEBUG - router: Munch({u'status': u'ACTIVE', u'description': u'', u'tags': [], u'updated_at': u'2020-04-07T20:22:40Z', u'revision_number': 8, u'ha': True, u'id': u'6b197599-9d14-4aff-a214-a23e7dc94b8e', u'external_gateway_info': {u'network_id': u'9b24788f-2677-4523-a9b5-32238bf8fb81', u'enable_snat': True, u'external_fixed_ips': [{u'subnet_id': u'e652b0d8-21ff-41cf-b8be-5b1af83bdabf', u'ip_address': u'10.10.155.41'}]}, u'availability_zone_hints': [], u'availability_zones': [], u'name': u'rally_full-router_346131ef-a87f-4291-a333-88b3f583c266', u'admin_state_up': True, u'tenant_id': u'a8af26728c1741ea8535788ee02b4c8b', u'created_at': u'2020-04-07T20:22:39Z', u'distributed': False, u'flavor_id': None, u'routes': [], u'project_id': u'a8af26728c1741ea8535788ee02b4c8b'}) 2020-04-07 20:22:51,285 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/9481550d-2913-4a73-8440-e1d4487fca7a/file', 'owner': u'a8af26728c1741ea8535788ee02b4c8b', 'id': u'9481550d-2913-4a73-8440-e1d4487fca7a', 'size': 12716032, u'self': u'/v2/images/9481550d-2913-4a73-8440-e1d4487fca7a', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'a8af26728c1741ea8535788ee02b4c8b', 'name': 'rally_full-project_346131ef-a87f-4291-a333-88b3f583c266', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-04-07T20:22:51Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-04-07T20:22:51Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/9481550d-2913-4a73-8440-e1d4487fca7a', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'created': u'2020-04-07T20:22:48Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-04-07T20:22:48Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/9481550d-2913-4a73-8440-e1d4487fca7a', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}}) 2020-04-07 20:22:51,479 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'ephemeral': 0, 'ram': 512, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ccff13acb1e34dbb92fba9734b4a371b', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'2f4ddad0-bd11-4c57-b4cc-53701649d06c', 'swap': 0}) 2020-04-07 20:22:51,527 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-04-07 20:22:56,556 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 80167c07-36e8-4585-8f30-1c1fb393b706 | 2020-04-07T20:22:56.412434 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 80167c07-36e8-4585-8f30-1c1fb393b706 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-04-07 20:22:59,150 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-04-07 20:23:00,108 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-04-07 20:23:01,827 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ccff13acb1e34dbb92fba9734b4a371b', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'021c76b1-0183-4a53-bf71-f5459274a937', 'swap': 0}) 2020-04-07 20:23:01,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ccff13acb1e34dbb92fba9734b4a371b', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'021c76b1-0183-4a53-bf71-f5459274a937', 'swap': 0}) 2020-04-07 20:23:01,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2020-04-07 20:23:01,909 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 20:23:01,933 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 20:23:01,934 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-04-07 20:23:01,934 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'authenticate', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 20:26:43,633 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: d80444da-77ae-4c40-bfae-6fe9b2e3ae6e 2020-04-07 20:26:43,633 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d80444da-77ae-4c40-bfae-6fe9b2e3ae6e 2020-04-07 20:26:43,633 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'd80444da-77ae-4c40-bfae-6fe9b2e3ae6e'] 2020-04-07 20:26:44,663 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d80444da-77ae-4c40-bfae-6fe9b2e3ae6e -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.153 | 7.94 | 39.814 | 41.152 | 42.49 | 14.801 | 100.0% | 10 | | total | 0.153 | 7.94 | 39.814 | 41.152 | 42.49 | 14.802 | 100.0% | 10 | | -> duration | 0.153 | 7.94 | 39.814 | 41.152 | 42.49 | 14.802 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.003956 Full duration: 55.022884 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.146 | 7.582 | 21.144 | 22.097 | 23.049 | 9.329 | 100.0% | 10 | | total | 0.23 | 7.817 | 21.23 | 22.229 | 23.228 | 9.517 | 100.0% | 10 | | -> duration | 0.23 | 7.817 | 21.23 | 22.229 | 23.228 | 9.517 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.613208 Full duration: 37.083079 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.247 | 0.285 | 0.476 | 0.519 | 0.562 | 0.329 | 100.0% | 10 | | total | 0.33 | 0.55 | 0.709 | 0.816 | 0.922 | 0.56 | 100.0% | 10 | | -> duration | 0.33 | 0.55 | 0.709 | 0.816 | 0.922 | 0.56 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.536163 Full duration: 57.135103 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.168 | 0.208 | 0.91 | 3.527 | 6.143 | 0.818 | 100.0% | 10 | | total | 0.277 | 0.566 | 4.488 | 9.851 | 15.213 | 2.282 | 100.0% | 10 | | -> duration | 0.277 | 0.566 | 4.488 | 9.851 | 15.213 | 2.282 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.283288 Full duration: 32.75774 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.381 | 0.493 | 0.72 | 0.725 | 0.73 | 0.544 | 100.0% | 10 | | total | 0.458 | 0.688 | 0.977 | 1.003 | 1.03 | 0.713 | 100.0% | 10 | | -> duration | 0.458 | 0.688 | 0.977 | 1.003 | 1.03 | 0.713 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.998946 Full duration: 13.008787 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d80444da-77ae-4c40-bfae-6fe9b2e3ae6e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.18 | 0.243 | 0.26 | 0.277 | 0.294 | 0.237 | 100.0% | 10 | | total | 0.301 | 0.531 | 0.8 | 0.833 | 0.867 | 0.518 | 100.0% | 10 | | -> duration | 0.301 | 0.531 | 0.8 | 0.833 | 0.867 | 0.518 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.433794 Full duration: 11.348016 HINTS: * To plot HTML graphics with this data, run: rally task report d80444da-77ae-4c40-bfae-6fe9b2e3ae6e --out output.html * To generate a JUnit report, run: rally task export d80444da-77ae-4c40-bfae-6fe9b2e3ae6e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d80444da-77ae-4c40-bfae-6fe9b2e3ae6e --json --out output.json 2020-04-07 20:26:44,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'd80444da-77ae-4c40-bfae-6fe9b2e3ae6e', '--out', u'/home/opnfv/functest/results/rally_full/authenticate.json'] 2020-04-07 20:26:46,876 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d80444da-77ae-4c40-bfae-6fe9b2e3ae6e --out /home/opnfv/functest/results/rally_full/authenticate.json 2020-04-07 20:26:46,890 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-04-07 20:26:46,890 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-glance.yaml 2020-04-07 20:26:46,890 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 20:26:46,912 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 20:26:46,913 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-04-07 20:26:46,913 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'glance', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['glance'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 20:30:58,343 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e 2020-04-07 20:30:58,343 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e 2020-04-07 20:30:58,343 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e'] 2020-04-07 20:30:59,106 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.402 | 3.872 | 4.729 | 4.748 | 4.767 | 4.037 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.095 | 0.104 | 0.13 | 0.145 | 0.16 | 0.112 | 100.0% | 10 | | -> glance_v2.upload_data | 1.006 | 1.127 | 2.27 | 2.289 | 2.308 | 1.516 | 100.0% | 10 | | glance_v2.delete_image | 0.518 | 0.692 | 0.779 | 0.796 | 0.813 | 0.687 | 100.0% | 10 | | total | 4.003 | 4.538 | 5.448 | 5.474 | 5.5 | 4.725 | 100.0% | 10 | | -> duration | 4.003 | 4.538 | 5.448 | 5.474 | 5.5 | 4.725 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.468155 Full duration: 24.051584 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.372 | 4.121 | 4.306 | 4.373 | 4.439 | 4.003 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.093 | 0.113 | 0.126 | 0.135 | 0.144 | 0.113 | 100.0% | 10 | | -> glance_v2.upload_data | 1.04 | 1.342 | 1.729 | 1.827 | 1.925 | 1.43 | 100.0% | 10 | | glance_v2.list_images | 0.063 | 0.072 | 0.236 | 0.258 | 0.281 | 0.109 | 100.0% | 10 | | total | 3.464 | 4.19 | 4.505 | 4.588 | 4.67 | 4.112 | 100.0% | 10 | | -> duration | 3.464 | 4.19 | 4.505 | 4.588 | 4.67 | 4.112 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.944211 Full duration: 97.626598 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.055725 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "boot_server_kwargs": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.058158 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_deactivate_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.058696 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_download_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 0.057405 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_get_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.196 | 4.148 | 4.585 | 4.597 | 4.608 | 4.064 | 100.0% | 10 | | -> glance_v2.get_image (x2) | 0.1 | 0.108 | 0.124 | 0.132 | 0.14 | 0.112 | 100.0% | 10 | | -> glance_v2.upload_data | 0.816 | 1.799 | 2.103 | 2.131 | 2.159 | 1.65 | 100.0% | 10 | | glance_v2.get_image | 0.028 | 0.038 | 0.048 | 0.052 | 0.056 | 0.039 | 100.0% | 10 | | total | 3.234 | 4.193 | 4.615 | 4.634 | 4.653 | 4.104 | 100.0% | 10 | | -> duration | 3.234 | 4.193 | 4.615 | 4.634 | 4.653 | 4.104 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.543267 Full duration: 28.364188 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_update_image args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e has 2 error(s) -------------------------------------------------------------------------------- HTTPInternalServerError: 500 Internal Server Error The server has either erred or is incapable of performing the requested operation. (HTTP 500) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/glance/images.py", line 298, in run properties=create_properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/image.py", line 70, in create_image properties=properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 200, in create_image properties=properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 97, in create_image self.upload_data(image_obj.id, image_location=image_location) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 51, in upload_data self._clients.glance("2").images.upload(image_id, image_data) File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python2.7/site-packages/glanceclient/v2/images.py", line 288, in upload resp, body = self.http_client.put(url, headers=hdrs, data=body) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 337, in put return self.request(url, 'PUT', **kwargs) File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) HTTPInternalServerError: 500 Internal Server Error The server has either erred or is incapable of performing the requested operation. (HTTP 500) -------------------------------------------------------------------------------- HTTPInternalServerError: 500 Internal Server Error The server has either erred or is incapable of performing the requested operation. (HTTP 500) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/glance/images.py", line 298, in run properties=create_properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/image.py", line 70, in create_image properties=properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 200, in create_image properties=properties) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 97, in create_image self.upload_data(image_obj.id, image_location=image_location) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/image/glance_v2.py", line 51, in upload_data self._clients.glance("2").images.upload(image_id, image_data) File "/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 598, in inner return RequestIdProxy(wrapped(*args, **kwargs)) File "/usr/lib/python2.7/site-packages/glanceclient/v2/images.py", line 288, in upload resp, body = self.http_client.put(url, headers=hdrs, data=body) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 337, in put return self.request(url, 'PUT', **kwargs) File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 377, in request return self._handle_response(resp) File "/usr/lib/python2.7/site-packages/glanceclient/common/http.py", line 126, in _handle_response raise exc.from_response(resp, resp.content) HTTPInternalServerError: 500 Internal Server Error The server has either erred or is incapable of performing the requested operation. (HTTP 500) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.313 | 62.185 | 62.697 | 62.719 | 62.74 | 50.511 | 60.0% | 5 | | -> glance_v2.get_image (x2) | 0.114 | 0.119 | 0.122 | 0.122 | 0.122 | 0.118 | 100.0% | 3 | | -> glance_v2.upload_data | 0.956 | 59.702 | 60.045 | 60.054 | 60.064 | 47.869 | 60.0% | 5 | | -> glance_v2.get_image | 0.071 | 0.1 | 0.123 | 0.126 | 0.129 | 0.1 | 100.0% | 2 | | glance_v2.update_image | 0.259 | 0.26 | 0.31 | 0.316 | 0.322 | 0.28 | 100.0% | 3 | | total | 3.573 | 62.186 | 62.995 | 63.029 | 63.063 | 50.679 | 60.0% | 5 | | -> duration | 3.573 | 62.186 | 62.995 | 63.029 | 63.063 | 50.679 | 60.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 60.0% | 5 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.950969 Full duration: 79.891026 HINTS: * To plot HTML graphics with this data, run: rally task report ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e --out output.html * To generate a JUnit report, run: rally task export ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e --json --out output.json At least one workload did not pass SLA criteria. 2020-04-07 20:30:59,107 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e', '--out', u'/home/opnfv/functest/results/rally_full/glance.json'] 2020-04-07 20:31:01,341 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ba78f50f-4fc6-4ea7-ace2-532d0fb9f06e --out /home/opnfv/functest/results/rally_full/glance.json 2020-04-07 20:31:01,362 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" Failed. 2020-04-07 20:31:01,362 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-cinder.yaml 2020-04-07 20:31:01,363 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 20:31:01,384 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 20:31:01,385 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-04-07 20:31:01,385 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'cinder', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 20:37:42,525 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 30361524-0684-4da9-bfea-18c19cad9e03 2020-04-07 20:37:42,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 30361524-0684-4da9-bfea-18c19cad9e03 2020-04-07 20:37:42,525 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'30361524-0684-4da9-bfea-18c19cad9e03'] 2020-04-07 20:37:43,527 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 30361524-0684-4da9-bfea-18c19cad9e03 -------------------------------------------------------------------------------- Task 30361524-0684-4da9-bfea-18c19cad9e03: aborted -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_attach_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 30361524-0684-4da9-bfea-18c19cad9e03 has 3 error(s) -------------------------------------------------------------------------------- NotFound: volume_id not found: 04ea3060-e9ad-4b61-b630-66975c47b032 (HTTP 404) (Request-ID: req-31a3c483-bd0b-4c4d-b025-4fcc54429199) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper return f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 462, in run self._detach_volume(server, volume) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 765, in _detach_volume volume.id) File "/usr/lib/python2.7/site-packages/novaclient/v2/volumes.py", line 160, in delete_server_volume (server_id, volume_id,)) File "/usr/lib/python2.7/site-packages/novaclient/base.py", line 375, in _delete resp, body = self.api.client.delete(url) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 343, in delete return self.request(url, 'DELETE', **kwargs) File "/usr/lib/python2.7/site-packages/novaclient/client.py", line 83, in request raise exceptions.from_response(resp, body, url, method) NotFound: volume_id not found: 04ea3060-e9ad-4b61-b630-66975c47b032 (HTTP 404) (Request-ID: req-31a3c483-bd0b-4c4d-b025-4fcc54429199) -------------------------------------------------------------------------------- ClientException: Gateway Time-out (HTTP 504) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper return f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 459, in run volume = self.cinder.create_volume(size, **create_volume_params) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume multiattach=multiattach, backup_id=backup_id) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume multiattach=multiattach, backup_id=backup_id)) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 73, in create_volume .volumes.create(size, **kwargs)) File "/usr/lib/python2.7/site-packages/cinderclient/v3/volumes.py", line 135, in create return self._create('/volumes', body, 'volume') File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 330, in _create resp, body = self.api.client.post(url, body=body) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 203, in post return self._cs_request(url, 'POST', **kwargs) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 191, in _cs_request return self.request(url, method, **kwargs) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 177, in request raise exceptions.from_response(resp, body) ClientException: Gateway Time-out (HTTP 504) -------------------------------------------------------------------------------- ClientException: Gateway Time-out (HTTP 504) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/common/logging.py", line 329, in wrapper return f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 459, in run volume = self.cinder.create_volume(size, **create_volume_params) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/block.py", line 82, in create_volume multiattach=multiattach, backup_id=backup_id) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 280, in create_volume multiattach=multiattach, backup_id=backup_id)) File "/usr/lib/python2.7/site-packages/rally/task/service.py", line 116, in wrapper return func(instance, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/services/storage/cinder_v3.py", line 73, in create_volume .volumes.create(size, **kwargs)) File "/usr/lib/python2.7/site-packages/cinderclient/v3/volumes.py", line 135, in create return self._create('/volumes', body, 'volume') File "/usr/lib/python2.7/site-packages/cinderclient/base.py", line 330, in _create resp, body = self.api.client.post(url, body=body) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 203, in post return self._cs_request(url, 'POST', **kwargs) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 191, in _cs_request return self.request(url, method, **kwargs) File "/usr/lib/python2.7/site-packages/cinderclient/client.py", line 177, in request raise exceptions.from_response(resp, body) ClientException: Gateway Time-out (HTTP 504) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 28.199 | 36.334 | 39.576 | 39.844 | 40.112 | 35.89 | 100.0% | 5 | | cinder_v3.create_volume | 33.019 | 56.528 | 60.043 | 60.05 | 60.058 | 49.675 | 60.0% | 5 | | nova.attach_volume | 44.542 | 93.304 | 112.101 | 114.451 | 116.8 | 84.882 | 100.0% | 3 | | nova.detach_volume | 52.652 | 69.129 | 98.174 | 101.805 | 105.435 | 75.739 | 66.7% | 3 | | cinder_v3.delete_volume | 12.81 | 28.997 | 41.948 | 43.566 | 45.185 | 28.997 | 100.0% | 2 | | nova.delete_server | 5.097 | 5.314 | 5.487 | 5.509 | 5.531 | 5.314 | 100.0% | 2 | | total | 88.219 | 243.212 | 274.467 | 276.693 | 278.919 | 195.662 | 40.0% | 5 | | -> duration | 87.219 | 242.212 | 273.467 | 275.693 | 277.919 | 194.662 | 40.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 40.0% | 5 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 277.924187 Full duration: 385.910862 HINTS: * To plot HTML graphics with this data, run: rally task report 30361524-0684-4da9-bfea-18c19cad9e03 --out output.html * To generate a JUnit report, run: rally task export 30361524-0684-4da9-bfea-18c19cad9e03 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 30361524-0684-4da9-bfea-18c19cad9e03 --json --out output.json At least one workload did not pass SLA criteria. 2020-04-07 20:37:43,527 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'30361524-0684-4da9-bfea-18c19cad9e03', '--out', u'/home/opnfv/functest/results/rally_full/cinder.json'] 2020-04-07 20:37:45,411 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 30361524-0684-4da9-bfea-18c19cad9e03 --out /home/opnfv/functest/results/rally_full/cinder.json 2020-04-07 20:37:45,416 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" Failed. 2020-04-07 20:37:45,416 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-heat.yaml 2020-04-07 20:37:45,417 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 20:37:45,440 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 20:37:45,440 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-04-07 20:37:45,441 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'heat', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['heat'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 21:04:54,580 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 259d02de-aa55-42b1-bbae-afdf789ca51c 2020-04-07 21:04:54,581 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 259d02de-aa55-42b1-bbae-afdf789ca51c 2020-04-07 21:04:54,581 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'259d02de-aa55-42b1-bbae-afdf789ca51c'] 2020-04-07 21:04:55,618 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 259d02de-aa55-42b1-bbae-afdf789ca51c -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c: aborted -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.085 | 8.252 | 8.998 | 9.049 | 9.1 | 6.839 | 100.0% | 10 | | heat.delete_stack | 1.221 | 2.321 | 3.406 | 3.436 | 3.466 | 2.435 | 100.0% | 10 | | total | 6.418 | 10.14 | 11.307 | 11.408 | 11.509 | 9.274 | 100.0% | 10 | | -> duration | 4.418 | 8.14 | 9.307 | 9.408 | 9.509 | 7.274 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.267887 Full duration: 40.623448 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_ports.yaml.template", "parameters": { "image": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266", "public_net": "public", "flavor": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 54.845 | 73.306 | 84.68 | 85.214 | 85.749 | 73.949 | 100.0% | 10 | | heat.delete_stack | 15.496 | 31.538 | 38.542 | 38.603 | 38.664 | 29.795 | 100.0% | 10 | | total | 81.328 | 104.81 | 122.222 | 122.724 | 123.225 | 103.745 | 100.0% | 10 | | -> duration | 79.328 | 102.81 | 120.222 | 120.724 | 121.225 | 101.745 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 306.278206 Full duration: 320.677804 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/server_with_volume.yaml.template", "parameters": { "network_id": "26633733-3fd7-4d03-98bc-47db7ab97cce", "image": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266", "flavor": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 35.754 | 50.537 | 53.049 | 53.469 | 53.89 | 46.754 | 100.0% | 10 | | heat.delete_stack | 11.046 | 12.205 | 14.728 | 15.66 | 16.592 | 12.993 | 100.0% | 10 | | total | 47.966 | 63.909 | 67.367 | 67.371 | 67.374 | 59.747 | 100.0% | 10 | | -> duration | 45.966 | 61.909 | 65.367 | 65.371 | 65.374 | 57.747 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 166.454455 Full duration: 203.60761 -------------------------------------------------------------------------------- test scenario HeatStacks.create_and_list_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 3.232 | 3.953 | 4.47 | 4.801 | 5.133 | 4.068 | 100.0% | 10 | | heat.list_stacks | 0.042 | 0.058 | 0.072 | 0.076 | 0.08 | 0.06 | 100.0% | 10 | | total | 3.292 | 4.006 | 4.548 | 4.871 | 5.194 | 4.127 | 100.0% | 10 | | -> duration | 1.292 | 2.006 | 2.548 | 2.871 | 3.194 | 2.127 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.402544 Full duration: 77.43844 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_add.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.182 | 9.225 | 15.433 | 17.044 | 18.655 | 10.454 | 100.0% | 10 | | heat.update_stack | 5.808 | 10.517 | 13.152 | 13.389 | 13.626 | 10.241 | 100.0% | 10 | | heat.delete_stack | 4.545 | 5.662 | 8.947 | 8.972 | 8.998 | 6.428 | 100.0% | 10 | | total | 16.802 | 27.452 | 31.934 | 32.915 | 33.895 | 27.122 | 100.0% | 10 | | -> duration | 12.802 | 23.452 | 27.934 | 28.915 | 29.895 | 23.122 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.59686 Full duration: 168.505117 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 1 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_delete.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.123 | 13.531 | 16.574 | 16.697 | 16.82 | 13.392 | 100.0% | 10 | | heat.update_stack | 3.849 | 8.738 | 12.609 | 12.783 | 12.956 | 9.231 | 100.0% | 10 | | heat.delete_stack | 1.254 | 6.716 | 7.914 | 8.472 | 9.031 | 6.074 | 100.0% | 10 | | total | 17.216 | 30.905 | 32.684 | 32.692 | 32.701 | 28.697 | 100.0% | 10 | | -> duration | 13.216 | 26.905 | 28.684 | 28.692 | 28.701 | 24.697 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 75.044581 Full duration: 94.514912 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 2 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_increase.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 11.238 | 14.398 | 17.548 | 17.716 | 17.884 | 14.845 | 100.0% | 10 | | heat.update_stack | 7.11 | 12.696 | 16.6 | 16.758 | 16.916 | 12.825 | 100.0% | 10 | | heat.delete_stack | 5.648 | 9.461 | 12.2 | 12.208 | 12.215 | 9.361 | 100.0% | 10 | | total | 25.242 | 37.231 | 42.895 | 42.955 | 43.015 | 37.032 | 100.0% | 10 | | -> duration | 21.242 | 33.231 | 38.895 | 38.955 | 39.015 | 33.032 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 104.128199 Full duration: 205.902791 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 3 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.848 | 14.327 | 15.409 | 15.496 | 15.583 | 13.652 | 100.0% | 10 | | heat.update_stack | 5.776 | 9.549 | 11.616 | 11.622 | 11.627 | 9.129 | 100.0% | 10 | | heat.delete_stack | 6.717 | 9.503 | 13.375 | 13.898 | 14.42 | 10.034 | 100.0% | 10 | | total | 26.347 | 31.945 | 39.223 | 40.324 | 41.425 | 32.815 | 100.0% | 10 | | -> duration | 22.347 | 27.945 | 35.223 | 36.324 | 37.425 | 28.815 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 87.962051 Full duration: 108.058351 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 4 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/resource_group.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_resource_group_reduce.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.894 | 12.307 | 43.557 | 44.084 | 44.612 | 22.072 | 100.0% | 10 | | heat.update_stack | 5.607 | 8.649 | 18.692 | 18.785 | 18.878 | 10.146 | 100.0% | 10 | | heat.delete_stack | 2.351 | 7.285 | 10.247 | 10.729 | 11.212 | 6.764 | 100.0% | 10 | | total | 18.245 | 31.145 | 58.874 | 59.282 | 59.69 | 38.982 | 100.0% | 10 | | -> duration | 14.245 | 27.145 | 54.874 | 55.282 | 55.69 | 34.982 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 102.077876 Full duration: 188.697926 -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 5 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_random_strings_replace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.225 | 7.656 | 12.683 | 12.931 | 13.18 | 8.328 | 100.0% | 10 | | heat.update_stack | 5.803 | 7.77 | 9.708 | 9.948 | 10.187 | 7.807 | 100.0% | 10 | | heat.delete_stack | 2.352 | 3.46 | 8.93 | 8.939 | 8.948 | 4.988 | 100.0% | 10 | | total | 15.979 | 20.867 | 26.789 | 27.132 | 27.475 | 21.124 | 100.0% | 10 | | -> duration | 11.979 | 16.867 | 22.789 | 23.132 | 23.475 | 17.124 | 100.0% | 10 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 58.277025 Full duration: 77.914492 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 259d02de-aa55-42b1-bbae-afdf789ca51c has 1 error(s) -------------------------------------------------------------------------------- HTTPInternalServerError: ERROR: Remote error: ConnectFailure Unable to establish connection to http://keystone-api.openstack.svc.cluster.local:5000/v3/auth/tokens: ('Connection aborted.', BadStatusLine("''",)) [u' Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/stacks.py", line 122, in run files, environment) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] File "/usr/lib/python2.7/site-packages/heatclient/v1/stacks.py", line 171, in create data=kwargs, headers=headers) File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python2.7/site-packages/heatclient/common/http.py", line 323, in request raise exc.from_response(resp) HTTPInternalServerError: ERROR: Remote error: ConnectFailure Unable to establish connection to http://keystone-api.openstack.svc.cluster.local:5000/v3/auth/tokens: ('Connection aborted.', BadStatusLine("''",)) [u' -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.261 | 15.451 | 30.94 | 33.877 | 36.814 | 17.185 | 87.5% | 8 | | heat.check_stack | 1.304 | 1.356 | 2.273 | 2.899 | 3.525 | 1.666 | 100.0% | 7 | | heat.delete_stack | 2.408 | 3.444 | 4.54 | 4.545 | 4.55 | 3.761 | 100.0% | 7 | | total | 11.57 | 19.715 | 35.023 | 35.919 | 36.815 | 21.934 | 87.5% | 8 | | -> duration | 9.57 | 17.715 | 33.623 | 35.219 | 36.815 | 20.184 | 87.5% | 8 | | -> idle_duration | 0.0 | 2.0 | 2.0 | 2.0 | 2.0 | 1.75 | 87.5% | 8 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.875567 Full duration: 78.598435 HINTS: * To plot HTML graphics with this data, run: rally task report 259d02de-aa55-42b1-bbae-afdf789ca51c --out output.html * To generate a JUnit report, run: rally task export 259d02de-aa55-42b1-bbae-afdf789ca51c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 259d02de-aa55-42b1-bbae-afdf789ca51c --json --out output.json At least one workload did not pass SLA criteria. 2020-04-07 21:04:55,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'259d02de-aa55-42b1-bbae-afdf789ca51c', '--out', u'/home/opnfv/functest/results/rally_full/heat.json'] 2020-04-07 21:04:58,127 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 259d02de-aa55-42b1-bbae-afdf789ca51c --out /home/opnfv/functest/results/rally_full/heat.json 2020-04-07 21:04:58,159 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" Failed. 2020-04-07 21:04:58,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2020-04-07 21:04:58,159 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 21:04:58,179 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 21:04:58,180 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-04-07 21:04:58,180 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'keystone', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 21:10:41,870 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: e12188ba-2fc1-4ad0-86da-6c45637c2f13 2020-04-07 21:10:41,871 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e12188ba-2fc1-4ad0-86da-6c45637c2f13 2020-04-07 21:10:41,871 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'e12188ba-2fc1-4ad0-86da-6c45637c2f13'] 2020-04-07 21:10:42,928 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e12188ba-2fc1-4ad0-86da-6c45637c2f13 -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.078 | 0.234 | 0.297 | 0.347 | 0.396 | 0.222 | 100.0% | 10 | | keystone_v3.add_role | 0.039 | 0.156 | 0.332 | 0.431 | 0.53 | 0.181 | 100.0% | 10 | | keystone_v3.revoke_role | 0.056 | 0.144 | 0.249 | 0.353 | 0.456 | 0.17 | 100.0% | 10 | | total | 0.25 | 0.528 | 0.762 | 1.017 | 1.273 | 0.573 | 100.0% | 10 | | -> duration | 0.25 | 0.528 | 0.762 | 1.017 | 1.273 | 0.573 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.979034 Full duration: 25.821855 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.072 | 0.197 | 0.353 | 0.541 | 0.73 | 0.238 | 100.0% | 10 | | keystone_v3.add_role | 0.052 | 0.088 | 0.162 | 0.164 | 0.167 | 0.101 | 100.0% | 10 | | keystone_v3.list_roles | 0.026 | 0.035 | 0.199 | 0.222 | 0.246 | 0.08 | 100.0% | 10 | | total | 0.158 | 0.394 | 0.557 | 0.747 | 0.936 | 0.419 | 100.0% | 10 | | -> duration | 0.158 | 0.394 | 0.557 | 0.747 | 0.936 | 0.419 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.306348 Full duration: 51.579386 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.154 | 0.266 | 0.434 | 0.546 | 0.657 | 0.297 | 100.0% | 10 | | keystone_v3.list_projects | 0.026 | 0.036 | 0.084 | 0.099 | 0.114 | 0.049 | 100.0% | 10 | | total | 0.188 | 0.303 | 0.545 | 0.642 | 0.738 | 0.346 | 100.0% | 10 | | -> duration | 0.188 | 0.303 | 0.545 | 0.642 | 0.738 | 0.346 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.287524 Full duration: 15.799159 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.055 | 1.46 | 12.604 | 13.489 | 14.374 | 3.663 | 100.0% | 10 | | keystone_v3.delete_role | 0.067 | 0.367 | 1.758 | 1.872 | 1.987 | 0.618 | 100.0% | 10 | | total | 0.123 | 2.111 | 14.172 | 14.312 | 14.453 | 4.282 | 100.0% | 10 | | -> duration | 0.123 | 2.111 | 14.172 | 14.312 | 14.453 | 4.282 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.772214 Full duration: 36.958507 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.048 | 0.09 | 0.283 | 0.292 | 0.301 | 0.136 | 100.0% | 10 | | keystone_v3.delete_service | 0.06 | 0.153 | 0.297 | 0.314 | 0.332 | 0.163 | 100.0% | 10 | | total | 0.113 | 0.306 | 0.452 | 0.543 | 0.633 | 0.299 | 100.0% | 10 | | -> duration | 0.113 | 0.306 | 0.452 | 0.543 | 0.633 | 0.299 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.946897 Full duration: 13.007269 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.13 | 0.193 | 0.337 | 0.386 | 0.435 | 0.224 | 100.0% | 10 | | keystone_v3.create_user | 0.298 | 0.413 | 0.524 | 0.528 | 0.532 | 0.422 | 100.0% | 10 | | -> keystone_v3.list_roles | 0.024 | 0.03 | 0.039 | 0.046 | 0.052 | 0.032 | 100.0% | 10 | | -> keystone_v3.add_role | 0.092 | 0.163 | 0.238 | 0.243 | 0.248 | 0.179 | 100.0% | 10 | | keystone_v3.create_role | 0.07 | 0.135 | 0.254 | 0.261 | 0.268 | 0.157 | 100.0% | 10 | | keystone_v3.get_project | 0.018 | 0.025 | 0.031 | 0.039 | 0.047 | 0.027 | 100.0% | 10 | | keystone_v3.get_user | 0.02 | 0.026 | 0.028 | 0.031 | 0.035 | 0.025 | 100.0% | 10 | | keystone_v3.get_role | 0.018 | 0.024 | 0.072 | 0.072 | 0.073 | 0.033 | 100.0% | 10 | | keystone_v3.list_services | 0.023 | 0.026 | 0.085 | 0.113 | 0.141 | 0.043 | 100.0% | 10 | | keystone_v3.get_services | 0.017 | 0.021 | 0.041 | 0.045 | 0.05 | 0.026 | 100.0% | 10 | | total | 0.812 | 0.976 | 1.153 | 1.172 | 1.191 | 0.983 | 100.0% | 10 | | -> duration | 0.812 | 0.976 | 1.153 | 1.172 | 1.191 | 0.983 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.750226 Full duration: 26.113372 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.107 | 0.227 | 0.333 | 0.337 | 0.341 | 0.215 | 100.0% | 10 | | keystone_v3.update_project | 0.053 | 0.11 | 0.199 | 0.223 | 0.247 | 0.124 | 100.0% | 10 | | keystone_v3.delete_project | 0.116 | 0.211 | 0.315 | 0.332 | 0.348 | 0.213 | 100.0% | 10 | | total | 0.307 | 0.501 | 0.743 | 0.835 | 0.927 | 0.552 | 100.0% | 10 | | -> duration | 0.307 | 0.501 | 0.743 | 0.835 | 0.927 | 0.552 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.965824 Full duration: 13.451362 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.164 | 0.327 | 0.769 | 0.784 | 0.799 | 0.42 | 100.0% | 10 | | total | 0.219 | 0.394 | 0.85 | 0.861 | 0.872 | 0.486 | 100.0% | 10 | | -> duration | 0.219 | 0.394 | 0.85 | 0.861 | 0.872 | 0.486 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.381017 Full duration: 9.063423 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.106 | 0.164 | 0.229 | 0.273 | 0.316 | 0.177 | 100.0% | 10 | | total | 0.106 | 0.165 | 0.229 | 0.273 | 0.317 | 0.177 | 100.0% | 10 | | -> duration | 0.106 | 0.165 | 0.229 | 0.273 | 0.317 | 0.177 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.452279 Full duration: 8.672462 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.106 | 0.2 | 0.325 | 0.336 | 0.347 | 0.211 | 100.0% | 10 | | keystone_v3.list_users | 0.048 | 0.057 | 0.098 | 0.101 | 0.104 | 0.065 | 100.0% | 10 | | total | 0.223 | 0.319 | 0.457 | 0.48 | 0.502 | 0.343 | 100.0% | 10 | | -> duration | 0.223 | 0.319 | 0.457 | 0.48 | 0.502 | 0.343 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.797931 Full duration: 8.857102 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e12188ba-2fc1-4ad0-86da-6c45637c2f13 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.097 | 0.243 | 0.641 | 1.95 | 3.258 | 0.522 | 100.0% | 10 | | keystone_v3.create_users | 2.976 | 4.285 | 9.517 | 9.696 | 9.875 | 5.555 | 100.0% | 10 | | -> keystone_v3.create_user (x10) | 2.975 | 4.285 | 9.516 | 9.696 | 9.875 | 5.555 | 100.0% | 10 | | --> keystone_v3.list_roles (x10) | 0.253 | 0.395 | 2.917 | 3.089 | 3.261 | 0.902 | 100.0% | 10 | | --> keystone_v3.add_role (x10) | 0.883 | 1.223 | 2.202 | 4.96 | 7.717 | 1.862 | 100.0% | 10 | | total | 3.946 | 8.56 | 10.469 | 10.615 | 10.76 | 7.508 | 100.0% | 10 | | -> duration | 3.946 | 8.56 | 10.469 | 10.615 | 10.76 | 7.508 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.947027 Full duration: 116.668912 HINTS: * To plot HTML graphics with this data, run: rally task report e12188ba-2fc1-4ad0-86da-6c45637c2f13 --out output.html * To generate a JUnit report, run: rally task export e12188ba-2fc1-4ad0-86da-6c45637c2f13 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e12188ba-2fc1-4ad0-86da-6c45637c2f13 --json --out output.json 2020-04-07 21:10:42,929 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'e12188ba-2fc1-4ad0-86da-6c45637c2f13', '--out', u'/home/opnfv/functest/results/rally_full/keystone.json'] 2020-04-07 21:10:45,528 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e12188ba-2fc1-4ad0-86da-6c45637c2f13 --out /home/opnfv/functest/results/rally_full/keystone.json 2020-04-07 21:10:45,569 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-04-07 21:10:45,569 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-neutron.yaml 2020-04-07 21:10:45,569 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 21:10:45,588 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 21:10:45,589 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-04-07 21:10:45,589 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 21:33:41,365 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 2020-04-07 21:33:41,365 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 2020-04-07 21:33:41,365 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'3b8e91bf-f522-45c3-b8c1-67c80b1bf502'] 2020-04-07 21:33:42,501 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.844 | 1.005 | 1.354 | 1.42 | 1.486 | 1.075 | 100.0% | 10 | | neutron.update_network | 0.653 | 0.77 | 0.985 | 0.997 | 1.009 | 0.812 | 100.0% | 10 | | total | 1.549 | 1.868 | 2.159 | 2.313 | 2.468 | 1.888 | 100.0% | 10 | | -> duration | 1.549 | 1.868 | 2.159 | 2.313 | 2.468 | 1.888 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.749148 Full duration: 23.7165 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.31 | 2.054 | 2.579 | 2.584 | 2.588 | 2.044 | 100.0% | 10 | | neutron.update_port | 0.589 | 0.932 | 1.629 | 1.641 | 1.654 | 1.022 | 100.0% | 10 | | total | 2.009 | 3.003 | 4.208 | 4.225 | 4.243 | 3.067 | 100.0% | 10 | | -> duration | 2.009 | 3.003 | 4.208 | 4.225 | 4.243 | 3.067 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.0875 Full duration: 49.787981 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.447 | 1.741 | 2.623 | 2.882 | 3.141 | 1.792 | 100.0% | 10 | | neutron.create_subnet | 0.898 | 1.492 | 1.996 | 2.161 | 2.326 | 1.536 | 100.0% | 10 | | neutron.create_router | 7.876 | 10.124 | 10.633 | 10.701 | 10.769 | 9.819 | 100.0% | 10 | | neutron.add_interface_router | 2.063 | 3.347 | 4.651 | 4.776 | 4.901 | 3.353 | 100.0% | 10 | | neutron.update_router | 0.536 | 0.75 | 1.013 | 1.094 | 1.175 | 0.778 | 100.0% | 10 | | total | 14.193 | 17.208 | 19.347 | 19.503 | 19.659 | 17.279 | 100.0% | 10 | | -> duration | 14.193 | 17.208 | 19.347 | 19.503 | 19.659 | 17.279 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.296056 Full duration: 91.692117 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.4.0.0/16", "subnet_update_args": { "enable_dhcp": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.552 | 1.605 | 1.802 | 1.962 | 2.121 | 1.336 | 100.0% | 10 | | neutron.create_subnet | 2.002 | 3.099 | 5.008 | 5.211 | 5.414 | 3.679 | 100.0% | 10 | | neutron.update_subnet | 0.595 | 0.947 | 2.01 | 2.081 | 2.153 | 1.127 | 100.0% | 10 | | total | 4.222 | 6.469 | 7.348 | 7.822 | 8.297 | 6.142 | 100.0% | 10 | | -> duration | 4.222 | 6.469 | 7.348 | 7.822 | 8.297 | 6.142 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.356443 Full duration: 42.78863 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.625 | 0.867 | 1.166 | 1.214 | 1.263 | 0.904 | 100.0% | 10 | | neutron.delete_network | 0.617 | 0.737 | 0.971 | 1.162 | 1.353 | 0.812 | 100.0% | 10 | | total | 1.351 | 1.669 | 2.046 | 2.114 | 2.182 | 1.716 | 100.0% | 10 | | -> duration | 1.351 | 1.669 | 2.046 | 2.114 | 2.182 | 1.716 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.95209 Full duration: 69.293554 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.261 | 1.818 | 3.192 | 3.834 | 4.475 | 2.177 | 100.0% | 10 | | neutron.delete_port | 0.651 | 0.948 | 1.5 | 1.85 | 2.201 | 1.093 | 100.0% | 10 | | total | 2.134 | 3.112 | 5.277 | 5.399 | 5.52 | 3.27 | 100.0% | 10 | | -> duration | 2.134 | 3.112 | 5.277 | 5.399 | 5.52 | 3.27 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.784429 Full duration: 47.071682 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.567 | 1.849 | 5.806 | 6.328 | 6.85 | 2.826 | 100.0% | 10 | | neutron.create_subnet | 0.809 | 2.218 | 3.871 | 3.992 | 4.114 | 2.376 | 100.0% | 10 | | neutron.create_router | 5.819 | 9.622 | 11.358 | 11.381 | 11.404 | 9.221 | 100.0% | 10 | | neutron.add_interface_router | 2.088 | 3.289 | 4.862 | 5.484 | 6.107 | 3.495 | 100.0% | 10 | | neutron.remove_interface_router | 1.518 | 2.119 | 2.732 | 2.969 | 3.205 | 2.218 | 100.0% | 10 | | neutron.delete_router | 3.338 | 4.458 | 7.071 | 7.109 | 7.147 | 4.936 | 100.0% | 10 | | total | 16.502 | 25.809 | 30.958 | 31.978 | 32.998 | 25.073 | 100.0% | 10 | | -> duration | 16.502 | 25.809 | 30.958 | 31.978 | 32.998 | 25.073 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 69.856385 Full duration: 212.296409 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 0.732 | 2.456 | 3.646 | 3.704 | 3.762 | 2.318 | 100.0% | 10 | | neutron.delete_subnet | 0.622 | 1.445 | 2.512 | 2.514 | 2.516 | 1.55 | 100.0% | 10 | | total | 3.064 | 3.877 | 4.455 | 4.54 | 4.625 | 3.868 | 100.0% | 10 | | -> duration | 3.064 | 3.877 | 4.455 | 4.54 | 4.625 | 3.868 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.009344 Full duration: 53.851615 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.469 | 0.674 | 0.955 | 1.037 | 1.118 | 0.728 | 100.0% | 10 | | neutron.list_networks | 0.148 | 0.174 | 0.258 | 0.293 | 0.327 | 0.196 | 100.0% | 10 | | total | 0.649 | 0.825 | 1.186 | 1.277 | 1.369 | 0.924 | 100.0% | 10 | | -> duration | 0.649 | 0.825 | 1.186 | 1.277 | 1.369 | 0.924 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.556388 Full duration: 21.746373 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.491 | 2.288 | 2.883 | 2.908 | 2.933 | 2.286 | 100.0% | 10 | | neutron.list_ports | 0.1 | 0.131 | 0.305 | 0.361 | 0.418 | 0.175 | 100.0% | 10 | | total | 1.823 | 2.523 | 3.041 | 3.055 | 3.069 | 2.461 | 100.0% | 10 | | -> duration | 1.823 | 2.523 | 3.041 | 3.055 | 3.069 | 2.461 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.824112 Full duration: 52.041394 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.683 | 1.024 | 1.532 | 1.716 | 1.899 | 1.104 | 100.0% | 10 | | neutron.create_subnet | 0.936 | 1.301 | 2.469 | 3.616 | 4.764 | 1.785 | 100.0% | 10 | | neutron.create_router | 5.758 | 8.292 | 11.21 | 11.317 | 11.425 | 8.392 | 100.0% | 10 | | neutron.add_interface_router | 2.203 | 3.138 | 4.439 | 4.516 | 4.593 | 3.217 | 100.0% | 10 | | neutron.list_routers | 0.089 | 0.119 | 0.407 | 0.464 | 0.52 | 0.194 | 100.0% | 10 | | total | 10.461 | 15.551 | 17.39 | 17.464 | 17.539 | 14.693 | 100.0% | 10 | | -> duration | 10.461 | 15.551 | 17.39 | 17.464 | 17.539 | 14.693 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.058322 Full duration: 83.523762 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.73 | 1.573 | 2.422 | 2.469 | 2.516 | 1.658 | 100.0% | 10 | | neutron.create_subnet | 1.387 | 2.187 | 4.142 | 4.439 | 4.737 | 2.681 | 100.0% | 10 | | neutron.list_subnets | 0.089 | 0.122 | 0.14 | 0.142 | 0.143 | 0.118 | 100.0% | 10 | | total | 2.611 | 3.999 | 6.157 | 6.213 | 6.269 | 4.457 | 100.0% | 10 | | -> duration | 2.611 | 3.999 | 6.157 | 6.213 | 6.269 | 4.457 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.461175 Full duration: 36.257613 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.564 | 0.735 | 0.865 | 0.91 | 0.955 | 0.729 | 100.0% | 10 | | neutron.delete_security_group | 0.153 | 0.197 | 0.277 | 0.28 | 0.283 | 0.207 | 100.0% | 10 | | total | 0.717 | 0.987 | 1.063 | 1.1 | 1.137 | 0.936 | 100.0% | 10 | | -> duration | 0.717 | 0.987 | 1.063 | 1.1 | 1.137 | 0.936 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.726107 Full duration: 17.688945 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.403 | 0.554 | 0.862 | 0.894 | 0.926 | 0.621 | 100.0% | 10 | | neutron.create_security_group_rule | 0.357 | 0.449 | 0.5 | 0.503 | 0.505 | 0.44 | 100.0% | 10 | | neutron.delete_security_group_rule | 0.127 | 0.209 | 0.253 | 0.267 | 0.281 | 0.202 | 100.0% | 10 | | neutron.delete_security_group | 0.164 | 0.202 | 0.263 | 0.27 | 0.276 | 0.207 | 100.0% | 10 | | total | 1.13 | 1.43 | 1.727 | 1.804 | 1.881 | 1.47 | 100.0% | 10 | | -> duration | 1.13 | 1.43 | 1.727 | 1.804 | 1.881 | 1.47 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.217441 Full duration: 50.280256 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.337 | 0.599 | 0.686 | 0.724 | 0.763 | 0.586 | 100.0% | 10 | | neutron.create_security_group_rule | 0.267 | 0.355 | 0.412 | 0.413 | 0.415 | 0.349 | 100.0% | 10 | | neutron.list_security_group_rules | 0.058 | 0.093 | 0.115 | 0.116 | 0.116 | 0.092 | 100.0% | 10 | | total | 0.778 | 0.991 | 1.158 | 1.208 | 1.257 | 1.027 | 100.0% | 10 | | -> duration | 0.778 | 0.991 | 1.158 | 1.208 | 1.257 | 1.027 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.222271 Full duration: 49.308911 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.383 | 0.625 | 1.934 | 1.978 | 2.021 | 1.087 | 100.0% | 10 | | neutron.show_security_group | 0.055 | 0.068 | 0.091 | 0.092 | 0.092 | 0.073 | 100.0% | 10 | | total | 0.459 | 0.716 | 2.023 | 2.055 | 2.086 | 1.16 | 100.0% | 10 | | -> duration | 0.459 | 0.716 | 2.023 | 2.055 | 2.086 | 1.16 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.143451 Full duration: 19.146266 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.494 | 0.962 | 1.803 | 1.899 | 1.994 | 1.06 | 100.0% | 10 | | neutron.create_router | 3.708 | 7.641 | 13.486 | 13.501 | 13.515 | 8.362 | 100.0% | 10 | | neutron.add_gateway_router | 2.403 | 3.085 | 3.954 | 4.149 | 4.345 | 3.162 | 100.0% | 10 | | neutron.remove_gateway_router | 1.103 | 1.754 | 2.55 | 2.662 | 2.774 | 1.826 | 100.0% | 10 | | total | 10.246 | 13.942 | 20.433 | 20.433 | 20.433 | 14.409 | 100.0% | 10 | | -> duration | 10.246 | 13.942 | 20.433 | 20.433 | 20.433 | 14.409 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.187411 Full duration: 85.309753 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "router": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "ports_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port (x2) | 3.071 | 4.092 | 6.162 | 6.395 | 6.627 | 4.598 | 100.0% | 10 | | neutron.show_port (x2) | 0.178 | 0.206 | 0.333 | 0.36 | 0.387 | 0.236 | 100.0% | 10 | | total | 3.458 | 4.293 | 6.414 | 6.621 | 6.828 | 4.835 | 100.0% | 10 | | -> duration | 3.458 | 4.293 | 6.414 | 6.621 | 6.828 | 4.835 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.853409 Full duration: 120.822398 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_routers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.645 | 1.206 | 2.159 | 2.436 | 2.713 | 1.434 | 100.0% | 10 | | neutron.create_subnet (x2) | 2.63 | 4.233 | 6.806 | 7.086 | 7.366 | 4.715 | 100.0% | 10 | | neutron.create_router (x2) | 10.174 | 21.039 | 26.616 | 27.028 | 27.439 | 19.562 | 100.0% | 10 | | neutron.add_interface_router (x2) | 4.875 | 7.338 | 8.981 | 9.517 | 10.052 | 7.305 | 100.0% | 10 | | neutron.show_router (x2) | 0.174 | 0.212 | 0.31 | 0.364 | 0.417 | 0.237 | 100.0% | 10 | | total | 21.387 | 35.117 | 40.984 | 41.172 | 41.36 | 33.254 | 100.0% | 10 | | -> duration | 21.387 | 35.117 | 40.984 | 41.172 | 41.36 | 33.254 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 91.68155 Full duration: 150.52952 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_show_subnets args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "router": {} } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 1.736 | 3.089 | 3.757 | 3.941 | 4.125 | 2.914 | 100.0% | 10 | | neutron.show_subnet (x2) | 0.157 | 0.205 | 0.452 | 0.472 | 0.492 | 0.256 | 100.0% | 10 | | total | 2.032 | 3.269 | 4.221 | 4.278 | 4.334 | 3.17 | 100.0% | 10 | | -> duration | 2.032 | 3.269 | 4.221 | 4.278 | 4.334 | 3.17 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.672389 Full duration: 54.154673 HINTS: * To plot HTML graphics with this data, run: rally task report 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 --out output.html * To generate a JUnit report, run: rally task export 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 --json --out output.json 2020-04-07 21:33:42,502 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'3b8e91bf-f522-45c3-b8c1-67c80b1bf502', '--out', u'/home/opnfv/functest/results/rally_full/neutron.json'] 2020-04-07 21:33:44,803 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3b8e91bf-f522-45c3-b8c1-67c80b1bf502 --out /home/opnfv/functest/results/rally_full/neutron.json 2020-04-07 21:33:44,864 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-04-07 21:33:44,864 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/full/opnfv-nova.yaml 2020-04-07 21:33:44,864 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 21:33:44,882 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 21:33:44,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-04-07 21:33:44,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'nova', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['nova'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 22:32:58,271 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: c3eb3a43-e996-4735-bb51-bb20c15dc458 2020-04-07 22:32:58,272 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c3eb3a43-e996-4735-bb51-bb20c15dc458 2020-04-07 22:32:58,272 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'c3eb3a43-e996-4735-bb51-bb20c15dc458'] 2020-04-07 22:32:59,328 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c3eb3a43-e996-4735-bb51-bb20c15dc458 -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_delete_keypair args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.372 | 0.664 | 1.023 | 1.202 | 1.381 | 0.747 | 100.0% | 10 | | nova.delete_keypair | 0.065 | 0.203 | 0.596 | 0.61 | 0.623 | 0.282 | 100.0% | 10 | | total | 0.456 | 0.982 | 1.425 | 1.435 | 1.446 | 1.029 | 100.0% | 10 | | -> duration | 0.456 | 0.982 | 1.425 | 1.435 | 1.446 | 1.029 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.188729 Full duration: 15.872118 -------------------------------------------------------------------------------- test scenario NovaKeypair.create_and_list_keypairs args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.403 | 0.868 | 0.909 | 0.923 | 0.936 | 0.798 | 100.0% | 10 | | nova.list_keypairs | 0.037 | 0.045 | 0.051 | 0.059 | 0.066 | 0.046 | 100.0% | 10 | | total | 0.451 | 0.92 | 0.955 | 0.968 | 0.981 | 0.844 | 100.0% | 10 | | -> duration | 0.451 | 0.92 | 0.955 | 0.968 | 0.981 | 0.844 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.512955 Full duration: 60.178917 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_bounce_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" }, "actions": [ { "hard_reboot": 1 }, { "soft_reboot": 1 }, { "stop_start": 1 }, { "rescue_unrescue": 1 } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.448 | 30.572 | 50.107 | 52.34 | 54.573 | 34.18 | 100.0% | 10 | | nova.reboot_server | 9.602 | 13.094 | 16.365 | 16.85 | 17.336 | 13.218 | 100.0% | 10 | | nova.soft_reboot_server | 5.954 | 134.09 | 137.496 | 138.788 | 140.08 | 122.064 | 100.0% | 10 | | nova.stop_and_start_server | 24.632 | 74.32 | 78.273 | 78.429 | 78.584 | 70.177 | 100.0% | 10 | | -> nova.stop_server | 14.599 | 63.424 | 64.035 | 64.092 | 64.149 | 58.555 | 100.0% | 10 | | -> nova.start_server | 10.033 | 10.414 | 15.745 | 15.809 | 15.872 | 11.622 | 100.0% | 10 | | nova.rescue_and_unrescue_server | 66.539 | 68.717 | 70.137 | 71.999 | 73.86 | 68.881 | 100.0% | 10 | | -> nova.rescue_server | 63.787 | 65.786 | 66.639 | 66.856 | 67.073 | 65.457 | 100.0% | 10 | | -> nova.unrescue_server | 2.544 | 2.752 | 5.147 | 6.25 | 7.353 | 3.424 | 100.0% | 10 | | nova.delete_server | 5.123 | 5.387 | 7.29 | 7.31 | 7.33 | 5.715 | 100.0% | 10 | | total | 155.991 | 332.028 | 348.418 | 351.051 | 353.683 | 314.276 | 100.0% | 10 | | -> duration | 146.991 | 323.028 | 339.418 | 342.051 | 344.683 | 305.276 | 100.0% | 10 | | -> idle_duration | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 9.0 | 100.0% | 10 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 984.435618 Full duration: 1088.867155 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 21.336 | 38.249 | 53.997 | 64.929 | 75.86 | 39.456 | 100.0% | 10 | | nova.delete_server | 23.874 | 37.182 | 52.115 | 58.141 | 64.166 | 40.035 | 100.0% | 10 | | total | 51.532 | 76.827 | 110.005 | 118.321 | 126.637 | 79.492 | 100.0% | 10 | | -> duration | 50.532 | 75.827 | 109.005 | 117.321 | 125.637 | 78.492 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 224.779944 Full duration: 311.934969 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_list_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "detailed": true, "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 26.366 | 44.05 | 63.849 | 75.334 | 86.819 | 46.754 | 100.0% | 10 | | nova.list_servers | 0.308 | 0.362 | 2.547 | 11.006 | 19.465 | 2.293 | 100.0% | 10 | | total | 26.69 | 44.549 | 81.406 | 84.302 | 87.199 | 49.048 | 100.0% | 10 | | -> duration | 25.69 | 43.549 | 80.406 | 83.302 | 86.199 | 48.048 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 132.979132 Full duration: 320.900679 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_rebuild_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "from_image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" }, "to_image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 27.025 | 51.263 | 173.365 | 177.983 | 182.601 | 78.637 | 100.0% | 10 | | nova.rebuild_server | 26.354 | 43.196 | 53.301 | 54.717 | 56.133 | 42.884 | 100.0% | 10 | | nova.delete_server | 5.401 | 15.752 | 19.945 | 25.244 | 30.543 | 15.395 | 100.0% | 10 | | total | 89.559 | 106.502 | 230.006 | 235.962 | 241.919 | 136.916 | 100.0% | 10 | | -> duration | 87.559 | 104.502 | 228.006 | 233.962 | 239.919 | 134.916 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 430.554974 Full duration: 540.335605 -------------------------------------------------------------------------------- test scenario NovaServers.snapshot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 2, "tenants": 3 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server (x2) | 56.102 | 146.174 | 257.888 | 258.681 | 259.473 | 155.919 | 100.0% | 10 | | nova.snapshot_server | 6.62 | 7.001 | 9.214 | 10.338 | 11.463 | 7.714 | 100.0% | 10 | | -> glance_v2.get_image | 0.078 | 0.088 | 0.092 | 0.096 | 0.101 | 0.087 | 100.0% | 10 | | -> glance.wait_for_image | 6.174 | 6.194 | 8.447 | 9.351 | 10.254 | 6.814 | 100.0% | 10 | | --> glance_v2.get_image (x4) | 0.166 | 0.182 | 0.232 | 0.274 | 0.316 | 0.198 | 100.0% | 8 | | --> glance_v2.get_image (x5) | 0.236 | 0.236 | 0.236 | 0.236 | 0.236 | 0.236 | 100.0% | 1 | | --> glance_v2.get_image (x6) | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 100.0% | 1 | | nova.delete_server (x2) | 10.613 | 17.537 | 32.453 | 38.133 | 43.812 | 21.149 | 100.0% | 10 | | nova.delete_image | 0.993 | 1.675 | 9.745 | 9.898 | 10.052 | 3.22 | 100.0% | 10 | | -> glance_v2.delete_image | 0.955 | 1.632 | 9.707 | 9.857 | 10.008 | 3.178 | 100.0% | 10 | | -> glance.wait_for_delete | 0.034 | 0.039 | 0.046 | 0.047 | 0.047 | 0.04 | 100.0% | 10 | | --> glance_v2.get_image | 0.034 | 0.039 | 0.046 | 0.046 | 0.047 | 0.04 | 0.0% | 10 | | total | 78.906 | 178.897 | 284.79 | 286.381 | 287.972 | 188.003 | 100.0% | 10 | | -> duration | 76.906 | 176.897 | 282.79 | 284.381 | 285.972 | 186.003 | 100.0% | 10 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 10 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 490.542071 Full duration: 607.496749 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "volume_size": 1, "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" }, "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.317 | 11.385 | 12.675 | 13.006 | 13.337 | 11.374 | 100.0% | 10 | | nova.boot_server | 18.911 | 24.274 | 42.913 | 44.492 | 46.071 | 29.593 | 100.0% | 10 | | total | 28.228 | 35.78 | 54.311 | 56.492 | 58.672 | 40.967 | 100.0% | 10 | | -> duration | 27.228 | 34.78 | 53.311 | 55.492 | 57.672 | 39.967 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 115.142107 Full duration: 171.557078 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 16.367 | 25.372 | 44.245 | 46.283 | 48.32 | 29.403 | 100.0% | 10 | | total | 16.367 | 25.372 | 44.245 | 46.283 | 48.321 | 29.403 | 100.0% | 10 | | -> duration | 15.367 | 24.372 | 43.245 | 45.283 | 47.321 | 28.403 | 100.0% | 10 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 75.902025 Full duration: 104.292921 -------------------------------------------------------------------------------- test scenario NovaServers.list_servers args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "network": {}, "users": { "users_per_tenant": 2, "tenants": 3 }, "servers": { "servers_per_tenant": 2, "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "auto_assign_nic": true, "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" } } }, "args": { "detailed": true }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.list_servers | 0.432 | 0.654 | 0.969 | 1.007 | 1.046 | 0.686 | 100.0% | 10 | | total | 0.432 | 0.654 | 0.969 | 1.008 | 1.046 | 0.686 | 100.0% | 10 | | -> duration | 0.432 | 0.654 | 0.969 | 1.008 | 1.046 | 0.686 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.982206 Full duration: 193.344988 -------------------------------------------------------------------------------- test scenario NovaServers.resize_server args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "confirm": true, "nics": [ { "net-id": "26633733-3fd7-4d03-98bc-47db7ab97cce" } ], "image": { "name": "rally_full-img_346131ef-a87f-4291-a333-88b3f583c266" }, "force_delete": false, "flavor": { "name": "rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266" }, "to_flavor": { "name": "rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c3eb3a43-e996-4735-bb51-bb20c15dc458 has 5 error(s) -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:05Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:05Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:00Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:00Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:31:44Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:31:44Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:04Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:04Z'} -------------------------------------------------------------------------------- GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:15Z'} Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 389, in run self._resize(server, to_flavor) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 693, in _resize check_interval=CONF.openstack.nova_server_resize_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 214, in wait_for_status resource = update_resource(resource) File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 89, in _get_from_manager fault=getattr(res, "fault", "n/a")) GetResourceErrorStatus: Resource has ERROR status. Fault: {u'message': u'OSError', u'code': 500, u'created': u'2020-04-07T22:32:15Z'} -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.714 | 35.972 | 40.987 | 41.865 | 42.744 | 32.346 | 100.0% | 5 | | nova.resize | 6.315 | 7.095 | 10.775 | 11.384 | 11.993 | 8.205 | 0.0% | 5 | | total | 27.809 | 47.301 | 48.838 | 49.129 | 49.419 | 40.552 | 0.0% | 5 | | -> duration | 26.809 | 46.301 | 47.838 | 48.129 | 48.419 | 39.552 | 0.0% | 5 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 5 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.094791 Full duration: 101.403374 HINTS: * To plot HTML graphics with this data, run: rally task report c3eb3a43-e996-4735-bb51-bb20c15dc458 --out output.html * To generate a JUnit report, run: rally task export c3eb3a43-e996-4735-bb51-bb20c15dc458 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c3eb3a43-e996-4735-bb51-bb20c15dc458 --json --out output.json At least one workload did not pass SLA criteria. 2020-04-07 22:32:59,330 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'c3eb3a43-e996-4735-bb51-bb20c15dc458', '--out', u'/home/opnfv/functest/results/rally_full/nova.json'] 2020-04-07 22:33:01,285 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c3eb3a43-e996-4735-bb51-bb20c15dc458 --out /home/opnfv/functest/results/rally_full/nova.json 2020-04-07 22:33:01,325 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-04-07 22:33:01,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2020-04-07 22:33:01,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 22:33:01,344 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 22:33:01,345 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-04-07 22:33:01,345 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'quotas', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 22:33:54,748 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 7c6a9228-65e0-4f04-8a52-4de6da6ad598 2020-04-07 22:33:54,749 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7c6a9228-65e0-4f04-8a52-4de6da6ad598 2020-04-07 22:33:54,749 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'7c6a9228-65e0-4f04-8a52-4de6da6ad598'] 2020-04-07 22:33:55,582 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7c6a9228-65e0-4f04-8a52-4de6da6ad598 -------------------------------------------------------------------------------- Task 7c6a9228-65e0-4f04-8a52-4de6da6ad598: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7c6a9228-65e0-4f04-8a52-4de6da6ad598 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.362 | 0.988 | 1.139 | 1.241 | 1.344 | 0.854 | 100.0% | 10 | | quotas.delete_quotas | 0.027 | 0.164 | 0.321 | 0.536 | 0.75 | 0.22 | 100.0% | 10 | | total | 0.513 | 1.188 | 1.339 | 1.355 | 1.371 | 1.074 | 100.0% | 10 | | -> duration | 0.513 | 1.188 | 1.339 | 1.355 | 1.371 | 1.074 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.930072 Full duration: 11.527295 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "api_versions": { "cinder": { "service_type": "volumev3", "version": 3 } }, "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7c6a9228-65e0-4f04-8a52-4de6da6ad598 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.431 | 0.769 | 1.114 | 1.159 | 1.204 | 0.787 | 100.0% | 10 | | total | 0.431 | 0.769 | 1.114 | 1.159 | 1.204 | 0.787 | 100.0% | 10 | | -> duration | 0.431 | 0.769 | 1.114 | 1.159 | 1.204 | 0.787 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.038134 Full duration: 7.699933 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7c6a9228-65e0-4f04-8a52-4de6da6ad598 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.294 | 1.382 | 2.579 | 2.591 | 2.602 | 1.601 | 100.0% | 10 | | total | 0.377 | 1.532 | 2.666 | 2.692 | 2.718 | 1.718 | 100.0% | 10 | | -> duration | 0.377 | 1.532 | 2.666 | 2.692 | 2.718 | 1.718 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.558336 Full duration: 13.591098 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7c6a9228-65e0-4f04-8a52-4de6da6ad598 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.72 | 1.566 | 2.356 | 2.363 | 2.371 | 1.64 | 100.0% | 10 | | total | 0.72 | 1.566 | 2.356 | 2.363 | 2.371 | 1.641 | 100.0% | 10 | | -> duration | 0.72 | 1.566 | 2.356 | 2.363 | 2.371 | 1.641 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.340158 Full duration: 10.681683 HINTS: * To plot HTML graphics with this data, run: rally task report 7c6a9228-65e0-4f04-8a52-4de6da6ad598 --out output.html * To generate a JUnit report, run: rally task export 7c6a9228-65e0-4f04-8a52-4de6da6ad598 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7c6a9228-65e0-4f04-8a52-4de6da6ad598 --json --out output.json 2020-04-07 22:33:55,582 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'7c6a9228-65e0-4f04-8a52-4de6da6ad598', '--out', u'/home/opnfv/functest/results/rally_full/quotas.json'] 2020-04-07 22:33:57,762 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7c6a9228-65e0-4f04-8a52-4de6da6ad598 --out /home/opnfv/functest/results/rally_full/quotas.json 2020-04-07 22:33:57,772 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-04-07 22:33:57,772 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-swift.yaml 2020-04-07 22:33:57,772 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-07 22:33:57,798 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-04-07 22:33:57,798 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-04-07 22:33:57,799 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'swift', '--abort-on-sla-failure', '--task', u'/home/opnfv/functest/data/rally/task/task.yaml', '--task-args', "{'smoke': False, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'public', 'block_migration': 'false', 'service_list': ['swift'], 'concurrency': 4, 'netid': '26633733-3fd7-4d03-98bc-47db7ab97cce', 'tenants_amount': 3, 'image_name': 'rally_full-img_346131ef-a87f-4291-a333-88b3f583c266', 'volume_service_type': 'volumev3', 'flavor_name': 'rally_full-flavor_346131ef-a87f-4291-a333-88b3f583c266', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally_full-flavor_alt_346131ef-a87f-4291-a333-88b3f583c266', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'volume_version': 3, 'glance_image_format': 'qcow2'}"] 2020-04-07 22:35:56,135 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 39228bda-b670-4edd-aca4-e0c66b987880 2020-04-07 22:35:56,136 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 39228bda-b670-4edd-aca4-e0c66b987880 2020-04-07 22:35:56,136 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'39228bda-b670-4edd-aca4-e0c66b987880'] 2020-04-07 22:35:57,127 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 39228bda-b670-4edd-aca4-e0c66b987880 -------------------------------------------------------------------------------- Task 39228bda-b670-4edd-aca4-e0c66b987880: aborted -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "runner": { "concurrency": 4, "times": 10 }, "contexts": { "users": { "users_per_tenant": 2, "tenants": 3 }, "roles": [ "admin" ] }, "args": { "object_size": 5120, "objects_per_container": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 39228bda-b670-4edd-aca4-e0c66b987880 has 1 error(s) -------------------------------------------------------------------------------- ClientException: Container GET failed: http://object-store-airship.intel-pod15.opnfv.org/swift/v1/KEY_b7437039671e4696ac8c0d67f1c2ea91/s_rally_9d54a4c0_515tEQqX?format=json&marker=s_rally_9d54a4c0_nvN341We 401 Unauthorized [first 60 chars of response] {"Code":"AccessDenied","RequestId":"tx000000000000000002f7c- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/objects.py", line 51, in run self._list_objects(container_name) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/swift/utils.py", line 76, in _list_objects **kwargs) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1801, in get_container query_string=query_string) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1722, in _retry service_token=self.service_token, **kwargs) File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 936, in get_container headers=headers)[1] File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 973, in get_container raise ClientException.from_response(resp, 'Container GET failed', body) ClientException: Container GET failed: http://object-store-airship.intel-pod15.opnfv.org/swift/v1/KEY_b7437039671e4696ac8c0d67f1c2ea91/s_rally_9d54a4c0_515tEQqX?format=json&marker=s_rally_9d54a4c0_nvN341We 401 Unauthorized [first 60 chars of response] {"Code":"AccessDenied","RequestId":"tx000000000000000002f7c- -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 0.495 | 0.56 | 11.556 | 12.157 | 12.758 | 4.821 | 100.0% | 5 | | swift.upload_object (x2) | 0.277 | 45.483 | 52.241 | 53.535 | 54.828 | 34.683 | 100.0% | 5 | | swift.list_objects | 0.267 | 0.293 | 24.896 | 29.143 | 33.391 | 9.275 | 80.0% | 5 | | total | 1.04 | 58.41 | 64.085 | 65.973 | 67.862 | 48.783 | 80.0% | 5 | | -> duration | 1.04 | 58.41 | 64.085 | 65.973 | 67.862 | 48.783 | 80.0% | 5 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 80.0% | 5 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 67.877391 Full duration: 109.823033 HINTS: * To plot HTML graphics with this data, run: rally task report 39228bda-b670-4edd-aca4-e0c66b987880 --out output.html * To generate a JUnit report, run: rally task export 39228bda-b670-4edd-aca4-e0c66b987880 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 39228bda-b670-4edd-aca4-e0c66b987880 --json --out output.json At least one workload did not pass SLA criteria. 2020-04-07 22:35:57,128 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'39228bda-b670-4edd-aca4-e0c66b987880', '--out', u'/home/opnfv/functest/results/rally_full/swift.json'] 2020-04-07 22:35:59,608 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 39228bda-b670-4edd-aca4-e0c66b987880 --out /home/opnfv/functest/results/rally_full/swift.json 2020-04-07 22:35:59,612 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" Failed. 2020-04-07 22:35:59,617 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:03:26 | 60 | 100.00% | | glance | 00:03:50 | 35 | 94.29% | | cinder | 00:06:25 | 5 | 40.00% | | heat | 00:26:04 | 108 | 99.07% | | keystone | 00:05:25 | 110 | 100.00% | | neutron | 00:22:11 | 200 | 100.00% | | nova | 00:58:36 | 105 | 95.24% | | quotas | 00:00:43 | 40 | 100.00% | | swift | 00:01:49 | 5 | 80.00% | | | | | | | TOTAL: | 02:08:33 | 668 | 98.20% | +----------------+------------+----------------+-----------+ 2020-04-07 22:35:59,617 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_full' success_rate is 98.20% in 4/9 modules 2020-04-07 22:35:59,617 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.html'] 2020-04-07 22:36:02,520 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.html 2020-04-07 22:36:02,521 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_full/rally_full.xml'] 2020-04-07 22:36:05,128 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_full/rally_full.xml 2020-04-07 22:36:05,128 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_full | functest | 133:32 | FAIL | +--------------------+------------------+------------------+----------------+ 2020-04-07 22:36:24,790 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)