2019-11-28 18:48:34,493 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-----------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-----------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/xtesting/airship-opnfv-functest-vnf-latest-heat_ims-run-39 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | | | DEBUG | true | | INSTALLER_TYPE | airship | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/xtesting/airship-opnfv-functest-vnf-latest-heat_ims-run-39 | | NODE_NAME | intel-pod17 | +-------------------------+-----------------------------------------------------------------------------------------------+ 2019-11-28 18:48:34,497 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod17 2019-11-28 18:48:34,497 - xtesting.ci.run_tests - DEBUG - Test args: heat_ims 2019-11-28 18:48:34,506 - xtesting.ci.run_tests - INFO - Loading test case 'heat_ims'... 2019-11-28 18:48:35,256 - functest.core.tenantnetwork - DEBUG - password: {M{v0xAc=L?sb4KHfKSadN|NQNq93] 2019-11-28 18:48:35,364 - functest.core.tenantnetwork - DEBUG - project: Munch({'is_enabled': True, 'is_domain': False, 'description': u'Created by OPNFV Functest: heat_ims', 'enabled': True, 'id': u'1f2094df2f02475b912fddc8e98354a7', 'parent_id': u'default', 'properties': Munch({}), 'location': Munch({'project': Munch({'domain_id': u'default', 'id': u'default', 'name': None, 'domain_name': None}), 'zone': None, 'region_name': None, 'cloud': 'envvars'}), 'domain_id': u'default', 'name': u'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f'}) 2019-11-28 18:48:35,432 - functest.core.tenantnetwork - DEBUG - user: Munch({'username': None, 'description': None, 'enabled': True, 'id': u'b4e01d22ccc94c2193fa6e6549c1d9e2', 'email': None, 'default_project_id': None, 'domain_id': u'default', 'name': u'heat_ims-user_926892b3-f19c-458e-ac22-d98fa139238f'}) 2019-11-28 18:48:35,848 - functest.core.tenantnetwork - DEBUG - cloud_config {'clouds': {'envvars': {u'auth_type': u'password', u'status': u'active', 'project_name': u'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f', u'compute_api_version': u'2', 'key': None, u'database_api_version': u'1.0', 'user_domain_name': 'default', 'api_timeout': None, u'baremetal_api_version': u'1', u'image_api_version': u'2', u'container_infra_api_version': u'1', u'metering_api_version': u'2', u'image_api_use_tasks': False, u'floating_ip_source': u'neutron', 'project_domain_name': 'default', u'orchestration_api_version': u'1', 'cacert': None, u'network_api_version': u'2', u'message': u'', u'image_format': u'qcow2', u'application_catalog_api_version': u'1', 'region_name': 'intel-pod17', u'key_manager_api_version': u'v1', 'password': '{M{v0xAc=L?sb4KHfKSadN|NQNq93]', u'workflow_api_version': u'2', 'verify': True, u'identity_api_version': '3', u'volume_api_version': u'2', 'username': u'heat_ims-user_926892b3-f19c-458e-ac22-d98fa139238f', 'project_id': u'1f2094df2f02475b912fddc8e98354a7', 'cert': None, u'secgroup_source': u'neutron', u'container_api_version': u'1', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', u'dns_api_version': u'2', u'object_store_api_version': u'1', u'interface': 'public', u'disable_vendor_agent': {}}}} 2019-11-28 18:48:35,852 - functest.core.tenantnetwork - DEBUG - new cloud {'username': u'heat_ims-user_926892b3-f19c-458e-ac22-d98fa139238f', 'password': '{M{v0xAc=L?sb4KHfKSadN|NQNq93]', 'project_name': 'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f', 'user_domain_name': 'default', 'auth_url': 'http://identity-airship.intel-pod17.opnfv.org:80/v3', 'project_id': '1f2094df2f02475b912fddc8e98354a7', 'project_domain_name': 'default'} 2019-11-28 18:48:35,877 - functest.opnfv_tests.vnf.ims.heat_ims - DEBUG - VNF configuration: {'descriptor': {u'file_name': u'/src/heat_vims/clearwater.yaml', u'version': u'130', u'name': u'clearwater-opnfv'}, 'parameters': {u'vellum_cluster_size': 1, u'zone': u'clearwater.opnfv', u'dnssec_key': u'GkBraPnditvP2Em4oXV5wUTawmZaGGuO+Jt3ZnFkznGV3zFoQ+Ak13nuuOnO0JV5FqAr/KitdW6siqjXSjROXg==', u'dn_range_length': u'1000', u'dime_cluster_size': 1, u'dn_range_start': u'6505550000', u'bono_cluster_size': 1, u'homer_cluster_size': 1, u'sprout_cluster_size': 1}} 2019-11-28 18:48:35,880 - xtesting.ci.run_tests - INFO - Running test case 'heat_ims'... 2019-11-28 18:48:44,498 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/0141659e-389f-4ce6-a864-d65b40e4f971/file', 'owner': u'1f2094df2f02475b912fddc8e98354a7', 'id': u'0141659e-389f-4ce6-a864-d65b40e4f971', 'size': 263848448, u'self': u'/v2/images/0141659e-389f-4ce6-a864-d65b40e4f971', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1f2094df2f02475b912fddc8e98354a7', 'name': 'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2019-11-28T18:48:44Z', 'tags': [], 'visibility': u'private', 'updated_at': u'2019-11-28T18:48:44Z', u'owner_specified.shade.sha256': u'93fe2ce68445e0e3ca98921643aa0adf8f5c948810cb88295737b0eb84db28d7', u'owner_specified.shade.object': u'images/heat_ims-img_926892b3-f19c-458e-ac22-d98fa139238f', 'min_disk': 0, 'is_public': False, 'virtual_size': 0, u'owner_specified.shade.md5': u'52fc95ebfee7f3e5bb64eed425820c4a', 'properties': {u'self': u'/v2/images/0141659e-389f-4ce6-a864-d65b40e4f971', u'owner_specified.shade.md5': u'52fc95ebfee7f3e5bb64eed425820c4a', u'owner_specified.shade.object': u'images/heat_ims-img_926892b3-f19c-458e-ac22-d98fa139238f', u'owner_specified.shade.sha256': u'93fe2ce68445e0e3ca98921643aa0adf8f5c948810cb88295737b0eb84db28d7', u'schema': u'/v2/schemas/image'}, 'name': u'heat_ims-img_926892b3-f19c-458e-ac22-d98fa139238f', 'created': u'2019-11-28T18:48:37Z', 'checksum': u'52fc95ebfee7f3e5bb64eed425820c4a', 'created_at': u'2019-11-28T18:48:37Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/0141659e-389f-4ce6-a864-d65b40e4f971', u'owner_specified.shade.md5': u'52fc95ebfee7f3e5bb64eed425820c4a', u'owner_specified.shade.object': u'images/heat_ims-img_926892b3-f19c-458e-ac22-d98fa139238f', u'owner_specified.shade.sha256': u'93fe2ce68445e0e3ca98921643aa0adf8f5c948810cb88295737b0eb84db28d7', u'schema': u'/v2/schemas/image'}}) 2019-11-28 18:48:44,586 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'heat_ims-flavor_926892b3-f19c-458e-ac22-d98fa139238f', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'27e2967ef2084123a979b06381ecc97a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 3, 'id': u'9d5af645-2fb5-435c-a69f-6b698c5b2989', 'swap': 0}) 2019-11-28 18:48:45,387 - functest.opnfv_tests.vnf.ims.heat_ims - INFO - keypair: -----BEGIN RSA PRIVATE KEY----- MIIEowIBAAKCAQEAxEH4do0p0Z+Cbqs22YAJTQ4idba2qZZgZxNzF+YwvwEvarl7 o+68J37jvXJO3fX2P8rfI2lkYJR+PHTtLNpHs9PqLaIudztrwTcOneN1niU8tfSH EJGi80GwdklCssLi9EJxk0w6cXcIGH21nr49kgV+EyWqK/6GHK9SjVSBG8FtcIEx 3PiDF859U00mk9S/+V+UJzorKPLk7aLfQvBqyqRdxn4n/Ghcvsbd/tzQSn16gPew 0Hr62U82Z8epEz21CAuhDx3/ZK7+rCUd0L/LIrkAUeQJi5B7g/VO/Weh2KHcoQz4 ajLILUrTkuUYdz7WEaWnRXR6+Ub5F3GmA+EUMQIDAQABAoIBAFxrbKP3SfArG3Me MZAvGTIuK9AfINmvtOoVYKeqgN4RotCxVCYYsIYw3PJDuBwSTcowsO+uG9TXWLMD pQTwLb/jVW3z58nCM7YjRUDY8nRsuLA+3LPSwVeoYX7ydPRVjibUe0OQLB1unmNa H4MHt1riN0KxA/f/vgwYC9n+J2Z31dhYNInO4E2vi3ADwGPQuL4hMP3QGyz6L7jQ yoi7FQ3/qZIq4g/gAIHHdmNu6mbkjSFmVhPHDyNUOYcWUX1Eujr6WmCUmWqdhmiQ BqXJSVO0Se7SnJfAR9c1WhPB0y+btjScKFOdEgiN0/4qaPyzjuVmrtecgEhpuSTy ZdJCZAECgYEA+QKCvb9AzywanCeOT7Rz6qg0hZpf32BKLEeizRqXo/Dz3UUeT6VI ZgZ5FQvGxsfxm+oeTkZUjshMN7zindIJj7+7xe7wOyM7QWQUeoNN9ZiKetxOfhYY Yk0ap3S/lG3R+/6ctfvzk5pNQo8eqjw7InAuCAs7b+TneVnUt5QoX2ECgYEAycRc aXLYe9NIkPZEHrG2ocxQ8GXbbrrciubL5pzlA36OA9VEI03d+3MsdEzPezgh5Hqm jrwCmMXyg4rcWJWDHjvyk2qCqFdcEtXW4M2aUjBM5o0e7mYEQQjS2LKDh7CqPIHW EH8oNu7d8QEiS90LVh8jzrBdk0aXQvdM2F3E9tECgYBYH1xXfEyaRLhyFMmXSXxQ ShC0S2qsaa42N2/U+Bk8KnSTFPfiJdMWUCofmZhSFsZZcCQjfV5FXXsjqpPkWEWL +sWgCaw4sYIx5RIePUOkq8QuMLMSig09FJ5fLsDx7V+Ht5aMDMsprEy1RmMKyd// kwWnURpKwg5s8q6F/UfAYQKBgQCn2jSrAQD6Gm5/MnC/PEbcWbZoF8SyXMAGyjSN GK8o9gq9Q5mY6Tmn60vrQM9HCg6gHi0cB2r9n4e+STJAe7mF2IdYfj5OP8b4YG+P u1wLzeTb1EEMQVB+rhGCdxgXNTCaf8UPGknhUVzQF4pppG2+6s8GLxDZ6dsCuetz AKdQUQKBgBkYNCfuX1dL9dZf2ROigIwKRNOGHDqCRut1G6GR1aJG3J4ZC6jKNubH FNJQyxGNrwiCkRIVPpkEKwD8hcdhfSJFyZ/4i8Kdmu90/cCWl1PwjcnqinavaZ/z C+C81xAMHC/OIHWc6wuYqMKGt9db+bDUEv0B/rc6I9WmgOek/2ve -----END RSA PRIVATE KEY----- 2019-11-28 18:48:45,388 - functest.opnfv_tests.vnf.ims.heat_ims - INFO - Create Heat Stack 2019-11-28 19:09:16,105 - functest.opnfv_tests.vnf.ims.heat_ims - DEBUG - stack: Munch({'stack_name': u'clearwater-opnfv', 'creation_time': u'2019-11-28T18:48:50Z', 'updated_at': u'2019-11-28T19:09:11Z', 'notification_topics': [], 'timeout_mins': 60, 'owner': None, 'tempate_description': u'No description', 'deleted_at': None, 'id': u'3b8f39f9-5112-455a-bae3-8866252742eb', 'parameters': Munch({u'OS::project_id': u'1f2094df2f02475b912fddc8e98354a7', u'OS::stack_id': u'3b8f39f9-5112-455a-bae3-8866252742eb', u'OS::stack_name': u'clearwater-opnfv'}), 'deletion_time': None, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1f2094df2f02475b912fddc8e98354a7', 'name': 'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'stack_user_project_id': u'6ff65fbb9252474a8f462844e0c4a629', 'status': u'IN_PROGRESS', 'disable_rollback': False, 'description': u'No description', 'parent': None, 'tags': None, 'outputs': [], 'stack_owner': None, 'stack_status': u'ROLLBACK_IN_PROGRESS', 'status_reason': u'Stack ROLLBACK started', 'properties': Munch({u'capabilities': []}), 'template_description': u'No description', 'is_rollback_enabled': False, 'name': u'clearwater-opnfv', 'created_at': u'2019-11-28T18:48:50Z', 'stack_status_reason': u'Stack ROLLBACK started', 'updated_time': u'2019-11-28T19:09:11Z', 'action': u'ROLLBACK', 'identifier': 'clearwater-opnfv/3b8f39f9-5112-455a-bae3-8866252742eb'}) 2019-11-28 19:09:18,776 - functest.opnfv_tests.vnf.ims.heat_ims - DEBUG - servers: [Munch({'vm_state': u'active', u'OS-EXT-STS:task_state': u'deleting', 'addresses': Munch({u'clearwater-opnfv-private-management': [Munch({u'OS-EXT-IPS-MAC:mac_addr': u'fa:16:3e:48:5a:ea', u'version': 4, u'addr': u'192.168.100.9', u'OS-EXT-IPS:type': u'fixed'}), Munch({u'OS-EXT-IPS-MAC:mac_addr': u'fa:16:3e:48:5a:ea', u'version': 4, u'addr': u'10.10.175.38', u'OS-EXT-IPS:type': u'floating'})]}), 'terminated_at': None, 'image': Munch({u'id': u'0141659e-389f-4ce6-a864-d65b40e4f971', 'name': u'heat_ims-img_926892b3-f19c-458e-ac22-d98fa139238f'}), u'OS-EXT-AZ:availability_zone': u'nova', u'OS-EXT-STS:vm_state': u'active', u'OS-SRV-USG:launched_at': u'2019-11-28T18:49:44.000000', 'flavor': Munch({u'id': u'9d5af645-2fb5-435c-a69f-6b698c5b2989', 'name': u'heat_ims-flavor_926892b3-f19c-458e-ac22-d98fa139238f'}), 'az': u'nova', 'id': u'53cb85fe-6345-47e8-8e96-a02e30a74cb3', 'security_groups': [], u'os-extended-volumes:volumes_attached': [], 'user_id': u'b4e01d22ccc94c2193fa6e6549c1d9e2', 'disk_config': u'MANUAL', u'OS-DCF:diskConfig': u'MANUAL', 'networks': {}, 'accessIPv4': u'10.10.175.38', 'accessIPv6': '', 'location': Munch({'project': Munch({'domain_id': None, 'id': u'1f2094df2f02475b912fddc8e98354a7', 'name': 'heat_ims-project_926892b3-f19c-458e-ac22-d98fa139238f', 'domain_name': 'default'}), 'zone': u'nova', 'region_name': 'intel-pod17', 'cloud': 'envvars'}), 'power_state': 1, 'public_v4': u'10.10.175.38', 'progress': 0, u'OS-EXT-STS:power_state': 1, 'interface_ip': u'10.10.175.38', 'launched_at': u'2019-11-28T18:49:44.000000', 'metadata': Munch({}), 'status': u'ACTIVE', 'updated': u'2019-11-28T19:09:16Z', 'hostId': u'0c7d34840a69a6b7d9c93a12bd2f49d3675319db31b9ae236ec28972', u'OS-SRV-USG:terminated_at': None, 'key_name': u'heat_ims-kp_926892b3-f19c-458e-ac22-d98fa139238f', 'public_v6': '', 'private_v4': u'192.168.100.9', 'cloud': 'envvars', 'host_id': u'0c7d34840a69a6b7d9c93a12bd2f49d3675319db31b9ae236ec28972', 'task_state': u'deleting', 'properties': Munch({u'OS-EXT-STS:task_state': u'deleting', u'OS-SRV-USG:terminated_at': None, u'OS-DCF:diskConfig': u'MANUAL', u'os-extended-volumes:volumes_attached': [], u'OS-EXT-STS:vm_state': u'active', u'OS-SRV-USG:launched_at': u'2019-11-28T18:49:44.000000', u'OS-EXT-STS:power_state': 1, u'OS-EXT-AZ:availability_zone': u'nova'}), 'project_id': u'1f2094df2f02475b912fddc8e98354a7', 'name': u'ns.clearwater.opnfv', 'adminPass': None, 'tenant_id': u'1f2094df2f02475b912fddc8e98354a7', 'created_at': u'2019-11-28T18:49:16Z', 'created': u'2019-11-28T18:49:16Z', 'has_config_drive': False, 'volumes': [], 'config_drive': u'', 'region': 'intel-pod17'})] 2019-11-28 19:09:18,976 - functest.opnfv_tests.vnf.ims.heat_ims - DEBUG - servers: [] 2019-11-28 19:09:18,976 - functest.opnfv_tests.vnf.ims.heat_ims - ERROR - Cannot run heat_ims Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 143, in run if not self.execute(): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 120, in execute if self.deploy_vnf() and self.test_vnf(): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 203, in deploy_vnf assert ellis_ip UnboundLocalError: local variable 'ellis_ip' referenced before assignment 2019-11-28 19:09:18,978 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | heat_ims | functest | 20:43 | FAIL | +-------------------+------------------+------------------+----------------+ 2019-11-28 19:09:40,289 - functest.opnfv_tests.vnf.ims.heat_ims - ERROR - Cannot clean stack ressources Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 244, in clean self.cloud.delete_stack(self.stack.id, wait=True) File "/usr/lib/python2.7/site-packages/shade/openstackcloud.py", line 1152, in delete_stack id=name_or_id, reason=stack['stack_status_reason'])) SDKException: Failed to delete stack 3b8f39f9-5112-455a-bae3-8866252742eb: Resource DELETE failed: resources.dns: Stack DELETE cancelled 2019-11-28 19:09:42,256 - functest.core.singlevm - DEBUG - Cleaning security group 33b72c56-33b6-4d4d-a391-151b70c34363 2019-11-28 19:09:42,505 - functest.core.singlevm - DEBUG - Orphan security group 33b72c56-33b6-4d4d-a391-151b70c34363 in use 2019-11-28 19:09:44,134 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)