Rally  verification result

processing ...

Verification UUID Status Started at Finished at Tests count Tests duration, sec success skipped expected failures unexpected success failures
479e2e17-a046-4fa9-9e54-dbbad8f8a08c failed 2020-05-07T18:08:12 2020-05-07T18:43:01 114 2079.775 83 0 0 0 31
Filter tests by status: ☐ ☑ ☐ ☑ ☐ ☑ ☐ ☑ ☐ ☑
Toggle Header Toggle Tags Toggle All Filters
Test name (shown 114) ▾ ▴
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
heat_tempest_plugin.tests.api.test_heat_api.environments_delete_envstack.test_request
id-0efde180-cc0e-4f2c-bb18-fa345e8d21ad
success 0.123
heat_tempest_plugin.tests.api.test_heat_api.environments_environment_with_parameter.test_request
id-8281d088-0c80-4071-a13d-333b309be6ca
success 1.416
heat_tempest_plugin.tests.api.test_heat_api.environments_get_stack_output.test_request
id-f60dd8df-82d1-4228-8926-54d65ebd12e1
success 0.143
heat_tempest_plugin.tests.api.test_heat_api.environments_poll_for_envstack_create_complete.test_request
id-29899c70-9c94-4e24-8988-df76f7eaaa70
success 2.291
heat_tempest_plugin.tests.api.test_heat_api.resources_create_stack_with_resources.test_request
id-947be7b2-503d-41f5-9843-61be50954f13
success 2.470
heat_tempest_plugin.tests.api.test_heat_api.resources_delete_stack_with_resources.test_request
id-0edc4fdc-811d-4d27-a0dd-6ec4db2bda6e
success 0.110
heat_tempest_plugin.tests.api.test_heat_api.resources_list_filtered_resources.test_request
id-da07d3d2-9ccc-4fa1-9b1b-9cb3074fe9b9
success 0.144
heat_tempest_plugin.tests.api.test_heat_api.resources_list_resources.test_request
id-ec53f10d-a89a-4243-8706-629a01ea890f
success 0.201
heat_tempest_plugin.tests.api.test_heat_api.resources_mark_resource_unhealthy.test_request
id-6031516b-3a8f-4d1b-8990-81a571b5f956
success 0.702
heat_tempest_plugin.tests.api.test_heat_api.resources_poll_for_rsrcstack_create_complete.test_request
id-e9eac22f-c3e7-450f-a087-08a8655a6e8e
success 2.332
heat_tempest_plugin.tests.api.test_heat_api.resources_show_resource.test_request
id-2cbcedc5-0aa7-454e-bf89-a3dd5d379dc1
success 0.145
heat_tempest_plugin.tests.api.test_heat_api.resources_show_unhealthy_resource.test_request
id-9e784490-2e88-49af-8ee7-c4c6aba2be64
success 0.217
heat_tempest_plugin.tests.api.test_heat_api.resources_signal_resource.test_request
id-c65a047c-8c7b-4b44-9f5f-bf1069751c5c
success 0.080
heat_tempest_plugin.tests.api.test_heat_api.resourcetypes_list_resource_types.test_request
id-5b4db88b-d171-4400-b7a7-a7dc8f597d31
success 2.774
heat_tempest_plugin.tests.api.test_heat_api.resourcetypes_resource_type_template.test_request
id-5a2164eb-645a-4245-acd7-b222a715fc09
success 0.146
heat_tempest_plugin.tests.api.test_heat_api.resourcetypes_show_resource_type.test_request
id-cc05d1ef-17f1-430e-bea1-0f6766f7d0b4
success 0.170
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_create_software_config.test_request
id-d26d11c0-4924-11e8-842f-0ed5f89f718b
success 0.198
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_create_software_deployment.test_request
id-d26d15ee-4924-11e8-842f-0ed5f89f718b
success 0.199
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_delete_config.test_request
id-d26d22be-4924-11e8-842f-0ed5f89f718b
success 0.203
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_delete_deployment.test_request
id-d26d1fda-4924-11e8-842f-0ed5f89f718b
success 0.084
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_list_software_configs.test_request
id-d26d1d46-4924-11e8-842f-0ed5f89f718b
success 0.185
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_list_software_deployments.test_request
id-d26d1e90-4924-11e8-842f-0ed5f89f718b
success 0.201
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_show_config.test_request
id-d26d149a-4924-11e8-842f-0ed5f89f718b
success 0.204
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_show_deployment.test_request
id-d26d1968-4924-11e8-842f-0ed5f89f718b
success 0.205
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_show_deployment_metadata.test_request
id-d26d1ae4-4924-11e8-842f-0ed5f89f718b
success 0.155
heat_tempest_plugin.tests.api.test_heat_api.softwareconfig_update_deployment.test_request
id-d26d1c1a-4924-11e8-842f-0ed5f89f718b
success 0.155
heat_tempest_plugin.tests.api.test_heat_api.stacks_create_empty_stack.test_request
id-bde1b827-65fb-47ea-909f-82537e6260d3
success 1.133
heat_tempest_plugin.tests.api.test_heat_api.stacks_create_stack.test_request
id-56ac2173-97c5-4347-bd32-529a260cfac3
fail 0.045
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 555, in _run_test
    self._assert_response()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 193, in _assert_response
    self._test_status(self.test_data['status'], self.response['status'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 610, in _test_status
    self.assert_in_or_print_output(observed_status, statii)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 671, in assert_in_or_print_output
    self.fail(msg)
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)
AssertionError: '400' not found in ['201'], response:
{
  "title": "Bad Request",
  "explanation": "The server could not comply with the request since it is either malformed or otherwise incorrect.",
  "code": 400,
  "error": {
    "message": "The template version is invalid: \"heat_template_version: pike\". \"heat_template_version\" should be one of: 2013-05-23, 2014-10-16, 2015-04-30, 2015-10-15, 2016-04-08, 2016-10-14, 2017-02-24, newton, ocata",
    "traceback": null,
    "type": "InvalidTemplateVersion"
  }
}
heat_tempest_plugin.tests.api.test_heat_api.stacks_delete_empty_stack.test_request
id-7eca55fe-8300-43b6-a6b8-fb2d99b51911
success 0.059
heat_tempest_plugin.tests.api.test_heat_api.stacks_delete_stack.test_request
id-bcf4c359-0a64-4652-b465-df3f688a9d4d
fail 0.050
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 555, in _run_test
    self._assert_response()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 193, in _assert_response
    self._test_status(self.test_data['status'], self.response['status'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 610, in _test_status
    self.assert_in_or_print_output(observed_status, statii)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 671, in assert_in_or_print_output
    self.fail(msg)
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)
AssertionError: '404' not found in ['204'], response:
{
  "title": "Not Found",
  "explanation": "The resource could not be found.",
  "code": 404,
  "error": {
    "message": "The Stack (api-1851792833-stack) could not be found.",
    "traceback": null,
    "type": "EntityNotFound"
  }
}
heat_tempest_plugin.tests.api.test_heat_api.stacks_get_stack_output.test_request
id-e761f5d7-70f6-4d95-a11b-e5fa0ecb43d2
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL/output_value, data unavailable: 'stacks_list_stack_outputs' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_list_stack_outputs.test_request
id-bbd98b50-b75b-44a1-b7e8-0a68fd7c6d33
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL/outputs, data unavailable: 'stacks_poll_for_stack_patch_update_complete' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_patch_update_stack.test_request
id-927cea42-a35b-4664-b209-ab2cb34e6ef4
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL, data unavailable: 'stacks_poll_for_stack_update_complete' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_poll_for_empty_create_complete.test_request
id-f575e5c4-2aed-4381-9f0d-2dfcb0640c4b
success 2.259
heat_tempest_plugin.tests.api.test_heat_api.stacks_poll_for_stack_create_complete.test_request
id-6a0fe2dc-2822-4af3-b606-321ff7ad3de9
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LOCATION in $LOCATION, data unavailable: 'stacks_create_stack' object has no attribute 'location'
heat_tempest_plugin.tests.api.test_heat_api.stacks_poll_for_stack_patch_update_complete.test_request
id-a1cfd3b4-2536-4c54-94f4-12093f2ccf3b
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL, data unavailable: 'stacks_patch_update_stack' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_poll_for_stack_update_complete.test_request
id-3e280fb3-02b6-44fb-84dd-e04921d47733
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL, data unavailable: 'stacks_update_stack' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_show_empty_stack.test_request
id-89b233fe-0d55-4959-9289-0b5dabe4e4c9
success 0.063
heat_tempest_plugin.tests.api.test_heat_api.stacks_show_stack.test_request
id-9b268607-0335-4667-a613-bccf81e66f8f
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL, data unavailable: 'stacks_poll_for_stack_create_complete' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.stacks_stack_list.test_request
id-39c0245e-6055-41cf-9f0e-15adfe55ded6
fail 0.190
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 555, in _run_test
    self._assert_response()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 195, in _assert_response
    handler(self)
  File "/usr/lib/python2.7/site-packages/gabbi/handlers/base.py", line 54, in __call__
    self.action(test, item, value=value)
  File "/usr/lib/python2.7/site-packages/gabbi/handlers/core.py", line 81, in action
    (header, header_value, response[header]))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: 'application/json' != 'application/json; charset=UTF-8': Expect header content-type with value application/json, got application/json; charset=UTF-8
heat_tempest_plugin.tests.api.test_heat_api.stacks_update_stack.test_request
id-6bb1ec02-dd19-4b2c-9a6d-866ce666650f
fail 0.001
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/gabbi/suitemaker.py", line 95, in do_test
    return test_method(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 94, in wrapper
    func(self)
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 148, in test_request
    self._run_test()
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 505, in _run_test
    base_url = self.replace_template(test['url'])
  File "/usr/lib/python2.7/site-packages/gabbi/case.py", line 180, in replace_template
    % (template, message, exc))
AssertionError: unable to replace $LAST_URL in $LAST_URL, data unavailable: 'stacks_show_stack' object has no attribute 'url'
heat_tempest_plugin.tests.api.test_heat_api.templates_list_template_functions.test_request
id-721ff23c-8527-480f-a090-1c915b4f8430
success 0.099
heat_tempest_plugin.tests.api.test_heat_api.templates_list_template_versions.test_request
id-cbc28c20-e740-43ef-a01b-b1a39f4a0db3
success 0.194
heat_tempest_plugin.tests.api.test_heat_api.templates_template_validate.test_request
id-f307139b-03d0-4006-92b7-81c86c949727
success 0.055
heat_tempest_plugin.tests.functional.test_create_update_neutron_port.UpdatePortTest.test_update_remove_ip
id-8e37933b-345c-4ce5-a523-e67bdf198d73
success 36.677
heat_tempest_plugin.tests.functional.test_create_update_neutron_port.UpdatePortTest.test_update_with_mac_address
id-df1bf0fb-115e-42f3-b6cc-e12b5d506c98
success 27.394
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_allocation_pools
id-af43fc6d-58ba-4b5f-bd68-07b29f0a96bc
success 22.815
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_allocation_pools_to_empty
id-2f1d3b04-2183-4e50-8aa3-fa0fbff5c861
success 26.752
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_gateway_ip
id-ffb3eaf8-044b-4229-99f9-5fd983ccc9d9
success 18.455
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_gateway_ip_to_empty
id-e7b37a6b-e883-4c0c-b6a3-9ece1843e902
success 22.540
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_to_no_allocation_pools
id-6ec51150-6f83-4179-9faa-a3aee91ea150
success 31.319
heat_tempest_plugin.tests.functional.test_create_update_neutron_subnet.UpdateSubnetTest.test_update_to_no_gateway_ip
id-373bab03-1f66-4883-b1de-2ecc39efe17e
success 26.823
heat_tempest_plugin.tests.functional.test_encrypted_parameter.EncryptedParametersTest.test_db_encryption
id-d5bbf763-8eb9-4657-ad3f-e97405b6e1f2
success 46.910
heat_tempest_plugin.tests.functional.test_encryption_vol_type.EncryptionVolTypeTest.test_create_update
id-a98de4ce-aa59-478b-a8ce-b5d818c76a68
success 15.335
heat_tempest_plugin.tests.functional.test_external_ref.ExternalReferencesTest.test_create_with_external_ref
id-45449bad-18ba-4148-82e6-a6bc1e9a9b04
success 11.207
heat_tempest_plugin.tests.functional.test_external_ref.ExternalReferencesTest.test_update_stack_contain_external_ref
id-0ac301c2-b377-49b8-82e2-2458634bc8cf
success 14.432
heat_tempest_plugin.tests.functional.test_external_ref.ExternalReferencesTest.test_update_with_external_ref
id-fb16477c-e981-4ef9-a83b-c0acc162343a
success 15.488
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_create
id-f14cbe86-0392-474a-9f28-bb561745698d
success 15.000
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_create_nested
id-7d96b5f4-4aba-493d-b098-4beea4654a2b
success 23.143
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_create_wildcard
id-cffc0783-3add-4f0c-ac66-03c90f6feeb0
success 25.045
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_update_in_place
id-15c4f97d-5e06-40c6-83af-0e57d5afaff9
success 27.240
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_update_nochange
id-75009076-96eb-43af-b4df-f002704737d2
success 19.861
heat_tempest_plugin.tests.functional.test_hooks.HooksTest.test_hook_pre_update_replace
id-9f03d1e0-a2d2-42fc-a9c6-47db05b9c8ed
success 23.147
heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_port
id-19479c15-6b25-4865-8889-658566608bd9
success 56.525
heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_subnet_fixed_ip_sec_group
id-58ccf0aa-7531-4eaa-8ed5-38663a4defaa
success 52.061
heat_tempest_plugin.tests.functional.test_nova_server_networks.CreateServerTest.test_create_update_server_with_subnet
id-12185eaa-927f-43f3-a525-0424c4eb9b5d
fail 77.753
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 442, in _stack_delete
    success_on_not_found=True)
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 423, in _wait_for_stack_status
    fail_regexp, is_action_cancelled):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 384, in _verify_status
    stack_status_reason=stack.stack_status_reason)
heat_tempest_plugin.common.exceptions.StackBuildErrorException: Stack create_server_with_sub_ip is in DELETE_FAILED status due to 'Resource DELETE failed: InternalServerError: resources.subnet_a: Request Failed: internal server error while processing your request.
Neutron server returns request_ids: ['req-27123109-e81d-434c-8fb0-55d827891b26']'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_network
id-abc39cd6-7745-4314-ac04-85df532dd7c9
fail 79.753
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 392, in test_create_update_server_add_network
    self.assertEqual(port0, self.get_outputs(stack_identifier, 'port0_id'))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = u'26d68661-45ac-4b64-9194-ddad3f5a26e9'
actual    = u'508f81f6-56f4-4427-8ed0-4465c4cefe4a'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_same_fixed_ip
id-01c0f1cd-25b2-49b9-b4ac-fc4dd8937e42
fail 57.361
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 365, in test_create_update_server_add_same_fixed_ip
    parameters=self.params)
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 489, in update_stack
    self._wait_for_stack_status(**kwargs)
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 423, in _wait_for_stack_status
    fail_regexp, is_action_cancelled):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 384, in _verify_status
    stack_status_reason=stack.stack_status_reason)
heat_tempest_plugin.common.exceptions.StackBuildErrorException: Stack same_fixed_ip/37f0f0b4-b769-46f3-95b2-2357fd92c0cc is in UPDATE_FAILED status due to 'Resource UPDATE failed: ClientException: resources.server: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.rpc.client.RemoteError'> (HTTP 500) (Request-ID: req-89ebd445-a406-488b-8587-dd62073dd502)'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_add_subnet
id-647fda5d-fc0c-4eb1-9ce3-c4c537461324
fail 70.055
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 338, in test_create_update_server_add_subnet
    self.assertEqual(port0, self.get_outputs(stack_identifier, 'port0_id'))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = u'8c202cf7-b91b-4364-ad8a-ed4c1102158b'
actual    = u'6904bbc8-f41e-44c4-b18a-87e66401acf6'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_multi_networks_swaps
id-3f729e7e-a698-4ee3-8a5e-0db84f16d1e1
fail 92.918
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 437, in test_create_update_server_multi_networks_swaps
    self.assertEqual(port1, self.get_outputs(stack_identifier, 'port1_id'))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = u'd9b6c258-af55-4f5b-90f5-28fab0c0e6ab'
actual    = u'd6fa702f-9ff1-4516-9559-717ca85b58f4'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_network_port
id-cccfe612-1ab7-401f-a4c5-63372826a780
fail 56.981
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 287, in test_create_update_server_swap_network_port
    parameters=self.params)
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 489, in update_stack
    self._wait_for_stack_status(**kwargs)
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 423, in _wait_for_stack_status
    fail_regexp, is_action_cancelled):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 384, in _verify_status
    stack_status_reason=stack.stack_status_reason)
heat_tempest_plugin.common.exceptions.StackBuildErrorException: Stack swap_network_port/dc75f575-4e85-4dde-aa9e-69d084a9b0e6 is in UPDATE_FAILED status due to 'Resource UPDATE failed: Conflict: resources.server: Port 27ebfc46-99ab-4ab9-a59e-ea5ea1a6ddbb is still in use. (HTTP 409) (Request-ID: req-12a9f7ba-cc69-434f-a67a-0d79e2a7aee7)'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_network_subnet
id-c1a22dbf-3160-41b7-8d3f-62ca33fc35a8
fail 73.281
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 264, in test_create_update_server_swap_network_subnet
    self.assertEqual(port0, self.get_outputs(stack_identifier, 'port0_id'))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = u'296b4647-6a99-4c8f-9f91-878504f67c24'
actual    = u'745d0b59-6d0b-4dcf-a95f-0d4569ce0c70'
heat_tempest_plugin.tests.functional.test_nova_server_networks.UpdateServerNetworksTest.test_create_update_server_swap_subnet_network
id-3eeb0dff-5d2d-4178-a4e6-06e4c26ce23a
fail 77.396
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_nova_server_networks.py", line 312, in test_create_update_server_swap_subnet_network
    self.assertEqual(port0, self.get_outputs(stack_identifier, 'port0_id'))
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = u'4d3531e5-4523-4802-b2eb-c246a543e036'
actual    = u'c167a833-cf5d-4012-a27f-246ab6c7f25a'
heat_tempest_plugin.tests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition
id-cc54ca6e-b91d-4ddd-80cc-24a886dfaaa0
success 54.594
heat_tempest_plugin.tests.functional.test_preview.StackPreviewTest.test_basic_fail
id-54e69a54-762d-479e-a4f4-1fbf21af01c6
success 0.369
heat_tempest_plugin.tests.functional.test_preview.StackPreviewTest.test_basic_pass
id-4c2c062d-4723-42c0-a113-3307dd4ceb12
success 0.246
heat_tempest_plugin.tests.functional.test_preview.StackPreviewTest.test_nested_pass
id-0449113c-ff90-4f2b-8825-27ea35c1983f
success 0.260
heat_tempest_plugin.tests.functional.test_preview.StackPreviewTest.test_res_group_with_nested_template
id-6ca8ddfc-106f-4ecc-83f7-fca31d0c85ca
success 0.264
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_remote_stack_alone
id-7e735c40-24fb-4ef8-8585-d1c68b344476
success 12.145
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_stack_create
id-aeed20d1-ebda-4544-9ace-16b0c8fc24f6
success 15.787
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_stack_create_bad_region
id-830bfeae-6d8a-4cb2-823d-d8b6c3a740ad
success 0.356
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_stack_resource_validation_fail
id-b2190dfc-d223-4595-b168-6c42b0f3a3e5
success 0.280
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_stack_suspend_resume
id-50841af8-bdf5-4df6-a075-dc061ada6833
success 27.712
heat_tempest_plugin.tests.functional.test_remote_stack.RemoteStackTest.test_stack_update
id-141f0478-121b-4e61-bde7-d5551bfd1fc2
success 23.877
heat_tempest_plugin.tests.functional.test_resources_list.ResourcesList.test_filtering_with_depend
id-b65b5c82-68b0-42c9-82a0-c0e74e9ad906
success 14.087
heat_tempest_plugin.tests.functional.test_resources_list.ResourcesList.test_required_by
id-97a65d53-b449-4a43-8283-42d43b165756
success 11.385
heat_tempest_plugin.tests.functional.test_software_config.ParallelDeploymentsTest.test_deployments_metadata
id-8ee231ff-f80a-4a17-a860-5cda87e18ad0
success 201.738
heat_tempest_plugin.tests.functional.test_software_config.ParallelDeploymentsTest.test_deployments_timeout_failed
id-bd539232-b999-4bec-b47d-ff4822fc8b82
fail 137.631
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_software_config.py", line 130, in test_deployments_timeout_failed
    20, 0, check_deployment_status))
  File "/usr/lib/python2.7/site-packages/unittest2/case.py", line 702, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true
heat_tempest_plugin.tests.functional.test_stack_events.StackEventsTest.test_event
id-620f4f7c-74f8-48a4-a8b0-d06d0337f133
success 15.464
heat_tempest_plugin.tests.functional.test_stack_outputs.StackOutputsTest.test_output_error_nested
id-993a403c-c6e2-475d-a65d-a82b8c9e0c22
success 22.421
heat_tempest_plugin.tests.functional.test_stack_outputs.StackOutputsTest.test_outputs
id-a886dd67-4506-4a37-82ae-43f0a7d83f35
success 13.839
heat_tempest_plugin.tests.functional.test_stack_outputs.StackOutputsTest.test_outputs_update_new_resource
id-aea0e495-4c77-4033-8c43-3351e9cb7b48
success 14.096
heat_tempest_plugin.tests.functional.test_stack_tags.StackTagTest.test_hidden_stack
id-5ed79584-0684-4f9c-ae8e-44a8f874ec79
success 14.870
heat_tempest_plugin.tests.functional.test_stack_tags.StackTagTest.test_stack_tag
id-67332e51-b427-42d5-ad8d-fd2ec334f361
success 23.401
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_basic
id-b65a80c2-a507-4deb-9e7e-43181cc05211
fail 0.291
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 105, in test_template_validate_basic
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the stack description',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'resources': {}}},
 'Parameters': {'aparam': {'Default': 10,
                           'Description': 'the param description',
                           'Label': 'aparam',
                           'NoEcho': 'false',
                           'Type': 'Number'}}}
actual    = {u'Description': u'the stack description',
 u'Parameters': {u'aparam': {u'Default': 10,
                             u'Description': u'the param description',
                             u'Label': u'aparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_basic_required_param
id-acb1435b-f1db-4427-9121-7e3144ddb81e
fail 0.205
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 164, in test_template_validate_basic_required_param
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the stack description',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'resources': {}}},
 'Parameters': {'aparam': {'Description': 'the param description',
                           'Label': 'aparam',
                           'NoEcho': 'false',
                           'Type': 'Number'}}}
actual    = {u'Description': u'the stack description',
 u'Parameters': {u'aparam': {u'Description': u'the param description',
                             u'Label': u'aparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_fail_version
id-7aac1feb-8256-4f70-8459-5e9780d28904
success 0.219
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_nested_off
id-5100cf18-f52a-47a2-880c-d540edad149f
fail 0.212
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 227, in test_template_validate_nested_off
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the parent template',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'mynested.yaml': u'mynested.yaml',
                                       u'resources': {}}},
 'Parameters': {'pparam': {'Default': 5,
                           'Description': 'the param description',
                           'Label': 'pparam',
                           'NoEcho': 'false',
                           'Type': 'Number'}}}
actual    = {u'Description': u'the parent template',
 u'Parameters': {u'pparam': {u'Default': 5,
                             u'Description': u'the param description',
                             u'Label': u'pparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_nested_on
id-480bcf64-25ae-49c7-b147-7cbc27d09cea
fail 0.229
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 254, in test_template_validate_nested_on
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the parent template',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'mynested.yaml': u'mynested.yaml',
                                       u'resources': {}}},
 'NestedParameters': {'nres': {'Description': 'the stack description',
                               'Parameters': {'aparam': {'Default': 10,
                                                         'Description': 'the param description',
                                                         'Label': 'aparam',
                                                         'NoEcho': 'false',
                                                         'Type': 'Number'}},
                               'Type': 'mynested.yaml'}},
 'Parameters': {}}
actual    = {u'Description': u'the parent template',
 u'NestedParameters': {u'nres': {u'Description': u'the stack description',
                                 u'Parameters': {u'aparam': {u'Default': 10,
                                                             u'Description': u'the param description',
                                                             u'Label': u'aparam',
                                                             u'NoEcho': u'false',
                                                             u'Type': u'Number'}},
                                 u'Type': u'mynested.yaml'}},
 u'Parameters': {}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_nested_on_multiple
id-a0bb07f0-2e10-4226-a205-a7eb04df415f
fail 0.246
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 302, in test_template_validate_nested_on_multiple
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the parent template',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'mynested.yaml': u'mynested.yaml',
                                       'resources': {}}},
 'NestedParameters': {'nres': {'Description': 'the stack description',
                               'NestedParameters': {'myres': {'Description': 'the stack description',
                                                              'Parameters': {'aparam': {'Default': 10,
                                                                                        'Description': 'the param description',
                                                                                        'Label': 'aparam',
                                                                                        'NoEcho': 'false',
                                                                                        'Type': 'Number'}},
                                                              'Type': 'mynested2.yaml'}},
                               'Parameters': {'aparam': {'Default': 10,
                                                         'Description': 'the param description',
                                                         'Label': 'aparam',
                                                         'NoEcho': 'false',
                                                         'Type': 'Number',
                                                         'Value': 5}},
                               'Type': 'mynested.yaml'}},
 'Parameters': {'pparam': {'Default': 5,
                           'Description': 'the param description',
                           'Label': 'pparam',
                           'NoEcho': 'false',
                           'Type': 'Number'}}}
actual    = {u'Description': u'the parent template',
 u'NestedParameters': {u'nres': {u'Description': u'the stack description',
                                 u'NestedParameters': {u'myres': {u'Description': u'the stack description',
                                                                  u'Parameters': {u'aparam': {u'Default': 10,
                                                                                              u'Description': u'the param description',
                                                                                              u'Label': u'aparam',
                                                                                              u'NoEcho': u'false',
                                                                                              u'Type': u'Number'}},
                                                                  u'Type': u'mynested2.yaml'}},
                                 u'Parameters': {u'aparam': {u'Default': 10,
                                                             u'Description': u'the param description',
                                                             u'Label': u'aparam',
                                                             u'NoEcho': u'false',
                                                             u'Type': u'Number',
                                                             u'Value': 5}},
                                 u'Type': u'mynested.yaml'}},
 u'Parameters': {u'pparam': {u'Default': 5,
                             u'Description': u'the param description',
                             u'Label': u'pparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_override_default
id-bf27371d-e202-4bae-9f13-2ef137958517
fail 0.233
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 125, in test_template_validate_override_default
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the stack description',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {'aparam': 5},
                 'resource_registry': {u'resources': {}}},
 'Parameters': {'aparam': {'Default': 10,
                           'Description': 'the param description',
                           'Label': 'aparam',
                           'NoEcho': 'false',
                           'Type': 'Number',
                           'Value': 5}}}
actual    = {u'Description': u'the stack description',
 u'Parameters': {u'aparam': {u'Default': 10,
                             u'Description': u'the param description',
                             u'Label': u'aparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number',
                             u'Value': 5}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_override_none
id-0278e03d-ed50-4909-b29d-9c4267d3fcd6
fail 0.232
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 147, in test_template_validate_override_none
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the stack description',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {'OS::Heat::RandomString': 'OS::Heat::None',
                                       u'resources': {}}},
 'Parameters': {'aparam': {'Default': 10,
                           'Description': 'the param description',
                           'Label': 'aparam',
                           'NoEcho': 'false',
                           'Type': 'Number'}}}
actual    = {u'Description': u'the stack description',
 u'Parameters': {u'aparam': {u'Default': 10,
                             u'Description': u'the param description',
                             u'Label': u'aparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_template_validate.StackTemplateValidateTest.test_template_validate_parameter_groups
id-6a6472d2-71fa-4ebe-a2b6-20878838555b
fail 0.224
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_template_validate.py", line 206, in test_template_validate_parameter_groups
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': 'the stack description',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'resources': {}}},
 'ParameterGroups': [{'description': 'The string params',
                      'label': 'str_params',
                      'parameters': ['bparam', 'cparam']}],
 'Parameters': {'aparam': {'Default': 10,
                           'Description': 'the param description',
                           'Label': 'aparam',
                           'NoEcho': 'false',
                           'Type': 'Number'},
                'bparam': {'Default': 'foo',
                           'Description': '',
                           'Label': 'bparam',
                           'NoEcho': 'false',
                           'Type': 'String'},
                'cparam': {'Default': 'secret',
                           'Description': '',
                           'Label': 'cparam',
                           'NoEcho': 'true',
                           'Type': 'String'}}}
actual    = {u'Description': u'the stack description',
 u'ParameterGroups': [{u'description': u'The string params',
                       u'label': u'str_params',
                       u'parameters': [u'bparam', u'cparam']}],
 u'Parameters': {u'aparam': {u'Default': 10,
                             u'Description': u'the param description',
                             u'Label': u'aparam',
                             u'NoEcho': u'false',
                             u'Type': u'Number'},
                 u'bparam': {u'Default': u'foo',
                             u'Description': u'',
                             u'Label': u'bparam',
                             u'NoEcho': u'false',
                             u'Type': u'String'},
                 u'cparam': {u'Default': u'secret',
                             u'Description': u'',
                             u'Label': u'cparam',
                             u'NoEcho': u'true',
                             u'Type': u'String'}}}
heat_tempest_plugin.tests.functional.test_templates.TemplateAPITest.test_get_stack_template
id-ac6ebc41-bd6a-4df4-80e5-f4b9ae3b5506
success 13.687
heat_tempest_plugin.tests.functional.test_templates.TemplateAPITest.test_resource_types
id-9f9a2fc0-f029-4d1f-a2eb-f019b9f75944
success 2.761
heat_tempest_plugin.tests.functional.test_templates.TemplateAPITest.test_show_resource_template
id-fafbdcd0-eec3-4e6f-9c88-1e4835d085cf
success 0.202
heat_tempest_plugin.tests.functional.test_unicode_template.StackUnicodeTemplateTest.test_create_stack
id-d2c4a10c-3cb4-4efd-889d-695a0acbd04f
success 9.672
heat_tempest_plugin.tests.functional.test_unicode_template.StackUnicodeTemplateTest.test_stack_preview
id-66338945-a3ae-4e3a-aa17-ab802ceb00b1
success 0.375
heat_tempest_plugin.tests.functional.test_unicode_template.StackUnicodeTemplateTest.test_template_validate_basic
id-871cc5dd-7550-494d-8c6d-9d549a8c0305
fail 0.218
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_unicode_template.py", line 86, in test_template_validate_basic
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {},
                 'resource_registry': {u'resources': {}}},
 'Parameters': {u'\u53c2\u6570': {'Default': 10,
                                  'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
                                  'Label': u'\u6807\u7b7e',
                                  'NoEcho': 'false',
                                  'Type': 'Number'}}}
actual    = {u'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
 u'Parameters': {u'\u53c2\u6570': {u'Default': 10,
                                   u'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
                                   u'Label': u'\u6807\u7b7e',
                                   u'NoEcho': u'false',
                                   u'Type': u'Number'}}}
heat_tempest_plugin.tests.functional.test_unicode_template.StackUnicodeTemplateTest.test_template_validate_override_default
id-e84c76b8-a5e5-45e7-9c4b-4c160d1c385f
fail 0.207
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/functional/test_unicode_template.py", line 111, in test_template_validate_override_default
    self.assertEqual(expected, ret)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 411, in assertEqual
    self.assertThat(observed, matcher, message)
  File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: !=:
reference = {'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
 'Environment': {'event_sinks': [],
                 'parameter_defaults': {},
                 'parameters': {u'\u53c2\u6570': 5},
                 'resource_registry': {u'resources': {}}},
 'Parameters': {u'\u53c2\u6570': {'Default': 10,
                                  'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
                                  'Label': u'\u6807\u7b7e',
                                  'NoEcho': 'false',
                                  'Type': 'Number',
                                  'Value': 5}}}
actual    = {u'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
 u'Parameters': {u'\u53c2\u6570': {u'Default': 10,
                                   u'Description': u'\u8fd9\u662f\u4e00\u4e2a\u63cf\u8ff0',
                                   u'Label': u'\u6807\u7b7e',
                                   u'NoEcho': u'false',
                                   u'Type': u'Number',
                                   u'Value': 5}}}
heat_tempest_plugin.tests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration
id-bd151ea4-2dcd-4440-9bf0-eff63a98e5d4
success 82.775
heat_tempest_plugin.tests.scenario.test_remote_deeply_nested.RemoteDeeplyNestedStackTest.test_remote_nested
id-2ed94cae-da14-4060-a6b3-526e7a8cbbe4
fail 1.419
479e2e17-a046-4fa9-9e54-dbbad8f8a08c
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/scenario/test_remote_deeply_nested.py", line 31, in test_remote_nested
    environment={'parameters': parameters}
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/tests/scenario/scenario_base.py", line 60, in launch_stack
    expected_status=expected_status
  File "/usr/lib/python2.7/site-packages/heat_tempest_plugin/common/test.py", line 650, in stack_create
    timeout_mins=timeout_mins
  File "/usr/lib/python2.7/site-packages/heatclient/v1/stacks.py", line 171, in create
    data=kwargs, headers=headers)
  File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 334, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/site-packages/heatclient/common/http.py", line 323, in request
    raise exc.from_response(resp)
heatclient.exc.HTTPBadRequest: ERROR: Failed validating stack template using Heat endpoint at region "intel-pod15" due to "ERROR: Property error: resources.network_stack_as_custom_type.properties: Unknown Property network_name"
heat_tempest_plugin.tests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_raw
id-8da0f6cc-60e6-4298-9e54-e1f905c5552a
success 88.740
heat_tempest_plugin.tests.scenario.test_server_signal.ServerSignalIntegrationTest.test_server_signal_userdata_format_software_config
id-3d753d42-7c16-4a0e-8f73-875881826626
success 109.054