2018-11-18 17:40:08.018 11135 INFO rally.api [-] Starting verification (UUID=5052b549-711d-4d65-91b8-9ba49b3bb9f5) for deployment 'opnfv-rally' (UUID=eb76cd52-4fb4-4a9a-ae30-365886fc7816) by verifier 'opnfv-tempest' (UUID=efa49fbd-20c3-4af2-a1ce-aeb3936f1536).
2018-11-18 17:40:08.491 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context tempest@default setup()  started
2018-11-18 17:40:08.754 11135 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-11-18 17:40:09.429 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context tempest@default setup()  finished in 0.94 sec
2018-11-18 17:40:09.430 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context testr@default setup()  started
2018-11-18 17:40:09.441 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context testr@default setup()  finished in 10.86 msec
2018-11-18 17:40:11.968 11135 INFO opnfv-tempest [-] {9} neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-11-18 17:40:12.571 11135 INFO opnfv-tempest [-] {3} neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-11-18 17:40:13.043 11135 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-11-18 17:40:20.754 11135 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.513s]
2018-11-18 17:40:25.319 11135 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest ... fail
2018-11-18 17:40:25.488 11135 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [4.735s]
2018-11-18 17:40:25.785 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.037s]
2018-11-18 17:40:25.973 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport ... success [10.745s]
2018-11-18 17:40:26.477 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.691s]
2018-11-18 17:40:26.916 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.438s]
2018-11-18 17:40:27.142 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.226s]
2018-11-18 17:40:27.269 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [11.234s]
2018-11-18 17:40:27.424 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.280s]
2018-11-18 17:40:28.822 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.396s]
2018-11-18 17:40:29.184 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.361s]
2018-11-18 17:40:29.214 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.031s]
2018-11-18 17:40:29.384 11135 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.168s]
2018-11-18 17:40:30.498 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [4.523s]
2018-11-18 17:40:31.725 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [4.456s]
2018-11-18 17:40:33.756 11135 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [8.267s]
2018-11-18 17:40:34.240 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [3.742s]
2018-11-18 17:40:37.019 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [5.294s]
2018-11-18 17:40:38.247 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [4.006s]
2018-11-18 17:40:41.095 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [4.075s]
2018-11-18 17:40:41.752 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.657s]: Vxlan type driver must be enabled for this test.
2018-11-18 17:40:42.683 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.436s]
2018-11-18 17:40:46.719 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [4.035s]
2018-11-18 17:40:48.075 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [6.322s]
2018-11-18 17:40:52.376 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [4.300s]
2018-11-18 17:40:53.289 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [6.568s]
2018-11-18 17:40:56.027 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [3.650s]
2018-11-18 17:40:59.033 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports ... success [5.744s]
2018-11-18 17:41:03.832 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.804s]
2018-11-18 17:41:05.215 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.383s]
2018-11-18 17:41:05.860 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.825s]
2018-11-18 17:41:08.967 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.751s]
2018-11-18 17:41:12.201 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.233s]
2018-11-18 17:41:15.212 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [9.350s]
2018-11-18 17:41:15.896 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.695s]
2018-11-18 17:41:19.264 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.367s]
2018-11-18 17:41:19.653 11135 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.441s]
2018-11-18 17:41:25.988 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.722s]
2018-11-18 17:41:30.355 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.366s]
2018-11-18 17:41:34.413 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.057s]
2018-11-18 17:41:41.570 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [7.156s]
2018-11-18 17:41:48.538 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [6.967s]
2018-11-18 17:41:53.678 11135 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [5.139s]
2018-11-18 17:41:58.282 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context testr@default cleanup() started
2018-11-18 17:41:58.282 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context testr@default cleanup() finished in 0.43 msec
2018-11-18 17:41:58.282 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context tempest@default cleanup() started
2018-11-18 17:41:59.118 11135 INFO rally.task.context [-] Verification efa49fbd-20c3-4af2-a1ce-aeb3936f1536 | Context tempest@default cleanup() finished in 0.84 sec
2018-11-18 17:41:59.179 11135 INFO rally.api [-] Verification (UUID=5052b549-711d-4d65-91b8-9ba49b3bb9f5) has been successfully finished for deployment 'opnfv-rally' (UUID=eb76cd52-4fb4-4a9a-ae30-365886fc7816)!

======
Totals
======

Ran: 52 tests in 101.721 sec.
 - Success: 42
 - Skipped: 8
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 2

Using verification (UUID=5052b549-711d-4d65-91b8-9ba49b3bb9f5) as the default verification for the future operations.