2018-07-07 10:51:05.397 9956 INFO rally.api [-] Starting verification (UUID=46954470-6b16-43b5-94dd-ecf454583713) for deployment 'opnfv-rally' (UUID=a4c042a3-17b3-49be-8c4b-48256e912402) by verifier 'opnfv-tempest' (UUID=9e7d7f1e-ebd3-4838-8ae8-acd27967e49d).
2018-07-07 10:51:05.898 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context tempest@default setup()  started
2018-07-07 10:51:07.882 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context tempest@default setup()  finished in 1.98 sec
2018-07-07 10:51:07.883 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context testr@default setup()  started
2018-07-07 10:51:07.886 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context testr@default setup()  finished in 2.95 msec
2018-07-07 10:51:10.850 9956 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-07-07 10:51:11.476 9956 INFO opnfv-tempest [-] {9} neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-07-07 10:51:11.776 9956 INFO opnfv-tempest [-] {3} neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-07-07 10:51:19.409 9956 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.750s]
2018-07-07 10:51:22.181 9956 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest ... fail
2018-07-07 10:51:23.128 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.196s]
2018-07-07 10:51:23.768 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.639s]
2018-07-07 10:51:24.131 9956 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [4.719s]
2018-07-07 10:51:24.132 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.360s]
2018-07-07 10:51:24.416 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport ... success [9.642s]
2018-07-07 10:51:24.522 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.393s]
2018-07-07 10:51:24.802 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.278s]
2018-07-07 10:51:25.091 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [10.849s]
2018-07-07 10:51:26.043 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.240s]
2018-07-07 10:51:26.568 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.525s]
2018-07-07 10:51:26.748 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.180s]
2018-07-07 10:51:26.784 9956 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.035s]
2018-07-07 10:51:28.632 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [4.216s]
2018-07-07 10:51:28.949 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [3.858s]
2018-07-07 10:51:31.376 9956 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [7.246s]
2018-07-07 10:51:32.742 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [4.109s]
2018-07-07 10:51:33.447 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [4.497s]
2018-07-07 10:51:36.446 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [3.703s]
2018-07-07 10:51:37.914 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [4.467s]
2018-07-07 10:51:38.603 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.689s]: Vxlan type driver must be enabled for this test.
2018-07-07 10:51:40.865 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.418s]
2018-07-07 10:51:44.841 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.975s]
2018-07-07 10:51:45.313 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [6.708s]
2018-07-07 10:51:49.025 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.711s]
2018-07-07 10:51:51.387 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [6.546s]
2018-07-07 10:51:52.225 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [3.200s]
2018-07-07 10:51:57.565 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports ... success [6.177s]
2018-07-07 10:51:59.643 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.416s]
2018-07-07 10:52:00.859 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.217s]
2018-07-07 10:52:04.226 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.365s]
2018-07-07 10:52:04.492 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.925s]
2018-07-07 10:52:07.694 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.468s]
2018-07-07 10:52:11.147 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.452s]
2018-07-07 10:52:13.377 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [8.883s]
2018-07-07 10:52:14.795 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.647s]
2018-07-07 10:52:17.927 9956 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.551s]
2018-07-07 10:52:21.660 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.863s]
2018-07-07 10:52:25.835 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.174s]
2018-07-07 10:52:30.392 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.556s]
2018-07-07 10:52:36.727 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.334s]
2018-07-07 10:52:43.663 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [6.935s]
2018-07-07 10:52:49.127 9956 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [5.464s]
2018-07-07 10:52:54.196 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context testr@default cleanup() started
2018-07-07 10:52:54.197 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context testr@default cleanup() finished in 0.72 msec
2018-07-07 10:52:54.197 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context tempest@default cleanup() started
2018-07-07 10:52:55.115 9956 INFO rally.task.context [-] Verification 9e7d7f1e-ebd3-4838-8ae8-acd27967e49d | Context tempest@default cleanup() finished in 0.92 sec
2018-07-07 10:52:55.163 9956 INFO rally.api [-] Verification (UUID=46954470-6b16-43b5-94dd-ecf454583713) has been successfully finished for deployment 'opnfv-rally' (UUID=a4c042a3-17b3-49be-8c4b-48256e912402)!

======
Totals
======

Ran: 52 tests in 98.302 sec.
 - Success: 42
 - Skipped: 8
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 2

Using verification (UUID=46954470-6b16-43b5-94dd-ecf454583713) as the default verification for the future operations.