2018-09-26 17:10:00.524 11459 INFO rally.api [-] Starting verification (UUID=7dd49bef-00e8-4cbe-8885-be8bccb5a050) for deployment 'opnfv-rally' (UUID=dc1eb190-7bd0-4fd6-b6a1-006809290ca8) by verifier 'opnfv-tempest' (UUID=71bdfcd3-43a1-4c15-8d4d-04fe51aa7759).
2018-09-26 17:10:01.021 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context tempest@default setup()  started
2018-09-26 17:10:01.280 11459 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-09-26 17:10:01.982 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context tempest@default setup()  finished in 0.96 sec
2018-09-26 17:10:01.982 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context testr@default setup()  started
2018-09-26 17:10:01.986 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context testr@default setup()  finished in 3.20 msec
2018-09-26 17:10:04.551 11459 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-09-26 17:10:05.660 11459 INFO opnfv-tempest [-] {3} neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-09-26 17:10:05.696 11459 INFO opnfv-tempest [-] {9} neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-09-26 17:10:13.180 11459 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.268s]
2018-09-26 17:10:15.518 11459 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest ... fail
2018-09-26 17:10:17.961 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.230s]
2018-09-26 17:10:18.471 11459 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [5.290s]
2018-09-26 17:10:18.565 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.602s]
2018-09-26 17:10:18.631 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport ... success [9.751s]
2018-09-26 17:10:18.773 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.208s]
2018-09-26 17:10:18.978 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.204s]
2018-09-26 17:10:19.104 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.125s]
2018-09-26 17:10:19.710 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [10.853s]
2018-09-26 17:10:20.869 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.762s]
2018-09-26 17:10:21.576 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.708s]
2018-09-26 17:10:21.606 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.031s]
2018-09-26 17:10:21.638 11459 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.031s]
2018-09-26 17:10:22.797 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [4.166s]
2018-09-26 17:10:23.755 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [4.044s]
2018-09-26 17:10:26.159 11459 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [7.686s]
2018-09-26 17:10:26.531 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [3.734s]
2018-09-26 17:10:29.005 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [5.249s]
2018-09-26 17:10:31.139 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [4.606s]
2018-09-26 17:10:33.271 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [4.265s]
2018-09-26 17:10:34.047 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.776s]: Vxlan type driver must be enabled for this test.
2018-09-26 17:10:34.796 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [3.656s]
2018-09-26 17:10:38.359 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.564s]
2018-09-26 17:10:39.668 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.620s]
2018-09-26 17:10:43.452 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.784s]
2018-09-26 17:10:45.014 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [6.654s]
2018-09-26 17:10:46.421 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.969s]
2018-09-26 17:10:50.874 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports ... success [5.859s]
2018-09-26 17:10:54.106 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.683s]
2018-09-26 17:10:55.501 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.394s]
2018-09-26 17:10:57.233 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.358s]
2018-09-26 17:10:58.788 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.285s]
2018-09-26 17:11:01.898 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.110s]
2018-09-26 17:11:05.316 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.417s]
2018-09-26 17:11:06.632 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [9.396s]
2018-09-26 17:11:08.589 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.272s]
2018-09-26 17:11:10.670 11459 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.039s]
2018-09-26 17:11:15.185 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.595s]
2018-09-26 17:11:19.472 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.285s]
2018-09-26 17:11:23.856 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.383s]
2018-09-26 17:11:30.306 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.449s]
2018-09-26 17:11:37.064 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [6.757s]
2018-09-26 17:11:42.109 11459 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [5.045s]
2018-09-26 17:11:47.809 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context testr@default cleanup() started
2018-09-26 17:11:47.810 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context testr@default cleanup() finished in 0.78 msec
2018-09-26 17:11:47.810 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context tempest@default cleanup() started
2018-09-26 17:11:48.996 11459 INFO rally.task.context [-] Verification 71bdfcd3-43a1-4c15-8d4d-04fe51aa7759 | Context tempest@default cleanup() finished in 1.19 sec
2018-09-26 17:11:49.056 11459 INFO rally.api [-] Verification (UUID=7dd49bef-00e8-4cbe-8885-be8bccb5a050) has been successfully finished for deployment 'opnfv-rally' (UUID=dc1eb190-7bd0-4fd6-b6a1-006809290ca8)!

======
Totals
======

Ran: 52 tests in 97.568 sec.
 - Success: 42
 - Skipped: 8
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 2

Using verification (UUID=7dd49bef-00e8-4cbe-8885-be8bccb5a050) as the default verification for the future operations.