2018-05-16 23:36:22.675 11733 INFO rally.api [-] Starting verification (UUID=7c7647eb-9241-4c8f-aa61-a25fdfc297aa) for deployment 'opnfv-rally' (UUID=05f3494d-d5ab-486b-9771-8fa97d3e36db) by verifier 'opnfv-tempest' (UUID=e39fa972-2ac6-4ed6-a58d-d9da35efbef5).
2018-05-16 23:36:23.175 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context tempest@default setup()  started
2018-05-16 23:36:24.441 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context tempest@default setup()  finished in 1.27 sec
2018-05-16 23:36:24.441 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context testr@default setup()  started
2018-05-16 23:36:24.444 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context testr@default setup()  finished in 2.92 msec
2018-05-16 23:36:27.440 11733 INFO opnfv-tempest [-] {3} neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-05-16 23:36:27.792 11733 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-05-16 23:36:28.287 11733 INFO opnfv-tempest [-] {9} neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-05-16 23:36:34.071 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport ... fail [3.869s]
2018-05-16 23:36:34.463 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... fail [3.207s]
2018-05-16 23:36:34.491 11733 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest ... fail
2018-05-16 23:36:34.991 11733 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [3.630s]
2018-05-16 23:36:36.538 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... fail [2.463s]
2018-05-16 23:36:36.807 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... fail [2.343s]
2018-05-16 23:36:37.277 11733 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... fail [2.281s]
2018-05-16 23:36:37.524 11733 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_subport_connectivity ... skip [0.000s]: Advanced image is required to run this test.
2018-05-16 23:36:38.634 11733 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_trunk_subport_lifecycle ... fail [1.105s]
2018-05-16 23:36:39.156 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... fail [2.620s]
2018-05-16 23:36:39.201 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... fail [2.390s]
2018-05-16 23:36:41.887 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... fail [2.729s]
2018-05-16 23:36:41.919 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... fail [2.716s]
2018-05-16 23:36:42.167 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.251s]: Vxlan type driver must be enabled for this test.
2018-05-16 23:36:42.544 11733 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... fail [5.266s]
2018-05-16 23:36:44.592 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... fail [2.705s]
2018-05-16 23:36:44.909 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... fail [2.739s]
2018-05-16 23:36:46.998 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... fail [2.405s]
2018-05-16 23:36:47.372 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... fail [2.462s]
2018-05-16 23:36:49.579 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.208s]
2018-05-16 23:36:51.670 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... fail [4.669s]
2018-05-16 23:36:52.000 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... fail [2.416s]
2018-05-16 23:36:52.459 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [0.462s]
2018-05-16 23:36:54.679 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [2.219s]
2018-05-16 23:36:56.085 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports ... fail [4.413s]
2018-05-16 23:36:57.465 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... fail [2.776s]
2018-05-16 23:36:58.858 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks ... fail [2.771s]
2018-05-16 23:37:00.299 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... fail [2.832s]
2018-05-16 23:37:02.895 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... fail [2.594s]
2018-05-16 23:37:05.358 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport ... fail [6.499s]
2018-05-16 23:37:07.668 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... fail [4.775s]
2018-05-16 23:37:08.366 11733 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... fail [3.005s]
2018-05-16 23:37:10.727 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... fail [3.057s]
2018-05-16 23:37:13.249 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... fail [2.520s]
2018-05-16 23:37:18.078 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... fail [4.827s]
2018-05-16 23:37:23.331 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... fail [5.252s]
2018-05-16 23:37:26.482 11733 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... fail [3.150s]
2018-05-16 23:37:30.224 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context testr@default cleanup() started
2018-05-16 23:37:30.225 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context testr@default cleanup() finished in 0.55 msec
2018-05-16 23:37:30.225 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context tempest@default cleanup() started
2018-05-16 23:37:31.031 11733 INFO rally.task.context [-] Verification e39fa972-2ac6-4ed6-a58d-d9da35efbef5 | Context tempest@default cleanup() finished in 0.81 sec
2018-05-16 23:37:31.093 11733 INFO rally.api [-] Verification (UUID=7c7647eb-9241-4c8f-aa61-a25fdfc297aa) has been successfully finished for deployment 'opnfv-rally' (UUID=05f3494d-d5ab-486b-9771-8fa97d3e36db)!

======
Totals
======

Ran: 52 tests in 59.414 sec.
 - Success: 4
 - Skipped: 9
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 39

Using verification (UUID=7c7647eb-9241-4c8f-aa61-a25fdfc297aa) as the default verification for the future operations.