2018-05-19 13:06:30.591 11630 INFO rally.api [-] Starting verification (UUID=9f8331b9-1444-4172-945c-6570fd804675) for deployment 'opnfv-rally' (UUID=2a297072-93f9-4abd-9a68-3f0a37c9a991) by verifier 'opnfv-tempest' (UUID=f6b30d16-5a90-467d-87f7-099c87b873e2).
2018-05-19 13:06:31.078 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context tempest@default setup()  started
2018-05-19 13:06:32.565 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context tempest@default setup()  finished in 1.49 sec
2018-05-19 13:06:32.565 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context testr@default setup()  started
2018-05-19 13:06:32.568 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context testr@default setup()  finished in 2.44 msec
2018-05-19 13:06:35.566 11630 INFO opnfv-tempest [-] {3} neutron.tests.tempest.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-05-19 13:06:36.134 11630 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-05-19 13:06:36.223 11630 INFO opnfv-tempest [-] {9} neutron.tests.tempest.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-05-19 13:06:41.954 11630 INFO opnfv-tempest [-] {12} neutron.tests.tempest.api.test_trunk.TrunksSearchCriteriaTest ... fail
2018-05-19 13:06:43.468 11630 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.017s]
2018-05-19 13:06:43.512 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_add_subport ... fail [5.169s]
2018-05-19 13:06:44.032 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... fail [4.886s]
2018-05-19 13:06:44.465 11630 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_subport_connectivity ... skip [0.000s]: Advanced image is required to run this test.
2018-05-19 13:06:45.481 11630 INFO opnfv-tempest [-] {10} neutron.tests.tempest.scenario.test_trunk.TrunkTest.test_trunk_subport_lifecycle ... fail [1.007s]
2018-05-19 13:06:47.312 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... fail [3.797s]
2018-05-19 13:06:47.551 11630 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... fail [4.079s]
2018-05-19 13:06:47.931 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... fail [3.898s]
2018-05-19 13:06:50.149 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... fail [2.216s]
2018-05-19 13:06:50.652 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... fail [3.339s]
2018-05-19 13:06:53.015 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... fail [2.863s]
2018-05-19 13:06:53.070 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... fail [2.415s]
2018-05-19 13:06:53.258 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.245s]: Vxlan type driver must be enabled for this test.
2018-05-19 13:06:53.570 11630 INFO opnfv-tempest [-] {6} neutron.tests.tempest.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... fail [6.019s]
2018-05-19 13:06:55.643 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... fail [2.573s]
2018-05-19 13:06:56.037 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... fail [2.775s]
2018-05-19 13:06:58.155 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... fail [2.511s]
2018-05-19 13:06:58.286 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... fail [2.247s]
2018-05-19 13:07:01.029 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.744s]
2018-05-19 13:07:02.556 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... fail [4.398s]
2018-05-19 13:07:03.786 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... fail [2.751s]
2018-05-19 13:07:04.289 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [0.507s]
2018-05-19 13:07:06.681 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [2.391s]
2018-05-19 13:07:07.300 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_get_subports ... fail [4.743s]
2018-05-19 13:07:09.872 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... fail [3.183s]
2018-05-19 13:07:10.041 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_list_trunks ... fail [2.740s]
2018-05-19 13:07:12.449 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... fail [2.575s]
2018-05-19 13:07:14.997 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... fail [2.546s]
2018-05-19 13:07:17.057 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_remove_subport ... fail [7.011s]
2018-05-19 13:07:19.909 11630 INFO opnfv-tempest [-] {11} neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... fail [2.851s]
2018-05-19 13:07:19.985 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... fail [4.988s]
2018-05-19 13:07:23.190 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... fail [3.205s]
2018-05-19 13:07:26.150 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... fail [2.956s]
2018-05-19 13:07:31.079 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... fail [4.927s]
2018-05-19 13:07:36.075 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... fail [4.995s]
2018-05-19 13:07:39.020 11630 INFO opnfv-tempest [-] {1} neutron.tests.tempest.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... fail [2.944s]
2018-05-19 13:07:42.269 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context testr@default cleanup() started
2018-05-19 13:07:42.270 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context testr@default cleanup() finished in 0.47 msec
2018-05-19 13:07:42.270 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context tempest@default cleanup() started
2018-05-19 13:07:43.081 11630 INFO rally.task.context [-] Verification f6b30d16-5a90-467d-87f7-099c87b873e2 | Context tempest@default cleanup() finished in 0.81 sec
2018-05-19 13:07:43.138 11630 INFO rally.api [-] Verification (UUID=9f8331b9-1444-4172-945c-6570fd804675) has been successfully finished for deployment 'opnfv-rally' (UUID=2a297072-93f9-4abd-9a68-3f0a37c9a991)!

======
Totals
======

Ran: 52 tests in 63.491 sec.
 - Success: 4
 - Skipped: 9
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 39

Using verification (UUID=9f8331b9-1444-4172-945c-6570fd804675) as the default verification for the future operations.