2018-08-25 18:30:05.411 11588 INFO rally.api [-] Starting verification (UUID=42c7605f-2bbe-4d8a-989b-013ff46a4d8b) for deployment 'opnfv-rally' (UUID=14778e74-9891-4978-80c0-90a359a0841d) by verifier 'opnfv-tempest' (UUID=3071b713-9a53-4980-9523-0c5e93afd028).
2018-08-25 18:30:06.269 11588 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-25 18:30:06.453 11588 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-25 18:30:07.730 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context tempest@default setup()  finished in 1.80 sec
2018-08-25 18:30:07.733 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context testr@default setup()  finished in 2.68 msec
2018-08-25 18:30:19.522 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_network ... success [3.960s]
2018-08-25 18:30:23.775 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_router ... success [4.252s]
2018-08-25 18:30:25.174 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_invalid_network ... success [1.398s]
2018-08-25 18:30:30.974 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_attach_associated_subnet_to_associated_router ... success [5.799s]
2018-08-25 18:30:31.244 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn ... success [0.271s]
2018-08-25 18:30:31.262 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail ... success [0.017s]
2018-08-25 18:30:31.497 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_with_invalid_routetargets ... success [0.234s]
2018-08-25 18:30:32.806 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn ... success [1.309s]
2018-08-25 18:30:32.945 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn_as_non_admin_fail ... success [0.139s]
2018-08-25 18:30:34.445 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_disassociate_invalid_network ... success [1.499s]
2018-08-25 18:30:34.905 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn ... success [0.460s]
2018-08-25 18:30:35.218 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn_as_non_owner_fail ... success [0.312s]
2018-08-25 18:30:36.332 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_netassoc_as_non_owner_fail ... success [1.112s]
2018-08-25 18:30:37.375 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_network_association ... success [1.043s]
2018-08-25 18:30:38.914 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_router_association ... success [1.539s]
2018-08-25 18:30:39.043 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn ... success [0.129s]
2018-08-25 18:30:39.425 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn_as_non_owner_fail ... success [0.382s]
2018-08-25 18:30:41.014 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_netassoc_as_non_owner_fail ... success [1.588s]
2018-08-25 18:30:41.443 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_bgpvpn_invalid_routetargets ... success [0.429s]
2018-08-25 18:30:41.676 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target ... fail [0.227s]
2018-08-25 18:30:41.800 11588 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target_non_admin_fail ... success [0.129s]
2018-08-25 18:36:19.590 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_basic ... fail [363.840s]
2018-08-25 18:42:13.296 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_bgpvpn ... fail [353.691s]
2018-08-25 18:48:09.281 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_net_association ... fail [355.964s]
2018-08-25 18:54:09.428 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_router_association ... fail [360.134s]
2018-08-25 18:55:12.857 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_disjoint_import_export ... success [63.418s]
2018-08-25 18:56:09.911 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_ping_to_unassociated_net ... success [57.045s]
2018-08-25 19:02:04.824 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_disjoint_import_export ... fail [354.893s]
2018-08-25 19:08:02.138 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_empty_rt_list ... fail [357.297s]
2018-08-25 19:08:04.787 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_delete ... skip [2.650s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-25 19:08:06.489 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_update ... skip [1.700s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-25 19:08:08.101 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_local_pref ... skip [1.613s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-25 19:10:50.283 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_tenant_separation_and_local_connectivity ... success [162.149s]
2018-08-25 19:11:52.748 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_and_unassociated_net ... fail [62.448s]
2018-08-25 19:17:52.443 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_common_target ... fail [359.675s]
2018-08-25 19:23:49.699 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_disjoint_targets ... fail [357.239s]
2018-08-25 19:25:46.383 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant1 ... fail [116.654s]
2018-08-25 19:30:39.625 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant2 ... fail [293.194s]
2018-08-25 19:36:34.506 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant1 ... fail [354.862s]
2018-08-25 19:42:40.307 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant2 ... fail [365.783s]
2018-08-25 19:48:44.484 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant3 ... fail [364.161s]
2018-08-25 19:54:48.173 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant4 ... fail [363.670s]
2018-08-25 20:00:55.174 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant5 ... fail [366.982s]
2018-08-25 20:06:58.315 11588 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant6 ... fail [363.123s]
2018-08-25 20:07:16.193 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context testr@default cleanup() started
2018-08-25 20:07:16.194 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context testr@default cleanup() finished in 0.73 msec
2018-08-25 20:07:16.194 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context tempest@default cleanup() started
2018-08-25 20:07:17.121 11588 INFO rally.task.context [-] Verification 3071b713-9a53-4980-9523-0c5e93afd028 | Context tempest@default cleanup() finished in 0.93 sec
2018-08-25 20:07:17.169 11588 INFO rally.api [-] Verification (UUID=42c7605f-2bbe-4d8a-989b-013ff46a4d8b) has been successfully finished for deployment 'opnfv-rally' (UUID=14778e74-9891-4978-80c0-90a359a0841d)!

======
Totals
======

Ran: 44 tests in 5807.892 sec.
 - Success: 23
 - Skipped: 3
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=42c7605f-2bbe-4d8a-989b-013ff46a4d8b) as the default verification for the future operations.