2018-08-12 18:19:46.514 10948 INFO rally.api [-] Starting verification (UUID=d65d0e6a-0e90-4b93-a746-06517d1fb2f7) for deployment 'opnfv-rally' (UUID=a0a7e09d-7b4e-4a41-bf8c-6960e69381ff) by verifier 'opnfv-tempest' (UUID=8aadde30-4293-453b-8883-8bfd40694310).
2018-08-12 18:19:47.422 10948 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-12 18:19:47.813 10948 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-12 18:19:49.992 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context tempest@default setup()  finished in 2.94 sec
2018-08-12 18:19:49.996 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context testr@default setup()  finished in 2.95 msec
2018-08-12 18:20:03.223 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_network ... success [4.950s]
2018-08-12 18:20:08.118 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_router ... success [4.895s]
2018-08-12 18:20:09.324 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_invalid_network ... success [1.205s]
2018-08-12 18:20:15.948 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_attach_associated_subnet_to_associated_router ... success [6.623s]
2018-08-12 18:20:16.410 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn ... success [0.463s]
2018-08-12 18:20:16.690 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail ... success [0.280s]
2018-08-12 18:20:17.204 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_with_invalid_routetargets ... success [0.514s]
2018-08-12 18:20:18.137 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn ... success [0.933s]
2018-08-12 18:20:19.036 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn_as_non_admin_fail ... success [0.898s]
2018-08-12 18:20:21.112 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_disassociate_invalid_network ... success [2.074s]
2018-08-12 18:20:21.816 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn ... success [0.704s]
2018-08-12 18:20:22.127 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn_as_non_owner_fail ... success [0.310s]
2018-08-12 18:20:23.719 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_netassoc_as_non_owner_fail ... success [1.590s]
2018-08-12 18:20:26.337 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_network_association ... success [2.618s]
2018-08-12 18:20:28.100 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_router_association ... success [1.762s]
2018-08-12 18:20:28.656 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn ... success [0.557s]
2018-08-12 18:20:29.681 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn_as_non_owner_fail ... success [1.024s]
2018-08-12 18:20:31.169 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_netassoc_as_non_owner_fail ... success [1.486s]
2018-08-12 18:20:31.759 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_bgpvpn_invalid_routetargets ... success [0.590s]
2018-08-12 18:20:32.203 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target ... fail [0.438s]
2018-08-12 18:20:32.360 10948 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target_non_admin_fail ... success [0.161s]
2018-08-12 18:26:16.384 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_basic ... fail [378.079s]
2018-08-12 18:32:32.452 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_bgpvpn ... fail [376.048s]
2018-08-12 18:38:43.155 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_net_association ... fail [370.683s]
2018-08-12 18:45:11.013 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_router_association ... fail [387.840s]
2018-08-12 18:46:21.647 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_disjoint_import_export ... success [70.627s]
2018-08-12 18:47:32.857 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_ping_to_unassociated_net ... success [71.201s]
2018-08-12 18:53:48.867 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_disjoint_import_export ... fail [375.994s]
2018-08-12 19:00:12.022 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_empty_rt_list ... fail [383.138s]
2018-08-12 19:00:15.690 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_delete ... skip [3.668s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-12 19:00:18.459 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_update ... skip [2.769s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-12 19:00:21.495 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_local_pref ... skip [3.035s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-12 19:03:10.963 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_tenant_separation_and_local_connectivity ... success [169.440s]
2018-08-12 19:04:37.865 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_and_unassociated_net ... fail [86.885s]
2018-08-12 19:11:01.794 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_common_target ... fail [383.911s]
2018-08-12 19:11:43.068 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_disjoint_targets ... fail [41.262s]
2018-08-12 19:14:10.029 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant1 ... fail [146.931s]
2018-08-12 19:19:24.405 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant2 ... fail [314.321s]
2018-08-12 19:25:48.667 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant1 ... fail [384.244s]
2018-08-12 19:32:17.810 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant2 ... fail [389.124s]
2018-08-12 19:38:48.022 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant3 ... fail [390.194s]
2018-08-12 19:45:20.935 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant4 ... fail [392.894s]
2018-08-12 19:51:52.642 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant5 ... fail [391.690s]
2018-08-12 19:58:20.962 10948 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant6 ... fail [388.300s]
2018-08-12 19:58:41.229 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context testr@default cleanup() started
2018-08-12 19:58:41.230 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context testr@default cleanup() finished in 0.90 msec
2018-08-12 19:58:41.230 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context tempest@default cleanup() started
2018-08-12 19:58:42.348 10948 INFO rally.task.context [-] Verification 8aadde30-4293-453b-8883-8bfd40694310 | Context tempest@default cleanup() finished in 1.12 sec
2018-08-12 19:58:42.402 10948 INFO rally.api [-] Verification (UUID=d65d0e6a-0e90-4b93-a746-06517d1fb2f7) has been successfully finished for deployment 'opnfv-rally' (UUID=a0a7e09d-7b4e-4a41-bf8c-6960e69381ff)!

======
Totals
======

Ran: 44 tests in 5908.301 sec.
 - Success: 23
 - Skipped: 3
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=d65d0e6a-0e90-4b93-a746-06517d1fb2f7) as the default verification for the future operations.