2018-08-21 04:31:43.750 11582 INFO rally.api [-] Starting verification (UUID=aba6e3b2-958c-4ffa-9835-88489d1f542f) for deployment 'opnfv-rally' (UUID=15def0d3-f0e1-478b-95f8-6bd11bd002f0) by verifier 'opnfv-tempest' (UUID=02432bf5-c0c6-4c28-9bf6-2e9736ed614d).
2018-08-21 04:31:44.556 11582 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-21 04:31:44.952 11582 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-21 04:31:46.480 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context tempest@default setup()  finished in 2.24 sec
2018-08-21 04:31:46.484 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context testr@default setup()  finished in 2.77 msec
2018-08-21 04:31:59.886 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_network ... success [5.504s]
2018-08-21 04:32:03.770 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_router ... success [3.884s]
2018-08-21 04:32:04.724 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_invalid_network ... success [0.953s]
2018-08-21 04:32:09.854 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_attach_associated_subnet_to_associated_router ... success [5.127s]
2018-08-21 04:32:09.946 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn ... success [0.094s]
2018-08-21 04:32:09.960 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail ... success [0.013s]
2018-08-21 04:32:10.181 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_with_invalid_routetargets ... success [0.221s]
2018-08-21 04:32:10.482 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn ... success [0.300s]
2018-08-21 04:32:10.993 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn_as_non_admin_fail ... success [0.510s]
2018-08-21 04:32:13.360 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_disassociate_invalid_network ... success [2.366s]
2018-08-21 04:32:13.837 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn ... success [0.478s]
2018-08-21 04:32:14.258 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn_as_non_owner_fail ... success [0.420s]
2018-08-21 04:32:15.222 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_netassoc_as_non_owner_fail ... success [0.964s]
2018-08-21 04:32:16.167 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_network_association ... success [0.944s]
2018-08-21 04:32:17.660 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_router_association ... success [1.492s]
2018-08-21 04:32:17.763 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn ... success [0.103s]
2018-08-21 04:32:18.100 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn_as_non_owner_fail ... success [0.336s]
2018-08-21 04:32:19.139 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_netassoc_as_non_owner_fail ... success [1.038s]
2018-08-21 04:32:19.293 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_bgpvpn_invalid_routetargets ... success [0.154s]
2018-08-21 04:32:19.924 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target ... fail [0.625s]
2018-08-21 04:32:20.134 11582 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target_non_admin_fail ... success [0.214s]
2018-08-21 04:38:06.697 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_basic ... fail [372.438s]
2018-08-21 04:43:58.792 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_bgpvpn ... fail [352.076s]
2018-08-21 04:50:02.927 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_net_association ... fail [364.120s]
2018-08-21 04:56:09.544 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_router_association ... fail [366.597s]
2018-08-21 04:57:07.889 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_disjoint_import_export ... success [58.337s]
2018-08-21 04:58:04.824 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_ping_to_unassociated_net ... success [56.932s]
2018-08-21 05:04:08.998 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_disjoint_import_export ... fail [364.155s]
2018-08-21 05:10:11.578 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_empty_rt_list ... fail [362.561s]
2018-08-21 05:10:13.958 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_delete ... skip [2.381s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-21 05:10:16.152 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_update ... skip [2.193s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-21 05:10:18.039 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_local_pref ... skip [1.887s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-21 05:13:03.534 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_tenant_separation_and_local_connectivity ... success [165.465s]
2018-08-21 05:14:13.576 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_and_unassociated_net ... fail [70.026s]
2018-08-21 05:20:01.190 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_common_target ... fail [347.600s]
2018-08-21 05:26:05.596 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_disjoint_targets ... fail [364.391s]
2018-08-21 05:27:45.899 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant1 ... fail [100.272s]
2018-08-21 05:31:55.170 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant2 ... fail [249.237s]
2018-08-21 05:38:02.059 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant1 ... fail [366.870s]
2018-08-21 05:44:06.553 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant2 ... fail [364.474s]
2018-08-21 05:50:12.979 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant3 ... fail [366.407s]
2018-08-21 05:56:27.019 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant4 ... fail [374.024s]
2018-08-21 06:02:44.864 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant5 ... fail [377.829s]
2018-08-21 06:08:59.431 11582 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant6 ... fail [374.545s]
2018-08-21 06:09:17.186 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context testr@default cleanup() started
2018-08-21 06:09:17.187 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context testr@default cleanup() finished in 0.92 msec
2018-08-21 06:09:17.187 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context tempest@default cleanup() started
2018-08-21 06:09:18.313 11582 INFO rally.task.context [-] Verification 02432bf5-c0c6-4c28-9bf6-2e9736ed614d | Context tempest@default cleanup() finished in 1.13 sec
2018-08-21 06:09:18.364 11582 INFO rally.api [-] Verification (UUID=aba6e3b2-958c-4ffa-9835-88489d1f542f) has been successfully finished for deployment 'opnfv-rally' (UUID=15def0d3-f0e1-478b-95f8-6bd11bd002f0)!

======
Totals
======

Ran: 44 tests in 5830.193 sec.
 - Success: 23
 - Skipped: 3
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=aba6e3b2-958c-4ffa-9835-88489d1f542f) as the default verification for the future operations.