2018-08-20 18:59:29.146 11574 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=36246d3d-8beb-4d60-9679-061ee0434715) for deployment 'opnfv-rally' (UUID=b2d480c1-701b-4c78-b8e9-4d7d6710321b).
2018-08-20 18:59:30.289 11574 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-20 18:59:30.291 11574 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=36246d3d-8beb-4d60-9679-061ee0434715) has been successfully configured for deployment 'opnfv-rally' (UUID=b2d480c1-701b-4c78-b8e9-4d7d6710321b)!
2018-08-20 18:59:36.801 11583 INFO rally.api [-] Starting verification (UUID=a2ae6087-c940-411f-873d-f3ac22dba848) for deployment 'opnfv-rally' (UUID=b2d480c1-701b-4c78-b8e9-4d7d6710321b) by verifier 'opnfv-tempest' (UUID=36246d3d-8beb-4d60-9679-061ee0434715).
2018-08-20 18:59:37.608 11583 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-20 18:59:38.231 11583 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-20 18:59:40.428 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context tempest@default setup()  finished in 3.13 sec
2018-08-20 18:59:40.432 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context testr@default setup()  finished in 2.81 msec
2018-08-20 18:59:54.798 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_network ... success [5.864s]
2018-08-20 18:59:59.471 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_router ... success [4.672s]
2018-08-20 19:00:01.201 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_invalid_network ... success [1.730s]
2018-08-20 19:00:09.265 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_attach_associated_subnet_to_associated_router ... success [8.063s]
2018-08-20 19:00:09.668 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn ... success [0.404s]
2018-08-20 19:00:09.871 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail ... success [0.202s]
2018-08-20 19:00:10.196 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_with_invalid_routetargets ... success [0.325s]
2018-08-20 19:00:11.239 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn ... success [1.042s]
2018-08-20 19:00:12.646 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn_as_non_admin_fail ... success [1.407s]
2018-08-20 19:00:14.535 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_disassociate_invalid_network ... success [1.887s]
2018-08-20 19:00:15.101 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn ... success [0.566s]
2018-08-20 19:00:15.915 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn_as_non_owner_fail ... success [0.814s]
2018-08-20 19:00:18.383 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_netassoc_as_non_owner_fail ... success [2.466s]
2018-08-20 19:00:20.038 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_network_association ... success [1.655s]
2018-08-20 19:00:21.651 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_router_association ... success [1.612s]
2018-08-20 19:00:23.040 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn ... success [1.389s]
2018-08-20 19:00:23.374 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn_as_non_owner_fail ... success [0.333s]
2018-08-20 19:00:24.919 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_netassoc_as_non_owner_fail ... success [1.544s]
2018-08-20 19:00:25.606 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_bgpvpn_invalid_routetargets ... success [0.687s]
2018-08-20 19:00:25.882 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target ... fail [0.271s]
2018-08-20 19:00:26.483 11583 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target_non_admin_fail ... success [0.605s]
2018-08-20 19:06:04.822 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_basic ... fail [375.784s]
2018-08-20 19:12:28.931 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_bgpvpn ... fail [384.091s]
2018-08-20 19:18:44.449 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_net_association ... fail [375.501s]
2018-08-20 19:25:14.643 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_router_association ... fail [390.174s]
2018-08-20 19:26:38.687 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_disjoint_import_export ... success [84.037s]
2018-08-20 19:27:54.674 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_ping_to_unassociated_net ... success [75.977s]
2018-08-20 19:34:05.778 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_disjoint_import_export ... fail [371.089s]
2018-08-20 19:40:29.897 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_empty_rt_list ... fail [384.101s]
2018-08-20 19:40:33.090 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_delete ... skip [3.194s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-20 19:40:36.282 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_update ... skip [3.191s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-20 19:40:39.683 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_local_pref ... skip [3.400s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-20 19:41:12.103 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_tenant_separation_and_local_connectivity ... fail [32.405s]
2018-08-20 19:41:34.772 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_and_unassociated_net ... fail [22.663s]
2018-08-20 19:47:56.670 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_common_target ... fail [381.884s]
2018-08-20 19:48:35.807 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_disjoint_targets ... fail [39.124s]
2018-08-20 19:49:34.378 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant1 ... fail [58.557s]
2018-08-20 19:54:51.325 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant2 ... fail [316.892s]
2018-08-20 20:01:04.273 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant1 ... fail [372.928s]
2018-08-20 20:01:28.434 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant2 ... fail [24.152s]
2018-08-20 20:07:54.276 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant3 ... fail [385.825s]
2018-08-20 20:14:27.934 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant4 ... fail [393.638s]
2018-08-20 20:21:00.844 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant5 ... fail [392.888s]
2018-08-20 20:27:23.497 11583 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant6 ... fail [382.635s]
2018-08-20 20:27:40.335 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context testr@default cleanup() started
2018-08-20 20:27:40.336 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context testr@default cleanup() finished in 0.84 msec
2018-08-20 20:27:40.336 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context tempest@default cleanup() started
2018-08-20 20:27:41.504 11583 INFO rally.task.context [-] Verification 36246d3d-8beb-4d60-9679-061ee0434715 | Context tempest@default cleanup() finished in 1.17 sec
2018-08-20 20:27:41.564 11583 INFO rally.api [-] Verification (UUID=a2ae6087-c940-411f-873d-f3ac22dba848) has been successfully finished for deployment 'opnfv-rally' (UUID=b2d480c1-701b-4c78-b8e9-4d7d6710321b)!