2018-08-13 08:20:23.312 11428 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=706c80fe-a76e-425e-9b75-b4ff9f77b5d3) for deployment 'opnfv-rally' (UUID=93a564f3-def7-41e5-af71-f6bf3602a127).
2018-08-13 08:20:24.131 11428 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-13 08:20:24.133 11428 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=706c80fe-a76e-425e-9b75-b4ff9f77b5d3) has been successfully configured for deployment 'opnfv-rally' (UUID=93a564f3-def7-41e5-af71-f6bf3602a127)!
2018-08-13 08:20:30.652 11437 INFO rally.api [-] Starting verification (UUID=62e10b6e-c3d0-4186-b285-e566df1f5c3f) for deployment 'opnfv-rally' (UUID=93a564f3-def7-41e5-af71-f6bf3602a127) by verifier 'opnfv-tempest' (UUID=706c80fe-a76e-425e-9b75-b4ff9f77b5d3).
2018-08-13 08:20:31.533 11437 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-13 08:20:31.832 11437 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-13 08:20:32.997 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context tempest@default setup()  finished in 1.84 sec
2018-08-13 08:20:33.000 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context testr@default setup()  finished in 2.55 msec
2018-08-13 08:20:45.892 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_network ... success [5.066s]
2018-08-13 08:20:49.551 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_disassociate_router ... success [3.659s]
2018-08-13 08:20:50.466 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_associate_invalid_network ... success [0.915s]
2018-08-13 08:20:55.772 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_attach_associated_subnet_to_associated_router ... success [5.304s]
2018-08-13 08:20:55.878 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn ... success [0.107s]
2018-08-13 08:20:56.126 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail ... success [0.248s]
2018-08-13 08:20:56.339 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_with_invalid_routetargets ... success [0.212s]
2018-08-13 08:20:57.103 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn ... success [0.762s]
2018-08-13 08:20:57.217 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_delete_bgpvpn_as_non_admin_fail ... success [0.115s]
2018-08-13 08:20:58.223 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_disassociate_invalid_network ... success [1.003s]
2018-08-13 08:20:58.660 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn ... success [0.438s]
2018-08-13 08:20:59.044 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_bgpvpn_as_non_owner_fail ... success [0.383s]
2018-08-13 08:21:01.274 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_netassoc_as_non_owner_fail ... success [2.229s]
2018-08-13 08:21:02.396 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_network_association ... success [1.122s]
2018-08-13 08:21:04.054 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_list_show_router_association ... success [1.658s]
2018-08-13 08:21:04.249 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn ... success [0.194s]
2018-08-13 08:21:04.786 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_bgpvpn_as_non_owner_fail ... success [0.537s]
2018-08-13 08:21:06.077 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_show_netassoc_as_non_owner_fail ... success [1.290s]
2018-08-13 08:21:06.704 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_bgpvpn_invalid_routetargets ... success [0.627s]
2018-08-13 08:21:06.901 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target ... fail [0.192s]
2018-08-13 08:21:07.029 11437 INFO opnfv-tempest [-] {1} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_update_route_target_non_admin_fail ... success [0.132s]
2018-08-13 08:26:40.404 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_basic ... fail [359.602s]
2018-08-13 08:32:28.461 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_bgpvpn ... fail [348.039s]
2018-08-13 08:38:35.625 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_net_association ... fail [367.145s]
2018-08-13 08:44:47.060 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_delete_router_association ... fail [371.418s]
2018-08-13 08:45:53.386 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_disjoint_import_export ... success [66.316s]
2018-08-13 08:46:50.345 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_ping_to_unassociated_net ... success [56.952s]
2018-08-13 08:52:44.320 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_disjoint_import_export ... fail [353.957s]
2018-08-13 08:58:40.582 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_negative_update_to_empty_rt_list ... fail [356.245s]
2018-08-13 08:58:42.627 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_delete ... skip [2.050s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-13 08:58:44.202 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_create_and_update ... skip [1.573s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-13 08:58:46.314 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_port_association_local_pref ... skip [2.112s]: Skipped because network extension: bgpvpn-routes-control is not enabled
2018-08-13 09:01:50.516 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_tenant_separation_and_local_connectivity ... success [184.167s]
2018-08-13 09:03:00.084 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_and_unassociated_net ... fail [69.548s]
2018-08-13 09:09:00.130 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_common_target ... fail [360.031s]
2018-08-13 09:15:05.511 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_route_targets_disjoint_targets ... fail [365.363s]
2018-08-13 09:17:03.589 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant1 ... fail [118.055s]
2018-08-13 09:20:59.978 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_update_rt_and_keep_local_connectivity_variant2 ... fail [236.334s]
2018-08-13 09:26:48.900 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant1 ... fail [348.907s]
2018-08-13 09:32:47.448 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant2 ... fail [358.529s]
2018-08-13 09:38:51.903 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant3 ... fail [364.437s]
2018-08-13 09:44:57.398 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant4 ... fail [365.476s]
2018-08-13 09:50:59.894 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant5 ... fail [362.478s]
2018-08-13 09:57:11.953 11437 INFO opnfv-tempest [-] {0} networking_bgpvpn_tempest.tests.scenario.test_bgpvpn_basic.TestBGPVPNBasic.test_bgpvpn_variant6 ... fail [372.043s]
2018-08-13 09:57:29.763 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context testr@default cleanup() started
2018-08-13 09:57:29.764 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context testr@default cleanup() finished in 0.72 msec
2018-08-13 09:57:29.765 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context tempest@default cleanup() started
2018-08-13 09:57:30.818 11437 INFO rally.task.context [-] Verification 706c80fe-a76e-425e-9b75-b4ff9f77b5d3 | Context tempest@default cleanup() finished in 1.05 sec
2018-08-13 09:57:30.864 11437 INFO rally.api [-] Verification (UUID=62e10b6e-c3d0-4186-b285-e566df1f5c3f) has been successfully finished for deployment 'opnfv-rally' (UUID=93a564f3-def7-41e5-af71-f6bf3602a127)!
2018-08-13 09:57:34.662 11890 INFO rally.api [-] Building 'html' report for the following verification(s): '62e10b6e-c3d0-4186-b285-e566df1f5c3f'
2018-08-13 09:57:34.679 11890 INFO rally.api [-] The report has been successfully built.
2018-08-13 09:57:47.527 11896 WARNING rally_openstack.platforms.existing [-] endpoint is deprecated and not used.
2018-08-13 09:57:54.277 11902 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=706c80fe-a76e-425e-9b75-b4ff9f77b5d3).
2018-08-13 09:57:54.403 11902 INFO rally.api [-] Verifier has been successfully deleted!
2018-08-13 09:57:57.123 11905 INFO rally.api [-] Creating verifier 'opnfv-tempest'.
2018-08-13 09:57:57.261 11905 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest.
2018-08-13 09:57:58.313 11905 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=f33820ea-57da-417b-a919-0190592ae505) has been successfully created!
2018-08-13 09:58:08.485 11927 WARNING rally_openstack.platforms.existing [-] endpoint is deprecated and not used.
2018-08-13 09:58:15.043 11933 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=f33820ea-57da-417b-a919-0190592ae505).
2018-08-13 09:58:16.296 11933 INFO rally.api [-] Verifier has been successfully deleted!
2018-08-13 09:58:18.859 11936 INFO rally.api [-] Creating verifier 'opnfv-tempest'.
2018-08-13 09:58:18.979 11936 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest.
2018-08-13 09:58:20.057 11936 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=e3cac326-7820-4e31-9fe6-659538ab2fba) has been successfully created!