2018-03-18 07:25:42,402 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Setting net/subnet/port/router quota to unlimited
2018-03-18 07:25:43,229 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Setting instances quota class to unlimited
2018-03-18 07:25:43,346 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_9 - Verify that all OpenStack nodes OVS br-int have fail_mode set to secure.'
2018-03-18 07:25:43,347 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ====================================================================================================================

2018-03-18 07:25:43,347 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_9
2018-03-18 07:25:43,397 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_9 main method
2018-03-18 07:26:10,796 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_9
2018-03-18 07:26:10,796 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_9 - Verify that all OpenStack nodes OVS br-int have fail_mode set to secure.':
{'status': 'PASS', 'details': [{'Controller (ODL) list is ready': 'PASS'}, {'Node overcloud-novacompute-1 br-int is fail_mode secure': 'PASS'}, {'Node overcloud-novacompute-0 br-int is fail_mode secure': 'PASS'}, {'Node overcloud-controller-2 br-int is fail_mode secure': 'PASS'}, {'Node overcloud-controller-1 br-int is fail_mode secure': 'PASS'}, {'Node overcloud-controller-0 br-int is fail_mode secure': 'PASS'}]}

2018-03-18 07:26:10,796 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_8 - Test floating IP and router assoc coexistence'
2018-03-18 07:26:10,797 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - =========================================================================================

2018-03-18 07:26:10,797 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_8
2018-03-18 07:26:10,879 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_8 main method
2018-03-18 07:28:58,364 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_8
2018-03-18 07:28:58,364 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_8 - Test floating IP and router assoc coexistence':
{'status': 'FAIL', 'details': [{u"'sdnvpn-8-1' can ping 'sdnvpn-8-2'": 'PASS'}, {u'Assign a Floating IP to sdnvpn-8-1': 'PASS'}, {u'Ping IP 172.30.9.213': 'FAIL'}]}

2018-03-18 07:28:58,364 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_3 - Data center gateway integration'
2018-03-18 07:28:58,364 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ===========================================================================

2018-03-18 07:28:58,364 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_3
2018-03-18 07:28:58,444 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_3 main method
2018-03-18 07:35:14,349 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_3
2018-03-18 07:35:14,350 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_3 - Data center gateway integration':
{'status': 'FAIL', 'details': [{'Controller (ODL) list is ready': 'PASS'}, {'zrpcd is running': 'PASS'}, {'bgpd is running': 'FAIL'}, {'Assign a Floating IP to sdnvpn-3-2-quagga ': 'PASS'}, {'Bootstrap quagga inside an OpenStack instance': 'FAIL'}, {'Peering with quagga': 'FAIL'}]}

2018-03-18 07:35:14,350 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_2 - Tenant separation'
2018-03-18 07:35:14,350 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - =============================================================

2018-03-18 07:35:14,350 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_2
2018-03-18 07:35:14,429 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_2 main method
2018-03-18 07:37:42,683 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_2
2018-03-18 07:37:42,683 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_2 - Tenant separation':
{'status': 'PASS', 'details': [{u"[10.10.10.12] returns 'I am sdnvpn-2-2' to 'sdnvpn-2-1'[10.10.10.11]": 'PASS'}, {u"[10.10.10.11] returns 'I am not reachable' to 'sdnvpn-2-4'[10.10.10.12]": 'PASS'}]}

2018-03-18 07:37:42,683 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_1 - VPN provides connectivity between subnets'
2018-03-18 07:37:42,683 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - =====================================================================================

2018-03-18 07:37:42,683 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_1
2018-03-18 07:37:42,765 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_1 main method
2018-03-18 07:42:15,341 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_1
2018-03-18 07:42:15,341 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_1 - VPN provides connectivity between subnets':
{'status': 'PASS', 'details': [{u"'sdnvpn-1-1' can ping 'sdnvpn-1-2'": 'PASS'}, {u"'sdnvpn-1-1' can ping 'sdnvpn-1-3'": 'PASS'}, {u"'sdnvpn-1-1' cannot ping 'sdnvpn-1-4'": 'PASS'}, {u"'sdnvpn-1-4' can ping 'sdnvpn-1-5'": 'PASS'}, {u"'sdnvpn-1-1' can ping 'sdnvpn-1-4'": 'PASS'}, {u"'sdnvpn-1-1' can ping 'sdnvpn-1-5'": 'PASS'}]}

2018-03-18 07:42:15,341 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_12 - Check Flows and Groups are reprogrammed after OVS reconnect'
2018-03-18 07:42:15,341 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ========================================================================================================

2018-03-18 07:42:15,341 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_12
2018-03-18 07:42:15,377 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_12 main method
2018-03-18 07:48:13,628 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_12
2018-03-18 07:48:13,628 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_12 - Check Flows and Groups are reprogrammed after OVS reconnect':
{'status': 'PASS', 'details': [{'New OVS flows added': 'PASS'}, {'New OVS groups added': 'PASS'}, {'OVS flows are programmed after resync expected flow count 254, actual flow count 275': 'PASS'}, {'OVS groups are programmed after resync expected group count 14, actual group count 14': 'PASS'}, {'OVS flows are programmed after resync expected flow count 254, actual flow count 273': 'PASS'}, {'OVS groups are programmed after resync expected group count 14, actual group count 14': 'PASS'}]}

2018-03-18 07:48:13,628 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_11 - Check relevant OVS groups are removed upon deletion of OpenStack topology'
2018-03-18 07:48:13,628 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ======================================================================================================================

2018-03-18 07:48:13,628 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_11
2018-03-18 07:48:13,701 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_11 main method
2018-03-18 07:52:08,551 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_11
2018-03-18 07:52:08,552 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_11 - Check relevant OVS groups are removed upon deletion of OpenStack topology':
{'status': 'PASS', 'details': [{'New OVS group added': 'PASS'}, {'Group was deleted from ovs': 'PASS'}]}

2018-03-18 07:52:08,552 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_4 - VPN provides connectivity between subnets using router association'
2018-03-18 07:52:08,552 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ==============================================================================================================

2018-03-18 07:52:08,553 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_4
2018-03-18 07:52:08,632 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_4 main method
2018-03-18 07:56:51,719 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_4
2018-03-18 07:56:51,720 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_4 - VPN provides connectivity between subnets using router association':
{'status': 'FAIL', 'details': [{u"'sdnvpn-4-1' can ping 'sdnvpn-4-2'": 'PASS'}, {u"'sdnvpn-4-1' can ping 'sdnvpn-4-3'": 'PASS'}, {u"'sdnvpn-4-1' cannot ping 'sdnvpn-4-4'": 'PASS'}, {u"'sdnvpn-4-4' can ping 'sdnvpn-4-5'": 'PASS'}, {u"'sdnvpn-4-1' can ping 'sdnvpn-4-4'": 'FAIL'}, {u"'sdnvpn-4-1' can ping 'sdnvpn-4-5'": 'FAIL'}]}

2018-03-18 07:56:51,720 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.run_tempest - Neutron BGPVPN tests in tempest'
2018-03-18 07:56:51,720 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ============================================================================

2018-03-18 07:56:51,720 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.run_tempest
2018-03-18 07:56:51,724 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.run_tempest main method
2018-03-18 07:57:01,500 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Caught Exception in sdnvpn.test.functest.run_tempest: Command '['rally', 'verify', 'delete-verifier', '--id', 'opnfv-tempest', '--force']' returned non-zero exit status 1 Trace: Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/sdnvpn/test/functest/run_sdnvpn_tests.py", line 82, in execute
    result = t.main()
  File "/usr/lib/python2.7/site-packages/sdnvpn/test/functest/run_tempest.py", line 23, in main
    verifier_id = tempest_utils.get_verifier_id()
  File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/conf_utils.py", line 107, in get_verifier_id
    create_verifier()
  File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/conf_utils.py", line 91, in create_verifier
    output = subprocess.check_output(cmd)
  File "/usr/lib/python2.7/subprocess.py", line 219, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['rally', 'verify', 'delete-verifier', '--id', 'opnfv-tempest', '--force']' returned non-zero exit status 1

2018-03-18 07:57:01,500 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Testcase sdnvpn.test.functest.run_tempest failed
2018-03-18 07:57:01,500 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_10 - Test if interupts occure during ping, when removing and adding instances'
2018-03-18 07:57:01,500 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - =====================================================================================================================

2018-03-18 07:57:01,500 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_10
2018-03-18 07:57:01,546 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_10 main method
2018-03-18 08:01:04,730 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_10
2018-03-18 08:01:04,731 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_10 - Test if interupts occure during ping, when removing and adding instances':
{'status': 'FAIL', 'details': [{' ,Ping failure from instance sdnvpn-10-1': 'FAIL'}, {' ,Ping failure from instance sdnvpn-10-1': 'FAIL'}]}

2018-03-18 08:01:04,731 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Running 'sdnvpn.test.functest.testcase_13 - Testing extra route ECMP for intra-data center scenario'
2018-03-18 08:01:04,731 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - ====================================================================================================

2018-03-18 08:01:04,731 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Importing the testcase sdnvpn.test.functest.testcase_13
2018-03-18 08:01:04,818 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Calling the testcase sdnvpn.test.functest.testcase_13 main method
2018-03-18 08:06:01,969 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Execution is complete for the testcase sdnvpn.test.functest.testcase_13
2018-03-18 08:06:01,969 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Results of test case 'sdnvpn.test.functest.testcase_13 - Testing extra route ECMP for intra-data center scenario':
{'status': 'PASS', 'details': [{u"'sdnvpn-13-3' can ping 'sdnvpn_extra_route_13'": 'PASS'}]}

2018-03-18 08:06:01,969 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Resetting subnet/net/port quota
2018-03-18 08:06:02,239 - sdnvpn.test.functest.run_sdnvpn_tests - INFO - Resetting instances quota class