CSIT Test Log

Total Statistics	Total	Pass	Fail	Elapsed	Pass / Fail
Critical Tests	152	135	17	00:43:19
All Tests	152	135	17	00:43:19

Statistics by Tag	Total	Pass	Elapsed
NON_GATE	26	26	00:06:46
Regression	4	4	00:00:49
skip_if_conntrack	25	25	00:07:26
skip_if_stateful	34	34	00:05:48

Statistics by Suite	Total	Pass	Fail	Elapsed
CSIT	152	135	17	01:29:55
CSIT . L2	14	14	0	00:07:53
CSIT . L3	27	27	0	00:14:56
CSIT . External Network	25	25	0	00:13:26
CSIT . Security Group	34	34	0	00:09:15
CSIT . Neutron Security Group	4	4	0	00:02:33
CSIT . Security Group L3Bcast	6	6	0	00:07:20
CSIT . Vpn Basic	24	19	5	00:16:02
CSIT . Elan	5	5	0	00:08:48
CSIT . Arp Learning	3	0	3	00:05:23
CSIT . L2L3 Gatewaymac Arp	9	0	9	00:04:19
CSIT . Create JVM Plots	1	1	0	00:00:00

01:29:54.810 SUITE CSIT

Full Name:	CSIT
Start / End / Elapsed:	20181116 11:04:24.842 / 20181116 12:34:19.652 / 01:29:54.810
Status:	152 critical test, 135 passed, 17 failed 152 test total, 135 passed, 17 failed

00:07:52.800 SUITE L2

Full Name:	CSIT.L2
Documentation:	Test suite to verify packet flows between vm instances.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot
Start / End / Elapsed:	20181116 11:04:25.011 / 20181116 11:12:17.811 / 00:07:52.800
Status:	14 critical test, 14 passed, 0 failed 14 test total, 14 passed, 0 failed

00:14:56.063 SUITE L3

Full Name:	CSIT.L3
Documentation:	Test suite to check connectivity in L3 using routers.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot
Start / End / Elapsed:	20181116 11:12:17.818 / 20181116 11:27:13.881 / 00:14:56.063
Status:	27 critical test, 27 passed, 0 failed 27 test total, 27 passed, 0 failed

00:13:25.782 SUITE External Network

Full Name:	CSIT.External Network
Documentation:	Test suite to check North-South connectivity in L3 using a router and an external network
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot
Start / End / Elapsed:	20181116 11:27:13.890 / 20181116 11:40:39.672 / 00:13:25.782
Status:	25 critical test, 25 passed, 0 failed 25 test total, 25 passed, 0 failed

00:09:14.771 SUITE Security Group

Full Name:	CSIT.Security Group
Documentation:	Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode.
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot
Start / End / Elapsed:	20181116 11:40:39.683 / 20181116 11:49:54.454 / 00:09:14.771
Status:	34 critical test, 34 passed, 0 failed 34 test total, 34 passed, 0 failed

00:02:33.322 SUITE Neutron Security Group

Full Name:	CSIT.Neutron Security Group
Documentation:	Test Suite for Neutron Security Group
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot
Start / End / Elapsed:	20181116 11:49:54.466 / 20181116 11:52:27.788 / 00:02:33.322
Status:	4 critical test, 4 passed, 0 failed 4 test total, 4 passed, 0 failed

00:07:20.493 SUITE Security Group L3Bcast

Full Name:	CSIT.Security Group L3Bcast
Documentation:	Test Suite for Network and Subnet Broadcast with security group
Source:	/home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot
Start / End / Elapsed:	20181116 11:52:27.792 / 20181116 11:59:48.285 / 00:07:20.493
Status:	6 critical test, 6 passed, 0 failed 6 test total, 6 passed, 0 failed

00:16:02.279 SUITE Vpn Basic

Full Name:	CSIT.Vpn Basic
Documentation:	Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot
Start / End / Elapsed:	20181116 11:59:48.291 / 20181116 12:15:50.570 / 00:16:02.279
Status:	24 critical test, 19 passed, 5 failed 24 test total, 19 passed, 5 failed

00:03:08.906 SETUP Suite Setup

Start / End / Elapsed:	20181116 11:59:48.370 / 20181116 12:02:57.276 / 00:03:08.906

00:01:32.440 TEARDOWN Suite Teardown

Documentation:	Delete the setup
Start / End / Elapsed:	20181116 12:14:18.130 / 20181116 12:15:50.570 / 00:01:32.440

00:00:16.097 TEST Check ELAN Datapath Traffic Within The Networks

Full Name:	CSIT.Vpn Basic.Check ELAN Datapath Traffic Within The Networks
Documentation:	Checks datapath within the same network with different vlans.
Start / End / Elapsed:	20181116 12:02:57.276 / 20181116 12:03:13.373 / 00:00:16.097
Status:	PASS (critical)

00:00:08.008 TEST Create Router

Full Name:	CSIT.Vpn Basic.Create Router
Start / End / Elapsed:	20181116 12:03:13.373 / 20181116 12:03:21.381 / 00:00:08.008
Status:	PASS (critical)

00:00:19.294 TEST Add Interfaces To Router

Full Name:	CSIT.Vpn Basic.Add Interfaces To Router
Start / End / Elapsed:	20181116 12:03:21.382 / 20181116 12:03:40.676 / 00:00:19.294
Status:	PASS (critical)

00:00:41.969 TEST Check L3_Datapath Traffic Across Networks With Router

Full Name:	CSIT.Vpn Basic.Check L3_Datapath Traffic Across Networks With Router
Start / End / Elapsed:	20181116 12:03:40.676 / 20181116 12:04:22.645 / 00:00:41.969
Status:	FAIL (critical)
Message:	Keyword 'VpnOperations.Verify GWMAC Flow Entry On Flow Table' failed after retrying for 30 seconds. The last error was: ' cookie=0x822002d, duration=3720.618s, table=43, n_packets=468, n_bytes=19656, priority=100,arp,arp_op=1 actions=group:5000 cookie=0x822002e, duration=3720.618s, table=43, n_packets=134, n_bytes=5628, priority=100,arp,arp_op=2 actions=CONTROLLER:65535,resubmit(,48) cookie=0x8220000, duration=3720.974s, table=43, n_packets=20052, n_bytes=2383553, priority=0 actions=goto_table:48' does not match 'arp,arp_op=2 actions=resubmit$,195$,resubmit$,196$,resubmit$,48$'

00:00:00.083 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing

Documentation:	Test case setup which explicitly ignores previous failure and logs test case name to Karaf log.
Start / End / Elapsed:	20181116 12:03:40.677 / 20181116 12:03:40.760 / 00:00:00.083

00:00:00.316 KEYWORD @{tcpdump_conn_ids} = OpenStackOperations . Start Packet Capture On Nodes tcpdump_vpn, ${EMPTY}, @{OS_ALL_IPS}

Documentation:	Wrapper keyword around the TcpDump packet capture that is catered to the Openstack setup.
Start / End / Elapsed:	20181116 12:03:40.760 / 20181116 12:03:41.076 / 00:00:00.316

00:00:00.001 KEYWORD ${vm_ips} = BuiltIn . Create List @{NET_1_VM_IPS}, @{NET_2_VM_IPS}

Documentation:	Returns a list containing given items.
Start / End / Elapsed:	20181116 12:03:41.076 / 20181116 12:03:41.077 / 00:00:00.001

00:00:00.026 KEYWORD BuiltIn . Wait Until Keyword Succeeds 30s, 10s, Utils.Check For Elements At URI, ${FIB_ENTRY_URL}, ${vm_ips}

Documentation:	Runs the specified keyword and retries if it fails.
Start / End / Elapsed:	20181116 12:03:41.077 / 20181116 12:03:41.103 / 00:00:00.026

00:00:00.433 KEYWORD VpnOperations . Verify Flows Are Present For L3VPN On All Compute Nodes ${vm_ips}

Documentation:	Verify Flows Are Present For L3VPN On All Compute Nodes
Start / End / Elapsed:	20181116 12:03:41.103 / 20181116 12:03:41.536 / 00:00:00.433

00:00:00.018 KEYWORD BuiltIn . Wait Until Keyword Succeeds 30s, 10s, VpnOperations.Verify GWMAC Entry On ODL, ${GWMAC_ADDRS}

Documentation:	Runs the specified keyword and retries if it fails.
Start / End / Elapsed:	20181116 12:03:41.536 / 20181116 12:03:41.554 / 00:00:00.018

00:00:34.069 KEYWORD VpnOperations . Verify GWMAC Flow Entry On Flow Table On All Compute Nodes

Documentation:	Verify the GWMAC Table, ARP Response table and Dispatcher table.
Start / End / Elapsed:	20181116 12:03:41.554 / 20181116 12:04:15.623 / 00:00:34.069

00:00:34.069 FOR ${ip} IN [ @{OS_CMP_IPS} ]

Start / End / Elapsed:	20181116 12:03:41.554 / 20181116 12:04:15.623 / 00:00:34.069

00:00:34.069 VAR ${ip} = 192.0.2.19

Start / End / Elapsed:	20181116 12:03:41.554 / 20181116 12:04:15.623 / 00:00:34.069

00:00:34.068 KEYWORD BuiltIn . Wait Until Keyword Succeeds 30s, 10s, VpnOperations.Verify GWMAC Flow Entry On Flow Table, ${ip}, ${ipv}

Documentation:

Runs the specified keyword and retries if it fails.

3 failing steps removed using --RemoveKeywords option.

Start / End / Elapsed:

20181116 12:03:41.555 / 20181116 12:04:15.623 / 00:00:34.068

00:00:01.091 KEYWORD VpnOperations . Verify GWMAC Flow Entry On Flow Table ${ip}, ${ipv}

Documentation:	Verify the GWMAC Table, ARP Response table and Dispatcher table.
Start / End / Elapsed:	20181116 12:04:14.531 / 20181116 12:04:15.622 / 00:00:01.091

00:00:00.497 KEYWORD ${flow_output} = Utils . Run Command On Remote System ${cnIp}, sudo ovs-ofctl -O OpenFlow13 dump-flows ${INTEGRATION_BRIDGE}

Documentation:	Reduces the common work of running a command on a remote system to a single higher level
Start / End / Elapsed:	20181116 12:04:14.532 / 20181116 12:04:15.029 / 00:00:00.497

00:00:00.460 KEYWORD ${group_output} = Utils . Run Command On Remote System ${cnIp}, sudo ovs-ofctl -O OpenFlow13 dump-groups ${INTEGRATION_BRIDGE}

Documentation:	Reduces the common work of running a command on a remote system to a single higher level
Start / End / Elapsed:	20181116 12:04:15.029 / 20181116 12:04:15.489 / 00:00:00.460

00:00:00.001 KEYWORD BuiltIn . Should Contain ${flow_output}, table=${DISPATCHER_TABLE}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:04:15.490 / 20181116 12:04:15.491 / 00:00:00.001

00:00:00.002 KEYWORD ${dispatcher_table} = String . Get Lines Containing String ${flow_output}, table=${DISPATCHER_TABLE}

Documentation:	Returns lines of the given `string` that contain the `pattern`.
Start / End / Elapsed:	20181116 12:04:15.491 / 20181116 12:04:15.493 / 00:00:00.002

00:00:00.000 KEYWORD BuiltIn . Should Contain ${dispatcher_table}, goto_table:${GWMAC_TABLE}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:04:15.494 / 20181116 12:04:15.494 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${dispatcher_table}, goto_table:${ARP_RESPONSE_TABLE}

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:04:15.495 / 20181116 12:04:15.495 / 00:00:00.000

00:00:00.001 KEYWORD BuiltIn . Should Contain ${flow_output}, table=${GWMAC_TABLE}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:04:15.496 / 20181116 12:04:15.497 / 00:00:00.001

00:00:00.002 KEYWORD ${gwmac_table} = String . Get Lines Containing String ${flow_output}, table=${GWMAC_TABLE}

Documentation:	Returns lines of the given `string` that contain the `pattern`.
Start / End / Elapsed:	20181116 12:04:15.497 / 20181116 12:04:15.499 / 00:00:00.002

00:00:00.003 FOR ${macAdd} IN [ @{GWMAC_ADDRS} ]

Start / End / Elapsed:	20181116 12:04:15.499 / 20181116 12:04:15.502 / 00:00:00.003

00:00:00.001 KEYWORD BuiltIn . Should Contain ${gwmac_table}, actions=resubmit(,17)

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:04:15.502 / 20181116 12:04:15.503 / 00:00:00.001

00:00:00.002 KEYWORD ${arpchk_table} = String . Get Lines Containing String ${flow_output}, table=${ARP_CHECK_TABLE}

Documentation:	Returns lines of the given `string` that contain the `pattern`.
Start / End / Elapsed:	20181116 12:04:15.503 / 20181116 12:04:15.505 / 00:00:00.002

00:00:00.037 KEYWORD CompareStream . Run_Keyword_If_At_Most_Oxygen BuiltIn.Should Match Regexp, ${arpchk_table}, ${ARP_RESPONSE_REGEX}

Documentation:	Compare oxygen to fluorine and in case fluorine is at most oxygen,
Start / End / Elapsed:	20181116 12:04:15.538 / 20181116 12:04:15.575 / 00:00:00.037

00:00:00.029 KEYWORD CompareStream . Run_Keyword_If_At_Least_Fluorine BuiltIn.Should Match Regexp, ${arpchk_table}, ${ARP_RESPONSE_REGEX_FLUORINE}

Documentation:	Compare fluorine to fluorine and in case fluorine is at least fluorine,
Start / End / Elapsed:	20181116 12:04:15.593 / 20181116 12:04:15.622 / 00:00:00.029

00:00:00.028 KEYWORD BuiltIn . Run Keyword And Return Run_Keyword_If_At_Least, fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:04:15.594 / 20181116 12:04:15.622 / 00:00:00.028

00:00:00.003 KEYWORD CompareStream . Run_Keyword_If_At_Least fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound},
Start / End / Elapsed:	20181116 12:04:15.619 / 20181116 12:04:15.622 / 00:00:00.003

00:00:00.002 KEYWORD BuiltIn . Run Keyword And Return If &{Stream_dict}[${ODL_STREAM}] >= &{Stream_dict}[${lower_bound}], ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:04:15.620 / 20181116 12:04:15.622 / 00:00:00.002

00:00:00.001 KEYWORD BuiltIn . Should Match Regexp @{varargs}, &{kwargs}

Documentation:	Fails if `string` does not match `pattern` as a regular expression.
Start / End / Elapsed:	20181116 12:04:15.621 / 20181116 12:04:15.622 / 00:00:00.001

12:04:15.622

FAIL

' cookie=0x822002d, duration=3720.618s, table=43, n_packets=468, n_bytes=19656, priority=100,arp,arp_op=1 actions=group:5000 cookie=0x822002e, duration=3720.618s, table=43, n_packets=134, n_bytes=5628, priority=100,arp,arp_op=2 actions=CONTROLLER:65535,resubmit(,48) cookie=0x8220000, duration=3720.974s, table=43, n_packets=20052, n_bytes=2383553, priority=0 actions=goto_table:48' does not match 'arp,arp_op=2 actions=resubmit$,195$,resubmit$,196$,resubmit$,48$'

12:04:15.623

FAIL

Keyword 'VpnOperations.Verify GWMAC Flow Entry On Flow Table' failed after retrying for 30 seconds. The last error was: ' cookie=0x822002d, duration=3720.618s, table=43, n_packets=468, n_bytes=19656, priority=100,arp,arp_op=1 actions=group:5000 cookie=0x822002e, duration=3720.618s, table=43, n_packets=134, n_bytes=5628, priority=100,arp,arp_op=2 actions=CONTROLLER:65535,resubmit(,48) cookie=0x8220000, duration=3720.974s, table=43, n_packets=20052, n_bytes=2383553, priority=0 actions=goto_table:48' does not match 'arp,arp_op=2 actions=resubmit$,195$,resubmit$,196$,resubmit$,48$'

00:00:07.022 TEARDOWN VpnOperations . Test Teardown With Tcpdump Stop ${tcpdump_conn_ids}

Start / End / Elapsed:	20181116 12:04:15.623 / 20181116 12:04:22.645 / 00:00:07.022

00:00:31.476 TEST Add Multiple Extra Routes And Check Datapath Before L3VPN Creation

Full Name:	CSIT.Vpn Basic.Add Multiple Extra Routes And Check Datapath Before L3VPN Creation
Start / End / Elapsed:	20181116 12:04:22.646 / 20181116 12:04:54.122 / 00:00:31.476
Status:	PASS (critical)

00:00:11.553 TEST Delete Extra Route

Full Name:	CSIT.Vpn Basic.Delete Extra Route
Start / End / Elapsed:	20181116 12:04:54.123 / 20181116 12:05:05.676 / 00:00:11.553
Status:	PASS (critical)

00:00:23.665 TEST Delete And Recreate Extra Route

Full Name:	CSIT.Vpn Basic.Delete And Recreate Extra Route
Documentation:	Recreate multiple extra route and check data path before L3VPN creation
Start / End / Elapsed:	20181116 12:05:05.676 / 20181116 12:05:29.341 / 00:00:23.665
Status:	PASS (critical)

00:00:08.731 TEST Create L3VPN

Full Name:	CSIT.Vpn Basic.Create L3VPN
Start / End / Elapsed:	20181116 12:05:29.341 / 20181116 12:05:38.072 / 00:00:08.731
Status:	PASS (critical)

00:00:08.536 TEST Associate L3VPN To Routers

Full Name:	CSIT.Vpn Basic.Associate L3VPN To Routers
Start / End / Elapsed:	20181116 12:05:38.073 / 20181116 12:05:46.609 / 00:00:08.536
Status:	FAIL (critical)
Message:	[ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.068 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing

Documentation:	Test case setup which explicitly ignores previous failure and logs test case name to Karaf log.
Start / End / Elapsed:	20181116 12:05:38.073 / 20181116 12:05:38.141 / 00:00:00.068

00:00:02.211 KEYWORD ${router_id} = OpenStackOperations . Get Router Id ${ROUTER}

Documentation:	Retrieve the router id for the given router name
Start / End / Elapsed:	20181116 12:05:38.141 / 20181116 12:05:40.352 / 00:00:02.211

00:00:00.156 KEYWORD VpnOperations . Associate VPN to Router routerid=${router_id}, vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Associate the created L3VPN to a router-id received as argument
Start / End / Elapsed:	20181116 12:05:40.352 / 20181116 12:05:40.508 / 00:00:00.156

00:00:00.143 KEYWORD CompareStream . Run_Keyword_If_At_Least_Fluorine TemplatedRequests.Post_As_Json_Templated, folder=${VAR_BASE}/assoc_two_router_l3vpn, mapping=${Kwargs}, session=default, http_timeout=${SESSION_TIMEOUT}

Documentation:	Compare fluorine to fluorine and in case fluorine is at least fluorine,
Start / End / Elapsed:	20181116 12:05:40.365 / 20181116 12:05:40.508 / 00:00:00.143

00:00:00.142 KEYWORD BuiltIn . Run Keyword And Return Run_Keyword_If_At_Least, fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:05:40.366 / 20181116 12:05:40.508 / 00:00:00.142

00:00:00.125 KEYWORD CompareStream . Run_Keyword_If_At_Least fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound},
Start / End / Elapsed:	20181116 12:05:40.383 / 20181116 12:05:40.508 / 00:00:00.125

00:00:00.125 KEYWORD BuiltIn . Run Keyword And Return If &{Stream_dict}[${ODL_STREAM}] >= &{Stream_dict}[${lower_bound}], ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:05:40.383 / 20181116 12:05:40.508 / 00:00:00.125

00:00:00.101 KEYWORD TemplatedRequests . Post_As_Json_Templated @{varargs}, &{kwargs}

Documentation:	Add arguments sensible for JSON data, return Post_Templated response text.
Start / End / Elapsed:	20181116 12:05:40.407 / 20181116 12:05:40.508 / 00:00:00.101

00:00:00.099 KEYWORD ${response_text} = TemplatedRequests . Post_Templated folder=${folder}, base_name=data, extension=json, accept=${ACCEPT_EMPTY}, content_type=${HEADERS_YANG_JSON}, mapping=${mapping}, session=${session}, normalize_json=True, endline=${\n}, iterations=${iterations}, iter_start=${iter_start}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	Resolve URI and data from folder, call Post_To_Uri, return response text.
Start / End / Elapsed:	20181116 12:05:40.409 / 20181116 12:05:40.508 / 00:00:00.099

00:00:00.031 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, base_name=location, extension=uri, mapping=${mapping}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:05:40.417 / 20181116 12:05:40.448 / 00:00:00.031

00:00:00.033 KEYWORD ${data} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, name_prefix=post_, base_name=${base_name}, extension=${extension}, mapping=${mapping}, endline=${endline}, iterations=${iterations}, iter_start=${iter_start}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:05:40.455 / 20181116 12:05:40.488 / 00:00:00.033

00:00:00.003 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path ${folder}

Documentation:	Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//assoc_two_router_l3vpn/jmespath.expr if the file exists and
Start / End / Elapsed:	20181116 12:05:40.488 / 20181116 12:05:40.491 / 00:00:00.003

00:00:00.015 KEYWORD ${response_text} = TemplatedRequests . Post_To_Uri uri=${uri}, data=${data}, content_type=${content_type}, accept=${accept}, session=${session}, jmes_path=${jmes_expression}, normalize_json=${normalize_json}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	POST data to given URI, check status code and return response text.
Start / End / Elapsed:	20181116 12:05:40.492 / 20181116 12:05:40.507 / 00:00:00.015

00:00:00.000 KEYWORD BuiltIn . Log ${uri}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.493 / 20181116 12:05:40.493 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${data}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.493 / 20181116 12:05:40.493 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${content_type}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.494 / 20181116 12:05:40.494 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${accept}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.494 / 20181116 12:05:40.494 / 00:00:00.000

00:00:00.004 KEYWORD ${headers} = TemplatedRequests . Join_Two_Headers first=${content_type}, second=${accept}

Documentation:	Take two dicts, join them, return result. Second argument values take precedence.
Start / End / Elapsed:	20181116 12:05:40.494 / 20181116 12:05:40.498 / 00:00:00.004

00:00:00.005 KEYWORD ${response} = BuiltIn . Run Keyword If """${http_timeout}""" == """${EMPTY}""", RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, ELSE, RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, timeout=${http_timeout}

Documentation:	Runs the given keyword with the given arguments, if `condition` is true.
Start / End / Elapsed:	20181116 12:05:40.498 / 20181116 12:05:40.503 / 00:00:00.005

00:00:00.003 KEYWORD TemplatedRequests . Check_Status_Code ${response}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}

Documentation:	Log response text, check status_code is one of allowed ones.
Start / End / Elapsed:	20181116 12:05:40.504 / 20181116 12:05:40.507 / 00:00:00.003

00:00:00.001 KEYWORD BuiltIn . Log ${response.text}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.504 / 20181116 12:05:40.505 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Log ${response.status_code}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:05:40.505 / 20181116 12:05:40.505 / 00:00:00.000

00:00:00.001 KEYWORD BuiltIn . Run Keyword And Return If """${explicit_status_codes}""" != """${NO_STATUS_CODES}""", Collections.List_Should_Contain_Value, ${explicit_status_codes}, ${response.status_code}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:05:40.505 / 20181116 12:05:40.506 / 00:00:00.001

00:00:00.000 KEYWORD ${final_allowd_list} = Collections . Combine Lists ${ALLOWED_STATUS_CODES}, ${additional_allowed_status_codes}

Documentation:	Combines the given `lists` together and returns the result.
Start / End / Elapsed:	20181116 12:05:40.506 / 20181116 12:05:40.506 / 00:00:00.000

00:00:00.001 KEYWORD Collections . List Should Contain Value ${final_allowd_list}, ${response.status_code}

Documentation:	Fails if the `value` is not found from `list`.
Start / End / Elapsed:	20181116 12:05:40.506 / 20181116 12:05:40.507 / 00:00:00.001

12:05:40.507

FAIL

[ 200 | 201 | 204 ] does not contain value '400'.

00:00:06.100 TEARDOWN OpenStackOperations . Get Test Teardown Debugs

Start / End / Elapsed:	20181116 12:05:40.509 / 20181116 12:05:46.609 / 00:00:06.100

00:01:06.693 TEST Verify L3VPN Datapath With Router Association

Full Name:	CSIT.Vpn Basic.Verify L3VPN Datapath With Router Association
Start / End / Elapsed:	20181116 12:05:46.609 / 20181116 12:06:53.302 / 00:01:06.693
Status:	FAIL (critical)
Message:	Keyword 'Utils.Check For Elements At URI' failed after retrying for 1 minute. The last error was: '{"vrfTables":[{"routeDistinguisher":"2200:2"}]}' does not contain '10.1.1.6'

00:00:00.075 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing

Documentation:	Test case setup which explicitly ignores previous failure and logs test case name to Karaf log.
Start / End / Elapsed:	20181116 12:05:46.610 / 20181116 12:05:46.685 / 00:00:00.075

00:00:00.000 KEYWORD ${vm_ips} = BuiltIn . Create List @{NET_1_VM_IPS}, @{NET_2_VM_IPS}

Documentation:	Returns a list containing given items.
Start / End / Elapsed:	20181116 12:05:46.685 / 20181116 12:05:46.685 / 00:00:00.000

00:00:00.020 KEYWORD BuiltIn . Wait Until Keyword Succeeds 30s, 10s, Utils.Check For Elements At URI, ${VPN_IFACES_URL}, ${vm_ips}

Documentation:	Runs the specified keyword and retries if it fails.
Start / End / Elapsed:	20181116 12:05:46.686 / 20181116 12:05:46.706 / 00:00:00.020

00:00:00.000 KEYWORD ${RD} = String . Strip String @{RDS}[0], characters="[]

Documentation:	Remove leading and/or trailing whitespaces from the given string.
Start / End / Elapsed:	20181116 12:05:46.707 / 20181116 12:05:46.707 / 00:00:00.000

00:01:00.193 KEYWORD BuiltIn . Wait Until Keyword Succeeds 60s, 15s, Utils.Check For Elements At URI, ${CONFIG_API}/odl-fib:fibEntries/vrfTables/${RD}/, ${vm_ips}

Documentation:

Runs the specified keyword and retries if it fails.

4 failing steps removed using --RemoveKeywords option.

Start / End / Elapsed:

20181116 12:05:46.707 / 20181116 12:06:46.900 / 00:01:00.193

00:00:00.011 KEYWORD Utils . Check For Elements At URI ${CONFIG_API}/odl-fib:fibEntries/vrfTables/${RD}/, ${vm_ips}

Documentation:	A GET is made at the supplied ${URI} and every item in the list of
Start / End / Elapsed:	20181116 12:06:46.889 / 20181116 12:06:46.900 / 00:00:00.011

00:00:00.006 KEYWORD ${resp} = RequestsLibrary . Get Request ${session}, ${uri}

Documentation:	Send a GET request on the session object found using the
Start / End / Elapsed:	20181116 12:06:46.890 / 20181116 12:06:46.896 / 00:00:00.006

00:00:00.001 KEYWORD BuiltIn . Run Keyword If "${pretty_print_json}" == "True", Log Content, ${resp.content}, ELSE, BuiltIn.Log, ${resp.content}

Documentation:	Runs the given keyword with the given arguments, if `condition` is true.
Start / End / Elapsed:	20181116 12:06:46.896 / 20181116 12:06:46.897 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Should Be Equal As Strings ${resp.status_code}, 200

Documentation:	Fails if objects are unequal after converting them to strings.
Start / End / Elapsed:	20181116 12:06:46.898 / 20181116 12:06:46.898 / 00:00:00.000

00:00:00.002 FOR ${i} IN [ @{elements} ]

Start / End / Elapsed:	20181116 12:06:46.898 / 20181116 12:06:46.900 / 00:00:00.002

00:00:00.001 VAR ${i} = 10.1.1.6

Start / End / Elapsed:	20181116 12:06:46.898 / 20181116 12:06:46.899 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Should Contain ${resp.content}, ${i}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:06:46.899 / 20181116 12:06:46.899 / 00:00:00.000

12:06:46.899

FAIL

'{"vrfTables":[{"routeDistinguisher":"2200:2"}]}' does not contain '10.1.1.6'

12:06:46.900

FAIL

Keyword 'Utils.Check For Elements At URI' failed after retrying for 1 minute. The last error was: '{"vrfTables":[{"routeDistinguisher":"2200:2"}]}' does not contain '10.1.1.6'

00:00:06.401 TEARDOWN OpenStackOperations . Get Test Teardown Debugs

Start / End / Elapsed:	20181116 12:06:46.900 / 20181116 12:06:53.301 / 00:00:06.401

00:00:13.585 TEST Delete Router Failure When Associated With L3VPN

Full Name:	CSIT.Vpn Basic.Delete Router Failure When Associated With L3VPN
Start / End / Elapsed:	20181116 12:06:53.302 / 20181116 12:07:06.887 / 00:00:13.585
Status:	FAIL (critical)
Message:	'{ "output": { "l3vpn-instances": [ { "export-RT": [ "2200:2" ], "id": "4ae8cd92-48ca-49b5-94e1-b2921a261441", "import-RT": [ "2200:2" ], "l3vni": 0, "name": "vpn_1", "route-distinguisher": [ "2200:2" ], "tenant-id": "f25b2177-9eac-453c-a526-2b4c72aa69b9" } ] } } ' does not contain '4097a737-e271-4515-b1c3-59c48ae5aae3'

00:00:00.080 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing

Documentation:	Test case setup which explicitly ignores previous failure and logs test case name to Karaf log.
Start / End / Elapsed:	20181116 12:06:53.303 / 20181116 12:06:53.383 / 00:00:00.080

00:00:02.406 KEYWORD ${router_id} = OpenStackOperations . Get Router Id ${ROUTER}

Documentation:	Retrieve the router id for the given router name
Start / End / Elapsed:	20181116 12:06:53.383 / 20181116 12:06:55.789 / 00:00:02.406

00:00:02.509 KEYWORD ${rc}, ${output} = OperatingSystem . Run And Return Rc And Output openstack router delete ${ROUTER}

Documentation:	Runs the given command in the system and returns the RC and output.
Start / End / Elapsed:	20181116 12:06:55.789 / 20181116 12:06:58.298 / 00:00:02.509

00:00:00.002 KEYWORD BuiltIn . Should Match Regexp ${output}, Failed to delete router.*${ROUTER}

Documentation:	Fails if `string` does not match `pattern` as a regular expression.
Start / End / Elapsed:	20181116 12:06:58.299 / 20181116 12:06:58.301 / 00:00:00.002

00:00:00.001 KEYWORD BuiltIn . Should Be True '${rc}' == '1'

Documentation:	Fails if the given condition is not true.
Start / End / Elapsed:	20181116 12:06:58.301 / 20181116 12:06:58.302 / 00:00:00.001

00:00:02.124 KEYWORD ${router_output} = OpenStackOperations . List Routers

Documentation:	List Routers and return output with neutron client.
Start / End / Elapsed:	20181116 12:06:58.302 / 20181116 12:07:00.426 / 00:00:02.124

00:00:00.001 KEYWORD BuiltIn . Should Contain ${router_output}, ${ROUTER}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:07:00.426 / 20181116 12:07:00.427 / 00:00:00.001

00:00:00.000 KEYWORD @{router_list} = BuiltIn . Create List ${ROUTER}

Documentation:	Returns a list containing given items.
Start / End / Elapsed:	20181116 12:07:00.427 / 20181116 12:07:00.427 / 00:00:00.000

00:00:00.024 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Utils.Check For Elements At URI, ${ROUTER_URL}, ${router_list}

Documentation:	Runs the specified keyword and retries if it fails.
Start / End / Elapsed:	20181116 12:07:00.427 / 20181116 12:07:00.451 / 00:00:00.024

00:00:00.152 KEYWORD ${resp} = VpnOperations . VPN Get L3VPN vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Will return detailed list of the L3VPN_ID received
Start / End / Elapsed:	20181116 12:07:00.452 / 20181116 12:07:00.604 / 00:00:00.152

00:00:00.000 KEYWORD BuiltIn . Should Contain ${resp}, ${router_id}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:07:00.604 / 20181116 12:07:00.604 / 00:00:00.000

12:07:00.604

FAIL

'{ "output": { "l3vpn-instances": [ { "export-RT": [ "2200:2" ], "id": "4ae8cd92-48ca-49b5-94e1-b2921a261441", "import-RT": [ "2200:2" ], "l3vni": 0, "name": "vpn_1", "route-distinguisher": [ "2200:2" ], "tenant-id": "f25b2177-9eac-453c-a526-2b4c72aa69b9" } ] } } ' does not contain '4097a737-e271-4515-b1c3-59c48ae5aae3'

00:00:06.282 TEARDOWN OpenStackOperations . Get Test Teardown Debugs

Start / End / Elapsed:	20181116 12:07:00.605 / 20181116 12:07:06.887 / 00:00:06.282

00:00:44.815 TEST Verify Remove Interface From Router When Associated With L3VPN

Full Name:	CSIT.Vpn Basic.Verify Remove Interface From Router When Associated With L3VPN
Start / End / Elapsed:	20181116 12:07:06.888 / 20181116 12:07:51.703 / 00:00:44.815
Status:	PASS (critical)

00:00:12.924 TEST Verify L3VPN Datapath With Router Dissociation When Interfaces are Added To Router

Full Name:	CSIT.Vpn Basic.Verify L3VPN Datapath With Router Dissociation When Interfaces are Added To Router
Start / End / Elapsed:	20181116 12:07:51.703 / 20181116 12:08:04.627 / 00:00:12.924
Status:	FAIL (critical)
Message:	[ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.096 SETUP SetupUtils . Setup_Test_With_Logging_And_Without_Fast_Failing

Documentation:	Test case setup which explicitly ignores previous failure and logs test case name to Karaf log.
Start / End / Elapsed:	20181116 12:07:51.704 / 20181116 12:07:51.800 / 00:00:00.096

00:00:04.194 KEYWORD OpenStackOperations . Add Router Interface ${ROUTER}, @{SUBNETS}[0]

Start / End / Elapsed:	20181116 12:07:51.800 / 20181116 12:07:55.994 / 00:00:04.194

00:00:00.001 KEYWORD ${vm_ips} = BuiltIn . Create List @{NET_1_VM_IPS}, @{NET_2_VM_IPS}

Documentation:	Returns a list containing given items.
Start / End / Elapsed:	20181116 12:07:55.994 / 20181116 12:07:55.995 / 00:00:00.001

00:00:02.356 KEYWORD ${router_id} = OpenStackOperations . Get Router Id ${ROUTER}

Documentation:	Retrieve the router id for the given router name
Start / End / Elapsed:	20181116 12:07:55.995 / 20181116 12:07:58.351 / 00:00:02.356

00:00:00.185 KEYWORD VpnOperations . Dissociate VPN to Router routerid=${router_id}, vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Dissociate the already associated routers from L3VPN
Start / End / Elapsed:	20181116 12:07:58.352 / 20181116 12:07:58.537 / 00:00:00.185

00:00:00.163 KEYWORD CompareStream . Run_Keyword_If_At_Least_Fluorine TemplatedRequests.Post_As_Json_Templated, folder=${VAR_BASE}/dissoc_two_router_l3vpn, mapping=${Kwargs}, session=default, http_timeout=${SESSION_TIMEOUT}

Documentation:	Compare fluorine to fluorine and in case fluorine is at least fluorine,
Start / End / Elapsed:	20181116 12:07:58.374 / 20181116 12:07:58.537 / 00:00:00.163

00:00:00.161 KEYWORD BuiltIn . Run Keyword And Return Run_Keyword_If_At_Least, fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:07:58.376 / 20181116 12:07:58.537 / 00:00:00.161

00:00:00.135 KEYWORD CompareStream . Run_Keyword_If_At_Least fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound},
Start / End / Elapsed:	20181116 12:07:58.402 / 20181116 12:07:58.537 / 00:00:00.135

00:00:00.134 KEYWORD BuiltIn . Run Keyword And Return If &{Stream_dict}[${ODL_STREAM}] >= &{Stream_dict}[${lower_bound}], ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:07:58.403 / 20181116 12:07:58.537 / 00:00:00.134

00:00:00.104 KEYWORD TemplatedRequests . Post_As_Json_Templated @{varargs}, &{kwargs}

Documentation:	Add arguments sensible for JSON data, return Post_Templated response text.
Start / End / Elapsed:	20181116 12:07:58.433 / 20181116 12:07:58.537 / 00:00:00.104

00:00:00.103 KEYWORD ${response_text} = TemplatedRequests . Post_Templated folder=${folder}, base_name=data, extension=json, accept=${ACCEPT_EMPTY}, content_type=${HEADERS_YANG_JSON}, mapping=${mapping}, session=${session}, normalize_json=True, endline=${\n}, iterations=${iterations}, iter_start=${iter_start}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	Resolve URI and data from folder, call Post_To_Uri, return response text.
Start / End / Elapsed:	20181116 12:07:58.434 / 20181116 12:07:58.537 / 00:00:00.103

00:00:00.035 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, base_name=location, extension=uri, mapping=${mapping}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:07:58.443 / 20181116 12:07:58.478 / 00:00:00.035

00:00:00.031 KEYWORD ${data} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, name_prefix=post_, base_name=${base_name}, extension=${extension}, mapping=${mapping}, endline=${endline}, iterations=${iterations}, iter_start=${iter_start}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:07:58.485 / 20181116 12:07:58.516 / 00:00:00.031

00:00:00.003 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path ${folder}

Documentation:	Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//dissoc_two_router_l3vpn/jmespath.expr if the file exists and
Start / End / Elapsed:	20181116 12:07:58.516 / 20181116 12:07:58.519 / 00:00:00.003

00:00:00.017 KEYWORD ${response_text} = TemplatedRequests . Post_To_Uri uri=${uri}, data=${data}, content_type=${content_type}, accept=${accept}, session=${session}, jmes_path=${jmes_expression}, normalize_json=${normalize_json}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	POST data to given URI, check status code and return response text.
Start / End / Elapsed:	20181116 12:07:58.519 / 20181116 12:07:58.536 / 00:00:00.017

00:00:00.000 KEYWORD BuiltIn . Log ${uri}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.520 / 20181116 12:07:58.520 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${data}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.521 / 20181116 12:07:58.521 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${content_type}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.521 / 20181116 12:07:58.521 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${accept}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.522 / 20181116 12:07:58.522 / 00:00:00.000

00:00:00.003 KEYWORD ${headers} = TemplatedRequests . Join_Two_Headers first=${content_type}, second=${accept}

Documentation:	Take two dicts, join them, return result. Second argument values take precedence.
Start / End / Elapsed:	20181116 12:07:58.522 / 20181116 12:07:58.525 / 00:00:00.003

00:00:00.006 KEYWORD ${response} = BuiltIn . Run Keyword If """${http_timeout}""" == """${EMPTY}""", RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, ELSE, RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, timeout=${http_timeout}

Documentation:	Runs the given keyword with the given arguments, if `condition` is true.
Start / End / Elapsed:	20181116 12:07:58.525 / 20181116 12:07:58.531 / 00:00:00.006

00:00:00.004 KEYWORD TemplatedRequests . Check_Status_Code ${response}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}

Documentation:	Log response text, check status_code is one of allowed ones.
Start / End / Elapsed:	20181116 12:07:58.532 / 20181116 12:07:58.536 / 00:00:00.004

00:00:00.001 KEYWORD BuiltIn . Log ${response.text}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.532 / 20181116 12:07:58.533 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Log ${response.status_code}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:07:58.533 / 20181116 12:07:58.533 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Run Keyword And Return If """${explicit_status_codes}""" != """${NO_STATUS_CODES}""", Collections.List_Should_Contain_Value, ${explicit_status_codes}, ${response.status_code}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:07:58.534 / 20181116 12:07:58.534 / 00:00:00.000

00:00:00.001 KEYWORD ${final_allowd_list} = Collections . Combine Lists ${ALLOWED_STATUS_CODES}, ${additional_allowed_status_codes}

Documentation:	Combines the given `lists` together and returns the result.
Start / End / Elapsed:	20181116 12:07:58.534 / 20181116 12:07:58.535 / 00:00:00.001

00:00:00.001 KEYWORD Collections . List Should Contain Value ${final_allowd_list}, ${response.status_code}

Documentation:	Fails if the `value` is not found from `list`.
Start / End / Elapsed:	20181116 12:07:58.535 / 20181116 12:07:58.536 / 00:00:00.001

12:07:58.536

FAIL

[ 200 | 201 | 204 ] does not contain value '400'.

00:00:06.089 TEARDOWN OpenStackOperations . Get Test Teardown Debugs

Start / End / Elapsed:	20181116 12:07:58.538 / 20181116 12:08:04.627 / 00:00:06.089

00:01:27.331 TEST Remove Router Interfaces And Check L3_Datapath Traffic Across Networks

Full Name:	CSIT.Vpn Basic.Remove Router Interfaces And Check L3_Datapath Traffic Across Networks
Start / End / Elapsed:	20181116 12:08:04.627 / 20181116 12:09:31.958 / 00:01:27.331
Status:	PASS (critical)

00:00:11.366 TEST Delete Router

Full Name:	CSIT.Vpn Basic.Delete Router
Start / End / Elapsed:	20181116 12:09:31.958 / 20181116 12:09:43.324 / 00:00:11.366
Status:	PASS (critical)

00:00:07.108 TEST Delete Router With NonExistentRouter Name

Full Name:	CSIT.Vpn Basic.Delete Router With NonExistentRouter Name
Documentation:	Delete router with nonExistentRouter name
Start / End / Elapsed:	20181116 12:09:43.324 / 20181116 12:09:50.432 / 00:00:07.108
Status:	PASS (critical)

00:00:11.127 TEST Associate Networks To L3VPN

Full Name:	CSIT.Vpn Basic.Associate Networks To L3VPN
Documentation:	Associates L3VPN to networks and verify
Start / End / Elapsed:	20181116 12:09:50.432 / 20181116 12:10:01.559 / 00:00:11.127
Status:	PASS (critical)

00:01:12.183 TEST Check Datapath Traffic Across Networks With L3VPN

Full Name:	CSIT.Vpn Basic.Check Datapath Traffic Across Networks With L3VPN
Documentation:	Datapath Test Across the networks with VPN.
Start / End / Elapsed:	20181116 12:10:01.559 / 20181116 12:11:13.742 / 00:01:12.183
Status:	PASS (critical)

00:01:31.241 TEST Verification of route update after VM port removed and re added to VPN

Full Name:	CSIT.Vpn Basic.Verification of route update after VM port removed and re added to VPN
Documentation:	Verify route update after VM port removed and re added to VPN
Start / End / Elapsed:	20181116 12:11:13.742 / 20181116 12:12:44.983 / 00:01:31.241
Status:	PASS (critical)

00:00:58.678 TEST Verification of route update after reconfiguring vpn by adding new ports

Full Name:	CSIT.Vpn Basic.Verification of route update after reconfiguring vpn by adding new ports
Documentation:	Verify route update after reconfiguring vpn by creating new VM with new port on openvswitch1
Start / End / Elapsed:	20181116 12:12:44.984 / 20181116 12:13:43.662 / 00:00:58.678
Status:	PASS (critical)

00:00:11.070 TEST Dissociate L3VPN From Networks

Full Name:	CSIT.Vpn Basic.Dissociate L3VPN From Networks
Documentation:	Dissociate L3VPN from networks
Start / End / Elapsed:	20181116 12:13:43.662 / 20181116 12:13:54.732 / 00:00:11.070
Status:	PASS (critical)

00:00:06.856 TEST Delete Unknown L3VPN

Full Name:	CSIT.Vpn Basic.Delete Unknown L3VPN
Documentation:	Verification of a failure response with deletion of an unknown L3VPN
Start / End / Elapsed:	20181116 12:13:54.733 / 20181116 12:14:01.589 / 00:00:06.856
Status:	PASS (critical)

00:00:06.935 TEST Delete L3VPN

Full Name:	CSIT.Vpn Basic.Delete L3VPN
Documentation:	Delete L3VPN
Start / End / Elapsed:	20181116 12:14:01.590 / 20181116 12:14:08.525 / 00:00:06.935
Status:	PASS (critical)

00:00:09.601 TEST Create Multiple L3VPN

Full Name:	CSIT.Vpn Basic.Create Multiple L3VPN
Documentation:	Creates three L3VPNs and then verify the same
Start / End / Elapsed:	20181116 12:14:08.526 / 20181116 12:14:18.127 / 00:00:09.601
Status:	PASS (critical)

00:08:47.876 SUITE Elan

Full Name:	CSIT.Elan
Documentation:	Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot
Start / End / Elapsed:	20181116 12:15:50.583 / 20181116 12:24:38.459 / 00:08:47.876
Status:	5 critical test, 5 passed, 0 failed 5 test total, 5 passed, 0 failed

00:05:22.562 SUITE Arp Learning

Full Name:	CSIT.Arp Learning
Documentation:	Test suite for ARP Request. More test cases to be added in subsequent patches.
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot
Start / End / Elapsed:	20181116 12:24:38.465 / 20181116 12:30:01.027 / 00:05:22.562
Status:	3 critical test, 0 passed, 3 failed 3 test total, 0 passed, 3 failed
Message:	Suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:03:05.525 SETUP Suite Setup

Documentation:	Suite Setup to create the necessary resources.
Start / End / Elapsed:	20181116 12:24:38.546 / 20181116 12:27:44.071 / 00:03:05.525

00:00:45.957 KEYWORD VpnOperations . Basic Suite Setup

Start / End / Elapsed:	20181116 12:24:38.546 / 20181116 12:25:24.503 / 00:00:45.957

00:00:06.654 FOR ${network} IN [ @{NETWORKS} ]

Start / End / Elapsed:	20181116 12:25:24.503 / 20181116 12:25:31.157 / 00:00:06.654

00:00:02.250 KEYWORD ${neutron_networks} = OpenStackOperations . List Networks

Documentation:	List networks and return output with neutron client.
Start / End / Elapsed:	20181116 12:25:31.157 / 20181116 12:25:33.407 / 00:00:02.250

00:00:00.002 FOR ${network} IN [ @{NETWORKS} ]

Start / End / Elapsed:	20181116 12:25:33.407 / 20181116 12:25:33.409 / 00:00:00.002

00:00:02.201 KEYWORD ${NET_ID} = OpenStackOperations . Get Net Id @{NETWORKS}[0]

Documentation:	Retrieve the net id for the given network name to create specific vm instance
Start / End / Elapsed:	20181116 12:25:33.409 / 20181116 12:25:35.610 / 00:00:02.201

00:00:00.000 KEYWORD BuiltIn . Set Suite Variable ${NET_ID}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:25:35.610 / 20181116 12:25:35.610 / 00:00:00.000

00:00:07.695 FOR ${i} IN RANGE [ 0 | 3 ]

Start / End / Elapsed:	20181116 12:25:35.610 / 20181116 12:25:43.305 / 00:00:07.695

00:00:02.235 KEYWORD ${neutron_subnets} = OpenStackOperations . List Subnets

Documentation:	List subnets and return output with neutron client.
Start / End / Elapsed:	20181116 12:25:43.306 / 20181116 12:25:45.541 / 00:00:02.235

00:00:00.002 FOR ${subnet} IN [ @{SUBNETS} ]

Start / End / Elapsed:	20181116 12:25:45.541 / 20181116 12:25:45.543 / 00:00:00.002

00:00:16.299 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}

Documentation:	Allow all TCP/UDP/ICMP packets for this suite
Start / End / Elapsed:	20181116 12:25:45.544 / 20181116 12:26:01.843 / 00:00:16.299

00:00:02.819 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[0], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:01.843 / 20181116 12:26:04.662 / 00:00:02.819

00:00:03.094 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[1], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:04.662 / 20181116 12:26:07.756 / 00:00:03.094

00:00:02.772 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[2], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:07.757 / 20181116 12:26:10.529 / 00:00:02.772

00:00:03.053 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[3], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:10.529 / 20181116 12:26:13.582 / 00:00:03.053

00:00:02.766 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[2], @{PORTS}[4], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:13.582 / 20181116 12:26:16.348 / 00:00:02.766

00:00:02.733 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[2], @{PORTS}[5], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}

Documentation:	Create Port with neutron request.
Start / End / Elapsed:	20181116 12:26:16.348 / 20181116 12:26:19.081 / 00:00:02.733

00:00:00.028 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Check For Elements At URI, ${CONFIG_API}/neutron:neutron/ports/, ${PORTS}

Documentation:	Runs the specified keyword and retries if it fails.
Start / End / Elapsed:	20181116 12:26:19.082 / 20181116 12:26:19.110 / 00:00:00.028

00:00:04.470 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:19.142 / 20181116 12:26:23.612 / 00:00:04.470

00:00:05.511 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[1], @{NET_1_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:23.647 / 20181116 12:26:29.158 / 00:00:05.511

00:00:05.039 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[2], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:29.184 / 20181116 12:26:34.223 / 00:00:05.039

00:00:05.799 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[3], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:34.250 / 20181116 12:26:40.049 / 00:00:05.799

00:00:06.101 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[4], @{NET_3_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:40.078 / 20181116 12:26:46.179 / 00:00:06.101

00:00:06.282 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[5], @{NET_3_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}

Documentation:	Create One VM instance using given ${port_name} and for given ${node_hostname}
Start / End / Elapsed:	20181116 12:26:46.208 / 20181116 12:26:52.490 / 00:00:06.282

00:00:14.719 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}

Documentation:	Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed:	20181116 12:26:52.490 / 20181116 12:27:07.209 / 00:00:14.719

00:00:11.934 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}

Documentation:	Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed:	20181116 12:27:07.210 / 20181116 12:27:19.144 / 00:00:11.934

00:00:11.634 KEYWORD @{NET_3_VM_IPS}, ${NET_3_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_3_VMS}

Documentation:	Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed:	20181116 12:27:19.145 / 20181116 12:27:30.779 / 00:00:11.634

00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:27:30.780 / 20181116 12:27:30.781 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:27:30.781 / 20181116 12:27:30.782 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_3_VM_IPS}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:27:30.782 / 20181116 12:27:30.783 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.784 / 20181116 12:27:30.784 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.785 / 20181116 12:27:30.785 / 00:00:00.000

00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_3_VM_IPS}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.785 / 20181116 12:27:30.786 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_1_DHCP_IP}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.786 / 20181116 12:27:30.787 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_2_DHCP_IP}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.787 / 20181116 12:27:30.788 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_3_DHCP_IP}, None

Documentation:	Fails if `container` contains `item` one or more times.
Start / End / Elapsed:	20181116 12:27:30.788 / 20181116 12:27:30.789 / 00:00:00.001

00:00:02.064 KEYWORD OpenStackOperations . Create Router ${ROUTER}

Documentation:	Create Router and Add Interface to the subnets.
Start / End / Elapsed:	20181116 12:27:30.789 / 20181116 12:27:32.853 / 00:00:02.064

00:00:03.887 KEYWORD OpenStackOperations . Add Router Interface ${ROUTER}, @{SUBNETS}[1]

Start / End / Elapsed:	20181116 12:27:32.853 / 20181116 12:27:36.740 / 00:00:03.887

00:00:04.159 KEYWORD OpenStackOperations . Add Router Interface ${ROUTER}, @{SUBNETS}[2]

Start / End / Elapsed:	20181116 12:27:36.741 / 20181116 12:27:40.900 / 00:00:04.159

00:00:00.044 KEYWORD ${tenant_id} = OpenStackOperations . Get Tenant ID From Network ${NET_ID}

Documentation:	Returns tenant ID by reading it from existing network.
Start / End / Elapsed:	20181116 12:27:40.900 / 20181116 12:27:40.944 / 00:00:00.044

00:00:00.210 KEYWORD VpnOperations . VPN Create L3VPN vpnid=@{VPN_INSTANCE_IDS}[0], name=${VPN_NAMES[0]}, rd=${RD1}, exportrt=${EXPORT_RT}, importrt=${IMPORT_RT}, tenantid=${tenant_id}

Documentation:	Create an L3VPN using the Json using the list of optional arguments received.
Start / End / Elapsed:	20181116 12:27:40.944 / 20181116 12:27:41.154 / 00:00:00.210

00:00:00.161 KEYWORD ${resp} = VpnOperations . VPN Get L3VPN vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Will return detailed list of the L3VPN_ID received
Start / End / Elapsed:	20181116 12:27:41.154 / 20181116 12:27:41.315 / 00:00:00.161

00:00:00.000 KEYWORD BuiltIn . Should Contain ${resp}, @{VPN_INSTANCE_IDS}[0]

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:27:41.316 / 20181116 12:27:41.316 / 00:00:00.000

00:00:02.755 KEYWORD Associate L3VPN To ROUTER

Start / End / Elapsed:	20181116 12:27:41.316 / 20181116 12:27:44.071 / 00:00:02.755

00:00:00.200 KEYWORD VpnOperations . Associate L3VPN To Network networkid=${NET_ID}, vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Associate the created L3VPN to a network-id received as dictionary argument
Start / End / Elapsed:	20181116 12:27:41.316 / 20181116 12:27:41.516 / 00:00:00.200

00:00:00.147 KEYWORD ${resp} = VpnOperations . VPN Get L3VPN vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Will return detailed list of the L3VPN_ID received
Start / End / Elapsed:	20181116 12:27:41.517 / 20181116 12:27:41.664 / 00:00:00.147

00:00:00.000 KEYWORD BuiltIn . Should Contain ${resp}, ${NET_ID}

Documentation:	Fails if `container` does not contain `item` one or more times.
Start / End / Elapsed:	20181116 12:27:41.665 / 20181116 12:27:41.665 / 00:00:00.000

00:00:02.247 KEYWORD ${ROUTER_ID} = OpenStackOperations . Get Router Id ${ROUTER}

Documentation:	Retrieve the router id for the given router name
Start / End / Elapsed:	20181116 12:27:41.665 / 20181116 12:27:43.912 / 00:00:02.247

00:00:00.000 KEYWORD BuiltIn . Set Suite Variable ${ROUTER_ID}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:27:43.912 / 20181116 12:27:43.912 / 00:00:00.000

00:00:00.158 KEYWORD VpnOperations . Associate VPN to Router routerid=${ROUTER_ID}, vpnid=@{VPN_INSTANCE_IDS}[0]

Documentation:	Associate the created L3VPN to a router-id received as argument
Start / End / Elapsed:	20181116 12:27:43.913 / 20181116 12:27:44.071 / 00:00:00.158

00:00:00.147 KEYWORD CompareStream . Run_Keyword_If_At_Least_Fluorine TemplatedRequests.Post_As_Json_Templated, folder=${VAR_BASE}/assoc_two_router_l3vpn, mapping=${Kwargs}, session=default, http_timeout=${SESSION_TIMEOUT}

Documentation:	Compare fluorine to fluorine and in case fluorine is at least fluorine,
Start / End / Elapsed:	20181116 12:27:43.924 / 20181116 12:27:44.071 / 00:00:00.147

00:00:00.145 KEYWORD BuiltIn . Run Keyword And Return Run_Keyword_If_At_Least, fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:27:43.925 / 20181116 12:27:44.070 / 00:00:00.145

00:00:00.129 KEYWORD CompareStream . Run_Keyword_If_At_Least fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound},
Start / End / Elapsed:	20181116 12:27:43.941 / 20181116 12:27:44.070 / 00:00:00.129

00:00:00.128 KEYWORD BuiltIn . Run Keyword And Return If &{Stream_dict}[${ODL_STREAM}] >= &{Stream_dict}[${lower_bound}], ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:27:43.942 / 20181116 12:27:44.070 / 00:00:00.128

00:00:00.102 KEYWORD TemplatedRequests . Post_As_Json_Templated @{varargs}, &{kwargs}

Documentation:	Add arguments sensible for JSON data, return Post_Templated response text.
Start / End / Elapsed:	20181116 12:27:43.968 / 20181116 12:27:44.070 / 00:00:00.102

00:00:00.101 KEYWORD ${response_text} = TemplatedRequests . Post_Templated folder=${folder}, base_name=data, extension=json, accept=${ACCEPT_EMPTY}, content_type=${HEADERS_YANG_JSON}, mapping=${mapping}, session=${session}, normalize_json=True, endline=${\n}, iterations=${iterations}, iter_start=${iter_start}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	Resolve URI and data from folder, call Post_To_Uri, return response text.
Start / End / Elapsed:	20181116 12:27:43.969 / 20181116 12:27:44.070 / 00:00:00.101

00:00:00.034 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, base_name=location, extension=uri, mapping=${mapping}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:27:43.976 / 20181116 12:27:44.010 / 00:00:00.034

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:27:44.020 / 20181116 12:27:44.051 / 00:00:00.031

00:00:00.004 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path ${folder}

Documentation:	Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//assoc_two_router_l3vpn/jmespath.expr if the file exists and
Start / End / Elapsed:	20181116 12:27:44.051 / 20181116 12:27:44.055 / 00:00:00.004

Documentation:	POST data to given URI, check status code and return response text.
Start / End / Elapsed:	20181116 12:27:44.055 / 20181116 12:27:44.070 / 00:00:00.015

00:00:00.000 KEYWORD BuiltIn . Log ${uri}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.056 / 20181116 12:27:44.056 / 00:00:00.000

00:00:00.001 KEYWORD BuiltIn . Log ${data}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.056 / 20181116 12:27:44.057 / 00:00:00.001

00:00:00.000 KEYWORD BuiltIn . Log ${content_type}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.057 / 20181116 12:27:44.057 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${accept}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.057 / 20181116 12:27:44.057 / 00:00:00.000

00:00:00.003 KEYWORD ${headers} = TemplatedRequests . Join_Two_Headers first=${content_type}, second=${accept}

Documentation:	Take two dicts, join them, return result. Second argument values take precedence.
Start / End / Elapsed:	20181116 12:27:44.058 / 20181116 12:27:44.061 / 00:00:00.003

Documentation:	Runs the given keyword with the given arguments, if `condition` is true.
Start / End / Elapsed:	20181116 12:27:44.061 / 20181116 12:27:44.066 / 00:00:00.005

00:00:00.004 KEYWORD TemplatedRequests . Check_Status_Code ${response}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}

Documentation:	Log response text, check status_code is one of allowed ones.
Start / End / Elapsed:	20181116 12:27:44.066 / 20181116 12:27:44.070 / 00:00:00.004

00:00:00.000 KEYWORD BuiltIn . Log ${response.text}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.067 / 20181116 12:27:44.067 / 00:00:00.000

00:00:00.000 KEYWORD BuiltIn . Log ${response.status_code}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:27:44.068 / 20181116 12:27:44.068 / 00:00:00.000

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:27:44.068 / 20181116 12:27:44.068 / 00:00:00.000

00:00:00.000 KEYWORD ${final_allowd_list} = Collections . Combine Lists ${ALLOWED_STATUS_CODES}, ${additional_allowed_status_codes}

Documentation:	Combines the given `lists` together and returns the result.
Start / End / Elapsed:	20181116 12:27:44.069 / 20181116 12:27:44.069 / 00:00:00.000

00:00:00.001 KEYWORD Collections . List Should Contain Value ${final_allowd_list}, ${response.status_code}

Documentation:	Fails if the `value` is not found from `list`.
Start / End / Elapsed:	20181116 12:27:44.069 / 20181116 12:27:44.070 / 00:00:00.001

12:27:44.070

FAIL

[ 200 | 201 | 204 ] does not contain value '400'.

00:02:16.953 TEARDOWN Suite Teardown

Documentation:	Delete the setup
Start / End / Elapsed:	20181116 12:27:44.074 / 20181116 12:30:01.027 / 00:02:16.953

00:00:00.001 TEST Verify Setup

Full Name:	CSIT.Arp Learning.Verify Setup
Documentation:	Verify that VMs received ip and ping is happening between different VMs. For this, we ssh to the VM using the dhcp-namespace on the controller node and verify ping reachability to the second VM on the same network and VMs on other network (i.e., east-west routing)
Start / End / Elapsed:	20181116 12:27:44.071 / 20181116 12:27:44.072 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify GARP Requests

Full Name:	CSIT.Arp Learning.Verify GARP Requests
Documentation:	Verify that GARP request is sent to controller and controller learns this info. In this test-case, before we validate the GARPs, we ensure that the necessary pipeline flows for the VMs spawned on the networks are as expected (along with the FIB Entries in the ODL Datastore). For triggering GARPs, we create an alias interface (eth0:1) on VM1_net0, configure it with an extra_route_ip, trigger 5 GARPs from the VM for the extra_route_ip and ensure that ODL learns (by looking at odl-fib:fibEntries) the extra_route_ip info with the nexthop pointing to Compute-1 (where VM1_net0 is spawned) hostIP. Finally, we verify ping reachability to the extra_route_ip from other VMs on the network.
Start / End / Elapsed:	20181116 12:27:44.072 / 20181116 12:27:44.073 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify MIP Migration

Full Name:	CSIT.Arp Learning.Verify MIP Migration
Documentation:	Verify that after migration of movable ip across compute nodes, the controller updates the routes. Unconfigure the extra_route_ip on VM1_net0 and configure it on vm0_net0 (on Compute-0 host). Trigger 5 GARPs from the VM for the extra_route_ip and ensure that ODL learns/updates the extra_route_ip info with nexthop in the FIB entry pointing to Compute-0 hostip.
Start / End / Elapsed:	20181116 12:27:44.073 / 20181116 12:27:44.074 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:04:18.588 SUITE L2L3 Gatewaymac Arp

Full Name:	CSIT.L2L3 Gatewaymac Arp
Documentation:	Test Suite for Gateway mac based L2L3 seggragation
Source:	/home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot
Start / End / Elapsed:	20181116 12:30:01.032 / 20181116 12:34:19.620 / 00:04:18.588
Status:	9 critical test, 0 passed, 9 failed 9 test total, 0 passed, 9 failed
Message:	Suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:02:31.330 SETUP Suite Setup

Documentation:	Test Suite for Gateway mac based L2L3 seggragation
Start / End / Elapsed:	20181116 12:30:01.145 / 20181116 12:32:32.475 / 00:02:31.330

00:00:46.844 KEYWORD VpnOperations . Basic Suite Setup

Start / End / Elapsed:	20181116 12:30:01.146 / 20181116 12:30:47.990 / 00:00:46.844

00:01:44.485 KEYWORD Create Setup

Documentation:	Create Two Networks, Two Subnets, Four Ports And Four VMs on each DPN
Start / End / Elapsed:	20181116 12:30:47.990 / 20181116 12:32:32.475 / 00:01:44.485

00:00:00.226 KEYWORD ${output} = KarafKeywords . Issue_Command_On_Karaf_Console ${TEP_SHOW}

Documentation:	Will execute the given ${cmd} by ssh'ing to the karaf console running on 192.0.2.19
Start / End / Elapsed:	20181116 12:30:47.998 / 20181116 12:30:48.224 / 00:00:00.226

00:00:04.523 KEYWORD Create Neutron Networks ${REQ_NUM_NET}

Documentation:	Create required number of networks
Start / End / Elapsed:	20181116 12:30:48.224 / 20181116 12:30:52.747 / 00:00:04.523

00:00:05.226 KEYWORD Create Neutron Subnets ${REQ_NUM_SUBNET}

Documentation:	Create required number of subnets for previously created networks
Start / End / Elapsed:	20181116 12:30:52.747 / 20181116 12:30:57.973 / 00:00:05.226

00:00:16.528 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}

Documentation:	Allow all TCP/UDP/ICMP packets for this suite
Start / End / Elapsed:	20181116 12:30:57.973 / 20181116 12:31:14.501 / 00:00:16.528

00:00:11.763 KEYWORD Create Neutron Ports

Documentation:	Create required number of ports under previously created subnets
Start / End / Elapsed:	20181116 12:31:14.501 / 20181116 12:31:26.264 / 00:00:11.763

00:00:02.176 KEYWORD OpenStackOperations . Create Router ${REQ_ROUTER}

Documentation:	Create Router and Add Interface to the subnets.
Start / End / Elapsed:	20181116 12:31:26.264 / 20181116 12:31:28.440 / 00:00:02.176

00:00:14.665 KEYWORD Add Interfaces To Routers

Documentation:	Add Multiple Interfaces to Router and Verify
Start / End / Elapsed:	20181116 12:31:28.440 / 20181116 12:31:43.105 / 00:00:14.665

00:00:46.531 KEYWORD Create Nova VMs ${REQ_NUM_OF_VMS_PER_DPN}

Documentation:	Create Vm instances on compute nodes
Start / End / Elapsed:	20181116 12:31:43.105 / 20181116 12:32:29.636 / 00:00:46.531

00:00:02.442 KEYWORD ${router_id} = OpenStackOperations . Get Router Id ${REQ_ROUTER}

Documentation:	Retrieve the router id for the given router name
Start / End / Elapsed:	20181116 12:32:29.636 / 20181116 12:32:32.078 / 00:00:02.442

00:00:00.000 KEYWORD BuiltIn . Set Suite Variable ${router_id}

Documentation:	Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed:	20181116 12:32:32.079 / 20181116 12:32:32.079 / 00:00:00.000

00:00:00.210 KEYWORD VpnOperations . VPN Create L3VPN vpnid=${VPN_INSTANCE_ID}, name=${VPN_NAME}, rd=${L3VPN_RD}, exportrt=${L3VPN_RD}, importrt=${L3VPN_RD}

Documentation:	Create an L3VPN using the Json using the list of optional arguments received.
Start / End / Elapsed:	20181116 12:32:32.080 / 20181116 12:32:32.290 / 00:00:00.210

00:00:00.184 KEYWORD VpnOperations . Associate VPN to Router routerid=${router_id}, vpnid=${VPN_INSTANCE_ID}

Documentation:	Associate the created L3VPN to a router-id received as argument
Start / End / Elapsed:	20181116 12:32:32.290 / 20181116 12:32:32.474 / 00:00:00.184

00:00:00.160 KEYWORD CompareStream . Run_Keyword_If_At_Least_Fluorine TemplatedRequests.Post_As_Json_Templated, folder=${VAR_BASE}/assoc_two_router_l3vpn, mapping=${Kwargs}, session=default, http_timeout=${SESSION_TIMEOUT}

Documentation:	Compare fluorine to fluorine and in case fluorine is at least fluorine,
Start / End / Elapsed:	20181116 12:32:32.314 / 20181116 12:32:32.474 / 00:00:00.160

00:00:00.159 KEYWORD BuiltIn . Run Keyword And Return Run_Keyword_If_At_Least, fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:32:32.315 / 20181116 12:32:32.474 / 00:00:00.159

00:00:00.132 KEYWORD CompareStream . Run_Keyword_If_At_Least fluorine, ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound},
Start / End / Elapsed:	20181116 12:32:32.342 / 20181116 12:32:32.474 / 00:00:00.132

00:00:00.131 KEYWORD BuiltIn . Run Keyword And Return If &{Stream_dict}[${ODL_STREAM}] >= &{Stream_dict}[${lower_bound}], ${kw_name}, @{varargs}, &{kwargs}

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:32:32.343 / 20181116 12:32:32.474 / 00:00:00.131

00:00:00.109 KEYWORD TemplatedRequests . Post_As_Json_Templated @{varargs}, &{kwargs}

Documentation:	Add arguments sensible for JSON data, return Post_Templated response text.
Start / End / Elapsed:	20181116 12:32:32.364 / 20181116 12:32:32.473 / 00:00:00.109

00:00:00.108 KEYWORD ${response_text} = TemplatedRequests . Post_Templated folder=${folder}, base_name=data, extension=json, accept=${ACCEPT_EMPTY}, content_type=${HEADERS_YANG_JSON}, mapping=${mapping}, session=${session}, normalize_json=True, endline=${\n}, iterations=${iterations}, iter_start=${iter_start}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	Resolve URI and data from folder, call Post_To_Uri, return response text.
Start / End / Elapsed:	20181116 12:32:32.365 / 20181116 12:32:32.473 / 00:00:00.108

00:00:00.028 KEYWORD ${uri} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, base_name=location, extension=uri, mapping=${mapping}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:32:32.373 / 20181116 12:32:32.401 / 00:00:00.028

00:00:00.028 KEYWORD ${data} = TemplatedRequests . Resolve_Text_From_Template_Folder folder=${folder}, name_prefix=post_, base_name=${base_name}, extension=${extension}, mapping=${mapping}, endline=${endline}, iterations=${iterations}, iter_start=${iter_start}

Documentation:	Read a template from folder, strip endline, make changes according to mapping, return the result.
Start / End / Elapsed:	20181116 12:32:32.408 / 20181116 12:32:32.436 / 00:00:00.028

00:00:00.007 KEYWORD ${jmes_expression} = TemplatedRequests . Resolve_Jmes_Path ${folder}

Documentation:	Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//assoc_two_router_l3vpn/jmespath.expr if the file exists and
Start / End / Elapsed:	20181116 12:32:32.436 / 20181116 12:32:32.443 / 00:00:00.007

00:00:00.029 KEYWORD ${response_text} = TemplatedRequests . Post_To_Uri uri=${uri}, data=${data}, content_type=${content_type}, accept=${accept}, session=${session}, jmes_path=${jmes_expression}, normalize_json=${normalize_json}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}, http_timeout=${http_timeout}

Documentation:	POST data to given URI, check status code and return response text.
Start / End / Elapsed:	20181116 12:32:32.444 / 20181116 12:32:32.473 / 00:00:00.029

00:00:00.001 KEYWORD BuiltIn . Log ${uri}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.446 / 20181116 12:32:32.447 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Log ${data}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.447 / 20181116 12:32:32.448 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Log ${content_type}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.448 / 20181116 12:32:32.449 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Log ${accept}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.449 / 20181116 12:32:32.450 / 00:00:00.001

00:00:00.007 KEYWORD ${headers} = TemplatedRequests . Join_Two_Headers first=${content_type}, second=${accept}

Documentation:	Take two dicts, join them, return result. Second argument values take precedence.
Start / End / Elapsed:	20181116 12:32:32.450 / 20181116 12:32:32.457 / 00:00:00.007

00:00:00.009 KEYWORD ${response} = BuiltIn . Run Keyword If """${http_timeout}""" == """${EMPTY}""", RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, ELSE, RequestsLibrary.Post_Request, alias=${session}, uri=${uri}, data=${data}, headers=${headers}, timeout=${http_timeout}

Documentation:	Runs the given keyword with the given arguments, if `condition` is true.
Start / End / Elapsed:	20181116 12:32:32.457 / 20181116 12:32:32.466 / 00:00:00.009

00:00:00.007 KEYWORD TemplatedRequests . Check_Status_Code ${response}, additional_allowed_status_codes=${additional_allowed_status_codes}, explicit_status_codes=${explicit_status_codes}

Documentation:	Log response text, check status_code is one of allowed ones.
Start / End / Elapsed:	20181116 12:32:32.466 / 20181116 12:32:32.473 / 00:00:00.007

00:00:00.001 KEYWORD BuiltIn . Log ${response.text}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.467 / 20181116 12:32:32.468 / 00:00:00.001

00:00:00.001 KEYWORD BuiltIn . Log ${response.status_code}

Documentation:	Logs the given message with the given level.
Start / End / Elapsed:	20181116 12:32:32.468 / 20181116 12:32:32.469 / 00:00:00.001

Documentation:	Runs the specified keyword and returns from the enclosing user keyword.
Start / End / Elapsed:	20181116 12:32:32.469 / 20181116 12:32:32.470 / 00:00:00.001

00:00:00.001 KEYWORD ${final_allowd_list} = Collections . Combine Lists ${ALLOWED_STATUS_CODES}, ${additional_allowed_status_codes}

Documentation:	Combines the given `lists` together and returns the result.
Start / End / Elapsed:	20181116 12:32:32.470 / 20181116 12:32:32.471 / 00:00:00.001

00:00:00.001 KEYWORD Collections . List Should Contain Value ${final_allowd_list}, ${response.status_code}

Documentation:	Fails if the `value` is not found from `list`.
Start / End / Elapsed:	20181116 12:32:32.471 / 20181116 12:32:32.472 / 00:00:00.001

12:32:32.472

FAIL

[ 200 | 201 | 204 ] does not contain value '400'.

00:01:47.131 TEARDOWN OpenStackOperations . OpenStack Suite Teardown

Documentation:	Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed:	20181116 12:32:32.489 / 20181116 12:34:19.620 / 00:01:47.131

00:00:00.001 TEST Verify that table Miss entry for GWMAC table 19 points to table 17 dispatcher table

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify that table Miss entry for GWMAC table 19 points to table 17 dispatcher table
Documentation:	To Verify there should be an entry for table=17,in the table=19 DUMP_FLOWS
Start / End / Elapsed:	20181116 12:32:32.475 / 20181116 12:32:32.476 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify the pipeline flow from dispatcher table 17 (L3VPN) to table 19

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify the pipeline flow from dispatcher table 17 (L3VPN) to table 19
Documentation:	To Verify the end to end pipeline flow from table=17 to table=19 DUMP_FLOWS
Start / End / Elapsed:	20181116 12:32:32.477 / 20181116 12:32:32.478 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify that ARP requests and ARP response received on GWMAC table are punted to controller for learning ,resubmitted to table 17,sent to ARP responder

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify that ARP requests and ARP response received on GWMAC table are punted to controller for learning ,resubmitted to table 17,sent to ARP responder
Documentation:	To verify the ARP Request and ARP response entry should be there after the dump_groups and dispatcher table should point to ARP responder
Start / End / Elapsed:	20181116 12:32:32.478 / 20181116 12:32:32.479 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify that table miss entry for table 17 should not point to table 81 arp table

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify that table miss entry for table 17 should not point to table 81 arp table
Documentation:	To Verify there should not be an entry for the arp_responder_table in table=17
Start / End / Elapsed:	20181116 12:32:32.479 / 20181116 12:32:32.480 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify that Multiple GWMAC entries in GWMAC table points to FIB table 21 (L3VPN pipeline)

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify that Multiple GWMAC entries in GWMAC table points to FIB table 21 (L3VPN pipeline)
Documentation:	To Verify the one or more default gateway mac enteries on the table=19 flows that points to FIB table 21
Start / End / Elapsed:	20181116 12:32:32.481 / 20181116 12:32:32.482 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify table miss entry of ARP responder table points to drop actions

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify table miss entry of ARP responder table points to drop actions
Documentation:	To Verify the default flow entry of table=81 drops when openflow controller connected to compute node
Start / End / Elapsed:	20181116 12:32:32.482 / 20181116 12:32:32.483 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify ARP eth_type entries and actions for ARP request and ARP response are populated on GWMAC table

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify ARP eth_type entries and actions for ARP request and ARP response are populated on GWMAC table
Documentation:	To Verify the entry of ARP request(arp=1) and ARP response(arp=2) in table=19
Start / End / Elapsed:	20181116 12:32:32.484 / 20181116 12:32:32.485 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify GWMAC entires are populated with Neutron Router MAC address per network in GWMAC table

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify GWMAC entires are populated with Neutron Router MAC address per network in GWMAC table
Documentation:	To Verify gateway mac entires are populated with neutron router mac address for network with vpn dissociation from router
Start / End / Elapsed:	20181116 12:32:32.485 / 20181116 12:32:32.486 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.001 TEST Verify GWMAC entires are populated with port MAC address for network with vpn association to router in GWMAC table

Full Name:	CSIT.L2L3 Gatewaymac Arp.Verify GWMAC entires are populated with port MAC address for network with vpn association to router in GWMAC table
Documentation:	To Verify gateway mac entires are populated with port MAC address for network with vpn association to router
Start / End / Elapsed:	20181116 12:32:32.486 / 20181116 12:32:32.487 / 00:00:00.001
Status:	FAIL (critical)
Message:	Parent suite setup failed: [ 200 \| 201 \| 204 ] does not contain value '400'.

00:00:00.015 SUITE Create JVM Plots

Full Name:	CSIT.Create JVM Plots
Documentation:	Test suite to Plot JVM Resources
Source:	/home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot
Start / End / Elapsed:	20181116 12:34:19.626 / 20181116 12:34:19.641 / 00:00:00.015
Status:	1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed

Opening Robot Framework log failed

CSIT Test Log

Test Statistics

Test Execution Errors

Test Execution Log