Total Statistics | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
Critical Tests | 152 | 135 | 17 | 00:43:20 | |
All Tests | 152 | 135 | 17 | 00:43:20 |
Statistics by Tag | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
NON_GATE | 26 | 26 | 0 | 00:06:54 | |
Regression | 4 | 4 | 0 | 00:00:49 | |
skip_if_conntrack | 25 | 25 | 0 | 00:07:35 | |
skip_if_stateful | 34 | 34 | 0 | 00:05:38 |
Statistics by Suite | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
152 | 135 | 17 | 01:29:43 | ||
14 | 14 | 0 | 00:07:49 | ||
27 | 27 | 0 | 00:15:02 | ||
25 | 25 | 0 | 00:13:36 | ||
34 | 34 | 0 | 00:09:05 | ||
4 | 4 | 0 | 00:02:33 | ||
6 | 6 | 0 | 00:07:22 | ||
24 | 19 | 5 | 00:16:05 | ||
5 | 5 | 0 | 00:08:31 | ||
3 | 0 | 3 | 00:05:23 | ||
9 | 0 | 9 | 00:04:17 | ||
1 | 1 | 0 | 00:00:00 |
Full Name: | CSIT |
---|---|
Start / End / Elapsed: | 20181119 10:49:08.210 / 20181119 12:18:50.811 / 01:29:42.601 |
Status: | 152 critical test, 135 passed, 17 failed 152 test total, 135 passed, 17 failed |
Full Name: | CSIT.L2 |
---|---|
Documentation: | Test suite to verify packet flows between vm instances. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot |
Start / End / Elapsed: | 20181119 10:49:08.227 / 20181119 10:56:56.822 / 00:07:48.595 |
Status: | 14 critical test, 14 passed, 0 failed 14 test total, 14 passed, 0 failed |
Full Name: | CSIT.L3 |
---|---|
Documentation: | Test suite to check connectivity in L3 using routers. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot |
Start / End / Elapsed: | 20181119 10:56:56.828 / 20181119 11:11:58.846 / 00:15:02.018 |
Status: | 27 critical test, 27 passed, 0 failed 27 test total, 27 passed, 0 failed |
Full Name: | CSIT.External Network |
---|---|
Documentation: | Test suite to check North-South connectivity in L3 using a router and an external network |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot |
Start / End / Elapsed: | 20181119 11:11:58.856 / 20181119 11:25:34.669 / 00:13:35.813 |
Status: | 25 critical test, 25 passed, 0 failed 25 test total, 25 passed, 0 failed |
Full Name: | CSIT.Security Group |
---|---|
Documentation: | Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot |
Start / End / Elapsed: | 20181119 11:25:34.678 / 20181119 11:34:39.570 / 00:09:04.892 |
Status: | 34 critical test, 34 passed, 0 failed 34 test total, 34 passed, 0 failed |
Full Name: | CSIT.Neutron Security Group |
---|---|
Documentation: | Test Suite for Neutron Security Group |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot |
Start / End / Elapsed: | 20181119 11:34:39.582 / 20181119 11:37:12.311 / 00:02:32.729 |
Status: | 4 critical test, 4 passed, 0 failed 4 test total, 4 passed, 0 failed |
Full Name: | CSIT.Security Group L3Bcast |
---|---|
Documentation: | Test Suite for Network and Subnet Broadcast with security group |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot |
Start / End / Elapsed: | 20181119 11:37:12.316 / 20181119 11:44:34.813 / 00:07:22.497 |
Status: | 6 critical test, 6 passed, 0 failed 6 test total, 6 passed, 0 failed |
Full Name: | CSIT.Vpn Basic |
---|---|
Documentation: | Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot |
Start / End / Elapsed: | 20181119 11:44:34.819 / 20181119 12:00:40.006 / 00:16:05.187 |
Status: | 24 critical test, 19 passed, 5 failed 24 test total, 19 passed, 5 failed |
Start / End / Elapsed: | 20181119 11:44:34.968 / 20181119 11:47:43.413 / 00:03:08.445 |
---|
Documentation: | Delete the setup |
---|---|
Start / End / Elapsed: | 20181119 11:59:06.743 / 20181119 12:00:40.006 / 00:01:33.263 |
Full Name: | CSIT.Vpn Basic.Check ELAN Datapath Traffic Within The Networks |
---|---|
Documentation: | Checks datapath within the same network with different vlans. |
Start / End / Elapsed: | 20181119 11:47:43.413 / 20181119 11:47:57.981 / 00:00:14.568 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Create Router |
---|---|
Start / End / Elapsed: | 20181119 11:47:57.981 / 20181119 11:48:05.796 / 00:00:07.815 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Add Interfaces To Router |
---|---|
Start / End / Elapsed: | 20181119 11:48:05.796 / 20181119 11:48:24.689 / 00:00:18.893 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Check L3_Datapath Traffic Across Networks With Router |
---|---|
Start / End / Elapsed: | 20181119 11:48:24.689 / 20181119 11:49:06.031 / 00:00:41.342 |
Status: | FAIL (critical) |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. |
---|---|
Start / End / Elapsed: | 20181119 11:48:24.690 / 20181119 11:48:24.772 / 00:00:00.082 |
Documentation: | Wrapper keyword around the TcpDump packet capture that is catered to the Openstack setup. |
---|---|
Start / End / Elapsed: | 20181119 11:48:24.772 / 20181119 11:48:25.082 / 00:00:00.310 |
Documentation: | Returns a list containing given items. |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.082 / 20181119 11:48:25.083 / 00:00:00.001 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.083 / 20181119 11:48:25.105 / 00:00:00.022 |
Documentation: | Verify Flows Are Present For L3VPN On All Compute Nodes |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.105 / 20181119 11:48:25.511 / 00:00:00.406 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.512 / 20181119 11:48:25.520 / 00:00:00.008 |
Documentation: | Verify the GWMAC Table, ARP Response table and Dispatcher table. |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.521 / 20181119 11:48:59.442 / 00:00:33.921 |
Start / End / Elapsed: | 20181119 11:48:25.521 / 20181119 11:48:59.441 / 00:00:33.920 |
---|
Start / End / Elapsed: | 20181119 11:48:25.521 / 20181119 11:48:59.441 / 00:00:33.920 |
---|
Documentation: | Runs the specified keyword and retries if it fails. 3 failing steps removed using --RemoveKeywords option. |
---|---|
Start / End / Elapsed: | 20181119 11:48:25.521 / 20181119 11:48:59.441 / 00:00:33.920 |
Documentation: | Verify the GWMAC Table, ARP Response table and Dispatcher table. |
---|---|
Start / End / Elapsed: | 20181119 11:48:58.351 / 20181119 11:48:59.441 / 00:00:01.090 |
Documentation: | Reduces the common work of running a command on a remote system to a single higher level |
---|---|
Start / End / Elapsed: | 20181119 11:48:58.352 / 20181119 11:48:58.906 / 00:00:00.554 |
Documentation: | Reduces the common work of running a command on a remote system to a single higher level |
---|---|
Start / End / Elapsed: | 20181119 11:48:58.906 / 20181119 11:48:59.358 / 00:00:00.452 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.359 / 20181119 11:48:59.359 / 00:00:00.000 |
Documentation: | Returns lines of the given |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.359 / 20181119 11:48:59.361 / 00:00:00.002 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.361 / 20181119 11:48:59.361 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.362 / 20181119 11:48:59.362 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.362 / 20181119 11:48:59.363 / 00:00:00.001 |
Documentation: | Returns lines of the given |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.363 / 20181119 11:48:59.364 / 00:00:00.001 |
Start / End / Elapsed: | 20181119 11:48:59.364 / 20181119 11:48:59.366 / 00:00:00.002 |
---|
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.367 / 20181119 11:48:59.367 / 00:00:00.000 |
Documentation: | Returns lines of the given |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.367 / 20181119 11:48:59.368 / 00:00:00.001 |
Documentation: | Compare oxygen to fluorine and in case fluorine is at most oxygen, |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.383 / 20181119 11:48:59.403 / 00:00:00.020 |
Documentation: | Compare fluorine to fluorine and in case fluorine is at least fluorine, |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.417 / 20181119 11:48:59.441 / 00:00:00.024 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.418 / 20181119 11:48:59.441 / 00:00:00.023 |
Documentation: | Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound}, |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.438 / 20181119 11:48:59.441 / 00:00:00.003 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:48:59.439 / 20181119 11:48:59.441 / 00:00:00.002 |
Full Name: | CSIT.Vpn Basic.Add Multiple Extra Routes And Check Datapath Before L3VPN Creation |
---|---|
Start / End / Elapsed: | 20181119 11:49:06.031 / 20181119 11:49:37.520 / 00:00:31.489 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete Extra Route |
---|---|
Start / End / Elapsed: | 20181119 11:49:37.520 / 20181119 11:49:49.459 / 00:00:11.939 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete And Recreate Extra Route |
---|---|
Documentation: | Recreate multiple extra route and check data path before L3VPN creation |
Start / End / Elapsed: | 20181119 11:49:49.460 / 20181119 11:50:12.467 / 00:00:23.007 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Create L3VPN |
---|---|
Start / End / Elapsed: | 20181119 11:50:12.468 / 20181119 11:50:21.517 / 00:00:09.049 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Associate L3VPN To Routers |
---|---|
Start / End / Elapsed: | 20181119 11:50:21.518 / 20181119 11:50:30.955 / 00:00:09.437 |
Status: | FAIL (critical) |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. |
---|---|
Start / End / Elapsed: | 20181119 11:50:21.519 / 20181119 11:50:21.611 / 00:00:00.092 |
Documentation: | Retrieve the router id for the given router name |
---|---|
Start / End / Elapsed: | 20181119 11:50:21.611 / 20181119 11:50:24.038 / 00:00:02.427 |
Documentation: | Associate the created L3VPN to a router-id received as argument |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.038 / 20181119 11:50:24.209 / 00:00:00.171 |
Documentation: | Compare fluorine to fluorine and in case fluorine is at least fluorine, |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.056 / 20181119 11:50:24.209 / 00:00:00.153 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.058 / 20181119 11:50:24.209 / 00:00:00.151 |
Documentation: | Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound}, |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.080 / 20181119 11:50:24.209 / 00:00:00.129 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.081 / 20181119 11:50:24.208 / 00:00:00.127 |
Documentation: | Add arguments sensible for JSON data, return Post_Templated response text. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.110 / 20181119 11:50:24.208 / 00:00:00.098 |
Documentation: | Resolve URI and data from folder, call Post_To_Uri, return response text. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.111 / 20181119 11:50:24.208 / 00:00:00.097 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.120 / 20181119 11:50:24.153 / 00:00:00.033 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.161 / 20181119 11:50:24.190 / 00:00:00.029 |
Documentation: | Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//assoc_two_router_l3vpn/jmespath.expr if the file exists and |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.190 / 20181119 11:50:24.193 / 00:00:00.003 |
Documentation: | POST data to given URI, check status code and return response text. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.193 / 20181119 11:50:24.208 / 00:00:00.015 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.194 / 20181119 11:50:24.194 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.194 / 20181119 11:50:24.195 / 00:00:00.001 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.195 / 20181119 11:50:24.195 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.195 / 20181119 11:50:24.196 / 00:00:00.001 |
Documentation: | Take two dicts, join them, return result. Second argument values take precedence. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.196 / 20181119 11:50:24.199 / 00:00:00.003 |
Documentation: | Runs the given keyword with the given arguments, if |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.199 / 20181119 11:50:24.205 / 00:00:00.006 |
Documentation: | Log response text, check status_code is one of allowed ones. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.205 / 20181119 11:50:24.208 / 00:00:00.003 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.205 / 20181119 11:50:24.206 / 00:00:00.001 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.206 / 20181119 11:50:24.206 / 00:00:00.000 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.206 / 20181119 11:50:24.207 / 00:00:00.001 |
Documentation: | Combines the given |
---|---|
Start / End / Elapsed: | 20181119 11:50:24.207 / 20181119 11:50:24.207 / 00:00:00.000 |
Full Name: | CSIT.Vpn Basic.Verify L3VPN Datapath With Router Association |
---|---|
Start / End / Elapsed: | 20181119 11:50:30.955 / 20181119 11:51:37.333 / 00:01:06.378 |
Status: | FAIL (critical) |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. |
---|---|
Start / End / Elapsed: | 20181119 11:50:30.956 / 20181119 11:50:31.034 / 00:00:00.078 |
Documentation: | Returns a list containing given items. |
---|---|
Start / End / Elapsed: | 20181119 11:50:31.035 / 20181119 11:50:31.035 / 00:00:00.000 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20181119 11:50:31.036 / 20181119 11:50:31.068 / 00:00:00.032 |
Documentation: | Remove leading and/or trailing whitespaces from the given string. |
---|---|
Start / End / Elapsed: | 20181119 11:50:31.068 / 20181119 11:50:31.069 / 00:00:00.001 |
Documentation: | Runs the specified keyword and retries if it fails. 4 failing steps removed using --RemoveKeywords option. |
---|---|
Start / End / Elapsed: | 20181119 11:50:31.069 / 20181119 11:51:31.237 / 00:01:00.168 |
Documentation: | A GET is made at the supplied ${URI} and every item in the list of |
---|---|
Start / End / Elapsed: | 20181119 11:51:31.215 / 20181119 11:51:31.237 / 00:00:00.022 |
Documentation: | Send a GET request on the session object found using the |
---|---|
Start / End / Elapsed: | 20181119 11:51:31.216 / 20181119 11:51:31.231 / 00:00:00.015 |
Documentation: | Runs the given keyword with the given arguments, if |
---|---|
Start / End / Elapsed: | 20181119 11:51:31.231 / 20181119 11:51:31.233 / 00:00:00.002 |
Documentation: | Fails if objects are unequal after converting them to strings. |
---|---|
Start / End / Elapsed: | 20181119 11:51:31.234 / 20181119 11:51:31.234 / 00:00:00.000 |
Start / End / Elapsed: | 20181119 11:51:31.235 / 20181119 11:51:31.236 / 00:00:00.001 |
---|
Start / End / Elapsed: | 20181119 11:51:31.235 / 20181119 11:51:31.236 / 00:00:00.001 |
---|
Full Name: | CSIT.Vpn Basic.Delete Router Failure When Associated With L3VPN |
---|---|
Start / End / Elapsed: | 20181119 11:51:37.334 / 20181119 11:51:52.638 / 00:00:15.304 |
Status: | FAIL (critical) |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. |
---|---|
Start / End / Elapsed: | 20181119 11:51:37.335 / 20181119 11:51:37.424 / 00:00:00.089 |
Documentation: | Retrieve the router id for the given router name |
---|---|
Start / End / Elapsed: | 20181119 11:51:37.424 / 20181119 11:51:39.907 / 00:00:02.483 |
Documentation: | Runs the given command in the system and returns the RC and output. |
---|---|
Start / End / Elapsed: | 20181119 11:51:39.907 / 20181119 11:51:42.369 / 00:00:02.462 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:51:42.369 / 20181119 11:51:42.370 / 00:00:00.001 |
Documentation: | Fails if the given condition is not true. |
---|---|
Start / End / Elapsed: | 20181119 11:51:42.371 / 20181119 11:51:42.371 / 00:00:00.000 |
Documentation: | List Routers and return output with neutron client. |
---|---|
Start / End / Elapsed: | 20181119 11:51:42.371 / 20181119 11:51:44.538 / 00:00:02.167 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:51:44.538 / 20181119 11:51:44.539 / 00:00:00.001 |
Documentation: | Returns a list containing given items. |
---|---|
Start / End / Elapsed: | 20181119 11:51:44.539 / 20181119 11:51:44.539 / 00:00:00.000 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20181119 11:51:44.540 / 20181119 11:51:44.570 / 00:00:00.030 |
Documentation: | Will return detailed list of the L3VPN_ID received |
---|---|
Start / End / Elapsed: | 20181119 11:51:44.570 / 20181119 11:51:44.747 / 00:00:00.177 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 11:51:44.747 / 20181119 11:51:44.748 / 00:00:00.001 |
Full Name: | CSIT.Vpn Basic.Verify Remove Interface From Router When Associated With L3VPN |
---|---|
Start / End / Elapsed: | 20181119 11:51:52.639 / 20181119 11:52:35.211 / 00:00:42.572 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Verify L3VPN Datapath With Router Dissociation When Interfaces are Added To Router |
---|---|
Start / End / Elapsed: | 20181119 11:52:35.212 / 20181119 11:52:48.229 / 00:00:13.017 |
Status: | FAIL (critical) |
Message: |
Documentation: | Test case setup which explicitly ignores previous failure and logs test case name to Karaf log. |
---|---|
Start / End / Elapsed: | 20181119 11:52:35.213 / 20181119 11:52:35.307 / 00:00:00.094 |
Start / End / Elapsed: | 20181119 11:52:35.307 / 20181119 11:52:39.519 / 00:00:04.212 |
---|
Documentation: | Returns a list containing given items. |
---|---|
Start / End / Elapsed: | 20181119 11:52:39.519 / 20181119 11:52:39.520 / 00:00:00.001 |
Documentation: | Retrieve the router id for the given router name |
---|---|
Start / End / Elapsed: | 20181119 11:52:39.520 / 20181119 11:52:41.853 / 00:00:02.333 |
Documentation: | Dissociate the already associated routers from L3VPN |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.853 / 20181119 11:52:41.994 / 00:00:00.141 |
Documentation: | Compare fluorine to fluorine and in case fluorine is at least fluorine, |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.864 / 20181119 11:52:41.993 / 00:00:00.129 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.865 / 20181119 11:52:41.993 / 00:00:00.128 |
Documentation: | Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound}, |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.880 / 20181119 11:52:41.993 / 00:00:00.113 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.881 / 20181119 11:52:41.993 / 00:00:00.112 |
Documentation: | Add arguments sensible for JSON data, return Post_Templated response text. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.904 / 20181119 11:52:41.993 / 00:00:00.089 |
Documentation: | Resolve URI and data from folder, call Post_To_Uri, return response text. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.905 / 20181119 11:52:41.993 / 00:00:00.088 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.913 / 20181119 11:52:41.941 / 00:00:00.028 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.947 / 20181119 11:52:41.975 / 00:00:00.028 |
Documentation: | Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//dissoc_two_router_l3vpn/jmespath.expr if the file exists and |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.975 / 20181119 11:52:41.978 / 00:00:00.003 |
Documentation: | POST data to given URI, check status code and return response text. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.978 / 20181119 11:52:41.993 / 00:00:00.015 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.979 / 20181119 11:52:41.980 / 00:00:00.001 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.980 / 20181119 11:52:41.980 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.980 / 20181119 11:52:41.980 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.981 / 20181119 11:52:41.981 / 00:00:00.000 |
Documentation: | Take two dicts, join them, return result. Second argument values take precedence. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.981 / 20181119 11:52:41.984 / 00:00:00.003 |
Documentation: | Runs the given keyword with the given arguments, if |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.984 / 20181119 11:52:41.989 / 00:00:00.005 |
Documentation: | Log response text, check status_code is one of allowed ones. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.989 / 20181119 11:52:41.993 / 00:00:00.004 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.990 / 20181119 11:52:41.990 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.991 / 20181119 11:52:41.991 / 00:00:00.000 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.991 / 20181119 11:52:41.991 / 00:00:00.000 |
Documentation: | Combines the given |
---|---|
Start / End / Elapsed: | 20181119 11:52:41.992 / 20181119 11:52:41.992 / 00:00:00.000 |
Full Name: | CSIT.Vpn Basic.Remove Router Interfaces And Check L3_Datapath Traffic Across Networks |
---|---|
Start / End / Elapsed: | 20181119 11:52:48.230 / 20181119 11:54:16.952 / 00:01:28.722 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete Router |
---|---|
Start / End / Elapsed: | 20181119 11:54:16.953 / 20181119 11:54:28.687 / 00:00:11.734 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete Router With NonExistentRouter Name |
---|---|
Documentation: | Delete router with nonExistentRouter name |
Start / End / Elapsed: | 20181119 11:54:28.688 / 20181119 11:54:36.568 / 00:00:07.880 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Associate Networks To L3VPN |
---|---|
Documentation: | Associates L3VPN to networks and verify |
Start / End / Elapsed: | 20181119 11:54:36.569 / 20181119 11:54:48.809 / 00:00:12.240 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Check Datapath Traffic Across Networks With L3VPN |
---|---|
Documentation: | Datapath Test Across the networks with VPN. |
Start / End / Elapsed: | 20181119 11:54:48.809 / 20181119 11:56:00.941 / 00:01:12.132 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Verification of route update after VM port removed and re added to VPN |
---|---|
Documentation: | Verify route update after VM port removed and re added to VPN |
Start / End / Elapsed: | 20181119 11:56:00.941 / 20181119 11:57:32.487 / 00:01:31.546 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Verification of route update after reconfiguring vpn by adding new ports |
---|---|
Documentation: | Verify route update after reconfiguring vpn by creating new VM with new port on openvswitch1 |
Start / End / Elapsed: | 20181119 11:57:32.487 / 20181119 11:58:33.044 / 00:01:00.557 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Dissociate L3VPN From Networks |
---|---|
Documentation: | Dissociate L3VPN from networks |
Start / End / Elapsed: | 20181119 11:58:33.044 / 20181119 11:58:44.211 / 00:00:11.167 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete Unknown L3VPN |
---|---|
Documentation: | Verification of a failure response with deletion of an unknown L3VPN |
Start / End / Elapsed: | 20181119 11:58:44.211 / 20181119 11:58:50.764 / 00:00:06.553 |
Status: | PASS (critical) |
Full Name: | CSIT.Vpn Basic.Delete L3VPN |
---|---|
Documentation: | Delete L3VPN |
Start / End / Elapsed: | 20181119 11:58:50.765 / 20181119 11:58:57.691 / 00:00:06.926 |
Status: | PASS (critical) |
Full Name: | CSIT.Elan |
---|---|
Documentation: | Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot |
Start / End / Elapsed: | 20181119 12:00:40.016 / 20181119 12:09:10.652 / 00:08:30.636 |
Status: | 5 critical test, 5 passed, 0 failed 5 test total, 5 passed, 0 failed |
Full Name: | CSIT.Arp Learning |
---|---|
Documentation: | Test suite for ARP Request. More test cases to be added in subsequent patches. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot |
Start / End / Elapsed: | 20181119 12:09:10.658 / 20181119 12:14:33.277 / 00:05:22.619 |
Status: | 3 critical test, 0 passed, 3 failed 3 test total, 0 passed, 3 failed |
Message: |
Documentation: | Suite Setup to create the necessary resources. |
---|---|
Start / End / Elapsed: | 20181119 12:09:10.740 / 20181119 12:12:17.331 / 00:03:06.591 |
Start / End / Elapsed: | 20181119 12:09:10.740 / 20181119 12:09:57.157 / 00:00:46.417 |
---|
Start / End / Elapsed: | 20181119 12:09:57.157 / 20181119 12:10:04.427 / 00:00:07.270 |
---|
Documentation: | List networks and return output with neutron client. |
---|---|
Start / End / Elapsed: | 20181119 12:10:04.427 / 20181119 12:10:06.448 / 00:00:02.021 |
Start / End / Elapsed: | 20181119 12:10:06.449 / 20181119 12:10:06.452 / 00:00:00.003 |
---|
Documentation: | Retrieve the net id for the given network name to create specific vm instance |
---|---|
Start / End / Elapsed: | 20181119 12:10:06.452 / 20181119 12:10:08.504 / 00:00:02.052 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20181119 12:10:08.504 / 20181119 12:10:08.505 / 00:00:00.001 |
Start / End / Elapsed: | 20181119 12:10:08.505 / 20181119 12:10:16.281 / 00:00:07.776 |
---|
Documentation: | List subnets and return output with neutron client. |
---|---|
Start / End / Elapsed: | 20181119 12:10:16.281 / 20181119 12:10:18.455 / 00:00:02.174 |
Start / End / Elapsed: | 20181119 12:10:18.455 / 20181119 12:10:18.457 / 00:00:00.002 |
---|
Documentation: | Allow all TCP/UDP/ICMP packets for this suite |
---|---|
Start / End / Elapsed: | 20181119 12:10:18.457 / 20181119 12:10:34.274 / 00:00:15.817 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:34.275 / 20181119 12:10:37.519 / 00:00:03.244 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:37.519 / 20181119 12:10:40.355 / 00:00:02.836 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:40.356 / 20181119 12:10:43.396 / 00:00:03.040 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:43.396 / 20181119 12:10:46.261 / 00:00:02.865 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:46.262 / 20181119 12:10:49.384 / 00:00:03.122 |
Documentation: | Create Port with neutron request. |
---|---|
Start / End / Elapsed: | 20181119 12:10:49.384 / 20181119 12:10:52.262 / 00:00:02.878 |
Documentation: | Runs the specified keyword and retries if it fails. |
---|---|
Start / End / Elapsed: | 20181119 12:10:52.263 / 20181119 12:10:52.304 / 00:00:00.041 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:10:52.324 / 20181119 12:10:56.573 / 00:00:04.249 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:10:56.590 / 20181119 12:11:02.149 / 00:00:05.559 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:11:02.181 / 20181119 12:11:07.235 / 00:00:05.054 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:11:07.254 / 20181119 12:11:12.579 / 00:00:05.325 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:11:12.604 / 20181119 12:11:18.322 / 00:00:05.718 |
Documentation: | Create One VM instance using given ${port_name} and for given ${node_hostname} |
---|---|
Start / End / Elapsed: | 20181119 12:11:18.345 / 20181119 12:11:24.280 / 00:00:05.935 |
Documentation: | Get the instance IP addresses and nameserver address for the list of given vms. |
---|---|
Start / End / Elapsed: | 20181119 12:11:24.280 / 20181119 12:11:39.783 / 00:00:15.503 |
Documentation: | Get the instance IP addresses and nameserver address for the list of given vms. |
---|---|
Start / End / Elapsed: | 20181119 12:11:39.783 / 20181119 12:11:51.692 / 00:00:11.909 |
Documentation: | Get the instance IP addresses and nameserver address for the list of given vms. |
---|---|
Start / End / Elapsed: | 20181119 12:11:51.693 / 20181119 12:12:03.894 / 00:00:12.201 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.895 / 20181119 12:12:03.895 / 00:00:00.000 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.895 / 20181119 12:12:03.896 / 00:00:00.001 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.897 / 20181119 12:12:03.897 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.898 / 20181119 12:12:03.898 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.899 / 20181119 12:12:03.899 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.899 / 20181119 12:12:03.900 / 00:00:00.001 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.900 / 20181119 12:12:03.900 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.901 / 20181119 12:12:03.901 / 00:00:00.000 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.901 / 20181119 12:12:03.901 / 00:00:00.000 |
Documentation: | Create Router and Add Interface to the subnets. |
---|---|
Start / End / Elapsed: | 20181119 12:12:03.902 / 20181119 12:12:06.056 / 00:00:02.154 |
Start / End / Elapsed: | 20181119 12:12:06.057 / 20181119 12:12:09.869 / 00:00:03.812 |
---|
Start / End / Elapsed: | 20181119 12:12:09.869 / 20181119 12:12:14.174 / 00:00:04.305 |
---|
Documentation: | Returns tenant ID by reading it from existing network. |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.175 / 20181119 12:12:14.208 / 00:00:00.033 |
Documentation: | Create an L3VPN using the Json using the list of optional arguments received. |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.208 / 20181119 12:12:14.379 / 00:00:00.171 |
Documentation: | Will return detailed list of the L3VPN_ID received |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.380 / 20181119 12:12:14.503 / 00:00:00.123 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.503 / 20181119 12:12:14.503 / 00:00:00.000 |
Start / End / Elapsed: | 20181119 12:12:14.503 / 20181119 12:12:17.331 / 00:00:02.828 |
---|
Documentation: | Associate the created L3VPN to a network-id received as dictionary argument |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.504 / 20181119 12:12:14.659 / 00:00:00.155 |
Documentation: | Will return detailed list of the L3VPN_ID received |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.660 / 20181119 12:12:14.785 / 00:00:00.125 |
Documentation: | Fails if |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.785 / 20181119 12:12:14.786 / 00:00:00.001 |
Documentation: | Retrieve the router id for the given router name |
---|---|
Start / End / Elapsed: | 20181119 12:12:14.786 / 20181119 12:12:17.130 / 00:00:02.344 |
Documentation: | Makes a variable available everywhere within the scope of the current suite. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.130 / 20181119 12:12:17.131 / 00:00:00.001 |
Documentation: | Associate the created L3VPN to a router-id received as argument |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.131 / 20181119 12:12:17.331 / 00:00:00.200 |
Documentation: | Compare fluorine to fluorine and in case fluorine is at least fluorine, |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.143 / 20181119 12:12:17.331 / 00:00:00.188 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.143 / 20181119 12:12:17.331 / 00:00:00.188 |
Documentation: | Compare ${lower_bound} to fluorine and in case fluorine is at least ${lower_bound}, |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.158 / 20181119 12:12:17.331 / 00:00:00.173 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.159 / 20181119 12:12:17.331 / 00:00:00.172 |
Documentation: | Add arguments sensible for JSON data, return Post_Templated response text. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.186 / 20181119 12:12:17.331 / 00:00:00.145 |
Documentation: | Resolve URI and data from folder, call Post_To_Uri, return response text. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.188 / 20181119 12:12:17.330 / 00:00:00.142 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.198 / 20181119 12:12:17.258 / 00:00:00.060 |
Documentation: | Read a template from folder, strip endline, make changes according to mapping, return the result. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.269 / 20181119 12:12:17.307 / 00:00:00.038 |
Documentation: | Reads JMES path from file /home/opnfv/repos/odl_test/csit/libraries/../variables/vpnservice//assoc_two_router_l3vpn/jmespath.expr if the file exists and |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.307 / 20181119 12:12:17.311 / 00:00:00.004 |
Documentation: | POST data to given URI, check status code and return response text. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.311 / 20181119 12:12:17.330 / 00:00:00.019 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.312 / 20181119 12:12:17.313 / 00:00:00.001 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.313 / 20181119 12:12:17.313 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.314 / 20181119 12:12:17.314 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.314 / 20181119 12:12:17.315 / 00:00:00.001 |
Documentation: | Take two dicts, join them, return result. Second argument values take precedence. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.315 / 20181119 12:12:17.318 / 00:00:00.003 |
Documentation: | Runs the given keyword with the given arguments, if |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.319 / 20181119 12:12:17.325 / 00:00:00.006 |
Documentation: | Log response text, check status_code is one of allowed ones. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.326 / 20181119 12:12:17.330 / 00:00:00.004 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.327 / 20181119 12:12:17.327 / 00:00:00.000 |
Documentation: | Logs the given message with the given level. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.327 / 20181119 12:12:17.328 / 00:00:00.001 |
Documentation: | Runs the specified keyword and returns from the enclosing user keyword. |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.328 / 20181119 12:12:17.328 / 00:00:00.000 |
Documentation: | Combines the given |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.329 / 20181119 12:12:17.329 / 00:00:00.000 |
Documentation: | Delete the setup |
---|---|
Start / End / Elapsed: | 20181119 12:12:17.335 / 20181119 12:14:33.277 / 00:02:15.942 |
Full Name: | CSIT.Arp Learning.Verify Setup |
---|---|
Documentation: | Verify that VMs received ip and ping is happening between different VMs. For this, we ssh to the VM using the dhcp-namespace on the controller node and verify ping reachability to the second VM on the same network and VMs on other network (i.e., east-west routing) |
Start / End / Elapsed: | 20181119 12:12:17.332 / 20181119 12:12:17.333 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.Arp Learning.Verify GARP Requests |
---|---|
Documentation: | Verify that GARP request is sent to controller and controller learns this info. In this test-case, before we validate the GARPs, we ensure that the necessary pipeline flows for the VMs spawned on the networks are as expected (along with the FIB Entries in the ODL Datastore). For triggering GARPs, we create an alias interface (eth0:1) on VM1_net0, configure it with an extra_route_ip, trigger 5 GARPs from the VM for the extra_route_ip and ensure that ODL learns (by looking at odl-fib:fibEntries) the extra_route_ip info with the nexthop pointing to Compute-1 (where VM1_net0 is spawned) hostIP. Finally, we verify ping reachability to the extra_route_ip from other VMs on the network. |
Start / End / Elapsed: | 20181119 12:12:17.333 / 20181119 12:12:17.334 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.Arp Learning.Verify MIP Migration |
---|---|
Documentation: | Verify that after migration of movable ip across compute nodes, the controller updates the routes. Unconfigure the extra_route_ip on VM1_net0 and configure it on vm0_net0 (on Compute-0 host). Trigger 5 GARPs from the VM for the extra_route_ip and ensure that ODL learns/updates the extra_route_ip info with nexthop in the FIB entry pointing to Compute-0 hostip. |
Start / End / Elapsed: | 20181119 12:12:17.334 / 20181119 12:12:17.335 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L2L3 Gatewaymac Arp |
---|---|
Documentation: | Test Suite for Gateway mac based L2L3 seggragation |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot |
Start / End / Elapsed: | 20181119 12:14:33.281 / 20181119 12:18:50.755 / 00:04:17.474 |
Status: | 9 critical test, 0 passed, 9 failed 9 test total, 0 passed, 9 failed |
Message: |
Full Name: | CSIT.Create JVM Plots |
---|---|
Documentation: | Test suite to Plot JVM Resources |
Source: | /home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot |
Start / End / Elapsed: | 20181119 12:18:50.761 / 20181119 12:18:50.788 / 00:00:00.027 |
Status: | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed |