Total Statistics | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
Critical Tests | 153 | 19 | 134 | 00:03:29 | |
All Tests | 153 | 19 | 134 | 00:03:29 |
Statistics by Tag | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
NON_GATE | 26 | 2 | 24 | 00:00:30 | |
Regression | 4 | 4 | 0 | 00:00:52 | |
skip_if_conntrack | 25 | 0 | 25 | 00:00:00 | |
skip_if_stateful | 34 | 0 | 34 | 00:00:00 |
Statistics by Suite | Total | Pass | Fail | Elapsed | Pass / Fail |
---|---|---|---|---|---|
153 | 19 | 134 | 02:02:30 | ||
14 | 14 | 0 | 00:07:30 | ||
27 | 0 | 27 | 00:14:53 | ||
1 | 0 | 1 | 00:01:24 | ||
25 | 0 | 25 | 00:14:06 | ||
34 | 0 | 34 | 00:12:58 | ||
4 | 4 | 0 | 00:02:37 | ||
6 | 0 | 6 | 00:14:12 | ||
24 | 0 | 24 | 00:13:54 | ||
5 | 0 | 5 | 00:12:39 | ||
3 | 0 | 3 | 00:14:18 | ||
9 | 0 | 9 | 00:14:00 | ||
1 | 1 | 0 | 00:00:00 |
Full Name: | CSIT |
---|---|
Start / End / Elapsed: | 20181213 11:58:03.349 / 20181213 14:00:33.760 / 02:02:30.411 |
Status: | 153 critical test, 19 passed, 134 failed 153 test total, 19 passed, 134 failed |
Full Name: | CSIT.L2 |
---|---|
Documentation: | Test suite to verify packet flows between vm instances. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot |
Start / End / Elapsed: | 20181213 11:58:03.365 / 20181213 12:05:33.783 / 00:07:30.418 |
Status: | 14 critical test, 14 passed, 0 failed 14 test total, 14 passed, 0 failed |
Full Name: | CSIT.L3 |
---|---|
Documentation: | Test suite to check connectivity in L3 using routers. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot |
Start / End / Elapsed: | 20181213 12:05:33.789 / 20181213 12:20:26.306 / 00:14:52.517 |
Status: | 27 critical test, 0 passed, 27 failed 27 test total, 0 passed, 27 failed |
Message: |
Start / End / Elapsed: | 20181213 12:05:33.870 / 20181213 12:18:08.954 / 00:12:35.084 |
---|
Documentation: | Wrapper teardown keyword that can be used in any suite running in an openstack environement |
---|---|
Start / End / Elapsed: | 20181213 12:05:33.871 / 20181213 12:06:21.130 / 00:00:47.259 |
Documentation: | Create Network with openstack request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:21.130 / 20181213 12:06:23.452 / 00:00:02.322 |
Documentation: | Create SubNet for the Network with neutron request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:23.452 / 20181213 12:06:26.086 / 00:00:02.634 |
Documentation: | Create Network with openstack request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:26.086 / 20181213 12:06:28.404 / 00:00:02.318 |
Documentation: | Create SubNet for the Network with neutron request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:28.404 / 20181213 12:06:31.125 / 00:00:02.721 |
Documentation: | Create Network with openstack request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:31.125 / 20181213 12:06:33.467 / 00:00:02.342 |
Documentation: | Create SubNet for the Network with neutron request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:33.468 / 20181213 12:06:36.328 / 00:00:02.860 |
Documentation: | Create Network with openstack request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:36.329 / 20181213 12:06:38.663 / 00:00:02.334 |
Documentation: | Create SubNet for the Network with neutron request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:38.663 / 20181213 12:06:41.725 / 00:00:03.062 |
Documentation: | Create Network with openstack request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:41.726 / 20181213 12:06:44.009 / 00:00:02.283 |
Documentation: | Create SubNet for the Network with neutron request. |
---|---|
Start / End / Elapsed: | 20181213 12:06:44.010 / 20181213 12:06:46.600 / 00:00:02.590 |
Documentation: | Allow all TCP/UDP/ICMP packets for this suite |
---|---|
Start / End / Elapsed: | 20181213 12:06:46.600 / 20181213 12:07:03.086 / 00:00:16.486 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:03.086 / 20181213 12:07:10.694 / 00:00:07.608 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:10.695 / 20181213 12:07:16.961 / 00:00:06.266 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:16.961 / 20181213 12:07:24.023 / 00:00:07.062 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:24.023 / 20181213 12:07:29.972 / 00:00:05.949 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:29.972 / 20181213 12:07:36.118 / 00:00:06.146 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:36.118 / 20181213 12:07:42.275 / 00:00:06.157 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:42.275 / 20181213 12:07:48.823 / 00:00:06.548 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:48.823 / 20181213 12:07:55.170 / 00:00:06.347 |
Documentation: | Create a VM instance on a specific compute node. |
---|---|
Start / End / Elapsed: | 20181213 12:07:55.170 / 20181213 12:08:01.353 / 00:00:06.183 |
Documentation: | Get the instance IP addresses and nameserver address for the list of given vms. |
---|---|
Start / End / Elapsed: | 20181213 12:08:01.353 / 20181213 12:18:08.953 / 00:10:07.600 |
Documentation: | Returns a list containing given items. |
---|---|
Start / End / Elapsed: | 20181213 12:08:01.354 / 20181213 12:08:01.355 / 00:00:00.001 |
Documentation: | Wrapper teardown keyword that can be used in any suite running in an openstack environement |
---|---|
Start / End / Elapsed: | 20181213 12:18:08.992 / 20181213 12:20:26.306 / 00:02:17.314 |
Full Name: | CSIT.L3.Ping Vm Instance1 In net_2 From net_1 (vxlan to vlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.954 / 20181213 12:18:08.955 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance2 In net_2 From net_1 (vxlan to vlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.956 / 20181213 12:18:08.957 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance3 In net_2 From net_1 (vxlan to vlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.958 / 20181213 12:18:08.959 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance1 In net_1 From net_2 (vlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.959 / 20181213 12:18:08.960 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance2 In net_1 From net_2 (vlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.961 / 20181213 12:18:08.962 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance3 In net_1 From net_2 (vlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.962 / 20181213 12:18:08.963 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance1 In net_3 From net_2 (vxlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.964 / 20181213 12:18:08.965 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance2 In net_3 From net_2 (vxlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.965 / 20181213 12:18:08.966 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance3 In net_3 From net_2 (vxlan to vxlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Start / End / Elapsed: | 20181213 12:18:08.966 / 20181213 12:18:08.967 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance1 In net_1 |
---|---|
Documentation: | Login to the VM instance and test operations |
Start / End / Elapsed: | 20181213 12:18:08.968 / 20181213 12:18:08.969 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance2 In net_1 |
---|---|
Documentation: | Login to the vm instance and test operations |
Start / End / Elapsed: | 20181213 12:18:08.969 / 20181213 12:18:08.970 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance3 In net_1 |
---|---|
Documentation: | Login to the vm instance and test operations |
Start / End / Elapsed: | 20181213 12:18:08.970 / 20181213 12:18:08.971 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance1 In net_2 |
---|---|
Documentation: | Login to the vm instance and test operations |
Start / End / Elapsed: | 20181213 12:18:08.972 / 20181213 12:18:08.972 / 00:00:00.000 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance2 In net_2 |
---|---|
Documentation: | Logging to the vm instance using generated key pair. |
Start / End / Elapsed: | 20181213 12:18:08.973 / 20181213 12:18:08.974 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance3 In net_2 |
---|---|
Documentation: | Logging to the vm instance using generated key pair. |
Start / End / Elapsed: | 20181213 12:18:08.974 / 20181213 12:18:08.975 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Delete Vm Instances In net_1 |
---|---|
Documentation: | Delete Vm instances using instance names in net_1. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.975 / 20181213 12:18:08.976 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Delete Vm Instances In net_2 |
---|---|
Documentation: | Delete Vm instances using instance names in net_2. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.976 / 20181213 12:18:08.977 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Delete Vm Instances In net_3 |
---|---|
Documentation: | Delete Vm instances using instance names in net_3. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.978 / 20181213 12:18:08.978 / 00:00:00.000 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Create Vm Instances For net_4 |
---|---|
Documentation: | Create VM instances using flavor and image names for a network. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.979 / 20181213 12:18:08.980 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Create Vm Instances For net_5 |
---|---|
Documentation: | Create VM instances using flavor and image names for a network. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.980 / 20181213 12:18:08.981 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Create Router2 |
---|---|
Documentation: | Create Router |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.981 / 20181213 12:18:08.982 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Add net_4 Interfaces To Router2 |
---|---|
Documentation: | Add Interfaces |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.982 / 20181213 12:18:08.983 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Check Vm Instances on net_4 and net_5 Have Ip Address |
---|---|
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.983 / 20181213 12:18:08.984 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Add net_5 Interfaces To Router2 |
---|---|
Documentation: | Add Interfaces |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.984 / 20181213 12:18:08.985 / 00:00:00.001 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance5 In net_5 From net_4 (vlan to vlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.986 / 20181213 12:18:08.986 / 00:00:00.000 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Ping Vm Instance5 In net_4 From net_5 (vlan to vlan) |
---|---|
Documentation: | Check reachability of vm instances by pinging to them after creating routers. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.987 / 20181213 12:18:08.989 / 00:00:00.002 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.L3.Connectivity Tests From Vm Instance4 In net_5 |
---|---|
Documentation: | Check reachability of vm instance on a different network with one vlan vm in source and destination. |
Tags: | NON_GATE |
Start / End / Elapsed: | 20181213 12:18:08.990 / 20181213 12:18:08.990 / 00:00:00.000 |
Status: | FAIL (critical) |
Message: |
Full Name: | CSIT.Live Migration |
---|---|
Documentation: | Test suite to verify live Migaration of VM instance also verify the connectivity of VM instance while Migrating the instance, |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/live_migration.robot |
Start / End / Elapsed: | 20181213 12:20:26.312 / 20181213 12:21:50.188 / 00:01:23.876 |
Status: | 1 critical test, 0 passed, 1 failed 1 test total, 0 passed, 1 failed |
Message: |
Full Name: | CSIT.External Network |
---|---|
Documentation: | Test suite to check North-South connectivity in L3 using a router and an external network |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot |
Start / End / Elapsed: | 20181213 12:21:50.192 / 20181213 12:35:55.751 / 00:14:05.559 |
Status: | 25 critical test, 0 passed, 25 failed 25 test total, 0 passed, 25 failed |
Message: |
Full Name: | CSIT.Security Group |
---|---|
Documentation: | Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode. |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot |
Start / End / Elapsed: | 20181213 12:35:55.756 / 20181213 12:48:53.835 / 00:12:58.079 |
Status: | 34 critical test, 0 passed, 34 failed 34 test total, 0 passed, 34 failed |
Message: |
Full Name: | CSIT.Neutron Security Group |
---|---|
Documentation: | Test Suite for Neutron Security Group |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot |
Start / End / Elapsed: | 20181213 12:48:53.839 / 20181213 12:51:31.134 / 00:02:37.295 |
Status: | 4 critical test, 4 passed, 0 failed 4 test total, 4 passed, 0 failed |
Full Name: | CSIT.Security Group L3Bcast |
---|---|
Documentation: | Test Suite for Network and Subnet Broadcast with security group |
Source: | /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot |
Start / End / Elapsed: | 20181213 12:51:31.138 / 20181213 13:05:42.991 / 00:14:11.853 |
Status: | 6 critical test, 0 passed, 6 failed 6 test total, 0 passed, 6 failed |
Message: |
Full Name: | CSIT.Vpn Basic |
---|---|
Documentation: | Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot |
Start / End / Elapsed: | 20181213 13:05:42.996 / 20181213 13:19:37.107 / 00:13:54.111 |
Status: | 24 critical test, 0 passed, 24 failed 24 test total, 0 passed, 24 failed |
Message: |
Full Name: | CSIT.Elan |
---|---|
Documentation: | Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot |
Start / End / Elapsed: | 20181213 13:19:37.112 / 20181213 13:32:15.925 / 00:12:38.813 |
Status: | 5 critical test, 0 passed, 5 failed 5 test total, 0 passed, 5 failed |
Message: |
Full Name: | CSIT.Arp Learning |
---|---|
Documentation: | Test suite for ARP Request. More test cases to be added in subsequent patches. |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot |
Start / End / Elapsed: | 20181213 13:32:15.928 / 20181213 13:46:33.567 / 00:14:17.639 |
Status: | 3 critical test, 0 passed, 3 failed 3 test total, 0 passed, 3 failed |
Message: |
Full Name: | CSIT.L2L3 Gatewaymac Arp |
---|---|
Documentation: | Test Suite for Gateway mac based L2L3 seggragation |
Source: | /home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot |
Start / End / Elapsed: | 20181213 13:46:33.570 / 20181213 14:00:33.733 / 00:14:00.163 |
Status: | 9 critical test, 0 passed, 9 failed 9 test total, 0 passed, 9 failed |
Message: |
Full Name: | CSIT.Create JVM Plots |
---|---|
Documentation: | Test suite to Plot JVM Resources |
Source: | /home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot |
Start / End / Elapsed: | 20181213 14:00:33.737 / 20181213 14:00:33.754 / 00:00:00.017 |
Status: | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed |