Test Statistics

Total Statistics
Total
Pass
Fail
Elapsed
Pass / Fail
Critical Tests
152115100:00:00
All Tests
152115100:00:00
Statistics by Tag
Total
Pass
Fail
Elapsed
Pass / Fail
NON_GATE
2602600:00:00
Regression
40400:00:00
skip_if_conntrack
2502500:00:00
skip_if_stateful
3403400:00:00
Statistics by Suite
Total
Pass
Fail
Elapsed
Pass / Fail
CSIT
152115100:20:35
CSIT . L2
1401400:07:32
CSIT . L3
2702700:01:27
CSIT . External Network
2502500:01:27
CSIT . Security Group
3403400:01:27
CSIT . Neutron Security Group
40400:01:27
CSIT . Security Group L3Bcast
60600:01:26
CSIT . Vpn Basic
2402400:01:28
CSIT . Elan
50500:01:27
CSIT . Arp Learning
30300:01:27
CSIT . L2L3 Gatewaymac Arp
90900:01:27
CSIT . Create JVM Plots
11000:00:00

Test Execution Errors

20181202 16:03:11.029 ERROR Error in file '/home/opnfv/repos/odl_test/csit/libraries/CheckJVMResource.robot': Importing test library '/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py' failed: ImportError: No module named elasticsearch Traceback (most recent call last): File "/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py", line 34, in <module> from elasticsearch import Elasticsearch PYTHONPATH: /usr/bin /usr/lib64/python27.zip /usr/lib64/python2.7 /usr/lib64/python2.7/plat-linux2 /usr/lib64/python2.7/lib-tk /usr/lib64/python2.7/lib-old /usr/lib64/python2.7/lib-dynload /usr/lib64/python2.7/site-packages /usr/lib/python2.7/site-packages

Test Execution Log

00:20:35.299 SUITE CSIT
Full Name: CSIT
Start / End / Elapsed: 20181202 15:42:35.740 / 20181202 16:03:11.039 / 00:20:35.299
Status: 152 critical test, 1 passed, 151 failed
152 test total, 1 passed, 151 failed
00:07:32.256 SUITE L2
Full Name: CSIT.L2
Documentation:

Test suite to verify packet flows between vm instances.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot
Start / End / Elapsed: 20181202 15:42:35.756 / 20181202 15:50:08.012 / 00:07:32.256
Status: 14 critical test, 0 passed, 14 failed
14 test total, 0 passed, 14 failed
Message: Suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:05:52.282 SETUP Suite Setup
Start / End / Elapsed: 20181202 15:42:36.341 / 20181202 15:48:28.623 / 00:05:52.282
00:01:01.062 KEYWORD OpenStackOperations . OpenStack Suite Setup
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181202 15:42:36.341 / 20181202 15:43:37.403 / 00:01:01.062
00:00:02.443 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[0], --provider-network-type vlan --provider-physical-network ${PUBLIC_PHYSICAL_NETWORK} --provider-segment ${NET_1_VLAN_ID}
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181202 15:43:37.404 / 20181202 15:43:39.847 / 00:00:02.443
00:00:02.608 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[0], @{SUBNETS}[0], @{SUBNET_CIDRS}[0]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181202 15:43:39.848 / 20181202 15:43:42.456 / 00:00:02.608
00:00:02.288 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[1]
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181202 15:43:42.456 / 20181202 15:43:44.744 / 00:00:02.288
00:00:02.857 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[1], @{SUBNETS}[1], @{SUBNET_CIDRS}[1]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181202 15:43:44.744 / 20181202 15:43:47.601 / 00:00:02.857
00:00:16.948 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}
Documentation:

Allow all TCP/UDP/ICMP packets for this suite
Start / End / Elapsed: 20181202 15:43:47.602 / 20181202 15:44:04.550 / 00:00:16.948
00:00:07.441 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:04.550 / 20181202 15:44:11.991 / 00:00:07.441
00:00:07.016 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[1], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:11.991 / 20181202 15:44:19.007 / 00:00:07.016
00:00:07.844 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:19.007 / 20181202 15:44:26.851 / 00:00:07.844
00:00:07.526 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:26.851 / 20181202 15:44:34.377 / 00:00:07.526
00:00:06.986 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:34.377 / 20181202 15:44:41.363 / 00:00:06.986
00:00:06.862 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181202 15:44:41.363 / 20181202 15:44:48.225 / 00:00:06.862
00:00:20.895 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181202 15:44:48.225 / 20181202 15:45:09.120 / 00:00:20.895
00:03:19.499 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181202 15:45:09.121 / 20181202 15:48:28.620 / 00:03:19.499
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181202 15:48:28.621 / 20181202 15:48:28.621 / 00:00:00.000
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181202 15:48:28.621 / 20181202 15:48:28.622 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181202 15:48:28.622 / 20181202 15:48:28.622 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181202 15:48:28.622 / 20181202 15:48:28.622 / 00:00:00.000
00:01:39.378 TEARDOWN OpenStackOperations . OpenStack Suite Teardown
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181202 15:48:28.634 / 20181202 15:50:08.012 / 00:01:39.378
00:00:00.001 TEST Ping Vm Instance1 In net_1
Full Name: CSIT.L2.Ping Vm Instance1 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.623 / 20181202 15:48:28.624 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST Ping Vm Instance2 In net_1
Full Name: CSIT.L2.Ping Vm Instance2 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.624 / 20181202 15:48:28.624 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST Ping Vm Instance3 In net_1
Full Name: CSIT.L2.Ping Vm Instance3 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.625 / 20181202 15:48:28.625 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Ping Vm Instance1 In net_2
Full Name: CSIT.L2.Ping Vm Instance1 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.625 / 20181202 15:48:28.626 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Ping Vm Instance2 In net_2
Full Name: CSIT.L2.Ping Vm Instance2 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.626 / 20181202 15:48:28.627 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST Ping Vm Instance3 In net_2
Full Name: CSIT.L2.Ping Vm Instance3 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181202 15:48:28.627 / 20181202 15:48:28.627 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance1 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_1
Documentation:

Login to the vm instance and test some operations
Start / End / Elapsed: 20181202 15:48:28.627 / 20181202 15:48:28.628 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance2 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181202 15:48:28.628 / 20181202 15:48:28.629 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181202 15:48:28.629 / 20181202 15:48:28.630 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST Connectivity Tests From Vm Instance1 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_2
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181202 15:48:28.630 / 20181202 15:48:28.630 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST Connectivity Tests From Vm Instance2 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_2
Documentation:

Logging to the vm instance using generated key pair.
Start / End / Elapsed: 20181202 15:48:28.631 / 20181202 15:48:28.631 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_2
Documentation:

Login to the vm instance using generated key pair.
Start / End / Elapsed: 20181202 15:48:28.631 / 20181202 15:48:28.632 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.001 TEST Delete A Vm Instance
Full Name: CSIT.L2.Delete A Vm Instance
Documentation:

Delete Vm instances using instance names. Also remove the VM from the list so that later cleanup will not try to delete it.
Tags: NON_GATE
Start / End / Elapsed: 20181202 15:48:28.632 / 20181202 15:48:28.633 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:00:00.000 TEST No Ping For Deleted Vm
Full Name: CSIT.L2.No Ping For Deleted Vm
Documentation:

Check non reachability of deleted vm instances by pinging to them.
Tags: NON_GATE
Start / End / Elapsed: 20181202 15:48:28.633 / 20181202 15:48:28.633 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.3', u'22.0.0.4']' contains 'None'
00:01:26.950 SUITE L3
Full Name: CSIT.L3
Documentation:

Test suite to check connectivity in L3 using routers.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot
Start / End / Elapsed: 20181202 15:50:08.016 / 20181202 15:51:34.966 / 00:01:26.950
Status: 27 critical test, 0 passed, 27 failed
27 test total, 0 passed, 27 failed
Message: Suite setup failed: AssertionError
00:01:27.471 SUITE External Network
Full Name: CSIT.External Network
Documentation:

Test suite to check North-South connectivity in L3 using a router and an external network
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot
Start / End / Elapsed: 20181202 15:51:34.970 / 20181202 15:53:02.441 / 00:01:27.471
Status: 25 critical test, 0 passed, 25 failed
25 test total, 0 passed, 25 failed
Message: Suite setup failed: AssertionError
00:01:27.047 SUITE Security Group
Full Name: CSIT.Security Group
Documentation:

Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot
Start / End / Elapsed: 20181202 15:53:02.445 / 20181202 15:54:29.492 / 00:01:27.047
Status: 34 critical test, 0 passed, 34 failed
34 test total, 0 passed, 34 failed
Message: Suite setup failed: AssertionError
00:01:26.661 SUITE Neutron Security Group
Full Name: CSIT.Neutron Security Group
Documentation:

Test Suite for Neutron Security Group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot
Start / End / Elapsed: 20181202 15:54:29.497 / 20181202 15:55:56.158 / 00:01:26.661
Status: 4 critical test, 0 passed, 4 failed
4 test total, 0 passed, 4 failed
Message: Suite setup failed: AssertionError
00:01:26.165 SUITE Security Group L3Bcast
Full Name: CSIT.Security Group L3Bcast
Documentation:

Test Suite for Network and Subnet Broadcast with security group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot
Start / End / Elapsed: 20181202 15:55:56.164 / 20181202 15:57:22.329 / 00:01:26.165
Status: 6 critical test, 0 passed, 6 failed
6 test total, 0 passed, 6 failed
Message: Suite setup failed: AssertionError
00:01:28.047 SUITE Vpn Basic
Full Name: CSIT.Vpn Basic
Documentation:

Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot
Start / End / Elapsed: 20181202 15:57:22.333 / 20181202 15:58:50.380 / 00:01:28.047
Status: 24 critical test, 0 passed, 24 failed
24 test total, 0 passed, 24 failed
Message: Suite setup failed: AssertionError
00:01:27.166 SUITE Elan
Full Name: CSIT.Elan
Documentation:

Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot
Start / End / Elapsed: 20181202 15:58:50.385 / 20181202 16:00:17.551 / 00:01:27.166
Status: 5 critical test, 0 passed, 5 failed
5 test total, 0 passed, 5 failed
Message: Suite setup failed: AssertionError
00:01:26.869 SUITE Arp Learning
Full Name: CSIT.Arp Learning
Documentation:

Test suite for ARP Request. More test cases to be added in subsequent patches.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot
Start / End / Elapsed: 20181202 16:00:17.556 / 20181202 16:01:44.425 / 00:01:26.869
Status: 3 critical test, 0 passed, 3 failed
3 test total, 0 passed, 3 failed
Message: Suite setup failed: AssertionError
00:01:26.583 SUITE L2L3 Gatewaymac Arp
Full Name: CSIT.L2L3 Gatewaymac Arp
Documentation:

Test Suite for Gateway mac based L2L3 seggragation
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot
Start / End / Elapsed: 20181202 16:01:44.430 / 20181202 16:03:11.013 / 00:01:26.583
Status: 9 critical test, 0 passed, 9 failed
9 test total, 0 passed, 9 failed
Message: Suite setup failed: AssertionError
00:00:00.017 SUITE Create JVM Plots
Full Name: CSIT.Create JVM Plots
Documentation:

Test suite to Plot JVM Resources
Source: /home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot
Start / End / Elapsed: 20181202 16:03:11.020 / 20181202 16:03:11.037 / 00:00:00.017
Status: 1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed