Test Statistics

Total Statistics
Total
Pass
Fail
Elapsed
Pass / Fail
Critical Tests
152115100:00:00
All Tests
152115100:00:00
Statistics by Tag
Total
Pass
Fail
Elapsed
Pass / Fail
NON_GATE
2602600:00:00
Regression
40400:00:00
skip_if_conntrack
2502500:00:00
skip_if_stateful
3403400:00:00
Statistics by Suite
Total
Pass
Fail
Elapsed
Pass / Fail
CSIT
152115100:20:31
CSIT . L2
1401400:07:31
CSIT . L3
2702700:01:27
CSIT . External Network
2502500:01:27
CSIT . Security Group
3403400:01:26
CSIT . Neutron Security Group
40400:01:27
CSIT . Security Group L3Bcast
60600:01:27
CSIT . Vpn Basic
2402400:01:28
CSIT . Elan
50500:01:27
CSIT . Arp Learning
30300:01:26
CSIT . L2L3 Gatewaymac Arp
90900:01:26
CSIT . Create JVM Plots
11000:00:00

Test Execution Errors

20181201 15:53:55.101 ERROR Error in file '/home/opnfv/repos/odl_test/csit/libraries/CheckJVMResource.robot': Importing test library '/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py' failed: ImportError: No module named elasticsearch Traceback (most recent call last): File "/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py", line 34, in <module> from elasticsearch import Elasticsearch PYTHONPATH: /usr/bin /usr/lib64/python27.zip /usr/lib64/python2.7 /usr/lib64/python2.7/plat-linux2 /usr/lib64/python2.7/lib-tk /usr/lib64/python2.7/lib-old /usr/lib64/python2.7/lib-dynload /usr/lib64/python2.7/site-packages /usr/lib/python2.7/site-packages

Test Execution Log

00:20:31.146 SUITE CSIT
Full Name: CSIT
Start / End / Elapsed: 20181201 15:33:23.965 / 20181201 15:53:55.111 / 00:20:31.146
Status: 152 critical test, 1 passed, 151 failed
152 test total, 1 passed, 151 failed
00:07:30.817 SUITE L2
Full Name: CSIT.L2
Documentation:

Test suite to verify packet flows between vm instances.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot
Start / End / Elapsed: 20181201 15:33:23.982 / 20181201 15:40:54.799 / 00:07:30.817
Status: 14 critical test, 0 passed, 14 failed
14 test total, 0 passed, 14 failed
Message: Suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:05:50.518 SETUP Suite Setup
Start / End / Elapsed: 20181201 15:33:24.587 / 20181201 15:39:15.105 / 00:05:50.518
00:00:59.518 KEYWORD OpenStackOperations . OpenStack Suite Setup
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181201 15:33:24.588 / 20181201 15:34:24.106 / 00:00:59.518
00:00:02.456 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[0], --provider-network-type vlan --provider-physical-network ${PUBLIC_PHYSICAL_NETWORK} --provider-segment ${NET_1_VLAN_ID}
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181201 15:34:24.106 / 20181201 15:34:26.562 / 00:00:02.456
00:00:02.613 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[0], @{SUBNETS}[0], @{SUBNET_CIDRS}[0]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181201 15:34:26.562 / 20181201 15:34:29.175 / 00:00:02.613
00:00:02.524 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[1]
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181201 15:34:29.176 / 20181201 15:34:31.700 / 00:00:02.524
00:00:02.645 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[1], @{SUBNETS}[1], @{SUBNET_CIDRS}[1]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181201 15:34:31.700 / 20181201 15:34:34.345 / 00:00:02.645
00:00:16.747 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}
Documentation:

Allow all TCP/UDP/ICMP packets for this suite
Start / End / Elapsed: 20181201 15:34:34.346 / 20181201 15:34:51.093 / 00:00:16.747
00:00:07.412 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:34:51.094 / 20181201 15:34:58.506 / 00:00:07.412
00:00:07.610 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[1], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:34:58.507 / 20181201 15:35:06.117 / 00:00:07.610
00:00:07.828 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:35:06.118 / 20181201 15:35:13.946 / 00:00:07.828
00:00:07.358 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:35:13.946 / 20181201 15:35:21.304 / 00:00:07.358
00:00:07.068 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:35:21.305 / 20181201 15:35:28.373 / 00:00:07.068
00:00:07.185 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181201 15:35:28.373 / 20181201 15:35:35.558 / 00:00:07.185
00:00:21.215 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181201 15:35:35.558 / 20181201 15:35:56.773 / 00:00:21.215
00:03:18.327 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181201 15:35:56.774 / 20181201 15:39:15.101 / 00:03:18.327
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181201 15:39:15.102 / 20181201 15:39:15.102 / 00:00:00.000
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181201 15:39:15.103 / 20181201 15:39:15.103 / 00:00:00.000
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181201 15:39:15.103 / 20181201 15:39:15.104 / 00:00:00.001
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181201 15:39:15.104 / 20181201 15:39:15.105 / 00:00:00.001
15:39:15.104 FAIL '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:01:39.678 TEARDOWN OpenStackOperations . OpenStack Suite Teardown
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181201 15:39:15.121 / 20181201 15:40:54.799 / 00:01:39.678
00:00:00.001 TEST Ping Vm Instance1 In net_1
Full Name: CSIT.L2.Ping Vm Instance1 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.105 / 20181201 15:39:15.106 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Ping Vm Instance2 In net_1
Full Name: CSIT.L2.Ping Vm Instance2 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.107 / 20181201 15:39:15.107 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Ping Vm Instance3 In net_1
Full Name: CSIT.L2.Ping Vm Instance3 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.108 / 20181201 15:39:15.108 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Ping Vm Instance1 In net_2
Full Name: CSIT.L2.Ping Vm Instance1 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.109 / 20181201 15:39:15.109 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Ping Vm Instance2 In net_2
Full Name: CSIT.L2.Ping Vm Instance2 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.110 / 20181201 15:39:15.110 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Ping Vm Instance3 In net_2
Full Name: CSIT.L2.Ping Vm Instance3 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181201 15:39:15.111 / 20181201 15:39:15.111 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.000 TEST Connectivity Tests From Vm Instance1 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_1
Documentation:

Login to the vm instance and test some operations
Start / End / Elapsed: 20181201 15:39:15.112 / 20181201 15:39:15.112 / 00:00:00.000
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance2 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181201 15:39:15.113 / 20181201 15:39:15.114 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181201 15:39:15.114 / 20181201 15:39:15.115 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance1 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_2
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181201 15:39:15.115 / 20181201 15:39:15.116 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance2 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_2
Documentation:

Logging to the vm instance using generated key pair.
Start / End / Elapsed: 20181201 15:39:15.116 / 20181201 15:39:15.117 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_2
Documentation:

Login to the vm instance using generated key pair.
Start / End / Elapsed: 20181201 15:39:15.117 / 20181201 15:39:15.118 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST Delete A Vm Instance
Full Name: CSIT.L2.Delete A Vm Instance
Documentation:

Delete Vm instances using instance names. Also remove the VM from the list so that later cleanup will not try to delete it.
Tags: NON_GATE
Start / End / Elapsed: 20181201 15:39:15.118 / 20181201 15:39:15.119 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:00:00.001 TEST No Ping For Deleted Vm
Full Name: CSIT.L2.No Ping For Deleted Vm
Documentation:

Check non reachability of deleted vm instances by pinging to them.
Tags: NON_GATE
Start / End / Elapsed: 20181201 15:39:15.119 / 20181201 15:39:15.120 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'None', u'22.0.0.7', u'22.0.0.6']' contains 'None'
00:01:27.057 SUITE L3
Full Name: CSIT.L3
Documentation:

Test suite to check connectivity in L3 using routers.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot
Start / End / Elapsed: 20181201 15:40:54.806 / 20181201 15:42:21.863 / 00:01:27.057
Status: 27 critical test, 0 passed, 27 failed
27 test total, 0 passed, 27 failed
Message: Suite setup failed: AssertionError
00:01:27.159 SUITE External Network
Full Name: CSIT.External Network
Documentation:

Test suite to check North-South connectivity in L3 using a router and an external network
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot
Start / End / Elapsed: 20181201 15:42:21.867 / 20181201 15:43:49.026 / 00:01:27.159
Status: 25 critical test, 0 passed, 25 failed
25 test total, 0 passed, 25 failed
Message: Suite setup failed: AssertionError
00:01:25.842 SUITE Security Group
Full Name: CSIT.Security Group
Documentation:

Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot
Start / End / Elapsed: 20181201 15:43:49.031 / 20181201 15:45:14.873 / 00:01:25.842
Status: 34 critical test, 0 passed, 34 failed
34 test total, 0 passed, 34 failed
Message: Suite setup failed: AssertionError
00:01:26.715 SUITE Neutron Security Group
Full Name: CSIT.Neutron Security Group
Documentation:

Test Suite for Neutron Security Group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot
Start / End / Elapsed: 20181201 15:45:14.878 / 20181201 15:46:41.593 / 00:01:26.715
Status: 4 critical test, 0 passed, 4 failed
4 test total, 0 passed, 4 failed
Message: Suite setup failed: AssertionError
00:01:26.860 SUITE Security Group L3Bcast
Full Name: CSIT.Security Group L3Bcast
Documentation:

Test Suite for Network and Subnet Broadcast with security group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot
Start / End / Elapsed: 20181201 15:46:41.596 / 20181201 15:48:08.456 / 00:01:26.860
Status: 6 critical test, 0 passed, 6 failed
6 test total, 0 passed, 6 failed
Message: Suite setup failed: AssertionError
00:01:27.566 SUITE Vpn Basic
Full Name: CSIT.Vpn Basic
Documentation:

Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot
Start / End / Elapsed: 20181201 15:48:08.460 / 20181201 15:49:36.026 / 00:01:27.566
Status: 24 critical test, 0 passed, 24 failed
24 test total, 0 passed, 24 failed
Message: Suite setup failed: AssertionError
00:01:27.192 SUITE Elan
Full Name: CSIT.Elan
Documentation:

Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot
Start / End / Elapsed: 20181201 15:49:36.030 / 20181201 15:51:03.222 / 00:01:27.192
Status: 5 critical test, 0 passed, 5 failed
5 test total, 0 passed, 5 failed
Message: Suite setup failed: AssertionError
00:01:25.877 SUITE Arp Learning
Full Name: CSIT.Arp Learning
Documentation:

Test suite for ARP Request. More test cases to be added in subsequent patches.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot
Start / End / Elapsed: 20181201 15:51:03.226 / 20181201 15:52:29.103 / 00:01:25.877
Status: 3 critical test, 0 passed, 3 failed
3 test total, 0 passed, 3 failed
Message: Suite setup failed: AssertionError
00:01:25.982 SUITE L2L3 Gatewaymac Arp
Full Name: CSIT.L2L3 Gatewaymac Arp
Documentation:

Test Suite for Gateway mac based L2L3 seggragation
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot
Start / End / Elapsed: 20181201 15:52:29.107 / 20181201 15:53:55.089 / 00:01:25.982
Status: 9 critical test, 0 passed, 9 failed
9 test total, 0 passed, 9 failed
Message: Suite setup failed: AssertionError
00:00:00.015 SUITE Create JVM Plots
Full Name: CSIT.Create JVM Plots
Documentation:

Test suite to Plot JVM Resources
Source: /home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot
Start / End / Elapsed: 20181201 15:53:55.093 / 20181201 15:53:55.108 / 00:00:00.015
Status: 1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed