Test Statistics

Total Statistics
Total
Pass
Fail
Elapsed
Pass / Fail
Critical Tests
153115200:00:00
All Tests
153115200:00:00
Statistics by Tag
Total
Pass
Fail
Elapsed
Pass / Fail
NON_GATE
2602600:00:00
Regression
40400:00:00
skip_if_conntrack
2502500:00:00
skip_if_stateful
3403400:00:00
Statistics by Suite
Total
Pass
Fail
Elapsed
Pass / Fail
CSIT
153115200:22:51
CSIT . L2
1401400:07:37
CSIT . L3
2702700:01:30
CSIT . Live Migration
10100:01:31
CSIT . External Network
2502500:01:31
CSIT . Security Group
3403400:01:32
CSIT . Neutron Security Group
40400:01:31
CSIT . Security Group L3Bcast
60600:01:31
CSIT . Vpn Basic
2402400:01:32
CSIT . Elan
50500:01:31
CSIT . Arp Learning
30300:01:33
CSIT . L2L3 Gatewaymac Arp
90900:01:31
CSIT . Create JVM Plots
11000:00:00

Test Execution Errors

20181214 12:04:35.569 ERROR Error in file '/home/opnfv/repos/odl_test/csit/libraries/CheckJVMResource.robot': Importing test library '/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py' failed: ImportError: No module named elasticsearch Traceback (most recent call last): File "/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py", line 34, in <module> from elasticsearch import Elasticsearch PYTHONPATH: /usr/bin /usr/lib64/python27.zip /usr/lib64/python2.7 /usr/lib64/python2.7/plat-linux2 /usr/lib64/python2.7/lib-tk /usr/lib64/python2.7/lib-old /usr/lib64/python2.7/lib-dynload /usr/lib64/python2.7/site-packages /usr/lib/python2.7/site-packages

Test Execution Log

00:22:51.473 SUITE CSIT
Full Name: CSIT
Start / End / Elapsed: 20181214 11:41:44.107 / 20181214 12:04:35.580 / 00:22:51.473
Status: 153 critical test, 1 passed, 152 failed
153 test total, 1 passed, 152 failed
00:07:36.871 SUITE L2
Full Name: CSIT.L2
Documentation:

Test suite to verify packet flows between vm instances.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l2.robot
Start / End / Elapsed: 20181214 11:41:44.124 / 20181214 11:49:20.995 / 00:07:36.871
Status: 14 critical test, 0 passed, 14 failed
14 test total, 0 passed, 14 failed
Message: Suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:05:53.638 SETUP Suite Setup
Start / End / Elapsed: 20181214 11:41:44.795 / 20181214 11:47:38.433 / 00:05:53.638
00:01:02.112 KEYWORD OpenStackOperations . OpenStack Suite Setup
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181214 11:41:44.796 / 20181214 11:42:46.908 / 00:01:02.112
00:00:02.487 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[0], --provider-network-type vlan --provider-physical-network ${PUBLIC_PHYSICAL_NETWORK} --provider-segment ${NET_1_VLAN_ID}
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181214 11:42:46.908 / 20181214 11:42:49.395 / 00:00:02.487
00:00:03.038 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[0], @{SUBNETS}[0], @{SUBNET_CIDRS}[0]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181214 11:42:49.396 / 20181214 11:42:52.434 / 00:00:03.038
00:00:02.634 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[1]
Documentation:

Create Network with openstack request.
Start / End / Elapsed: 20181214 11:42:52.434 / 20181214 11:42:55.068 / 00:00:02.634
00:00:02.623 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[1], @{SUBNETS}[1], @{SUBNET_CIDRS}[1]
Documentation:

Create SubNet for the Network with neutron request.
Start / End / Elapsed: 20181214 11:42:55.069 / 20181214 11:42:57.692 / 00:00:02.623
00:00:17.757 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}
Documentation:

Allow all TCP/UDP/ICMP packets for this suite
Start / End / Elapsed: 20181214 11:42:57.692 / 20181214 11:43:15.449 / 00:00:17.757
00:00:07.894 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:15.449 / 20181214 11:43:23.343 / 00:00:07.894
00:00:07.866 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[1], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:23.344 / 20181214 11:43:31.210 / 00:00:07.866
00:00:06.621 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[0], @{NET_1_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:31.210 / 20181214 11:43:37.831 / 00:00:06.621
00:00:07.217 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:37.831 / 20181214 11:43:45.048 / 00:00:07.217
00:00:06.707 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:45.049 / 20181214 11:43:51.756 / 00:00:06.707
00:00:06.469 KEYWORD OpenStackOperations . Create Vm Instance On Compute Node @{NETWORKS}[1], @{NET_2_VMS}[2], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
Documentation:

Create a VM instance on a specific compute node.
Start / End / Elapsed: 20181214 11:43:51.756 / 20181214 11:43:58.225 / 00:00:06.469
00:00:19.787 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181214 11:43:58.225 / 20181214 11:44:18.012 / 00:00:19.787
00:03:20.417 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}
Documentation:

Get the instance IP addresses and nameserver address for the list of given vms.
Start / End / Elapsed: 20181214 11:44:18.013 / 20181214 11:47:38.430 / 00:03:20.417
00:00:00.000 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181214 11:47:38.431 / 20181214 11:47:38.431 / 00:00:00.000
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}
Documentation:

Makes a variable available everywhere within the scope of the current suite.
Start / End / Elapsed: 20181214 11:47:38.431 / 20181214 11:47:38.432 / 00:00:00.001
00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181214 11:47:38.432 / 20181214 11:47:38.432 / 00:00:00.000
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None
Documentation:

Fails if container contains item one or more times.
Start / End / Elapsed: 20181214 11:47:38.432 / 20181214 11:47:38.433 / 00:00:00.001
00:01:42.535 TEARDOWN OpenStackOperations . OpenStack Suite Teardown
Documentation:

Wrapper teardown keyword that can be used in any suite running in an openstack environement
Start / End / Elapsed: 20181214 11:47:38.460 / 20181214 11:49:20.995 / 00:01:42.535
00:00:00.002 TEST Ping Vm Instance1 In net_1
Full Name: CSIT.L2.Ping Vm Instance1 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.433 / 20181214 11:47:38.435 / 00:00:00.002
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Ping Vm Instance2 In net_1
Full Name: CSIT.L2.Ping Vm Instance2 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.436 / 20181214 11:47:38.437 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Ping Vm Instance3 In net_1
Full Name: CSIT.L2.Ping Vm Instance3 In net_1
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.438 / 20181214 11:47:38.439 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Ping Vm Instance1 In net_2
Full Name: CSIT.L2.Ping Vm Instance1 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.440 / 20181214 11:47:38.441 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Ping Vm Instance2 In net_2
Full Name: CSIT.L2.Ping Vm Instance2 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.441 / 20181214 11:47:38.442 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Ping Vm Instance3 In net_2
Full Name: CSIT.L2.Ping Vm Instance3 In net_2
Documentation:

Check reachability of vm instances by pinging to them.
Start / End / Elapsed: 20181214 11:47:38.443 / 20181214 11:47:38.444 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance1 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_1
Documentation:

Login to the vm instance and test some operations
Start / End / Elapsed: 20181214 11:47:38.445 / 20181214 11:47:38.446 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance2 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181214 11:47:38.446 / 20181214 11:47:38.447 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_1
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_1
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181214 11:47:38.448 / 20181214 11:47:38.449 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance1 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance1 In net_2
Documentation:

Login to the vm instance and test operations
Start / End / Elapsed: 20181214 11:47:38.450 / 20181214 11:47:38.451 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance2 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance2 In net_2
Documentation:

Logging to the vm instance using generated key pair.
Start / End / Elapsed: 20181214 11:47:38.451 / 20181214 11:47:38.452 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.001 TEST Connectivity Tests From Vm Instance3 In net_2
Full Name: CSIT.L2.Connectivity Tests From Vm Instance3 In net_2
Documentation:

Login to the vm instance using generated key pair.
Start / End / Elapsed: 20181214 11:47:38.453 / 20181214 11:47:38.454 / 00:00:00.001
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.002 TEST Delete A Vm Instance
Full Name: CSIT.L2.Delete A Vm Instance
Documentation:

Delete Vm instances using instance names. Also remove the VM from the list so that later cleanup will not try to delete it.
Tags: NON_GATE
Start / End / Elapsed: 20181214 11:47:38.455 / 20181214 11:47:38.457 / 00:00:00.002
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:00:00.002 TEST No Ping For Deleted Vm
Full Name: CSIT.L2.No Ping For Deleted Vm
Documentation:

Check non reachability of deleted vm instances by pinging to them.
Tags: NON_GATE
Start / End / Elapsed: 20181214 11:47:38.457 / 20181214 11:47:38.459 / 00:00:00.002
Status: FAIL (critical)
Message: Parent suite setup failed: '[u'22.0.0.16', u'22.0.0.192', u'None']' contains 'None'
00:01:30.346 SUITE L3
Full Name: CSIT.L3
Documentation:

Test suite to check connectivity in L3 using routers.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/l3.robot
Start / End / Elapsed: 20181214 11:49:21.001 / 20181214 11:50:51.347 / 00:01:30.346
Status: 27 critical test, 0 passed, 27 failed
27 test total, 0 passed, 27 failed
Message: Suite setup failed: AssertionError
00:01:31.120 SUITE Live Migration
Full Name: CSIT.Live Migration
Documentation:

Test suite to verify live Migaration of VM instance also verify the connectivity of VM instance while Migrating the instance,
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/live_migration.robot
Start / End / Elapsed: 20181214 11:50:51.352 / 20181214 11:52:22.472 / 00:01:31.120
Status: 1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
Message: Suite setup failed: AssertionError Also suite teardown failed: Several failures occurred: 1) ''1' == '0'' should be true. 2) ''5' == '0'' should be true. 3) ''1' == '0'' should be true. 4) ''5' == '0'' should be true.
00:01:31.115 SUITE External Network
Full Name: CSIT.External Network
Documentation:

Test suite to check North-South connectivity in L3 using a router and an external network
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/external_network.robot
Start / End / Elapsed: 20181214 11:52:22.476 / 20181214 11:53:53.591 / 00:01:31.115
Status: 25 critical test, 0 passed, 25 failed
25 test total, 0 passed, 25 failed
Message: Suite setup failed: AssertionError
00:01:31.847 SUITE Security Group
Full Name: CSIT.Security Group
Documentation:

Test suite to verify security groups basic and advanced functionalities, including negative tests. These test cases are not so relevant for transparent mode, so each test case will be tagged with "skip_if_transparent" to allow any underlying keywords to return with a PASS without risking a false failure. The real value of this suite will be in stateful mode.
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity/security_group.robot
Start / End / Elapsed: 20181214 11:53:53.596 / 20181214 11:55:25.443 / 00:01:31.847
Status: 34 critical test, 0 passed, 34 failed
34 test total, 0 passed, 34 failed
Message: Suite setup failed: AssertionError
00:01:31.191 SUITE Neutron Security Group
Full Name: CSIT.Neutron Security Group
Documentation:

Test Suite for Neutron Security Group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/neutron_security_group.robot
Start / End / Elapsed: 20181214 11:55:25.449 / 20181214 11:56:56.640 / 00:01:31.191
Status: 4 critical test, 0 passed, 4 failed
4 test total, 0 passed, 4 failed
Message: Suite setup failed: AssertionError
00:01:31.253 SUITE Security Group L3Bcast
Full Name: CSIT.Security Group L3Bcast
Documentation:

Test Suite for Network and Subnet Broadcast with security group
Source: /home/opnfv/repos/odl_test/csit/suites/openstack/securitygroup/security_group_l3bcast.robot
Start / End / Elapsed: 20181214 11:56:56.643 / 20181214 11:58:27.896 / 00:01:31.253
Status: 6 critical test, 0 passed, 6 failed
6 test total, 0 passed, 6 failed
Message: Suite setup failed: AssertionError
00:01:31.925 SUITE Vpn Basic
Full Name: CSIT.Vpn Basic
Documentation:

Test suite to validate vpnservice functionality in an openstack integrated environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/vpn_basic.robot
Start / End / Elapsed: 20181214 11:58:27.900 / 20181214 11:59:59.825 / 00:01:31.925
Status: 24 critical test, 0 passed, 24 failed
24 test total, 0 passed, 24 failed
Message: Suite setup failed: AssertionError
00:01:31.497 SUITE Elan
Full Name: CSIT.Elan
Documentation:

Test suite to validate elan service functionality in ODL environment. The assumption of this suite is that the environment is already configured with the proper integration bridges and vxlan tunnels.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/elan/elan.robot
Start / End / Elapsed: 20181214 11:59:59.830 / 20181214 12:01:31.327 / 00:01:31.497
Status: 5 critical test, 0 passed, 5 failed
5 test total, 0 passed, 5 failed
Message: Suite setup failed: AssertionError
00:01:32.988 SUITE Arp Learning
Full Name: CSIT.Arp Learning
Documentation:

Test suite for ARP Request. More test cases to be added in subsequent patches.
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/vpnservice/arp_learning.robot
Start / End / Elapsed: 20181214 12:01:31.331 / 20181214 12:03:04.319 / 00:01:32.988
Status: 3 critical test, 0 passed, 3 failed
3 test total, 0 passed, 3 failed
Message: Suite setup failed: AssertionError
00:01:31.232 SUITE L2L3 Gatewaymac Arp
Full Name: CSIT.L2L3 Gatewaymac Arp
Documentation:

Test Suite for Gateway mac based L2L3 seggragation
Source: /home/opnfv/repos/odl_test/csit/suites/netvirt/l2l3_gatewaymac_arp.robot
Start / End / Elapsed: 20181214 12:03:04.324 / 20181214 12:04:35.556 / 00:01:31.232
Status: 9 critical test, 0 passed, 9 failed
9 test total, 0 passed, 9 failed
Message: Suite setup failed: AssertionError
00:00:00.016 SUITE Create JVM Plots
Full Name: CSIT.Create JVM Plots
Documentation:

Test suite to Plot JVM Resources
Source: /home/opnfv/repos/odl_test/csit/suites/integration/Create_JVM_Plots.robot
Start / End / Elapsed: 20181214 12:04:35.561 / 20181214 12:04:35.577 / 00:00:00.016
Status: 1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed