Test Statistics

Total Statistics
Total
Pass
Fail
Elapsed
Pass / Fail
Critical Tests
1531252800:33:00
All Tests
1531252800:33:00
Statistics by Tag
Total
Pass
Fail
Elapsed
Pass / Fail
NON_GATE
2626000:06:52
Regression
44000:00:55
skip_if_conntrack
2525000:07:17
skip_if_stateful
3434000:05:42
Statistics by Suite
Total
Pass
Fail
Elapsed
Pass / Fail
1531252801:26:36
1414000:07:17
2727000:13:53
10100:01:25
2525000:13:10
3434000:09:14
44000:02:44
66000:07:29
2402400:07:11
55000:09:32
30300:07:53
99000:06:49
11000:00:00

Test Execution Errors

20190331 15:49:25.728 ERROR Error in file '/home/opnfv/repos/odl_test/csit/libraries/CheckJVMResource.robot': Importing test library '/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py' failed: ImportError: No module named elasticsearch Traceback (most recent call last): File "/home/opnfv/repos/odl_test/csit/libraries/Appenders/ElasticsearchAppender.py", line 34, in <module> from elasticsearch import Elasticsearch PYTHONPATH: /usr/bin /usr/lib64/python27.zip /usr/lib64/python2.7 /usr/lib64/python2.7/plat-linux2 /usr/lib64/python2.7/lib-tk /usr/lib64/python2.7/lib-old /usr/lib64/python2.7/lib-dynload /usr/lib64/python2.7/site-packages /usr/lib/python2.7/site-packages

Test Execution Log

01:26:36.272 SUITE CSIT
00:07:17.144 SUITE L2
00:13:53.424 SUITE L3
00:01:25.178 SUITE Live Migration
00:00:48.753 SETUP Suite Setup
00:00:48.752 KEYWORD LiveMigration . Live Migration Suite Setup
00:00:48.456 KEYWORD OpenStackOperations . OpenStack Suite Setup
00:00:00.295 KEYWORD LiveMigration . Setup Live Migration In Compute Nodes
00:00:00.295 FOR ${conn_id} IN [ @{OS_CMP_CONN_IDS} ]
00:00:00.295 VAR ${conn_id} = 12
00:00:00.162 KEYWORD OpenStackOperations . Modify OpenStack Configuration File ${conn_id}, ${NOVA_CPU_CONF}, DEFAULT, instances_path, ${CMP_INSTANCES_SHARED_PATH}
00:00:00.133 KEYWORD OpenStackOperations . Restart DevStack Service ${conn_id}, ${NOVA_COMPUTE_SERVICE}
00:00:00.000 KEYWORD SSHLibrary . Switch Connection ${conn_id}
00:00:00.127 KEYWORD ${output}, ${rc} = SSHLibrary . Execute Command sudo systemctl restart devstack@${service_name}.service, return_rc=True, return_stdout=True
00:00:00.001 KEYWORD BuiltIn . Log ${output}
00:00:00.001 KEYWORD BuiltIn . Should Be True '${rc}' == '0'
14:44:48.917 FAIL ''5' == '0'' should be true.
00:00:36.336 TEARDOWN LiveMigration . Live Migration Suite Teardown
00:00:00.272 KEYWORD LiveMigration . UnSet Live Migration In Compute Nodes
00:00:00.271 FOR ${conn_id} IN [ @{OS_CMP_CONN_IDS} ]
00:00:00.271 VAR ${conn_id} = 12
00:00:00.154 KEYWORD OpenStackOperations . Modify OpenStack Configuration File ${conn_id}, ${NOVA_CPU_CONF}, DEFAULT, instances_path, ${CMP_INSTANCES_DEFAULT_PATH}
00:00:00.116 KEYWORD OpenStackOperations . Restart DevStack Service ${conn_id}, ${NOVA_COMPUTE_SERVICE}
00:00:00.001 KEYWORD SSHLibrary . Switch Connection ${conn_id}
00:00:00.109 KEYWORD ${output}, ${rc} = SSHLibrary . Execute Command sudo systemctl restart devstack@${service_name}.service, return_rc=True, return_stdout=True
00:00:00.001 KEYWORD BuiltIn . Log ${output}
00:00:00.001 KEYWORD BuiltIn . Should Be True '${rc}' == '0'
14:44:49.194 FAIL ''5' == '0'' should be true.
00:00:36.061 KEYWORD OpenStackOperations . OpenStack Suite Teardown
00:00:00.002 TEST Migrate Instance And Verify Connectivity While Migration And After
00:13:09.768 SUITE External Network
00:09:13.845 SUITE Security Group
00:02:43.729 SUITE Neutron Security Group
00:07:28.557 SUITE Security Group L3Bcast
00:07:11.424 SUITE Vpn Basic
00:05:34.855 SETUP Suite Setup
00:00:48.162 KEYWORD VpnOperations . Basic Suite Setup
00:00:02.367 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[0]
00:00:02.336 KEYWORD OpenStackOperations . Create Network @{NETWORKS}[1]
00:00:00.044 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Utils.Check For Elements At URI, ${NETWORK_URL}, ${NETWORKS}
00:00:03.194 KEYWORD OpenStackOperations . Update Network @{NETWORKS}[0], additional_args=--description ${UPDATE_NETWORK}
00:00:02.264 KEYWORD ${output} = OpenStackOperations . Show Network @{NETWORKS}[0]
00:00:00.001 KEYWORD BuiltIn . Should Contain ${output}, ${UPDATE_NETWORK}
00:00:02.616 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[0], @{SUBNETS}[0], @{SUBNET_CIDRS}[0]
00:00:02.844 KEYWORD OpenStackOperations . Create SubNet @{NETWORKS}[1], @{SUBNETS}[1], @{SUBNET_CIDRS}[1]
00:00:00.054 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Utils.Check For Elements At URI, ${SUBNETWORK_URL}, ${SUBNETS}
00:00:02.431 KEYWORD OpenStackOperations . Update SubNet @{SUBNETS}[0], additional_args=--description ${UPDATE_SUBNET}
00:00:02.192 KEYWORD ${output} = OpenStackOperations . Show SubNet @{SUBNETS}[0]
00:00:00.001 KEYWORD BuiltIn . Should Contain ${output}, ${UPDATE_SUBNET}
00:00:17.002 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}
00:00:00.001 KEYWORD ${allowed_address_pairs_args} = BuiltIn . Set Variable --allowed-address ip-address=@{EXTRA_NW_SUBNET}[0] --allowed-address ip-address=@{EXTRA_NW_SUBNET}[1]
00:00:03.345 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[0], sg=${SECURITY_GROUP}, additional_args=${allowed_address_pairs_args}
00:00:03.012 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[1], sg=${SECURITY_GROUP}, additional_args=${allowed_address_pairs_args}
00:00:03.550 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[2], sg=${SECURITY_GROUP}, additional_args=${allowed_address_pairs_args}
00:00:03.130 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[3], sg=${SECURITY_GROUP}, additional_args=${allowed_address_pairs_args}
00:00:00.054 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Check For Elements At URI, ${PORT_URL}, ${PORTS}
00:00:09.495 KEYWORD ${PORTS_MACADDR} = OpenStackOperations . Get Ports MacAddr ${PORTS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable ${PORTS_MACADDR}
00:00:02.868 KEYWORD OpenStackOperations . Update Port @{PORTS}[0], additional_args=--description ${UPDATE_PORT}
00:00:02.372 KEYWORD ${output} = OpenStackOperations . Show Port @{PORTS}[0]
00:00:00.000 KEYWORD BuiltIn . Should Contain ${output}, ${UPDATE_PORT}
00:00:04.725 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:04.107 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[1], @{NET_1_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:03.334 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[2], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:03.939 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[3], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:11.826 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}
00:03:13.487 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}
00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None
00:00:00.000 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None
15:23:36.199 FAIL '[u'20.1.1.4', u'None']' contains 'None'
00:01:36.410 TEARDOWN Suite Teardown
00:00:00.001 TEST Check ELAN Datapath Traffic Within The Networks
00:00:00.000 TEST Create Router
00:00:00.000 TEST Add Interfaces To Router
00:00:00.001 TEST Check L3_Datapath Traffic Across Networks With Router
00:00:00.000 TEST Add Multiple Extra Routes And Check Datapath Before L3VPN Creation
00:00:00.000 TEST Delete Extra Route
00:00:00.001 TEST Delete And Recreate Extra Route
00:00:00.000 TEST Create L3VPN
00:00:00.000 TEST Associate L3VPN To Routers
00:00:00.001 TEST Verify L3VPN Datapath With Router Association
00:00:00.001 TEST Delete Router Failure When Associated With L3VPN
00:00:00.000 TEST Verify Remove Interface From Router When Associated With L3VPN
00:00:00.000 TEST Verify L3VPN Datapath With Router Dissociation When Interfaces are Added To Router
00:00:00.001 TEST Remove Router Interfaces And Check L3_Datapath Traffic Across Networks
00:00:00.000 TEST Delete Router
00:00:00.000 TEST Delete Router With NonExistentRouter Name
00:00:00.001 TEST Associate Networks To L3VPN
00:00:00.000 TEST Check Datapath Traffic Across Networks With L3VPN
00:00:00.000 TEST Verification of route update after VM port removed and re added to VPN
00:00:00.001 TEST Verification of route update after reconfiguring vpn by adding new ports
00:00:00.000 TEST Dissociate L3VPN From Networks
00:00:00.001 TEST Delete Unknown L3VPN
00:00:00.001 TEST Delete L3VPN
00:00:00.000 TEST Create Multiple L3VPN
00:09:31.606 SUITE Elan
00:07:52.807 SUITE Arp Learning
00:05:50.636 SETUP Suite Setup
00:00:47.990 KEYWORD VpnOperations . Basic Suite Setup
00:00:07.493 FOR ${network} IN [ @{NETWORKS} ]
00:00:02.498 KEYWORD ${neutron_networks} = OpenStackOperations . List Networks
00:00:00.004 FOR ${network} IN [ @{NETWORKS} ]
00:00:02.310 KEYWORD ${NET_ID} = OpenStackOperations . Get Net Id @{NETWORKS}[0]
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable ${NET_ID}
00:00:08.333 FOR ${i} IN RANGE [ 0 | 3 ]
00:00:02.101 KEYWORD ${neutron_subnets} = OpenStackOperations . List Subnets
00:00:00.002 FOR ${subnet} IN [ @{SUBNETS} ]
00:00:17.848 KEYWORD OpenStackOperations . Create Allow All SecurityGroup ${SECURITY_GROUP}
00:00:03.477 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[0], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:03.440 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[0], @{PORTS}[1], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:03.385 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[2], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:03.271 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[1], @{PORTS}[3], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:03.166 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[2], @{PORTS}[4], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:03.430 KEYWORD OpenStackOperations . Create Port @{NETWORKS}[2], @{PORTS}[5], sg=${SECURITY_GROUP}, allowed_address_pairs=@{EXTRA_NW_IP}
00:00:00.056 KEYWORD BuiltIn . Wait Until Keyword Succeeds 3s, 1s, Check For Elements At URI, ${CONFIG_API}/neutron:neutron/ports/, ${PORTS}
00:00:04.685 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[0], @{NET_1_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:03.958 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[1], @{NET_1_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:03.519 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[2], @{NET_2_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:04.559 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[3], @{NET_2_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:03.807 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[4], @{NET_3_VMS}[0], ${OS_CMP1_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:04.022 KEYWORD OpenStackOperations . Create Vm Instance With Port On Compute Node @{PORTS}[5], @{NET_3_VMS}[1], ${OS_CMP2_HOSTNAME}, sg=${SECURITY_GROUP}
00:00:12.577 KEYWORD @{NET_1_VM_IPS}, ${NET_1_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_1_VMS}
00:00:11.431 KEYWORD @{NET_2_VM_IPS}, ${NET_2_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_2_VMS}
00:03:13.112 KEYWORD @{NET_3_VM_IPS}, ${NET_3_DHCP_IP} = OpenStackOperations . Get VM IPs @{NET_3_VMS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_1_VM_IPS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_2_VM_IPS}
00:00:00.001 KEYWORD BuiltIn . Set Suite Variable @{NET_3_VM_IPS}
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_1_VM_IPS}, None
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_2_VM_IPS}, None
00:00:00.001 KEYWORD BuiltIn . Should Not Contain ${NET_3_VM_IPS}, None
15:40:34.961 FAIL '[u'10.30.30.8', u'None']' contains 'None'
00:02:02.085 TEARDOWN Suite Teardown
00:00:00.001 TEST Verify Setup
00:00:00.001 TEST Verify GARP Requests
00:00:00.001 TEST Verify MIP Migration
00:06:48.650 SUITE L2L3 Gatewaymac Arp
00:00:00.018 SUITE Create JVM Plots