2018-04-24 10:53:41,793 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-04-24 10:53:41,793 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-04-24 10:53:45,875 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-04-24 10:53:45,875 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.3'] 2018-04-24 10:53:45,875 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.7', 'overcloud-novacompute-1: 192.30.9.5'] 2018-04-24 10:53:45,875 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-04-24 10:53:57,775 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-04-24 10:53:57,825 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-04-24 10:53:58,192 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-04-24 10:53:58,206 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-04-24 10:53:58,256 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-04-24 10:53:58,630 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-04-24 10:54:08,784 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-04-24 10:54:09,033 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-04-24 10:54:09,033 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-04-24 10:54:48,838 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-04-24 10:54:59,324 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-04-24 10:54:59,324 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-04-24 10:56:16,732 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-24 10:56:40,810 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 10:56:43,500 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Hugepages. 2018-04-24 10:57:30,912 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-24 10:58:05,202 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 10:58:42,342 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-24 10:58:42,342 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-24 10:58:42,343 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Intel RDT. 2018-04-24 10:59:29,151 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-24 10:59:52,936 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:00:29,997 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-24 11:00:29,997 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-24 11:00:29,997 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Mcelog. 2018-04-24 11:01:16,746 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-24 11:01:39,650 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:01:42,406 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-04-24 11:02:28,828 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-24 11:02:52,761 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:03:29,857 - baro_tests.barometer - INFO - PASS 2018-04-24 11:03:29,857 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on OVS stats. 2018-04-24 11:04:16,635 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-24 11:04:38,975 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-24 11:04:58,761 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-24 11:04:58,762 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-04-24 11:05:44,683 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-24 11:06:07,240 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-24 11:06:09,456 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-04-24 11:06:09,457 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-04-24 11:06:09,457 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-24 11:06:21,073 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-24 11:06:32,216 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-24 11:06:43,246 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-24 11:07:42,344 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-24 11:08:06,366 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 8f5a0ba3-a161-4bd4-ac38-292db7bcfb31... 2018-04-24 11:08:06,367 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-24 11:08:06,367 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-24 11:08:06,367 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-24 11:08:17,893 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:08:17,894 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524567669.03 ... 2018-04-24 11:08:17,894 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:17,894 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524567669.03 ... 2018-04-24 11:08:17,894 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:17,894 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524567669.03 ... 2018-04-24 11:08:17,895 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:17,895 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524567669.03 ... 2018-04-24 11:08:17,895 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:17,895 - baro_tests.barometer - INFO - OK 2018-04-24 11:08:17,895 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-24 11:08:29,907 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-24 11:08:42,171 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:08:42,171 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524567669.032, 1524567679.032), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524567669.032, 1524567679.032), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524567669.032, 1524567679.032), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524567669.032, 1524567679.032)] 2018-04-24 11:08:42,171 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524567689.032, 1524567699.032), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524567689.032, 1524567699.032), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524567689.032, 1524567699.032), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524567689.032, 1524567699.032)] 2018-04-24 11:08:42,172 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524567669.03 - hugepages-mm-2048Kb vmpage_number-free 1524567689.03 ... 2018-04-24 11:08:42,172 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:42,172 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524567669.03 - hugepages-mm-2048Kb vmpage_number-used 1524567689.03 ... 2018-04-24 11:08:42,173 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:42,173 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524567669.03 - hugepages-node0-2048Kb vmpage_number-free 1524567689.03 ... 2018-04-24 11:08:42,173 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:42,173 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524567669.03 - hugepages-node0-2048Kb vmpage_number-used 1524567689.03 ... 2018-04-24 11:08:42,173 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:08:42,173 - baro_tests.barometer - INFO - OK 2018-04-24 11:08:42,173 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-04-24 11:09:29,682 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-24 11:10:03,212 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 8f5a0ba3-a161-4bd4-ac38-292db7bcfb31... 2018-04-24 11:10:03,212 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-24 11:10:03,213 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-24 11:10:03,213 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-24 11:10:14,592 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:10:14,592 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524567789.03 ... 2018-04-24 11:10:14,593 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:10:14,593 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524567789.03 ... 2018-04-24 11:10:14,593 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:10:14,594 - baro_tests.barometer - INFO - OK 2018-04-24 11:10:14,594 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-24 11:10:26,603 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-24 11:10:38,031 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:10:38,032 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524567789.032, 1524567799.032), ('intel_rdt-0-2', 'ipc', 1524567789.032, 1524567799.032)] 2018-04-24 11:10:38,032 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524567809.032, 1524567819.032), ('intel_rdt-0-2', 'ipc', 1524567809.032, 1524567819.032)] 2018-04-24 11:10:38,032 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524567789.03 - intel_rdt-0-2 bytes-llc 1524567809.03 ... 2018-04-24 11:10:38,033 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:10:38,033 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524567789.03 - intel_rdt-0-2 ipc 1524567809.03 ... 2018-04-24 11:10:38,033 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:10:38,033 - baro_tests.barometer - INFO - OK 2018-04-24 11:10:38,033 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-04-24 11:11:23,074 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-24 11:11:45,891 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 8f5a0ba3-a161-4bd4-ac38-292db7bcfb31... 2018-04-24 11:11:45,891 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:11:45,892 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-24 11:11:45,892 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-24 11:11:58,176 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:11:58,176 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524567902.03 ... 2018-04-24 11:11:58,176 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:11:58,177 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524567902.03 ... 2018-04-24 11:11:58,177 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:11:58,177 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524567902.03 ... 2018-04-24 11:11:58,177 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:11:58,177 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524567902.03 ... 2018-04-24 11:11:58,178 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:11:58,178 - baro_tests.barometer - INFO - OK 2018-04-24 11:11:58,178 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:12:01,182 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-24 11:12:12,333 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:12:12,334 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524567902.033, 1524567903.033), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524567902.033, 1524567903.033), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524567902.033, 1524567903.033), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524567902.033, 1524567903.033)] 2018-04-24 11:12:12,334 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524567916.033, 1524567917.033), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524567916.033, 1524567917.033), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524567916.032, 1524567918.033), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524567917.032, 1524567918.033)] 2018-04-24 11:12:12,334 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524567902.03 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524567916.03 ... 2018-04-24 11:12:12,335 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:12:12,335 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524567902.03 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524567916.03 ... 2018-04-24 11:12:12,335 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:12:12,335 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524567902.03 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524567916.03 ... 2018-04-24 11:12:12,335 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:12:12,336 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524567902.03 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524567917.03 ... 2018-04-24 11:12:12,336 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:12:12,336 - baro_tests.barometer - INFO - OK 2018-04-24 11:12:12,336 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-04-24 11:12:57,398 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-24 11:13:20,750 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 8f5a0ba3-a161-4bd4-ac38-292db7bcfb31... 2018-04-24 11:13:20,751 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:13:20,751 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-24 11:13:20,751 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-24 11:13:32,684 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:13:32,684 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524567997.03 ... 2018-04-24 11:13:32,684 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:13:32,685 - baro_tests.barometer - INFO - OK 2018-04-24 11:13:32,685 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:13:35,688 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-24 11:13:47,257 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:13:47,257 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524567997.033, 1524567998.033)] 2018-04-24 11:13:47,258 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524568011.033, 1524568012.033)] 2018-04-24 11:13:47,258 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524567997.03 - ovs_events-br0 gauge-link_status 1524568011.03 ... 2018-04-24 11:13:47,259 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:13:47,259 - baro_tests.barometer - INFO - OK 2018-04-24 11:13:47,260 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-04-24 11:14:32,484 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-24 11:14:54,546 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 8f5a0ba3-a161-4bd4-ac38-292db7bcfb31... 2018-04-24 11:14:54,546 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:14:54,546 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-24 11:14:54,547 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-24 11:15:07,223 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:15:07,223 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524568091.03 ... 2018-04-24 11:15:07,223 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:07,224 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524568091.03 ... 2018-04-24 11:15:07,224 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:07,224 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524568091.03 ... 2018-04-24 11:15:07,225 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:07,225 - baro_tests.barometer - INFO - OK 2018-04-24 11:15:07,225 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:15:10,226 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-24 11:15:21,615 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:15:21,615 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524568091.033, 1524568092.033), ('ovs_stats-br0.br0', 'if_errors', 1524568091.033, 1524568092.033), ('ovs_stats-br0.br0', 'if_packets', 1524568091.033, 1524568092.033)] 2018-04-24 11:15:21,616 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524568106.033, 1524568107.033), ('ovs_stats-br0.br0', 'if_errors', 1524568106.033, 1524568107.033), ('ovs_stats-br0.br0', 'if_packets', 1524568106.033, 1524568107.033)] 2018-04-24 11:15:21,616 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524568091.03 - ovs_stats-br0.br0 if_dropped 1524568106.03 ... 2018-04-24 11:15:21,616 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:21,617 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524568091.03 - ovs_stats-br0.br0 if_errors 1524568106.03 ... 2018-04-24 11:15:21,617 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:21,617 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524568091.03 - ovs_stats-br0.br0 if_packets 1524568106.03 ... 2018-04-24 11:15:21,617 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:15:21,617 - baro_tests.barometer - INFO - OK 2018-04-24 11:15:21,617 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-04-24 11:15:32,727 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-04-24 11:15:43,239 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-04-24 11:15:43,240 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-04-24 11:16:55,756 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-24 11:17:19,200 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:17:56,253 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-24 11:17:56,253 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-24 11:17:56,254 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Hugepages. 2018-04-24 11:18:41,715 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-24 11:19:15,245 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:19:52,086 - baro_tests.barometer - INFO - PASS 2018-04-24 11:19:52,087 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on Intel RDT. 2018-04-24 11:20:35,324 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-24 11:20:57,396 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:21:34,778 - baro_tests.barometer - INFO - PASS 2018-04-24 11:21:34,780 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on Mcelog. 2018-04-24 11:22:19,940 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-24 11:22:41,877 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:23:18,855 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-24 11:23:18,856 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-24 11:23:18,857 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS events. 2018-04-24 11:24:01,944 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-24 11:24:25,164 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-24 11:25:02,561 - baro_tests.barometer - INFO - PASS 2018-04-24 11:25:02,565 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on OVS stats. 2018-04-24 11:25:47,316 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-24 11:26:08,443 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-24 11:26:27,266 - baro_tests.barometer - INFO - PASS 2018-04-24 11:26:27,268 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with AODH PASSED on Mcelog. 2018-04-24 11:27:12,794 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-24 11:27:34,554 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-24 11:27:53,289 - baro_tests.barometer - INFO - PASS 2018-04-24 11:27:53,290 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with AODH PASSED on OVS events. 2018-04-24 11:27:53,290 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-04-24 11:27:53,291 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-24 11:28:04,582 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-24 11:28:15,981 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-24 11:28:26,307 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-24 11:29:21,725 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-24 11:29:45,621 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 32894a2f-0877-4670-874b-2542b5be37f0... 2018-04-24 11:29:45,621 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-24 11:29:45,621 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-24 11:29:45,622 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-24 11:29:57,762 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524568978.48 ... 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524568978.48 ... 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524568978.48 ... 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524568978.48 ... 2018-04-24 11:29:57,763 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:29:57,764 - baro_tests.barometer - INFO - OK 2018-04-24 11:29:57,764 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-24 11:30:09,773 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-24 11:30:20,976 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:30:20,976 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524568978.482, 1524568988.482), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524568978.482, 1524568988.482), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524568978.482, 1524568988.482), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524568978.482, 1524568988.482)] 2018-04-24 11:30:20,976 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524568998.482, 1524569008.482), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524568998.482, 1524569008.482), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524568998.482, 1524569008.482), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524568998.482, 1524569008.482)] 2018-04-24 11:30:20,977 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524568978.48 - hugepages-mm-2048Kb vmpage_number-free 1524568998.48 ... 2018-04-24 11:30:20,977 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:30:20,977 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524568978.48 - hugepages-mm-2048Kb vmpage_number-used 1524568998.48 ... 2018-04-24 11:30:20,978 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:30:20,978 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524568978.48 - hugepages-node0-2048Kb vmpage_number-free 1524568998.48 ... 2018-04-24 11:30:20,978 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:30:20,978 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524568978.48 - hugepages-node0-2048Kb vmpage_number-used 1524568998.48 ... 2018-04-24 11:30:20,978 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:30:20,978 - baro_tests.barometer - INFO - OK 2018-04-24 11:30:20,979 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-04-24 11:31:06,539 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-24 11:31:40,112 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 32894a2f-0877-4670-874b-2542b5be37f0... 2018-04-24 11:31:40,113 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-24 11:31:40,113 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-24 11:31:40,113 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-24 11:31:50,639 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:31:50,639 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524569088.48 ... 2018-04-24 11:31:50,640 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:31:50,640 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524569088.48 ... 2018-04-24 11:31:50,640 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:31:50,641 - baro_tests.barometer - INFO - OK 2018-04-24 11:31:50,641 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-24 11:32:02,653 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-24 11:32:13,679 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:32:13,679 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524569088.482, 1524569098.482), ('intel_rdt-0-2', 'ipc', 1524569088.482, 1524569098.482)] 2018-04-24 11:32:13,679 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524569108.482, 1524569118.482), ('intel_rdt-0-2', 'ipc', 1524569108.482, 1524569118.482)] 2018-04-24 11:32:13,680 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524569088.48 - intel_rdt-0-2 bytes-llc 1524569108.48 ... 2018-04-24 11:32:13,680 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:32:13,680 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524569088.48 - intel_rdt-0-2 ipc 1524569108.48 ... 2018-04-24 11:32:13,681 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:32:13,681 - baro_tests.barometer - INFO - OK 2018-04-24 11:32:13,681 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-04-24 11:32:57,148 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-24 11:33:20,066 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 32894a2f-0877-4670-874b-2542b5be37f0... 2018-04-24 11:33:20,067 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:33:20,067 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-24 11:33:20,068 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-24 11:33:32,742 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:33:32,742 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524569203.48 ... 2018-04-24 11:33:32,743 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:32,743 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524569203.48 ... 2018-04-24 11:33:32,743 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:32,744 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524569203.48 ... 2018-04-24 11:33:32,744 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:32,744 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524569203.48 ... 2018-04-24 11:33:32,744 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:32,744 - baro_tests.barometer - INFO - OK 2018-04-24 11:33:32,745 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:33:35,745 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-24 11:33:46,766 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:33:46,766 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524569203.483, 1524569204.483), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524569203.483, 1524569204.483), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524569203.483, 1524569204.483), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524569203.483, 1524569204.483)] 2018-04-24 11:33:46,766 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524569216.483, 1524569217.483), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524569216.483, 1524569217.483), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524569216.483, 1524569217.483), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524569216.483, 1524569218.483)] 2018-04-24 11:33:46,767 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524569203.48 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524569216.48 ... 2018-04-24 11:33:46,767 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:46,767 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524569203.48 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524569216.48 ... 2018-04-24 11:33:46,767 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:46,768 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524569203.48 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524569216.48 ... 2018-04-24 11:33:46,768 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:46,768 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524569203.48 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524569216.48 ... 2018-04-24 11:33:46,768 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:33:46,768 - baro_tests.barometer - INFO - OK 2018-04-24 11:33:46,768 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-04-24 11:34:32,016 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-24 11:34:53,179 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 32894a2f-0877-4670-874b-2542b5be37f0... 2018-04-24 11:34:53,179 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:34:53,179 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-24 11:34:53,180 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-24 11:35:04,552 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:35:04,552 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524569295.48 ... 2018-04-24 11:35:04,553 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:35:04,555 - baro_tests.barometer - INFO - OK 2018-04-24 11:35:04,557 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:35:07,560 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-24 11:35:18,071 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:35:18,071 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524569295.483, 1524569296.483)] 2018-04-24 11:35:18,071 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524569308.483, 1524569309.483)] 2018-04-24 11:35:18,071 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524569295.48 - ovs_events-br0 gauge-link_status 1524569308.48 ... 2018-04-24 11:35:18,072 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:35:18,072 - baro_tests.barometer - INFO - OK 2018-04-24 11:35:18,073 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-04-24 11:36:01,561 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-24 11:36:23,219 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 32894a2f-0877-4670-874b-2542b5be37f0... 2018-04-24 11:36:23,219 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-24 11:36:23,219 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-24 11:36:23,220 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-24 11:36:34,589 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-24 11:36:34,589 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524569385.48 ... 2018-04-24 11:36:34,589 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:34,590 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524569385.48 ... 2018-04-24 11:36:34,590 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:34,590 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524569385.48 ... 2018-04-24 11:36:34,590 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:34,590 - baro_tests.barometer - INFO - OK 2018-04-24 11:36:34,590 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-24 11:36:37,594 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-24 11:36:47,690 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-24 11:36:47,691 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524569385.483, 1524569386.483), ('ovs_stats-br0.br0', 'if_errors', 1524569385.483, 1524569386.483), ('ovs_stats-br0.br0', 'if_packets', 1524569385.483, 1524569386.483)] 2018-04-24 11:36:47,691 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524569398.483, 1524569399.483), ('ovs_stats-br0.br0', 'if_errors', 1524569398.483, 1524569399.483), ('ovs_stats-br0.br0', 'if_packets', 1524569398.483, 1524569399.483)] 2018-04-24 11:36:47,692 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524569385.48 - ovs_stats-br0.br0 if_dropped 1524569398.48 ... 2018-04-24 11:36:47,692 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:47,693 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524569385.48 - ovs_stats-br0.br0 if_errors 1524569398.48 ... 2018-04-24 11:36:47,694 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:47,694 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524569385.48 - ovs_stats-br0.br0 if_packets 1524569398.48 ... 2018-04-24 11:36:47,695 - baro_tests.barometer - DEBUG - OK 2018-04-24 11:36:47,697 - baro_tests.barometer - INFO - OK 2018-04-24 11:36:47,699 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-04-24 11:36:58,812 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-04-24 11:36:58,812 - baro_tests.barometer - INFO - ====================================================================== 2018-04-24 11:36:58,813 - baro_tests.barometer - INFO - +----------------------------------+ 2018-04-24 11:36:58,814 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-04-24 11:36:58,815 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-24 11:36:58,815 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-04-24 11:36:58,816 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-24 11:36:58,819 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-04-24 11:36:58,820 - baro_tests.barometer - INFO - | IN:Hugepages | FAIL | FAIL | 2018-04-24 11:36:58,822 - baro_tests.barometer - INFO - | IN:Intel RDT | FAIL | PASS | 2018-04-24 11:36:58,822 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | PASS | 2018-04-24 11:36:58,823 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-04-24 11:36:58,823 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-04-24 11:36:58,823 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-24 11:36:58,823 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-04-24 11:36:58,823 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | PASS | 2018-04-24 11:36:58,824 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | PASS | 2018-04-24 11:36:58,824 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-24 11:36:58,825 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-04-24 11:36:58,825 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-04-24 11:36:58,825 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-04-24 11:36:58,825 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-04-24 11:36:58,826 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-04-24 11:36:58,826 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-04-24 11:36:58,826 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-24 11:36:58,826 - baro_tests.barometer - INFO - ====================================================================== 2018-04-24 11:36:58,827 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-04-24 11:36:58,827 - baro_tests.barometer - ERROR - Overall Result is Fail