2018-03-12 07:06:46,714 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-03-12 07:06:46,715 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-03-12 07:06:51,188 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-03-12 07:06:51,188 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.6', 'overcloud-controller-1: 192.30.9.4', 'overcloud-controller-2: 192.30.9.5'] 2018-03-12 07:06:51,188 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.9', 'overcloud-novacompute-1: 192.30.9.3'] 2018-03-12 07:06:51,189 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-03-12 07:07:06,574 - baro_tests.barometer - INFO - Mcelog will NOT be enabled on node-{}. Unsupported CentOS release found (overcloud-novacompute-0). 2018-03-12 07:07:06,616 - baro_tests.barometer - INFO - Mcelog will NOT be enabled on node-{}. Unsupported CentOS release found (overcloud-novacompute-1). 2018-03-12 07:07:20,887 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-03-12 07:07:21,139 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-03-12 07:07:21,139 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-03-12 07:09:10,740 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-03-12 07:09:24,129 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-03-12 07:09:24,129 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-03-12 07:10:39,762 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-03-12 07:11:05,615 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:11:25,365 - baro_tests.barometer - INFO - PASS 2018-03-12 07:11:25,365 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Hugepages. 2018-03-12 07:12:18,208 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-03-12 07:12:44,204 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:13:03,159 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-03-12 07:13:03,160 - baro_tests.barometer - INFO - Data not updated after 12 seconds 2018-03-12 07:13:03,160 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Intel RDT. 2018-03-12 07:13:56,079 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-12 07:14:22,227 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:14:24,973 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-12 07:14:27,728 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-03-12 07:14:30,453 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Mcelog. 2018-03-12 07:15:25,939 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-12 07:15:51,388 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:15:54,013 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-12 07:15:56,596 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-03-12 07:15:59,123 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-03-12 07:16:53,051 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-03-12 07:17:18,935 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:17:28,733 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-12 07:17:28,734 - baro_tests.barometer - INFO - Data not updated after 3 seconds 2018-03-12 07:17:28,734 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS stats. 2018-03-12 07:18:21,033 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-12 07:18:46,490 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-03-12 07:19:05,064 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-03-12 07:19:05,065 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-03-12 07:19:55,825 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-12 07:20:21,173 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-03-12 07:20:23,364 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-12 07:20:25,643 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-03-12 07:20:28,294 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-03-12 07:20:28,295 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-03-12 07:20:28,296 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-03-12 07:20:41,110 - baro_tests.barometer - INFO - Stopping collectd service... 2018-03-12 07:20:51,740 - baro_tests.barometer - INFO - Starting collectd service... 2018-03-12 07:21:02,013 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-03-12 07:22:03,438 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-03-12 07:22:28,761 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 915fd01b-485c-45c6-a180-139ce0f4a82c... 2018-03-12 07:22:28,762 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-12 07:22:28,762 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb', 'hugepages-node1-2048Kb'] 2018-03-12 07:22:28,762 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-03-12 07:22:42,201 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:22:42,201 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1520838972.37 ... 2018-03-12 07:22:42,202 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,202 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1520838972.37 ... 2018-03-12 07:22:42,202 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1520838972.37 ... 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1520838972.37 ... 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-free 1520838972.37 ... 2018-03-12 07:22:42,203 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,204 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-used 1520838972.37 ... 2018-03-12 07:22:42,204 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:22:42,204 - baro_tests.barometer - INFO - OK 2018-03-12 07:22:42,204 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-12 07:22:54,208 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-12 07:23:07,214 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1520838972.371, 1520838982.371), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1520838972.371, 1520838982.371), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1520838972.371, 1520838982.371), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1520838972.371, 1520838982.371), ('hugepages-node1-2048Kb', 'vmpage_number-free', 1520838972.371, 1520838982.371), ('hugepages-node1-2048Kb', 'vmpage_number-used', 1520838972.371, 1520838982.371)] 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1520839002.371, 1520839012.371), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1520839002.371, 1520839012.371), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1520839002.371, 1520839012.371), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1520839002.371, 1520839012.371), ('hugepages-node1-2048Kb', 'vmpage_number-free', 1520839002.371, 1520839012.371), ('hugepages-node1-2048Kb', 'vmpage_number-used', 1520839002.371, 1520839012.371)] 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1520838972.37 - hugepages-mm-2048Kb vmpage_number-free 1520839002.37 ... 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1520838972.37 - hugepages-mm-2048Kb vmpage_number-used 1520839002.37 ... 2018-03-12 07:23:07,215 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1520838972.37 - hugepages-node0-2048Kb vmpage_number-free 1520839002.37 ... 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1520838972.37 - hugepages-node0-2048Kb vmpage_number-used 1520839002.37 ... 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-free 1520838972.37 - hugepages-node1-2048Kb vmpage_number-free 1520839002.37 ... 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-used 1520838972.37 - hugepages-node1-2048Kb vmpage_number-used 1520839002.37 ... 2018-03-12 07:23:07,216 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - INFO - OK 2018-03-12 07:23:07,216 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-03-12 07:23:58,497 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-03-12 07:24:24,314 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 915fd01b-485c-45c6-a180-139ce0f4a82c... 2018-03-12 07:24:24,314 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-12 07:24:24,315 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-03-12 07:24:24,315 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-03-12 07:24:36,797 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:24:36,797 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1520839092.37 ... 2018-03-12 07:24:36,797 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:24:36,798 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1520839092.37 ... 2018-03-12 07:24:36,798 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:24:36,798 - baro_tests.barometer - INFO - OK 2018-03-12 07:24:36,799 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-12 07:24:48,809 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-12 07:25:02,625 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:25:02,625 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1520839092.371, 1520839102.371), ('intel_rdt-0-2', 'ipc', 1520839092.371, 1520839102.371)] 2018-03-12 07:25:02,626 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1520839122.371, 1520839132.371), ('intel_rdt-0-2', 'ipc', 1520839122.371, 1520839132.371)] 2018-03-12 07:25:02,626 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1520839092.37 - intel_rdt-0-2 bytes-llc 1520839122.37 ... 2018-03-12 07:25:02,626 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:25:02,626 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1520839092.37 - intel_rdt-0-2 ipc 1520839122.37 ... 2018-03-12 07:25:02,626 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:25:02,626 - baro_tests.barometer - INFO - OK 2018-03-12 07:25:02,627 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-03-12 07:25:56,242 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-12 07:26:22,869 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 915fd01b-485c-45c6-a180-139ce0f4a82c... 2018-03-12 07:26:22,870 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:26:22,870 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-03-12 07:26:22,871 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-03-12 07:26:35,224 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-corrected_memory_errors in mcelog-SOCKET_0_CHANNEL_0_DIMM_any subdir failed 2018-03-12 07:26:35,352 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-uncorrected_memory_errors in mcelog-SOCKET_0_CHANNEL_0_DIMM_any subdir failed 2018-03-12 07:26:35,455 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-corrected_memory_errors in mcelog-SOCKET_0_CHANNEL_any_DIMM_any subdir failed 2018-03-12 07:26:35,559 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-uncorrected_memory_errors in mcelog-SOCKET_0_CHANNEL_any_DIMM_any subdir failed 2018-03-12 07:26:35,559 - baro_tests.barometer - ERROR - Some plugin metrics not found 2018-03-12 07:26:35,559 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with CSV FAILED on Mcelog. 2018-03-12 07:27:24,678 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-12 07:27:50,177 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 915fd01b-485c-45c6-a180-139ce0f4a82c... 2018-03-12 07:27:50,177 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:27:50,178 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-03-12 07:27:50,178 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-03-12 07:28:02,428 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:28:02,428 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1520839310.37 ... 2018-03-12 07:28:02,428 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:28:02,428 - baro_tests.barometer - INFO - OK 2018-03-12 07:28:02,428 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-12 07:28:05,429 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-12 07:28:17,875 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:28:17,875 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1520839310.372, 1520839311.372)] 2018-03-12 07:28:17,876 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1520839326.372, 1520839327.372)] 2018-03-12 07:28:17,876 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1520839310.37 - ovs_events-br0 gauge-link_status 1520839326.37 ... 2018-03-12 07:28:17,877 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:28:17,877 - baro_tests.barometer - INFO - OK 2018-03-12 07:28:17,877 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-03-12 07:29:07,339 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-03-12 07:29:32,274 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 915fd01b-485c-45c6-a180-139ce0f4a82c... 2018-03-12 07:29:32,275 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:29:32,275 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-03-12 07:29:32,275 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-03-12 07:29:45,620 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:29:45,620 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1520839414.37 ... 2018-03-12 07:29:45,621 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:29:45,621 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1520839414.37 ... 2018-03-12 07:29:45,621 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:29:45,621 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1520839414.37 ... 2018-03-12 07:29:45,621 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:29:45,622 - baro_tests.barometer - INFO - OK 2018-03-12 07:29:45,622 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-12 07:29:48,623 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-12 07:30:00,964 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:30:00,965 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1520839414.372, 1520839415.372), ('ovs_stats-br0.br0', 'if_errors', 1520839414.372, 1520839415.372), ('ovs_stats-br0.br0', 'if_packets', 1520839414.372, 1520839415.372)] 2018-03-12 07:30:00,965 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1520839429.372, 1520839430.372), ('ovs_stats-br0.br0', 'if_errors', 1520839429.372, 1520839430.372), ('ovs_stats-br0.br0', 'if_packets', 1520839429.372, 1520839430.372)] 2018-03-12 07:30:00,965 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1520839414.37 - ovs_stats-br0.br0 if_dropped 1520839429.37 ... 2018-03-12 07:30:00,966 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:30:00,966 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1520839414.37 - ovs_stats-br0.br0 if_errors 1520839429.37 ... 2018-03-12 07:30:00,966 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:30:00,966 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1520839414.37 - ovs_stats-br0.br0 if_packets 1520839429.37 ... 2018-03-12 07:30:00,966 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:30:00,966 - baro_tests.barometer - INFO - OK 2018-03-12 07:30:00,966 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-03-12 07:30:13,511 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-03-12 07:30:26,381 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-03-12 07:30:26,381 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-03-12 07:31:38,033 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-03-12 07:32:03,312 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:32:22,244 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-03-12 07:32:22,245 - baro_tests.barometer - INFO - Data not updated after 12 seconds 2018-03-12 07:32:22,248 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Hugepages. 2018-03-12 07:33:16,471 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-03-12 07:33:42,217 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:34:01,285 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-03-12 07:34:01,285 - baro_tests.barometer - INFO - Data not updated after 12 seconds 2018-03-12 07:34:01,286 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Intel RDT. 2018-03-12 07:34:52,860 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-12 07:35:18,870 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:35:21,508 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-12 07:35:24,143 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-03-12 07:35:26,649 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-03-12 07:36:18,888 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-12 07:36:42,643 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:36:52,620 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-12 07:36:52,622 - baro_tests.barometer - INFO - Data not updated after 3 seconds 2018-03-12 07:36:52,624 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS events. 2018-03-12 07:37:41,656 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-03-12 07:38:06,868 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-03-12 07:38:16,883 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-12 07:38:16,883 - baro_tests.barometer - INFO - Data not updated after 3 seconds 2018-03-12 07:38:16,884 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS stats. 2018-03-12 07:39:07,350 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-12 07:39:32,678 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-03-12 07:39:51,364 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-03-12 07:39:51,364 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-03-12 07:40:41,046 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-12 07:41:05,912 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-03-12 07:41:08,126 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-12 07:41:10,306 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-03-12 07:41:12,567 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-03-12 07:41:12,572 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-03-12 07:41:12,572 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-03-12 07:41:25,309 - baro_tests.barometer - INFO - Stopping collectd service... 2018-03-12 07:41:35,997 - baro_tests.barometer - INFO - Starting collectd service... 2018-03-12 07:41:46,295 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-03-12 07:42:48,639 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-03-12 07:43:14,322 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 12ed8b08-8d31-47fd-9778-03fb392bca93... 2018-03-12 07:43:14,322 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-12 07:43:14,323 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb', 'hugepages-node1-2048Kb'] 2018-03-12 07:43:14,323 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-03-12 07:43:28,149 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:43:28,150 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1520840240.67 ... 2018-03-12 07:43:28,150 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,152 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1520840240.67 ... 2018-03-12 07:43:28,152 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,153 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1520840240.67 ... 2018-03-12 07:43:28,153 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,153 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1520840240.67 ... 2018-03-12 07:43:28,153 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,154 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-free 1520840240.67 ... 2018-03-12 07:43:28,154 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,154 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-used 1520840240.67 ... 2018-03-12 07:43:28,154 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:28,156 - baro_tests.barometer - INFO - OK 2018-03-12 07:43:28,156 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-12 07:43:40,166 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-12 07:43:53,444 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:43:53,445 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1520840240.67, 1520840250.67), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1520840240.67, 1520840250.67), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1520840240.67, 1520840250.67), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1520840240.67, 1520840250.67), ('hugepages-node1-2048Kb', 'vmpage_number-free', 1520840240.67, 1520840250.67), ('hugepages-node1-2048Kb', 'vmpage_number-used', 1520840240.67, 1520840250.67)] 2018-03-12 07:43:53,445 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1520840260.67, 1520840270.67), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1520840260.67, 1520840270.67), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1520840260.67, 1520840270.67), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1520840260.67, 1520840270.67), ('hugepages-node1-2048Kb', 'vmpage_number-free', 1520840260.67, 1520840270.67), ('hugepages-node1-2048Kb', 'vmpage_number-used', 1520840260.67, 1520840270.67)] 2018-03-12 07:43:53,445 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1520840240.67 - hugepages-mm-2048Kb vmpage_number-free 1520840260.67 ... 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1520840240.67 - hugepages-mm-2048Kb vmpage_number-used 1520840260.67 ... 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1520840240.67 - hugepages-node0-2048Kb vmpage_number-free 1520840260.67 ... 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1520840240.67 - hugepages-node0-2048Kb vmpage_number-used 1520840260.67 ... 2018-03-12 07:43:53,446 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,447 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-free 1520840240.67 - hugepages-node1-2048Kb vmpage_number-free 1520840260.67 ... 2018-03-12 07:43:53,447 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,447 - baro_tests.barometer - DEBUG - hugepages-node1-2048Kb vmpage_number-used 1520840240.67 - hugepages-node1-2048Kb vmpage_number-used 1520840260.67 ... 2018-03-12 07:43:53,447 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:43:53,447 - baro_tests.barometer - INFO - OK 2018-03-12 07:43:53,447 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-03-12 07:44:43,012 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-03-12 07:45:08,330 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 12ed8b08-8d31-47fd-9778-03fb392bca93... 2018-03-12 07:45:08,331 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-12 07:45:08,331 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-03-12 07:45:08,331 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-03-12 07:45:20,966 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:45:20,968 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1520840350.67 ... 2018-03-12 07:45:20,968 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:45:20,970 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1520840350.67 ... 2018-03-12 07:45:20,970 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:45:20,970 - baro_tests.barometer - INFO - OK 2018-03-12 07:45:20,971 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-12 07:45:32,982 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-12 07:45:45,353 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:45:45,353 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1520840350.67, 1520840360.67), ('intel_rdt-0-2', 'ipc', 1520840350.67, 1520840360.67)] 2018-03-12 07:45:45,354 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1520840370.67, 1520840380.67), ('intel_rdt-0-2', 'ipc', 1520840370.67, 1520840380.67)] 2018-03-12 07:45:45,354 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1520840350.67 - intel_rdt-0-2 bytes-llc 1520840370.67 ... 2018-03-12 07:45:45,354 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:45:45,354 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1520840350.67 - intel_rdt-0-2 ipc 1520840370.67 ... 2018-03-12 07:45:45,354 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:45:45,354 - baro_tests.barometer - INFO - OK 2018-03-12 07:45:45,355 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-03-12 07:46:36,575 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-12 07:47:00,352 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 12ed8b08-8d31-47fd-9778-03fb392bca93... 2018-03-12 07:47:00,352 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:47:00,352 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-03-12 07:47:00,352 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-03-12 07:47:12,313 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-corrected_memory_errors in mcelog-SOCKET_0_CHANNEL_0_DIMM_any subdir failed 2018-03-12 07:47:12,448 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-uncorrected_memory_errors in mcelog-SOCKET_0_CHANNEL_0_DIMM_any subdir failed 2018-03-12 07:47:12,577 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-corrected_memory_errors in mcelog-SOCKET_0_CHANNEL_any_DIMM_any subdir failed 2018-03-12 07:47:12,704 - baro_tests.barometer - ERROR - Getting last two CSV entries of meter category errors-uncorrected_memory_errors in mcelog-SOCKET_0_CHANNEL_any_DIMM_any subdir failed 2018-03-12 07:47:12,705 - baro_tests.barometer - ERROR - Some plugin metrics not found 2018-03-12 07:47:12,708 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with CSV FAILED on Mcelog. 2018-03-12 07:48:02,381 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-12 07:48:26,631 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 12ed8b08-8d31-47fd-9778-03fb392bca93... 2018-03-12 07:48:26,632 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:48:26,632 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-03-12 07:48:26,632 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-03-12 07:48:39,353 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:48:39,353 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1520840562.67 ... 2018-03-12 07:48:39,354 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:48:39,354 - baro_tests.barometer - INFO - OK 2018-03-12 07:48:39,354 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-12 07:48:42,357 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-12 07:48:55,133 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:48:55,134 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1520840562.671, 1520840563.671)] 2018-03-12 07:48:55,136 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1520840577.671, 1520840578.671)] 2018-03-12 07:48:55,137 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1520840562.67 - ovs_events-br0 gauge-link_status 1520840577.67 ... 2018-03-12 07:48:55,137 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:48:55,138 - baro_tests.barometer - INFO - OK 2018-03-12 07:48:55,138 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-03-12 07:49:46,256 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-03-12 07:50:09,747 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 12ed8b08-8d31-47fd-9778-03fb392bca93... 2018-03-12 07:50:09,747 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-12 07:50:09,747 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-03-12 07:50:09,747 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-03-12 07:50:22,745 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-12 07:50:22,745 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1520840665.67 ... 2018-03-12 07:50:22,745 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:22,745 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1520840665.67 ... 2018-03-12 07:50:22,746 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:22,746 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1520840665.67 ... 2018-03-12 07:50:22,746 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:22,746 - baro_tests.barometer - INFO - OK 2018-03-12 07:50:22,746 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-12 07:50:25,748 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-12 07:50:38,553 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-12 07:50:38,554 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1520840665.671, 1520840666.671), ('ovs_stats-br0.br0', 'if_errors', 1520840665.671, 1520840666.671), ('ovs_stats-br0.br0', 'if_packets', 1520840665.671, 1520840666.671)] 2018-03-12 07:50:38,555 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1520840681.671, 1520840682.671), ('ovs_stats-br0.br0', 'if_errors', 1520840681.671, 1520840682.671), ('ovs_stats-br0.br0', 'if_packets', 1520840681.671, 1520840682.671)] 2018-03-12 07:50:38,556 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1520840665.67 - ovs_stats-br0.br0 if_dropped 1520840681.67 ... 2018-03-12 07:50:38,557 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:38,558 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1520840665.67 - ovs_stats-br0.br0 if_errors 1520840681.67 ... 2018-03-12 07:50:38,559 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:38,560 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1520840665.67 - ovs_stats-br0.br0 if_packets 1520840681.67 ... 2018-03-12 07:50:38,560 - baro_tests.barometer - DEBUG - OK 2018-03-12 07:50:38,561 - baro_tests.barometer - INFO - OK 2018-03-12 07:50:38,561 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-03-12 07:50:50,910 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-03-12 07:50:50,911 - baro_tests.barometer - INFO - ====================================================================== 2018-03-12 07:50:50,912 - baro_tests.barometer - INFO - +----------------------------------+ 2018-03-12 07:50:50,912 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-03-12 07:50:50,912 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-12 07:50:50,913 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-03-12 07:50:50,913 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-12 07:50:50,914 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | FAIL | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - | IN:Intel RDT | FAIL | FAIL | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - | IN:OVS stats | FAIL | FAIL | 2018-03-12 07:50:50,915 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-03-12 07:50:50,916 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-03-12 07:50:50,917 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-12 07:50:50,917 - baro_tests.barometer - INFO - ====================================================================== 2018-03-12 07:50:50,917 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-03-12 07:50:50,917 - baro_tests.barometer - ERROR - Overall Result is Fail