2018-04-21 21:45:37,489 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-04-21 21:45:37,490 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-04-21 21:45:41,846 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-04-21 21:45:41,846 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.10', 'overcloud-controller-1: 192.30.9.3', 'overcloud-controller-2: 192.30.9.5'] 2018-04-21 21:45:41,847 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.8', 'overcloud-novacompute-1: 192.30.9.6'] 2018-04-21 21:45:41,847 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-04-21 21:45:55,351 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-04-21 21:45:55,401 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-04-21 21:45:55,769 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-04-21 21:45:55,781 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-04-21 21:45:55,831 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-04-21 21:45:56,240 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-04-21 21:46:10,439 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-04-21 21:46:10,706 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-04-21 21:46:10,707 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-04-21 21:48:02,600 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-04-21 21:48:16,565 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-04-21 21:48:16,565 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-04-21 21:49:39,127 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-21 21:50:05,356 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 21:50:42,823 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-21 21:50:42,823 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-21 21:50:42,824 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Hugepages. 2018-04-21 21:51:35,390 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-21 21:52:14,490 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 21:52:51,689 - baro_tests.barometer - INFO - PASS 2018-04-21 21:52:51,689 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Intel RDT. 2018-04-21 21:53:46,006 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-21 21:54:10,801 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 21:54:48,014 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-21 21:54:48,015 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-21 21:54:48,015 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Mcelog. 2018-04-21 21:55:42,510 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-21 21:56:09,527 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 21:56:46,820 - baro_tests.barometer - INFO - PASS 2018-04-21 21:56:46,820 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on OVS events. 2018-04-21 21:57:38,080 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-21 21:58:03,945 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 21:58:41,166 - baro_tests.barometer - INFO - PASS 2018-04-21 21:58:41,168 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on OVS stats. 2018-04-21 21:59:33,439 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-21 21:59:58,771 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-21 22:00:18,851 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-21 22:00:18,852 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-04-21 22:01:08,434 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-21 22:01:33,244 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-21 22:01:35,523 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-21 22:01:38,769 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-04-21 22:01:41,288 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-04-21 22:01:41,291 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-04-21 22:01:41,291 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-21 22:01:53,579 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-21 22:02:04,610 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-21 22:02:14,980 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-21 22:03:16,708 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-21 22:03:41,541 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 1b37259d-5e41-4697-a5c4-fd93de1aa72e... 2018-04-21 22:03:41,541 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-21 22:03:41,541 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-21 22:03:41,542 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-21 22:03:54,621 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:03:54,621 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524347802.62 ... 2018-04-21 22:03:54,622 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:03:54,622 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524347802.62 ... 2018-04-21 22:03:54,622 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:03:54,622 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524347802.62 ... 2018-04-21 22:03:54,623 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:03:54,623 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524347802.62 ... 2018-04-21 22:03:54,623 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:03:54,623 - baro_tests.barometer - INFO - OK 2018-04-21 22:03:54,623 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-21 22:04:06,635 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-21 22:04:19,847 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:04:19,848 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524347802.619, 1524347812.619), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524347802.619, 1524347812.619), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524347802.619, 1524347812.62), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524347802.619, 1524347812.62)] 2018-04-21 22:04:19,848 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1524347832.619, 1524347842.619), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1524347832.619, 1524347842.619), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1524347832.619, 1524347842.619), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1524347832.619, 1524347842.619)] 2018-04-21 22:04:19,848 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524347802.62 - hugepages-mm-2048Kb vmpage_number-free 1524347832.62 ... 2018-04-21 22:04:19,849 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:04:19,849 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524347802.62 - hugepages-mm-2048Kb vmpage_number-used 1524347832.62 ... 2018-04-21 22:04:19,849 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:04:19,849 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524347802.62 - hugepages-node0-2048Kb vmpage_number-free 1524347832.62 ... 2018-04-21 22:04:19,849 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:04:19,850 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524347802.62 - hugepages-node0-2048Kb vmpage_number-used 1524347832.62 ... 2018-04-21 22:04:19,850 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:04:19,850 - baro_tests.barometer - INFO - OK 2018-04-21 22:04:19,850 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-04-21 22:05:12,680 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-21 22:05:51,177 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 1b37259d-5e41-4697-a5c4-fd93de1aa72e... 2018-04-21 22:05:51,177 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-21 22:05:51,177 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-21 22:05:51,178 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-21 22:06:04,935 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:06:04,936 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524347932.62 ... 2018-04-21 22:06:04,936 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:06:04,936 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524347932.62 ... 2018-04-21 22:06:04,936 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:06:04,936 - baro_tests.barometer - INFO - OK 2018-04-21 22:06:04,937 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-21 22:06:16,949 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-21 22:06:30,744 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:06:30,744 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524347932.619, 1524347942.619), ('intel_rdt-0-2', 'ipc', 1524347932.619, 1524347942.619)] 2018-04-21 22:06:30,745 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524347962.619, 1524347972.619), ('intel_rdt-0-2', 'ipc', 1524347962.619, 1524347972.619)] 2018-04-21 22:06:30,745 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524347932.62 - intel_rdt-0-2 bytes-llc 1524347962.62 ... 2018-04-21 22:06:30,745 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:06:30,745 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524347932.62 - intel_rdt-0-2 ipc 1524347962.62 ... 2018-04-21 22:06:30,746 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:06:30,746 - baro_tests.barometer - INFO - OK 2018-04-21 22:06:30,746 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-04-21 22:07:24,614 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-21 22:07:48,969 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 1b37259d-5e41-4697-a5c4-fd93de1aa72e... 2018-04-21 22:07:48,970 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:07:48,970 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-21 22:07:48,971 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-21 22:08:01,600 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:08:01,600 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524348067.62 ... 2018-04-21 22:08:01,601 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:01,601 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524348067.62 ... 2018-04-21 22:08:01,601 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:01,601 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524348067.62 ... 2018-04-21 22:08:01,601 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:01,602 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524348067.62 ... 2018-04-21 22:08:01,602 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:01,602 - baro_tests.barometer - INFO - OK 2018-04-21 22:08:01,602 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:08:04,602 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-21 22:08:18,430 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:08:18,431 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524348067.62, 1524348068.62), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524348067.62, 1524348068.62), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524348067.62, 1524348068.62), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524348067.62, 1524348068.62)] 2018-04-21 22:08:18,431 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524348084.62, 1524348085.621), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524348084.62, 1524348085.621), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524348084.62, 1524348085.621), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524348084.62, 1524348085.621)] 2018-04-21 22:08:18,431 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524348067.62 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524348084.62 ... 2018-04-21 22:08:18,431 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524348067.62 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524348084.62 ... 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524348067.62 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524348084.62 ... 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524348067.62 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524348084.62 ... 2018-04-21 22:08:18,432 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:08:18,432 - baro_tests.barometer - INFO - OK 2018-04-21 22:08:18,433 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-04-21 22:09:11,751 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-21 22:09:35,783 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 1b37259d-5e41-4697-a5c4-fd93de1aa72e... 2018-04-21 22:09:35,783 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:09:35,783 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-21 22:09:35,784 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-21 22:09:48,368 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:09:48,368 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524348174.62 ... 2018-04-21 22:09:48,369 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:09:48,369 - baro_tests.barometer - INFO - OK 2018-04-21 22:09:48,371 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:09:51,374 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-21 22:10:04,801 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:10:04,803 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524348174.621, 1524348175.621)] 2018-04-21 22:10:04,803 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524348190.621, 1524348191.62)] 2018-04-21 22:10:04,804 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524348174.62 - ovs_events-br0 gauge-link_status 1524348190.62 ... 2018-04-21 22:10:04,805 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:10:04,805 - baro_tests.barometer - INFO - OK 2018-04-21 22:10:04,805 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-04-21 22:10:57,367 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-21 22:11:22,829 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 1b37259d-5e41-4697-a5c4-fd93de1aa72e... 2018-04-21 22:11:22,829 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:11:22,830 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-21 22:11:22,830 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-21 22:11:36,089 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:11:36,089 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524348281.62 ... 2018-04-21 22:11:36,089 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:36,089 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524348281.62 ... 2018-04-21 22:11:36,090 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:36,090 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524348282.62 ... 2018-04-21 22:11:36,090 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:36,090 - baro_tests.barometer - INFO - OK 2018-04-21 22:11:36,090 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:11:39,094 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-21 22:11:51,804 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:11:51,804 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524348281.62, 1524348282.62), ('ovs_stats-br0.br0', 'if_errors', 1524348281.62, 1524348283.62), ('ovs_stats-br0.br0', 'if_packets', 1524348282.62, 1524348283.62)] 2018-04-21 22:11:51,804 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524348297.62, 1524348298.62), ('ovs_stats-br0.br0', 'if_errors', 1524348297.62, 1524348298.62), ('ovs_stats-br0.br0', 'if_packets', 1524348297.62, 1524348298.62)] 2018-04-21 22:11:51,805 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524348281.62 - ovs_stats-br0.br0 if_dropped 1524348297.62 ... 2018-04-21 22:11:51,805 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:51,806 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524348281.62 - ovs_stats-br0.br0 if_errors 1524348297.62 ... 2018-04-21 22:11:51,806 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:51,806 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524348282.62 - ovs_stats-br0.br0 if_packets 1524348297.62 ... 2018-04-21 22:11:51,806 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:11:51,806 - baro_tests.barometer - INFO - OK 2018-04-21 22:11:51,807 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-04-21 22:12:03,546 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-04-21 22:12:16,467 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-04-21 22:12:16,467 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-04-21 22:13:39,010 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-21 22:14:03,121 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 22:14:40,438 - baro_tests.barometer - INFO - PASS 2018-04-21 22:14:40,439 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on Hugepages. 2018-04-21 22:15:32,231 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-21 22:16:10,900 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 22:16:13,510 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-21 22:16:16,156 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-04-21 22:16:18,864 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Intel RDT. 2018-04-21 22:17:10,029 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-21 22:17:34,702 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 22:18:12,246 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-21 22:18:12,246 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-21 22:18:12,247 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-04-21 22:19:02,346 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-21 22:19:26,802 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 22:20:04,263 - baro_tests.barometer - INFO - PASS 2018-04-21 22:20:04,265 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on OVS events. 2018-04-21 22:20:56,113 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-21 22:21:20,234 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-21 22:21:57,727 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-21 22:21:57,727 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-21 22:21:57,728 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS stats. 2018-04-21 22:22:49,661 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-21 22:23:14,918 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-21 22:23:33,804 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-21 22:23:33,805 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-04-21 22:24:24,634 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-21 22:24:49,186 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-21 22:24:51,589 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-21 22:24:53,863 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-04-21 22:24:56,221 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-04-21 22:24:56,222 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-04-21 22:24:56,222 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-21 22:25:08,926 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-21 22:25:20,017 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-21 22:25:30,330 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-21 22:26:32,407 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-21 22:26:58,299 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 911f16c8-1a8d-4deb-9a5f-0178cafdfc6b... 2018-04-21 22:26:58,300 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-21 22:26:58,301 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-21 22:26:58,304 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-21 22:27:10,738 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:27:10,738 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1524349206.24 ... 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1524349206.24 ... 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1524349206.24 ... 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:27:10,739 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1524349206.24 ... 2018-04-21 22:27:10,740 - baro_tests.barometer - ERROR - Time of last two entries differ by 20.0, but interval is 10 2018-04-21 22:27:10,740 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with CSV FAILED on Hugepages. 2018-04-21 22:27:59,129 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-21 22:28:35,883 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 911f16c8-1a8d-4deb-9a5f-0178cafdfc6b... 2018-04-21 22:28:35,885 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-21 22:28:35,887 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-21 22:28:35,888 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-21 22:28:48,118 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:28:48,118 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524349306.24 ... 2018-04-21 22:28:48,118 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:28:48,118 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524349306.24 ... 2018-04-21 22:28:48,118 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:28:48,119 - baro_tests.barometer - INFO - OK 2018-04-21 22:28:48,119 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-21 22:29:00,124 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-21 22:29:12,597 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524349306.238, 1524349316.238), ('intel_rdt-0-2', 'ipc', 1524349306.238, 1524349316.238)] 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1524349336.238, 1524349346.238), ('intel_rdt-0-2', 'ipc', 1524349336.238, 1524349346.238)] 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1524349306.24 - intel_rdt-0-2 bytes-llc 1524349336.24 ... 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1524349306.24 - intel_rdt-0-2 ipc 1524349336.24 ... 2018-04-21 22:29:12,598 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:29:12,599 - baro_tests.barometer - INFO - OK 2018-04-21 22:29:12,600 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-04-21 22:30:03,771 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-21 22:30:26,810 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 911f16c8-1a8d-4deb-9a5f-0178cafdfc6b... 2018-04-21 22:30:26,811 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:30:26,811 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-21 22:30:26,811 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-21 22:30:38,960 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:30:38,960 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524349433.24 ... 2018-04-21 22:30:38,960 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:38,961 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524349433.24 ... 2018-04-21 22:30:38,961 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:38,961 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524349433.24 ... 2018-04-21 22:30:38,961 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:38,961 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524349433.24 ... 2018-04-21 22:30:38,962 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:38,962 - baro_tests.barometer - INFO - OK 2018-04-21 22:30:38,962 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:30:41,964 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-21 22:30:53,988 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524349433.239, 1524349434.239), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524349433.239, 1524349434.239), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524349433.239, 1524349434.239), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524349433.239, 1524349434.239)] 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1524349448.239, 1524349449.239), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1524349448.239, 1524349449.239), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1524349448.239, 1524349449.239), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1524349448.239, 1524349449.239)] 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524349433.24 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1524349448.24 ... 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524349433.24 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1524349448.24 ... 2018-04-21 22:30:53,988 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:53,989 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524349433.24 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1524349448.24 ... 2018-04-21 22:30:53,989 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:53,989 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524349433.24 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1524349448.24 ... 2018-04-21 22:30:53,989 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:30:53,989 - baro_tests.barometer - INFO - OK 2018-04-21 22:30:53,992 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-04-21 22:31:42,076 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-21 22:32:05,610 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 911f16c8-1a8d-4deb-9a5f-0178cafdfc6b... 2018-04-21 22:32:05,610 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:32:05,611 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-21 22:32:05,611 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-21 22:32:18,003 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:32:18,005 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524349532.24 ... 2018-04-21 22:32:18,006 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:32:18,006 - baro_tests.barometer - INFO - OK 2018-04-21 22:32:18,006 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:32:21,010 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-21 22:32:33,268 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:32:33,269 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524349532.239, 1524349533.239)] 2018-04-21 22:32:33,270 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1524349547.239, 1524349548.239)] 2018-04-21 22:32:33,270 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1524349532.24 - ovs_events-br0 gauge-link_status 1524349547.24 ... 2018-04-21 22:32:33,271 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:32:33,272 - baro_tests.barometer - INFO - OK 2018-04-21 22:32:33,277 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-04-21 22:33:22,159 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-21 22:33:46,024 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 911f16c8-1a8d-4deb-9a5f-0178cafdfc6b... 2018-04-21 22:33:46,024 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-21 22:33:46,024 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-21 22:33:46,025 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-21 22:33:59,558 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-21 22:33:59,558 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524349634.24 ... 2018-04-21 22:33:59,558 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:33:59,559 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524349634.24 ... 2018-04-21 22:33:59,559 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:33:59,559 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524349634.24 ... 2018-04-21 22:33:59,559 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:33:59,560 - baro_tests.barometer - INFO - OK 2018-04-21 22:33:59,560 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-21 22:34:02,563 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-21 22:34:15,251 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-21 22:34:15,252 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524349634.239, 1524349635.239), ('ovs_stats-br0.br0', 'if_errors', 1524349634.239, 1524349635.239), ('ovs_stats-br0.br0', 'if_packets', 1524349634.239, 1524349635.239)] 2018-04-21 22:34:15,252 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1524349649.239, 1524349650.239), ('ovs_stats-br0.br0', 'if_errors', 1524349649.239, 1524349650.239), ('ovs_stats-br0.br0', 'if_packets', 1524349649.239, 1524349650.239)] 2018-04-21 22:34:15,256 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1524349634.24 - ovs_stats-br0.br0 if_dropped 1524349649.24 ... 2018-04-21 22:34:15,259 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:34:15,270 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1524349634.24 - ovs_stats-br0.br0 if_errors 1524349649.24 ... 2018-04-21 22:34:15,271 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:34:15,273 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1524349634.24 - ovs_stats-br0.br0 if_packets 1524349649.24 ... 2018-04-21 22:34:15,276 - baro_tests.barometer - DEBUG - OK 2018-04-21 22:34:15,278 - baro_tests.barometer - INFO - OK 2018-04-21 22:34:15,283 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-04-21 22:34:27,949 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-04-21 22:34:27,949 - baro_tests.barometer - INFO - ====================================================================== 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - +----------------------------------+ 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - | IN:Hugepages | FAIL | PASS | 2018-04-21 22:34:27,950 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | FAIL | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | FAIL | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | SKIP | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | FAIL | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-04-21 22:34:27,951 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-04-21 22:34:27,952 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-04-21 22:34:27,952 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-21 22:34:27,952 - baro_tests.barometer - INFO - ====================================================================== 2018-04-21 22:34:27,952 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-04-21 22:34:27,952 - baro_tests.barometer - ERROR - Overall Result is Fail