2018-04-17 15:06:43,401 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-04-17 15:06:43,401 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-04-17 15:06:47,354 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-04-17 15:06:47,354 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.5'] 2018-04-17 15:06:47,354 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.10', 'overcloud-novacompute-1: 192.30.9.3'] 2018-04-17 15:06:47,354 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-04-17 15:07:00,698 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-04-17 15:07:00,748 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-04-17 15:07:01,110 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-04-17 15:07:01,122 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-04-17 15:07:01,172 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-04-17 15:07:01,575 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-04-17 15:07:13,764 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-04-17 15:07:14,020 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-04-17 15:07:14,020 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-04-17 15:07:53,428 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-04-17 15:08:05,182 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-04-17 15:08:05,183 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-04-17 15:09:19,936 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-17 15:09:44,926 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:10:22,417 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-17 15:10:22,417 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:10:22,417 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Hugepages. 2018-04-17 15:11:09,260 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-17 15:11:43,097 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:12:20,240 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-17 15:12:20,240 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:12:20,241 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Intel RDT. 2018-04-17 15:13:07,656 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-17 15:13:31,150 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:13:33,848 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Mcelog. 2018-04-17 15:14:20,964 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-17 15:14:43,992 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:14:46,655 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-04-17 15:15:33,414 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-17 15:15:57,030 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:15:59,674 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS stats. 2018-04-17 15:16:45,276 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-17 15:17:08,102 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-17 15:17:26,856 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-17 15:17:26,856 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-04-17 15:18:13,780 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-17 15:18:35,656 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-17 15:18:37,929 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-04-17 15:18:37,930 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-04-17 15:18:37,930 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-17 15:18:49,325 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-17 15:18:59,978 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-17 15:19:10,263 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-17 15:20:06,401 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-17 15:20:29,648 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node a65ee56f-3191-4031-842a-b7ab720d7e82... 2018-04-17 15:20:29,649 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-17 15:20:29,649 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-17 15:20:29,649 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-17 15:20:41,054 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:20:41,054 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1523978032.81 ... 2018-04-17 15:20:41,055 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:20:41,055 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1523978032.81 ... 2018-04-17 15:20:41,056 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:20:41,056 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1523978032.81 ... 2018-04-17 15:20:41,056 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:20:41,056 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1523978032.81 ... 2018-04-17 15:20:41,056 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:20:41,056 - baro_tests.barometer - INFO - OK 2018-04-17 15:20:41,056 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-17 15:20:53,060 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-17 15:21:05,320 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:21:05,321 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1523978032.808, 1523978042.808), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1523978032.808, 1523978042.808), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1523978032.808, 1523978042.808), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1523978032.808, 1523978042.808)] 2018-04-17 15:21:05,321 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1523978052.808, 1523978062.808), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1523978052.808, 1523978062.808), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1523978052.808, 1523978062.808), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1523978052.808, 1523978062.808)] 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1523978032.81 - hugepages-mm-2048Kb vmpage_number-free 1523978052.81 ... 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1523978032.81 - hugepages-mm-2048Kb vmpage_number-used 1523978052.81 ... 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1523978032.81 - hugepages-node0-2048Kb vmpage_number-free 1523978052.81 ... 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1523978032.81 - hugepages-node0-2048Kb vmpage_number-used 1523978052.81 ... 2018-04-17 15:21:05,322 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:21:05,322 - baro_tests.barometer - INFO - OK 2018-04-17 15:21:05,323 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-04-17 15:21:51,682 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-17 15:22:24,693 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node a65ee56f-3191-4031-842a-b7ab720d7e82... 2018-04-17 15:22:24,694 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-17 15:22:24,694 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-17 15:22:24,694 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-17 15:22:36,327 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:22:36,328 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1523978142.81 ... 2018-04-17 15:22:36,328 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:22:36,328 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1523978142.81 ... 2018-04-17 15:22:36,329 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:22:36,329 - baro_tests.barometer - INFO - OK 2018-04-17 15:22:36,329 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-17 15:22:48,336 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-17 15:23:00,138 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:23:00,138 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1523978142.808, 1523978152.808), ('intel_rdt-0-2', 'ipc', 1523978142.808, 1523978152.808)] 2018-04-17 15:23:00,138 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1523978162.808, 1523978172.808), ('intel_rdt-0-2', 'ipc', 1523978162.808, 1523978172.808)] 2018-04-17 15:23:00,139 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1523978142.81 - intel_rdt-0-2 bytes-llc 1523978162.81 ... 2018-04-17 15:23:00,139 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:23:00,139 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1523978142.81 - intel_rdt-0-2 ipc 1523978162.81 ... 2018-04-17 15:23:00,140 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:23:00,140 - baro_tests.barometer - INFO - OK 2018-04-17 15:23:00,141 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-04-17 15:23:47,600 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-17 15:24:10,369 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node a65ee56f-3191-4031-842a-b7ab720d7e82... 2018-04-17 15:24:10,369 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:24:10,369 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-17 15:24:10,370 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-17 15:24:21,854 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:24:21,854 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523978262.81 ... 2018-04-17 15:24:21,855 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:21,855 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523978262.81 ... 2018-04-17 15:24:21,855 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:21,855 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523978262.81 ... 2018-04-17 15:24:21,856 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:21,856 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523978262.81 ... 2018-04-17 15:24:21,856 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:21,856 - baro_tests.barometer - INFO - OK 2018-04-17 15:24:21,856 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:24:24,859 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-17 15:24:36,612 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:24:36,612 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1523978262.809, 1523978263.809), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1523978262.809, 1523978263.809), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1523978262.809, 1523978263.809), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1523978262.809, 1523978263.809)] 2018-04-17 15:24:36,613 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1523978277.809, 1523978278.809), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1523978277.809, 1523978278.809), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1523978277.809, 1523978278.809), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1523978277.809, 1523978278.809)] 2018-04-17 15:24:36,613 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523978262.81 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523978277.81 ... 2018-04-17 15:24:36,613 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:36,613 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523978262.81 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523978277.81 ... 2018-04-17 15:24:36,613 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:36,614 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523978262.81 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523978277.81 ... 2018-04-17 15:24:36,614 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:36,614 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523978262.81 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523978277.81 ... 2018-04-17 15:24:36,614 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:24:36,614 - baro_tests.barometer - INFO - OK 2018-04-17 15:24:36,615 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-04-17 15:25:22,468 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-17 15:25:44,829 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node a65ee56f-3191-4031-842a-b7ab720d7e82... 2018-04-17 15:25:44,829 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:25:44,829 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-17 15:25:44,830 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-17 15:25:55,678 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:25:55,678 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1523978356.81 ... 2018-04-17 15:25:55,679 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:25:55,680 - baro_tests.barometer - INFO - OK 2018-04-17 15:25:55,680 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:25:58,684 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-17 15:26:10,971 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:26:10,972 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1523978356.809, 1523978357.809)] 2018-04-17 15:26:10,972 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1523978371.809, 1523978372.809)] 2018-04-17 15:26:10,972 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1523978356.81 - ovs_events-br0 gauge-link_status 1523978371.81 ... 2018-04-17 15:26:10,973 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:26:10,973 - baro_tests.barometer - INFO - OK 2018-04-17 15:26:10,973 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-04-17 15:26:57,449 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-17 15:27:18,852 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node a65ee56f-3191-4031-842a-b7ab720d7e82... 2018-04-17 15:27:18,852 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:27:18,853 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-17 15:27:18,853 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-17 15:27:29,936 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:27:29,937 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1523978450.81 ... 2018-04-17 15:27:29,937 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:29,938 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1523978450.81 ... 2018-04-17 15:27:29,938 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:29,938 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1523978450.81 ... 2018-04-17 15:27:29,938 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:29,939 - baro_tests.barometer - INFO - OK 2018-04-17 15:27:29,939 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:27:32,943 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-17 15:27:44,482 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:27:44,483 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1523978450.809, 1523978451.809), ('ovs_stats-br0.br0', 'if_errors', 1523978450.809, 1523978451.809), ('ovs_stats-br0.br0', 'if_packets', 1523978450.809, 1523978451.809)] 2018-04-17 15:27:44,483 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1523978464.809, 1523978466.809), ('ovs_stats-br0.br0', 'if_errors', 1523978465.809, 1523978466.809), ('ovs_stats-br0.br0', 'if_packets', 1523978465.809, 1523978466.809)] 2018-04-17 15:27:44,483 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1523978450.81 - ovs_stats-br0.br0 if_dropped 1523978464.81 ... 2018-04-17 15:27:44,484 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:44,484 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1523978450.81 - ovs_stats-br0.br0 if_errors 1523978465.81 ... 2018-04-17 15:27:44,484 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:44,484 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1523978450.81 - ovs_stats-br0.br0 if_packets 1523978465.81 ... 2018-04-17 15:27:44,484 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:27:44,484 - baro_tests.barometer - INFO - OK 2018-04-17 15:27:44,484 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-04-17 15:27:56,048 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-04-17 15:28:07,314 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-04-17 15:28:07,316 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-04-17 15:29:15,256 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-17 15:29:38,080 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:30:15,401 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-17 15:30:15,401 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:30:15,402 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Hugepages. 2018-04-17 15:31:03,137 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-17 15:31:37,942 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:32:15,087 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-17 15:32:15,089 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:32:15,091 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Intel RDT. 2018-04-17 15:33:00,382 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-17 15:33:23,516 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:34:00,895 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-17 15:34:00,895 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:34:00,897 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-04-17 15:34:46,636 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-17 15:35:08,473 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:35:11,069 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS events. 2018-04-17 15:35:57,133 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-17 15:36:20,093 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-17 15:36:57,468 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-17 15:36:57,468 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-17 15:36:57,469 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS stats. 2018-04-17 15:37:43,927 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-17 15:38:06,842 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-17 15:38:25,722 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-17 15:38:25,723 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-04-17 15:39:10,216 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-17 15:39:32,645 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-17 15:39:34,989 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-04-17 15:39:34,989 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-04-17 15:39:34,989 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-17 15:39:46,170 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-17 15:39:57,470 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-17 15:40:07,776 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-17 15:41:02,360 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-17 15:41:23,322 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node a8a2fcfc-b97f-4778-823b-615a279ec104... 2018-04-17 15:41:23,323 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-17 15:41:23,323 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-17 15:41:23,323 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-17 15:41:34,432 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:41:34,432 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1523979270.38 ... 2018-04-17 15:41:34,432 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:34,432 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1523979270.38 ... 2018-04-17 15:41:34,433 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:34,433 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1523979270.38 ... 2018-04-17 15:41:34,434 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:34,434 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1523979270.38 ... 2018-04-17 15:41:34,434 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:34,434 - baro_tests.barometer - INFO - OK 2018-04-17 15:41:34,434 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-17 15:41:46,446 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-17 15:41:58,236 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:41:58,236 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1523979270.383, 1523979280.383), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1523979270.383, 1523979280.383), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1523979270.383, 1523979280.383), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1523979270.383, 1523979280.383)] 2018-04-17 15:41:58,237 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1523979290.383, 1523979300.383), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1523979290.383, 1523979300.383), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1523979290.383, 1523979300.383), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1523979290.383, 1523979310.383)] 2018-04-17 15:41:58,237 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1523979270.38 - hugepages-mm-2048Kb vmpage_number-free 1523979290.38 ... 2018-04-17 15:41:58,237 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:58,237 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1523979270.38 - hugepages-mm-2048Kb vmpage_number-used 1523979290.38 ... 2018-04-17 15:41:58,238 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:58,238 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1523979270.38 - hugepages-node0-2048Kb vmpage_number-free 1523979290.38 ... 2018-04-17 15:41:58,238 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:58,238 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1523979270.38 - hugepages-node0-2048Kb vmpage_number-used 1523979290.38 ... 2018-04-17 15:41:58,238 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:41:58,238 - baro_tests.barometer - INFO - OK 2018-04-17 15:41:58,238 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-04-17 15:42:43,563 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-17 15:43:15,475 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node a8a2fcfc-b97f-4778-823b-615a279ec104... 2018-04-17 15:43:15,476 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-17 15:43:15,476 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-17 15:43:15,476 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-17 15:43:26,839 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:43:26,839 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1523979380.38 ... 2018-04-17 15:43:26,840 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:43:26,840 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1523979380.38 ... 2018-04-17 15:43:26,840 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:43:26,840 - baro_tests.barometer - INFO - OK 2018-04-17 15:43:26,840 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-17 15:43:38,851 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-17 15:43:49,665 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:43:49,665 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1523979380.383, 1523979390.383), ('intel_rdt-0-2', 'ipc', 1523979380.383, 1523979390.383)] 2018-04-17 15:43:49,665 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1523979410.383, 1523979420.383), ('intel_rdt-0-2', 'ipc', 1523979410.383, 1523979420.383)] 2018-04-17 15:43:49,666 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1523979380.38 - intel_rdt-0-2 bytes-llc 1523979410.38 ... 2018-04-17 15:43:49,666 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:43:49,666 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1523979380.38 - intel_rdt-0-2 ipc 1523979410.38 ... 2018-04-17 15:43:49,667 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:43:49,667 - baro_tests.barometer - INFO - OK 2018-04-17 15:43:49,667 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-04-17 15:44:34,683 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-17 15:44:57,557 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node a8a2fcfc-b97f-4778-823b-615a279ec104... 2018-04-17 15:44:57,557 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:44:57,557 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-17 15:44:57,558 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-17 15:45:10,039 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:45:10,040 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523979500.96 ... 2018-04-17 15:45:10,040 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:10,040 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523979500.96 ... 2018-04-17 15:45:10,040 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:10,041 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523979500.96 ... 2018-04-17 15:45:10,041 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:10,041 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523979500.96 ... 2018-04-17 15:45:10,041 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:10,042 - baro_tests.barometer - INFO - OK 2018-04-17 15:45:10,042 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:45:13,045 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-17 15:45:25,593 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:45:25,595 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1523979500.965, 1523979501.964), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1523979500.965, 1523979501.964), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1523979500.964, 1523979501.964), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1523979500.964, 1523979501.964)] 2018-04-17 15:45:25,597 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1523979515.964, 1523979516.964), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1523979515.964, 1523979517.965), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1523979516.964, 1523979517.965), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1523979516.964, 1523979517.965)] 2018-04-17 15:45:25,602 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523979500.96 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1523979515.96 ... 2018-04-17 15:45:25,602 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:25,605 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523979500.96 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1523979515.96 ... 2018-04-17 15:45:25,606 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:25,606 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523979500.96 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1523979516.96 ... 2018-04-17 15:45:25,607 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:25,608 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523979500.96 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1523979516.96 ... 2018-04-17 15:45:25,610 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:45:25,612 - baro_tests.barometer - INFO - OK 2018-04-17 15:45:25,614 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-04-17 15:46:12,708 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-17 15:46:34,771 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node a8a2fcfc-b97f-4778-823b-615a279ec104... 2018-04-17 15:46:34,771 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:46:34,772 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-17 15:46:34,772 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-17 15:46:46,478 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:46:46,478 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1523979597.96 ... 2018-04-17 15:46:46,478 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:46:46,479 - baro_tests.barometer - INFO - OK 2018-04-17 15:46:46,479 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:46:49,482 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-17 15:46:59,989 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:46:59,990 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1523979597.964, 1523979598.965)] 2018-04-17 15:46:59,990 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1523979610.965, 1523979611.965)] 2018-04-17 15:46:59,992 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1523979597.96 - ovs_events-br0 gauge-link_status 1523979610.96 ... 2018-04-17 15:46:59,993 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:46:59,993 - baro_tests.barometer - INFO - OK 2018-04-17 15:46:59,994 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-04-17 15:47:44,844 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-17 15:48:05,006 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node a8a2fcfc-b97f-4778-823b-615a279ec104... 2018-04-17 15:48:05,006 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-17 15:48:05,006 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-17 15:48:05,007 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-17 15:48:16,337 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-17 15:48:16,337 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1523979686.96 ... 2018-04-17 15:48:16,337 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:16,338 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1523979686.96 ... 2018-04-17 15:48:16,338 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:16,338 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1523979686.96 ... 2018-04-17 15:48:16,338 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:16,338 - baro_tests.barometer - INFO - OK 2018-04-17 15:48:16,339 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-17 15:48:19,342 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-17 15:48:30,398 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-17 15:48:30,398 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1523979686.964, 1523979687.964), ('ovs_stats-br0.br0', 'if_errors', 1523979686.964, 1523979687.964), ('ovs_stats-br0.br0', 'if_packets', 1523979686.964, 1523979688.964)] 2018-04-17 15:48:30,398 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1523979700.964, 1523979701.964), ('ovs_stats-br0.br0', 'if_errors', 1523979700.964, 1523979701.964), ('ovs_stats-br0.br0', 'if_packets', 1523979701.965, 1523979702.964)] 2018-04-17 15:48:30,399 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1523979686.96 - ovs_stats-br0.br0 if_dropped 1523979700.96 ... 2018-04-17 15:48:30,399 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:30,399 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1523979686.96 - ovs_stats-br0.br0 if_errors 1523979700.96 ... 2018-04-17 15:48:30,399 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:30,400 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1523979686.96 - ovs_stats-br0.br0 if_packets 1523979701.96 ... 2018-04-17 15:48:30,400 - baro_tests.barometer - DEBUG - OK 2018-04-17 15:48:30,400 - baro_tests.barometer - INFO - OK 2018-04-17 15:48:30,400 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-04-17 15:48:41,893 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-04-17 15:48:41,894 - baro_tests.barometer - INFO - ====================================================================== 2018-04-17 15:48:41,895 - baro_tests.barometer - INFO - +----------------------------------+ 2018-04-17 15:48:41,895 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-04-17 15:48:41,895 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-17 15:48:41,895 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-04-17 15:48:41,895 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-17 15:48:41,896 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-04-17 15:48:41,896 - baro_tests.barometer - INFO - | IN:Hugepages | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:Intel RDT | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:OVS stats | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | SKIP | 2018-04-17 15:48:41,897 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-17 15:48:41,898 - baro_tests.barometer - INFO - ====================================================================== 2018-04-17 15:48:41,898 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-04-17 15:48:41,898 - baro_tests.barometer - ERROR - Overall Result is Fail