2018-05-03 02:13:43,102 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-05-03 02:13:43,102 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-05-03 02:13:47,394 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-05-03 02:13:47,394 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.10'] 2018-05-03 02:13:47,395 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.9', 'overcloud-novacompute-1: 192.30.9.3'] 2018-05-03 02:13:47,395 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-05-03 02:14:00,758 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-05-03 02:14:00,827 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-05-03 02:14:01,348 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-05-03 02:14:01,379 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-05-03 02:14:01,448 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-05-03 02:14:01,937 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-05-03 02:14:14,307 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-05-03 02:14:14,648 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-05-03 02:14:14,649 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-05-03 02:14:56,608 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-05-03 02:15:09,159 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-05-03 02:15:09,160 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-05-03 02:16:29,442 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-05-03 02:16:54,217 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:17:31,471 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-05-03 02:17:31,471 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-05-03 02:17:31,472 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Hugepages. 2018-05-03 02:18:23,024 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-05-03 02:18:58,022 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:19:35,211 - baro_tests.barometer - INFO - PASS 2018-05-03 02:19:35,212 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Intel RDT. 2018-05-03 02:20:23,275 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-05-03 02:20:47,756 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:21:24,789 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-05-03 02:21:24,789 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-05-03 02:21:24,790 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Mcelog. 2018-05-03 02:22:14,165 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-05-03 02:22:38,176 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:22:40,808 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-05-03 02:23:29,066 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-05-03 02:23:52,235 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:24:29,377 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-05-03 02:24:29,378 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-05-03 02:24:29,378 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS stats. 2018-05-03 02:25:15,903 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-05-03 02:25:39,340 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-05-03 02:25:58,341 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-05-03 02:25:58,342 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-05-03 02:26:47,695 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-05-03 02:27:10,539 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-05-03 02:27:12,850 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-05-03 02:27:12,850 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-05-03 02:27:12,851 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-05-03 02:27:24,573 - baro_tests.barometer - INFO - Stopping collectd service... 2018-05-03 02:27:35,672 - baro_tests.barometer - INFO - Starting collectd service... 2018-05-03 02:27:46,041 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-05-03 02:28:44,400 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-05-03 02:29:07,516 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 8b2ac13d-342a-452f-a129-84c250c26514... 2018-05-03 02:29:07,516 - baro_tests.barometer - DEBUG - Interval: 10 2018-05-03 02:29:07,517 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-05-03 02:29:07,517 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-05-03 02:29:19,518 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:29:19,518 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525314125.11 ... 2018-05-03 02:29:19,519 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:19,519 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525314125.11 ... 2018-05-03 02:29:19,519 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:19,519 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525314125.11 ... 2018-05-03 02:29:19,520 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:19,520 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525314125.11 ... 2018-05-03 02:29:19,520 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:19,520 - baro_tests.barometer - INFO - OK 2018-05-03 02:29:19,521 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-05-03 02:29:31,533 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-05-03 02:29:43,377 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:29:43,377 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525314125.105, 1525314135.105), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525314125.105, 1525314135.105), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525314125.105, 1525314135.105), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525314125.105, 1525314135.105)] 2018-05-03 02:29:43,378 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525314145.105, 1525314155.105), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525314145.105, 1525314155.105), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525314145.105, 1525314155.105), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525314145.105, 1525314155.105)] 2018-05-03 02:29:43,378 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525314125.11 - hugepages-mm-2048Kb vmpage_number-free 1525314145.11 ... 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525314125.11 - hugepages-mm-2048Kb vmpage_number-used 1525314145.11 ... 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525314125.11 - hugepages-node0-2048Kb vmpage_number-free 1525314145.11 ... 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525314125.11 - hugepages-node0-2048Kb vmpage_number-used 1525314145.11 ... 2018-05-03 02:29:43,379 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:29:43,379 - baro_tests.barometer - INFO - OK 2018-05-03 02:29:43,380 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-05-03 02:30:30,552 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-05-03 02:31:05,629 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 8b2ac13d-342a-452f-a129-84c250c26514... 2018-05-03 02:31:05,629 - baro_tests.barometer - DEBUG - Interval: 10 2018-05-03 02:31:05,630 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-05-03 02:31:05,630 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-05-03 02:31:17,796 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:31:17,797 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525314245.11 ... 2018-05-03 02:31:17,797 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:31:17,797 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525314245.11 ... 2018-05-03 02:31:17,797 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:31:17,797 - baro_tests.barometer - INFO - OK 2018-05-03 02:31:17,797 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-05-03 02:31:29,807 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-05-03 02:31:42,719 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:31:42,719 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525314245.105, 1525314255.105), ('intel_rdt-0-2', 'ipc', 1525314245.105, 1525314255.105)] 2018-05-03 02:31:42,720 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525314265.105, 1525314275.105), ('intel_rdt-0-2', 'ipc', 1525314265.105, 1525314275.105)] 2018-05-03 02:31:42,720 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525314245.11 - intel_rdt-0-2 bytes-llc 1525314265.11 ... 2018-05-03 02:31:42,721 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:31:42,721 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525314245.11 - intel_rdt-0-2 ipc 1525314265.11 ... 2018-05-03 02:31:42,721 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:31:42,721 - baro_tests.barometer - INFO - OK 2018-05-03 02:31:42,721 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-05-03 02:32:28,916 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-05-03 02:32:52,943 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 8b2ac13d-342a-452f-a129-84c250c26514... 2018-05-03 02:32:52,943 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:32:52,944 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-05-03 02:32:52,944 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-05-03 02:33:05,836 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:33:05,836 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525314363.11 ... 2018-05-03 02:33:05,837 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:05,837 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525314363.11 ... 2018-05-03 02:33:05,837 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:05,837 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525314363.11 ... 2018-05-03 02:33:05,838 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:05,838 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525314363.11 ... 2018-05-03 02:33:05,838 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:05,838 - baro_tests.barometer - INFO - OK 2018-05-03 02:33:05,838 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:33:08,839 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-05-03 02:33:20,899 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:33:20,900 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525314363.106, 1525314364.106), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525314363.106, 1525314364.106), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525314363.106, 1525314364.106), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525314363.106, 1525314364.106)] 2018-05-03 02:33:20,900 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525314378.106, 1525314379.106), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525314378.106, 1525314379.106), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525314378.106, 1525314379.106), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525314378.106, 1525314379.106)] 2018-05-03 02:33:20,900 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525314363.11 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525314378.11 ... 2018-05-03 02:33:20,901 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:20,901 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525314363.11 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525314378.11 ... 2018-05-03 02:33:20,901 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:20,902 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525314363.11 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525314378.11 ... 2018-05-03 02:33:20,902 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:20,902 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525314363.11 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525314378.11 ... 2018-05-03 02:33:20,902 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:33:20,903 - baro_tests.barometer - INFO - OK 2018-05-03 02:33:20,903 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-05-03 02:34:09,494 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-05-03 02:34:33,225 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 8b2ac13d-342a-452f-a129-84c250c26514... 2018-05-03 02:34:33,225 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:34:33,225 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-05-03 02:34:33,226 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-05-03 02:34:45,552 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:34:45,552 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525314463.11 ... 2018-05-03 02:34:45,553 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:34:45,553 - baro_tests.barometer - INFO - OK 2018-05-03 02:34:45,554 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:34:48,556 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-05-03 02:35:00,301 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:35:00,302 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525314463.106, 1525314464.106)] 2018-05-03 02:35:00,302 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525314478.106, 1525314479.106)] 2018-05-03 02:35:00,302 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525314463.11 - ovs_events-br0 gauge-link_status 1525314478.11 ... 2018-05-03 02:35:00,303 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:35:00,303 - baro_tests.barometer - INFO - OK 2018-05-03 02:35:00,304 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-05-03 02:35:46,599 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-05-03 02:36:09,715 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 8b2ac13d-342a-452f-a129-84c250c26514... 2018-05-03 02:36:09,715 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:36:09,716 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-05-03 02:36:09,716 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-05-03 02:36:22,025 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:36:22,026 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525314559.11 ... 2018-05-03 02:36:22,027 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:22,028 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525314559.11 ... 2018-05-03 02:36:22,028 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:22,029 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525314559.11 ... 2018-05-03 02:36:22,029 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:22,030 - baro_tests.barometer - INFO - OK 2018-05-03 02:36:22,030 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:36:25,032 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-05-03 02:36:37,407 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:36:37,407 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525314559.106, 1525314560.106), ('ovs_stats-br0.br0', 'if_errors', 1525314559.106, 1525314560.106), ('ovs_stats-br0.br0', 'if_packets', 1525314559.106, 1525314560.106)] 2018-05-03 02:36:37,408 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525314575.106, 1525314576.106), ('ovs_stats-br0.br0', 'if_errors', 1525314575.106, 1525314576.106), ('ovs_stats-br0.br0', 'if_packets', 1525314575.106, 1525314576.106)] 2018-05-03 02:36:37,408 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525314559.11 - ovs_stats-br0.br0 if_dropped 1525314575.11 ... 2018-05-03 02:36:37,408 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:37,408 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525314559.11 - ovs_stats-br0.br0 if_errors 1525314575.11 ... 2018-05-03 02:36:37,409 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:37,409 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525314559.11 - ovs_stats-br0.br0 if_packets 1525314575.11 ... 2018-05-03 02:36:37,409 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:36:37,409 - baro_tests.barometer - INFO - OK 2018-05-03 02:36:37,409 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-05-03 02:36:49,566 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-05-03 02:37:00,981 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-05-03 02:37:00,982 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-05-03 02:38:16,678 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-05-03 02:38:41,123 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:39:18,472 - baro_tests.barometer - INFO - PASS 2018-05-03 02:39:18,479 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on Hugepages. 2018-05-03 02:40:05,600 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-05-03 02:40:41,790 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:41:19,208 - baro_tests.barometer - INFO - PASS 2018-05-03 02:41:19,209 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on Intel RDT. 2018-05-03 02:42:06,631 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-05-03 02:42:29,728 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:43:07,318 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-05-03 02:43:07,318 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-05-03 02:43:07,319 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-05-03 02:43:54,915 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-05-03 02:44:18,572 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:44:56,411 - baro_tests.barometer - INFO - PASS 2018-05-03 02:44:56,412 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on OVS events. 2018-05-03 02:45:43,623 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-05-03 02:46:07,523 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-05-03 02:46:45,019 - baro_tests.barometer - INFO - PASS 2018-05-03 02:46:45,019 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on OVS stats. 2018-05-03 02:47:32,422 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-05-03 02:47:55,045 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-05-03 02:48:13,944 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-05-03 02:48:13,949 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-05-03 02:49:01,862 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-05-03 02:49:25,126 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-05-03 02:49:27,668 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-05-03 02:49:27,669 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-05-03 02:49:27,669 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-05-03 02:49:39,561 - baro_tests.barometer - INFO - Stopping collectd service... 2018-05-03 02:49:51,630 - baro_tests.barometer - INFO - Starting collectd service... 2018-05-03 02:50:01,991 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-05-03 02:50:58,554 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-05-03 02:51:21,993 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 589aee1b-99c3-4c00-bd8c-fbfd2f271081... 2018-05-03 02:51:21,994 - baro_tests.barometer - DEBUG - Interval: 10 2018-05-03 02:51:21,995 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-05-03 02:51:21,995 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-05-03 02:51:34,017 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:51:34,017 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525315456.14 ... 2018-05-03 02:51:34,018 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:34,018 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525315456.14 ... 2018-05-03 02:51:34,018 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:34,018 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525315456.14 ... 2018-05-03 02:51:34,019 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:34,019 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525315456.14 ... 2018-05-03 02:51:34,019 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:34,019 - baro_tests.barometer - INFO - OK 2018-05-03 02:51:34,019 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-05-03 02:51:46,028 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-05-03 02:51:57,937 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:51:57,939 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525315456.143, 1525315466.143), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525315456.143, 1525315466.143), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525315456.143, 1525315466.143), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525315456.143, 1525315466.143)] 2018-05-03 02:51:57,946 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525315476.143, 1525315486.143), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525315476.143, 1525315486.143), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525315476.143, 1525315486.143), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525315476.143, 1525315486.143)] 2018-05-03 02:51:57,947 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525315456.14 - hugepages-mm-2048Kb vmpage_number-free 1525315476.14 ... 2018-05-03 02:51:57,949 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:57,950 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525315456.14 - hugepages-mm-2048Kb vmpage_number-used 1525315476.14 ... 2018-05-03 02:51:57,951 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:57,952 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525315456.14 - hugepages-node0-2048Kb vmpage_number-free 1525315476.14 ... 2018-05-03 02:51:57,952 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:57,953 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525315456.14 - hugepages-node0-2048Kb vmpage_number-used 1525315476.14 ... 2018-05-03 02:51:57,954 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:51:57,956 - baro_tests.barometer - INFO - OK 2018-05-03 02:51:57,956 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-05-03 02:52:43,974 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-05-03 02:53:18,837 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 589aee1b-99c3-4c00-bd8c-fbfd2f271081... 2018-05-03 02:53:18,837 - baro_tests.barometer - DEBUG - Interval: 10 2018-05-03 02:53:18,838 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-05-03 02:53:18,838 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-05-03 02:53:29,842 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:53:29,843 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525315566.14 ... 2018-05-03 02:53:29,843 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:53:29,843 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525315566.14 ... 2018-05-03 02:53:29,844 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:53:29,844 - baro_tests.barometer - INFO - OK 2018-05-03 02:53:29,844 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-05-03 02:53:41,855 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-05-03 02:53:54,169 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:53:54,169 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525315566.143, 1525315576.143), ('intel_rdt-0-2', 'ipc', 1525315566.143, 1525315576.143)] 2018-05-03 02:53:54,169 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525315596.143, 1525315606.143), ('intel_rdt-0-2', 'ipc', 1525315596.143, 1525315606.143)] 2018-05-03 02:53:54,170 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525315566.14 - intel_rdt-0-2 bytes-llc 1525315596.14 ... 2018-05-03 02:53:54,170 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:53:54,171 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525315566.14 - intel_rdt-0-2 ipc 1525315596.14 ... 2018-05-03 02:53:54,171 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:53:54,172 - baro_tests.barometer - INFO - OK 2018-05-03 02:53:54,172 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-05-03 02:54:39,997 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-05-03 02:55:02,018 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 589aee1b-99c3-4c00-bd8c-fbfd2f271081... 2018-05-03 02:55:02,018 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:55:02,018 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-05-03 02:55:02,018 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-05-03 02:55:13,901 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:55:13,903 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525315686.14 ... 2018-05-03 02:55:13,904 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:13,904 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525315686.14 ... 2018-05-03 02:55:13,905 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:13,906 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525315686.14 ... 2018-05-03 02:55:13,906 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:13,907 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525315686.14 ... 2018-05-03 02:55:13,908 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:13,909 - baro_tests.barometer - INFO - OK 2018-05-03 02:55:13,911 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:55:16,915 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-05-03 02:55:28,371 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:55:28,372 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525315686.144, 1525315687.145), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525315686.144, 1525315687.145), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525315686.144, 1525315687.145), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525315686.144, 1525315687.145)] 2018-05-03 02:55:28,372 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525315700.144, 1525315702.144), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525315701.144, 1525315702.144), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525315701.144, 1525315702.144), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525315701.144, 1525315702.144)] 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525315686.14 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525315700.14 ... 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525315686.14 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525315701.14 ... 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525315686.14 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525315701.14 ... 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525315686.14 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525315701.14 ... 2018-05-03 02:55:28,373 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:55:28,373 - baro_tests.barometer - INFO - OK 2018-05-03 02:55:28,374 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-05-03 02:56:16,527 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-05-03 02:56:38,502 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 589aee1b-99c3-4c00-bd8c-fbfd2f271081... 2018-05-03 02:56:38,502 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:56:38,502 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-05-03 02:56:38,502 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-05-03 02:56:50,519 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:56:50,520 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525315783.14 ... 2018-05-03 02:56:50,520 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:56:50,520 - baro_tests.barometer - INFO - OK 2018-05-03 02:56:50,520 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:56:53,524 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-05-03 02:57:04,740 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:57:04,740 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525315783.144, 1525315784.144)] 2018-05-03 02:57:04,741 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525315797.144, 1525315798.145)] 2018-05-03 02:57:04,741 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525315783.14 - ovs_events-br0 gauge-link_status 1525315797.14 ... 2018-05-03 02:57:04,741 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:57:04,742 - baro_tests.barometer - INFO - OK 2018-05-03 02:57:04,742 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-05-03 02:57:51,600 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-05-03 02:58:14,229 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 589aee1b-99c3-4c00-bd8c-fbfd2f271081... 2018-05-03 02:58:14,229 - baro_tests.barometer - DEBUG - Interval: 1 2018-05-03 02:58:14,231 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-05-03 02:58:14,232 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-05-03 02:58:25,959 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-05-03 02:58:25,960 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525315878.14 ... 2018-05-03 02:58:25,962 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:25,963 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525315878.14 ... 2018-05-03 02:58:25,965 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:25,968 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525315878.14 ... 2018-05-03 02:58:25,971 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:25,972 - baro_tests.barometer - INFO - OK 2018-05-03 02:58:25,973 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-05-03 02:58:28,976 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-05-03 02:58:40,896 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-05-03 02:58:40,897 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525315878.144, 1525315879.144), ('ovs_stats-br0.br0', 'if_errors', 1525315878.144, 1525315879.144), ('ovs_stats-br0.br0', 'if_packets', 1525315878.144, 1525315880.144)] 2018-05-03 02:58:40,897 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525315893.144, 1525315894.144), ('ovs_stats-br0.br0', 'if_errors', 1525315893.144, 1525315894.144), ('ovs_stats-br0.br0', 'if_packets', 1525315893.144, 1525315894.144)] 2018-05-03 02:58:40,898 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525315878.14 - ovs_stats-br0.br0 if_dropped 1525315893.14 ... 2018-05-03 02:58:40,900 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:40,902 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525315878.14 - ovs_stats-br0.br0 if_errors 1525315893.14 ... 2018-05-03 02:58:40,902 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:40,903 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525315878.14 - ovs_stats-br0.br0 if_packets 1525315893.14 ... 2018-05-03 02:58:40,903 - baro_tests.barometer - DEBUG - OK 2018-05-03 02:58:40,903 - baro_tests.barometer - INFO - OK 2018-05-03 02:58:40,904 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-05-03 02:58:54,101 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-05-03 02:58:54,101 - baro_tests.barometer - INFO - ====================================================================== 2018-05-03 02:58:54,102 - baro_tests.barometer - INFO - +----------------------------------+ 2018-05-03 02:58:54,102 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-05-03 02:58:54,102 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-05-03 02:58:54,103 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-05-03 02:58:54,104 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-05-03 02:58:54,105 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-05-03 02:58:54,106 - baro_tests.barometer - INFO - | IN:Hugepages | FAIL | PASS | 2018-05-03 02:58:54,106 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-05-03 02:58:54,106 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-05-03 02:58:54,106 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | PASS | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | IN:OVS stats | FAIL | PASS | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | SKIP | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-05-03 02:58:54,107 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-05-03 02:58:54,108 - baro_tests.barometer - INFO - ====================================================================== 2018-05-03 02:58:54,108 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-05-03 02:58:54,109 - baro_tests.barometer - ERROR - Overall Result is Fail