2018-03-31 15:47:11,962 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-03-31 15:47:11,963 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-03-31 15:47:15,915 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-03-31 15:47:15,915 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.7'] 2018-03-31 15:47:15,916 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.10', 'overcloud-novacompute-1: 192.30.9.4'] 2018-03-31 15:47:15,916 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-03-31 15:47:28,569 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-03-31 15:47:28,642 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-03-31 15:47:29,013 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-03-31 15:47:29,026 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-03-31 15:47:29,076 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-03-31 15:47:29,454 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-03-31 15:47:41,456 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-03-31 15:47:41,713 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-03-31 15:47:41,713 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-03-31 15:48:21,146 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-03-31 15:48:33,312 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-03-31 15:48:33,313 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-03-31 15:49:44,653 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-03-31 15:50:07,285 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 15:50:44,623 - baro_tests.barometer - INFO - PASS 2018-03-31 15:50:44,624 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Hugepages. 2018-03-31 15:51:34,070 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-03-31 15:52:08,414 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 15:52:11,143 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on Intel RDT. 2018-03-31 15:52:57,476 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-31 15:53:19,483 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 15:53:56,537 - baro_tests.barometer - INFO - PASS 2018-03-31 15:53:56,538 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Mcelog. 2018-03-31 15:54:44,218 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-31 15:55:06,665 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 15:55:43,738 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-31 15:55:43,739 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-03-31 15:55:43,739 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-03-31 15:56:28,717 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-03-31 15:56:52,774 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 15:57:29,848 - baro_tests.barometer - INFO - PASS 2018-03-31 15:57:29,848 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on OVS stats. 2018-03-31 15:58:17,875 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-31 15:58:40,528 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-31 15:58:59,300 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-03-31 15:58:59,300 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-03-31 15:59:45,528 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-31 16:00:09,023 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-31 16:00:11,290 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-03-31 16:00:11,291 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-03-31 16:00:11,291 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-03-31 16:00:22,314 - baro_tests.barometer - INFO - Stopping collectd service... 2018-03-31 16:00:33,029 - baro_tests.barometer - INFO - Starting collectd service... 2018-03-31 16:00:44,134 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-03-31 16:01:38,282 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-03-31 16:02:00,388 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node f6a3e266-a48a-4f9a-917e-874c25a43492... 2018-03-31 16:02:00,389 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-31 16:02:00,389 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-03-31 16:02:00,389 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-03-31 16:02:11,876 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:02:11,876 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1522511723.23 ... 2018-03-31 16:02:11,877 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:11,877 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1522511723.23 ... 2018-03-31 16:02:11,877 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:11,877 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1522511723.23 ... 2018-03-31 16:02:11,878 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:11,878 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1522511723.23 ... 2018-03-31 16:02:11,878 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:11,878 - baro_tests.barometer - INFO - OK 2018-03-31 16:02:11,878 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-31 16:02:23,881 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-31 16:02:36,014 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:02:36,015 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1522511723.231, 1522511733.231), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1522511723.231, 1522511733.231), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1522511723.231, 1522511733.231), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1522511723.231, 1522511733.231)] 2018-03-31 16:02:36,015 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1522511753.231, 1522511763.231), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1522511753.231, 1522511763.231), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1522511753.231, 1522511763.231), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1522511753.231, 1522511763.231)] 2018-03-31 16:02:36,016 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1522511723.23 - hugepages-mm-2048Kb vmpage_number-free 1522511753.23 ... 2018-03-31 16:02:36,016 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1522511723.23 - hugepages-mm-2048Kb vmpage_number-used 1522511753.23 ... 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1522511723.23 - hugepages-node0-2048Kb vmpage_number-free 1522511753.23 ... 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1522511723.23 - hugepages-node0-2048Kb vmpage_number-used 1522511753.23 ... 2018-03-31 16:02:36,017 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:02:36,017 - baro_tests.barometer - INFO - OK 2018-03-31 16:02:36,017 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-03-31 16:03:22,962 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-03-31 16:03:57,390 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node f6a3e266-a48a-4f9a-917e-874c25a43492... 2018-03-31 16:03:57,390 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-31 16:03:57,391 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-03-31 16:03:57,391 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-03-31 16:04:07,853 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:04:07,853 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1522511843.23 ... 2018-03-31 16:04:07,854 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:04:07,854 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1522511843.23 ... 2018-03-31 16:04:07,854 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:04:07,855 - baro_tests.barometer - INFO - OK 2018-03-31 16:04:07,855 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-31 16:04:19,862 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-31 16:04:31,718 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:04:31,718 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1522511843.231, 1522511853.231), ('intel_rdt-0-2', 'ipc', 1522511843.231, 1522511853.231)] 2018-03-31 16:04:31,718 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1522511863.231, 1522511873.231), ('intel_rdt-0-2', 'ipc', 1522511863.231, 1522511873.231)] 2018-03-31 16:04:31,719 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1522511843.23 - intel_rdt-0-2 bytes-llc 1522511863.23 ... 2018-03-31 16:04:31,719 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:04:31,719 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1522511843.23 - intel_rdt-0-2 ipc 1522511863.23 ... 2018-03-31 16:04:31,720 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:04:31,720 - baro_tests.barometer - INFO - OK 2018-03-31 16:04:31,720 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-03-31 16:05:18,072 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-03-31 16:05:40,404 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node f6a3e266-a48a-4f9a-917e-874c25a43492... 2018-03-31 16:05:40,405 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:05:40,405 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-03-31 16:05:40,405 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-03-31 16:05:51,825 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:05:51,826 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522511959.23 ... 2018-03-31 16:05:51,826 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:05:51,827 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522511959.23 ... 2018-03-31 16:05:51,827 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:05:51,828 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522511959.23 ... 2018-03-31 16:05:51,828 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:05:51,828 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522511959.23 ... 2018-03-31 16:05:51,828 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:05:51,828 - baro_tests.barometer - INFO - OK 2018-03-31 16:05:51,828 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:05:54,832 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-31 16:06:06,262 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:06:06,262 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1522511959.232, 1522511960.232), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1522511959.232, 1522511960.232), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1522511959.232, 1522511960.232), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1522511959.232, 1522511960.232)] 2018-03-31 16:06:06,262 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1522511973.232, 1522511974.232), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1522511973.232, 1522511974.232), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1522511974.232, 1522511975.232), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1522511974.232, 1522511975.232)] 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522511959.23 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522511973.23 ... 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522511959.23 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522511973.23 ... 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522511959.23 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522511974.23 ... 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522511959.23 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522511974.23 ... 2018-03-31 16:06:06,263 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:06:06,263 - baro_tests.barometer - INFO - OK 2018-03-31 16:06:06,264 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-03-31 16:06:52,060 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-03-31 16:07:13,720 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node f6a3e266-a48a-4f9a-917e-874c25a43492... 2018-03-31 16:07:13,720 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:07:13,721 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-03-31 16:07:13,721 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-03-31 16:07:24,644 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:07:24,645 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1522512052.23 ... 2018-03-31 16:07:24,645 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:07:24,645 - baro_tests.barometer - INFO - OK 2018-03-31 16:07:24,646 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:07:27,649 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-31 16:07:40,043 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:07:40,044 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1522512052.232, 1522512053.232)] 2018-03-31 16:07:40,044 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1522512067.232, 1522512068.232)] 2018-03-31 16:07:40,044 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1522512052.23 - ovs_events-br0 gauge-link_status 1522512067.23 ... 2018-03-31 16:07:40,045 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:07:40,045 - baro_tests.barometer - INFO - OK 2018-03-31 16:07:40,045 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-03-31 16:08:24,577 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-03-31 16:08:47,687 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node f6a3e266-a48a-4f9a-917e-874c25a43492... 2018-03-31 16:08:47,688 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:08:47,688 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-03-31 16:08:47,688 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-03-31 16:09:00,693 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:09:00,694 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1522512148.23 ... 2018-03-31 16:09:00,694 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:00,694 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1522512148.23 ... 2018-03-31 16:09:00,695 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:00,695 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1522512148.23 ... 2018-03-31 16:09:00,695 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:00,695 - baro_tests.barometer - INFO - OK 2018-03-31 16:09:00,695 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:09:03,697 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-03-31 16:09:14,483 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:09:14,483 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1522512148.232, 1522512149.232), ('ovs_stats-br0.br0', 'if_errors', 1522512148.232, 1522512149.232), ('ovs_stats-br0.br0', 'if_packets', 1522512148.232, 1522512149.232)] 2018-03-31 16:09:14,484 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1522512162.232, 1522512163.232), ('ovs_stats-br0.br0', 'if_errors', 1522512162.232, 1522512163.232), ('ovs_stats-br0.br0', 'if_packets', 1522512162.232, 1522512163.232)] 2018-03-31 16:09:14,484 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1522512148.23 - ovs_stats-br0.br0 if_dropped 1522512162.23 ... 2018-03-31 16:09:14,484 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:14,485 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1522512148.23 - ovs_stats-br0.br0 if_errors 1522512162.23 ... 2018-03-31 16:09:14,485 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:14,485 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1522512148.23 - ovs_stats-br0.br0 if_packets 1522512162.23 ... 2018-03-31 16:09:14,485 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:09:14,485 - baro_tests.barometer - INFO - OK 2018-03-31 16:09:14,486 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-03-31 16:09:26,903 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-03-31 16:09:37,424 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-03-31 16:09:37,424 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-03-31 16:10:44,037 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-03-31 16:11:06,784 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 16:11:43,979 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-03-31 16:11:43,980 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-03-31 16:11:43,981 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Hugepages. 2018-03-31 16:12:29,968 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-03-31 16:13:03,271 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 16:13:40,333 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-03-31 16:13:40,334 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-03-31 16:13:40,334 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Intel RDT. 2018-03-31 16:14:25,678 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-31 16:14:48,302 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 16:15:25,693 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-31 16:15:25,694 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-03-31 16:15:25,696 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-03-31 16:16:09,917 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-31 16:16:33,541 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 16:16:36,159 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS events. 2018-03-31 16:17:20,411 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-03-31 16:17:43,092 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-03-31 16:18:20,327 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-03-31 16:18:20,327 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-03-31 16:18:20,327 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS stats. 2018-03-31 16:19:04,248 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-31 16:19:26,802 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-31 16:19:45,542 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-03-31 16:19:45,543 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-03-31 16:20:31,556 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-31 16:20:53,599 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-03-31 16:20:55,924 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-03-31 16:20:55,924 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-03-31 16:20:55,924 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-03-31 16:21:07,902 - baro_tests.barometer - INFO - Stopping collectd service... 2018-03-31 16:21:19,544 - baro_tests.barometer - INFO - Starting collectd service... 2018-03-31 16:21:30,652 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-03-31 16:22:25,005 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-03-31 16:22:46,604 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node c1a8c897-235a-49b3-af2b-c41f513d6d77... 2018-03-31 16:22:46,604 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-31 16:22:46,604 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-03-31 16:22:46,605 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-03-31 16:22:58,428 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:22:58,428 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1522512983.12 ... 2018-03-31 16:22:58,429 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:22:58,429 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1522512983.12 ... 2018-03-31 16:22:58,430 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:22:58,430 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1522512983.12 ... 2018-03-31 16:22:58,430 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:22:58,430 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1522512983.12 ... 2018-03-31 16:22:58,431 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:22:58,431 - baro_tests.barometer - INFO - OK 2018-03-31 16:22:58,431 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-31 16:23:10,442 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-31 16:23:22,151 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:23:22,154 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1522512983.117, 1522512993.117), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1522512983.117, 1522512993.117), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1522512983.118, 1522512993.118), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1522512983.118, 1522512993.118)] 2018-03-31 16:23:22,155 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1522513013.117, 1522513023.117), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1522513013.117, 1522513023.117), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1522513013.118, 1522513023.117), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1522513013.118, 1522513023.117)] 2018-03-31 16:23:22,157 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1522512983.12 - hugepages-mm-2048Kb vmpage_number-free 1522513013.12 ... 2018-03-31 16:23:22,158 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:23:22,158 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1522512983.12 - hugepages-mm-2048Kb vmpage_number-used 1522513013.12 ... 2018-03-31 16:23:22,159 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:23:22,159 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1522512983.12 - hugepages-node0-2048Kb vmpage_number-free 1522513013.12 ... 2018-03-31 16:23:22,159 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:23:22,159 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1522512983.12 - hugepages-node0-2048Kb vmpage_number-used 1522513013.12 ... 2018-03-31 16:23:22,160 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:23:22,160 - baro_tests.barometer - INFO - OK 2018-03-31 16:23:22,160 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-03-31 16:24:08,441 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-03-31 16:24:41,918 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node c1a8c897-235a-49b3-af2b-c41f513d6d77... 2018-03-31 16:24:41,918 - baro_tests.barometer - DEBUG - Interval: 10 2018-03-31 16:24:41,919 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-03-31 16:24:41,919 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-03-31 16:24:52,843 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:24:52,843 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1522513103.12 ... 2018-03-31 16:24:52,844 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:24:52,845 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1522513103.12 ... 2018-03-31 16:24:52,845 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:24:52,845 - baro_tests.barometer - INFO - OK 2018-03-31 16:24:52,845 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-03-31 16:25:04,853 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-31 16:25:16,546 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:25:16,548 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1522513103.117, 1522513113.117), ('intel_rdt-0-2', 'ipc', 1522513103.117, 1522513113.117)] 2018-03-31 16:25:16,549 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1522513123.117, 1522513133.117), ('intel_rdt-0-2', 'ipc', 1522513123.117, 1522513133.117)] 2018-03-31 16:25:16,550 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1522513103.12 - intel_rdt-0-2 bytes-llc 1522513123.12 ... 2018-03-31 16:25:16,554 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:25:16,555 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1522513103.12 - intel_rdt-0-2 ipc 1522513123.12 ... 2018-03-31 16:25:16,555 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:25:16,555 - baro_tests.barometer - INFO - OK 2018-03-31 16:25:16,555 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Intel RDT. 2018-03-31 16:26:01,338 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-03-31 16:26:23,198 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node c1a8c897-235a-49b3-af2b-c41f513d6d77... 2018-03-31 16:26:23,200 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:26:23,200 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-03-31 16:26:23,201 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-03-31 16:26:35,265 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:26:35,265 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522513216.12 ... 2018-03-31 16:26:35,266 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:35,266 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522513216.12 ... 2018-03-31 16:26:35,266 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:35,266 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522513216.12 ... 2018-03-31 16:26:35,267 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:35,267 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522513216.12 ... 2018-03-31 16:26:35,267 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:35,267 - baro_tests.barometer - INFO - OK 2018-03-31 16:26:35,268 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:26:38,269 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-31 16:26:49,730 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:26:49,731 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1522513216.119, 1522513217.119), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1522513216.119, 1522513217.119), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1522513216.119, 1522513217.119), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1522513216.119, 1522513217.119)] 2018-03-31 16:26:49,732 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1522513230.119, 1522513231.119), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1522513230.119, 1522513231.119), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1522513230.119, 1522513232.119), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1522513231.119, 1522513232.119)] 2018-03-31 16:26:49,732 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522513216.12 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1522513230.12 ... 2018-03-31 16:26:49,732 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:49,733 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522513216.12 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1522513230.12 ... 2018-03-31 16:26:49,734 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:49,735 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522513216.12 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1522513230.12 ... 2018-03-31 16:26:49,736 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:49,736 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522513216.12 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1522513231.12 ... 2018-03-31 16:26:49,736 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:26:49,737 - baro_tests.barometer - INFO - OK 2018-03-31 16:26:49,739 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-03-31 16:27:34,801 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-03-31 16:27:57,291 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node c1a8c897-235a-49b3-af2b-c41f513d6d77... 2018-03-31 16:27:57,291 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:27:57,291 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-03-31 16:27:57,292 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-03-31 16:28:08,577 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:28:08,577 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1522513309.12 ... 2018-03-31 16:28:08,578 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:28:08,578 - baro_tests.barometer - INFO - OK 2018-03-31 16:28:08,578 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:28:11,581 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-31 16:28:23,361 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:28:23,363 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1522513309.119, 1522513310.119)] 2018-03-31 16:28:23,367 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1522513324.119, 1522513325.119)] 2018-03-31 16:28:23,369 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1522513309.12 - ovs_events-br0 gauge-link_status 1522513324.12 ... 2018-03-31 16:28:23,371 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:28:23,371 - baro_tests.barometer - INFO - OK 2018-03-31 16:28:23,371 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-03-31 16:29:06,621 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-03-31 16:29:28,343 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node c1a8c897-235a-49b3-af2b-c41f513d6d77... 2018-03-31 16:29:28,344 - baro_tests.barometer - DEBUG - Interval: 1 2018-03-31 16:29:28,344 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-03-31 16:29:28,345 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-03-31 16:29:39,731 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-03-31 16:29:39,731 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1522513400.12 ... 2018-03-31 16:29:39,732 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:39,732 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1522513400.12 ... 2018-03-31 16:29:39,732 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:39,732 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1522513401.12 ... 2018-03-31 16:29:39,732 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:39,732 - baro_tests.barometer - INFO - OK 2018-03-31 16:29:39,733 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-03-31 16:29:42,734 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-03-31 16:29:53,823 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-03-31 16:29:53,823 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1522513400.119, 1522513401.119), ('ovs_stats-br0.br0', 'if_errors', 1522513400.119, 1522513402.119), ('ovs_stats-br0.br0', 'if_packets', 1522513401.119, 1522513402.119)] 2018-03-31 16:29:53,824 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1522513414.119, 1522513416.119), ('ovs_stats-br0.br0', 'if_errors', 1522513415.119, 1522513416.119), ('ovs_stats-br0.br0', 'if_packets', 1522513415.119, 1522513416.119)] 2018-03-31 16:29:53,824 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1522513400.12 - ovs_stats-br0.br0 if_dropped 1522513414.12 ... 2018-03-31 16:29:53,824 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:53,825 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1522513400.12 - ovs_stats-br0.br0 if_errors 1522513415.12 ... 2018-03-31 16:29:53,825 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:53,825 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1522513401.12 - ovs_stats-br0.br0 if_packets 1522513415.12 ... 2018-03-31 16:29:53,825 - baro_tests.barometer - DEBUG - OK 2018-03-31 16:29:53,825 - baro_tests.barometer - INFO - OK 2018-03-31 16:29:53,825 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-03-31 16:30:04,737 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-03-31 16:30:04,738 - baro_tests.barometer - INFO - ====================================================================== 2018-03-31 16:30:04,740 - baro_tests.barometer - INFO - +----------------------------------+ 2018-03-31 16:30:04,742 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-03-31 16:30:04,742 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-31 16:30:04,743 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-03-31 16:30:04,743 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-31 16:30:04,744 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-03-31 16:30:04,745 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | FAIL | 2018-03-31 16:30:04,746 - baro_tests.barometer - INFO - | IN:Intel RDT | FAIL | FAIL | 2018-03-31 16:30:04,746 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | FAIL | 2018-03-31 16:30:04,747 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-03-31 16:30:04,747 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | FAIL | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | SKIP | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-03-31 16:30:04,748 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | PASS | 2018-03-31 16:30:04,749 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-03-31 16:30:04,749 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-03-31 16:30:04,750 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-03-31 16:30:04,750 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-03-31 16:30:04,750 - baro_tests.barometer - INFO - ====================================================================== 2018-03-31 16:30:04,752 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-03-31 16:30:04,753 - baro_tests.barometer - ERROR - Overall Result is Fail