2018-04-29 13:38:37,357 - baro_tests.barometer - INFO - =================== Starting barometer tests suite =================== 2018-04-29 13:38:37,358 - baro_tests.barometer - INFO - RSA key file /root/.ssh/id_rsa exists. 2018-04-29 13:38:41,663 - baro_tests.barometer - INFO - ==== Display of Control and Compute nodes available in the set up ==== 2018-04-29 13:38:41,664 - baro_tests.barometer - INFO - controllers: ['overcloud-controller-0: 192.30.9.5', 'overcloud-controller-1: 192.30.9.9', 'overcloud-controller-2: 192.30.9.4'] 2018-04-29 13:38:41,664 - baro_tests.barometer - INFO - computes: ['overcloud-novacompute-0: 192.30.9.7', 'overcloud-novacompute-1: 192.30.9.6'] 2018-04-29 13:38:41,664 - baro_tests.barometer - INFO - ========== Enabling mcelog and OVS bridges on compute nodes ========== 2018-04-29 13:38:55,276 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-0... 2018-04-29 13:38:55,343 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-0... 2018-04-29 13:38:55,852 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-0. 2018-04-29 13:38:55,885 - baro_tests.barometer - INFO - Checking if mcelog is enabled on node-overcloud-novacompute-1... 2018-04-29 13:38:55,979 - baro_tests.barometer - INFO - Mcelog will be enabled on node-overcloud-novacompute-1... 2018-04-29 13:38:56,477 - baro_tests.barometer - INFO - Mcelog was installed on node-overcloud-novacompute-1. 2018-04-29 13:39:10,107 - baro_tests.barometer - INFO - Creating OVS bridges on computes nodes 2018-04-29 13:39:10,463 - baro_tests.barometer - INFO - OVS Bridges created on compute nodes 2018-04-29 13:39:10,464 - baro_tests.barometer - INFO - ============= Testing Gnocchi and AODH plugins on nodes ============== 2018-04-29 13:41:07,019 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-0 2018-04-29 13:41:21,202 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-0 2018-04-29 13:41:21,203 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-0: Enabling Test Plug-in and Test case execution === 2018-04-29 13:42:50,765 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-29 13:43:18,792 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 13:43:56,686 - baro_tests.barometer - INFO - PASS 2018-04-29 13:43:56,687 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Hugepages. 2018-04-29 13:44:54,291 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-29 13:45:34,717 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 13:46:12,076 - baro_tests.barometer - INFO - PASS 2018-04-29 13:46:12,076 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Intel RDT. 2018-04-29 13:47:09,280 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-29 13:47:36,056 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 13:48:13,332 - baro_tests.barometer - INFO - PASS 2018-04-29 13:48:13,333 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with Gnocchi PASSED on Mcelog. 2018-04-29 13:49:08,510 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-29 13:49:36,421 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 13:49:39,172 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-29 13:49:41,873 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-04-29 13:49:44,836 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS events. 2018-04-29 13:50:42,618 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-29 13:51:09,655 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 13:51:12,316 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-29 13:51:15,003 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-04-29 13:51:17,636 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with Gnocchi FAILED on OVS stats. 2018-04-29 13:52:10,237 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-29 13:52:36,340 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-29 13:52:55,549 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-29 13:52:55,550 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on Mcelog. 2018-04-29 13:53:50,181 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-29 13:54:16,809 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-29 13:54:19,211 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-29 13:54:22,041 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-04-29 13:54:25,131 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-0 with AODH FAILED on OVS events. 2018-04-29 13:54:25,132 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-0: Executing CSV Testcases ======== 2018-04-29 13:54:25,132 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-29 13:54:37,524 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-29 13:54:48,811 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-29 13:54:59,525 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-29 13:56:03,860 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Hugepages Test case execution === 2018-04-29 13:56:30,823 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 2f08aa4a-8222-42cb-a02a-f8dfc990f008... 2018-04-29 13:56:30,823 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-29 13:56:30,824 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-29 13:56:30,824 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-29 13:56:44,910 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 13:56:44,910 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525009769.01 ... 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525009769.01 ... 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525009769.01 ... 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525009769.01 ... 2018-04-29 13:56:44,911 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:56:44,912 - baro_tests.barometer - INFO - OK 2018-04-29 13:56:44,912 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-29 13:56:56,924 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-29 13:57:11,958 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 13:57:11,958 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525009769.012, 1525009779.012), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525009769.012, 1525009779.012), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525009769.012, 1525009779.012), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525009769.012, 1525009779.012)] 2018-04-29 13:57:11,959 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525009799.012, 1525009809.012), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525009799.012, 1525009809.012), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525009799.012, 1525009809.012), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525009799.012, 1525009809.012)] 2018-04-29 13:57:11,959 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525009769.01 - hugepages-mm-2048Kb vmpage_number-free 1525009799.01 ... 2018-04-29 13:57:11,959 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:57:11,959 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525009769.01 - hugepages-mm-2048Kb vmpage_number-used 1525009799.01 ... 2018-04-29 13:57:11,959 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:57:11,960 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525009769.01 - hugepages-node0-2048Kb vmpage_number-free 1525009799.01 ... 2018-04-29 13:57:11,960 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:57:11,960 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525009769.01 - hugepages-node0-2048Kb vmpage_number-used 1525009799.01 ... 2018-04-29 13:57:11,960 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:57:11,960 - baro_tests.barometer - INFO - OK 2018-04-29 13:57:11,960 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Hugepages. 2018-04-29 13:58:09,175 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Intel RDT Test case execution === 2018-04-29 13:58:48,494 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 2f08aa4a-8222-42cb-a02a-f8dfc990f008... 2018-04-29 13:58:48,494 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-29 13:58:48,495 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-29 13:58:48,495 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-29 13:59:01,991 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 13:59:01,991 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525009909.01 ... 2018-04-29 13:59:01,991 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:59:01,992 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525009909.01 ... 2018-04-29 13:59:01,992 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:59:01,992 - baro_tests.barometer - INFO - OK 2018-04-29 13:59:01,993 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-29 13:59:14,005 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-29 13:59:28,738 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 13:59:28,738 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525009909.012, 1525009919.012), ('intel_rdt-0-2', 'ipc', 1525009909.012, 1525009919.012)] 2018-04-29 13:59:28,739 - baro_tests.barometer - DEBUG - [('intel_rdt-0-2', 'bytes-llc', 1525009929.012, 1525009939.012), ('intel_rdt-0-2', 'ipc', 1525009929.012, 1525009939.012)] 2018-04-29 13:59:28,739 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525009909.01 - intel_rdt-0-2 bytes-llc 1525009929.01 ... 2018-04-29 13:59:28,739 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:59:28,739 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525009909.01 - intel_rdt-0-2 ipc 1525009929.01 ... 2018-04-29 13:59:28,740 - baro_tests.barometer - DEBUG - OK 2018-04-29 13:59:28,740 - baro_tests.barometer - INFO - OK 2018-04-29 13:59:28,740 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Intel RDT. 2018-04-29 14:00:25,932 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in Mcelog Test case execution === 2018-04-29 14:00:52,521 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 2f08aa4a-8222-42cb-a02a-f8dfc990f008... 2018-04-29 14:00:52,521 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:00:52,521 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-29 14:00:52,522 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-29 14:01:07,011 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:01:07,012 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525010044.01 ... 2018-04-29 14:01:07,012 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525010045.01 ... 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525010045.01 ... 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525010045.01 ... 2018-04-29 14:01:07,013 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:07,014 - baro_tests.barometer - INFO - OK 2018-04-29 14:01:07,014 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:01:10,016 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-29 14:01:23,905 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:01:23,906 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525010044.014, 1525010046.014), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525010045.014, 1525010046.014), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525010045.013, 1525010046.014), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525010045.013, 1525010046.014)] 2018-04-29 14:01:23,906 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525010061.014, 1525010063.014), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525010062.014, 1525010063.014), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525010062.013, 1525010063.014), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525010062.013, 1525010063.014)] 2018-04-29 14:01:23,907 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525010044.01 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525010061.01 ... 2018-04-29 14:01:23,907 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:23,907 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525010045.01 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525010062.01 ... 2018-04-29 14:01:23,908 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:23,908 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525010045.01 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525010062.01 ... 2018-04-29 14:01:23,908 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:23,908 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525010045.01 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525010062.01 ... 2018-04-29 14:01:23,908 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:01:23,908 - baro_tests.barometer - INFO - OK 2018-04-29 14:01:23,908 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on Mcelog. 2018-04-29 14:02:16,622 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS events Test case execution === 2018-04-29 14:02:42,518 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 2f08aa4a-8222-42cb-a02a-f8dfc990f008... 2018-04-29 14:02:42,518 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:02:42,519 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-29 14:02:42,519 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-29 14:02:56,052 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:02:56,052 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525010154.01 ... 2018-04-29 14:02:56,052 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:02:56,053 - baro_tests.barometer - INFO - OK 2018-04-29 14:02:56,053 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:02:59,057 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-29 14:03:11,664 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:03:11,664 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525010154.014, 1525010155.014)] 2018-04-29 14:03:11,665 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525010170.014, 1525010171.014)] 2018-04-29 14:03:11,665 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525010154.01 - ovs_events-br0 gauge-link_status 1525010170.01 ... 2018-04-29 14:03:11,665 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:03:11,666 - baro_tests.barometer - INFO - OK 2018-04-29 14:03:11,666 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS events. 2018-04-29 14:04:03,606 - baro_tests.barometer - INFO - === Node overcloud-novacompute-0: Plug-in OVS stats Test case execution === 2018-04-29 14:04:28,904 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 2f08aa4a-8222-42cb-a02a-f8dfc990f008... 2018-04-29 14:04:28,905 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:04:28,905 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-29 14:04:28,905 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-29 14:04:43,220 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:04:43,220 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525010261.01 ... 2018-04-29 14:04:43,220 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:43,221 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525010261.01 ... 2018-04-29 14:04:43,221 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:43,221 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525010261.01 ... 2018-04-29 14:04:43,221 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:43,221 - baro_tests.barometer - INFO - OK 2018-04-29 14:04:43,221 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:04:46,225 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-0... 2018-04-29 14:04:59,698 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:04:59,698 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525010261.014, 1525010262.014), ('ovs_stats-br0.br0', 'if_errors', 1525010261.014, 1525010262.014), ('ovs_stats-br0.br0', 'if_packets', 1525010261.014, 1525010262.014)] 2018-04-29 14:04:59,699 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525010277.014, 1525010278.014), ('ovs_stats-br0.br0', 'if_errors', 1525010277.014, 1525010278.014), ('ovs_stats-br0.br0', 'if_packets', 1525010278.014, 1525010279.014)] 2018-04-29 14:04:59,699 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525010261.01 - ovs_stats-br0.br0 if_dropped 1525010277.01 ... 2018-04-29 14:04:59,699 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:59,699 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525010261.01 - ovs_stats-br0.br0 if_errors 1525010277.01 ... 2018-04-29 14:04:59,699 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:59,700 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525010261.01 - ovs_stats-br0.br0 if_packets 1525010278.01 ... 2018-04-29 14:04:59,700 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:04:59,700 - baro_tests.barometer - INFO - OK 2018-04-29 14:04:59,700 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-0 with CSV PASSED on OVS stats. 2018-04-29 14:05:13,811 - baro_tests.barometer - INFO - Gnocchi plugin available in compute node overcloud-novacompute-1 2018-04-29 14:05:27,145 - baro_tests.barometer - INFO - AODH plugin present in compute node overcloud-novacompute-1 2018-04-29 14:05:27,145 - baro_tests.barometer - INFO - === NODE overcloud-novacompute-1: Enabling Test Plug-in and Test case execution === 2018-04-29 14:06:56,960 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-29 14:07:24,517 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 14:08:02,803 - baro_tests.barometer - INFO - Plugin Interval is 10 2018-04-29 14:08:02,803 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-29 14:08:02,804 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Hugepages. 2018-04-29 14:08:57,570 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-29 14:09:37,931 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 14:09:40,692 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-29 14:09:43,328 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-04-29 14:09:45,946 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Intel RDT. 2018-04-29 14:10:41,503 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-29 14:11:07,307 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 14:11:45,139 - baro_tests.barometer - INFO - Plugin Interval is 1 2018-04-29 14:11:45,139 - baro_tests.barometer - INFO - Data not updated after 30 seconds 2018-04-29 14:11:45,139 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on Mcelog. 2018-04-29 14:12:39,126 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-29 14:13:06,351 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 14:13:09,104 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-0 2018-04-29 14:13:11,861 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-1 2018-04-29 14:13:14,520 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with Gnocchi FAILED on OVS events. 2018-04-29 14:14:09,432 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-29 14:14:35,411 - baro_tests.barometer - INFO - Getting gnocchi metric list on overcloud-controller-2 2018-04-29 14:15:12,883 - baro_tests.barometer - INFO - PASS 2018-04-29 14:15:12,883 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with Gnocchi PASSED on OVS stats. 2018-04-29 14:16:06,840 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-29 14:16:31,845 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-29 14:16:50,795 - baro_tests.barometer - INFO - Data not updated after interval of 12 seconds 2018-04-29 14:16:50,801 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on Mcelog. 2018-04-29 14:17:44,155 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-29 14:18:11,282 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-2 2018-04-29 14:18:13,705 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-0 2018-04-29 14:18:16,089 - baro_tests.barometer - INFO - Getting AODH Alarm list on overcloud-controller-1 2018-04-29 14:18:18,582 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with AODH FAILED on OVS events. 2018-04-29 14:18:18,583 - baro_tests.barometer - INFO - ======= Node overcloud-novacompute-1: Executing CSV Testcases ======== 2018-04-29 14:18:18,584 - baro_tests.barometer - INFO - Restarting collectd for CSV tests 2018-04-29 14:18:32,111 - baro_tests.barometer - INFO - Stopping collectd service... 2018-04-29 14:18:43,291 - baro_tests.barometer - INFO - Starting collectd service... 2018-04-29 14:18:53,645 - baro_tests.barometer - INFO - Sleeping for 10 seconds after collectd restart... 2018-04-29 14:19:58,055 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Hugepages Test case execution === 2018-04-29 14:20:25,870 - baro_tests.barometer - INFO - Getting CSV metrics of plugin hugepages on compute node 501bbb5a-f9a5-4089-8db9-eedc0edcd3ce... 2018-04-29 14:20:25,871 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-29 14:20:25,871 - baro_tests.barometer - DEBUG - Plugin subdirs: ['hugepages-mm-2048Kb', 'hugepages-node0-2048Kb'] 2018-04-29 14:20:25,871 - baro_tests.barometer - DEBUG - Plugin meter categories: ['vmpage_number-free', 'vmpage_number-used'] 2018-04-29 14:20:39,987 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:20:39,988 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525011208.91 ... 2018-04-29 14:20:39,988 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525011208.91 ... 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525011208.91 ... 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525011208.91 ... 2018-04-29 14:20:39,989 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:20:39,990 - baro_tests.barometer - INFO - OK 2018-04-29 14:20:39,990 - baro_tests.barometer - INFO - Sleeping for 12 seconds to get updated entries (interval is 10 sec)... 2018-04-29 14:20:51,998 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-29 14:21:05,690 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:21:05,691 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525011208.91, 1525011218.91), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525011208.91, 1525011218.91), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525011208.911, 1525011218.91), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525011208.911, 1525011218.91)] 2018-04-29 14:21:05,693 - baro_tests.barometer - DEBUG - [('hugepages-mm-2048Kb', 'vmpage_number-free', 1525011238.91, 1525011248.91), ('hugepages-mm-2048Kb', 'vmpage_number-used', 1525011238.91, 1525011248.91), ('hugepages-node0-2048Kb', 'vmpage_number-free', 1525011238.91, 1525011248.91), ('hugepages-node0-2048Kb', 'vmpage_number-used', 1525011238.91, 1525011248.91)] 2018-04-29 14:21:05,694 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-free 1525011208.91 - hugepages-mm-2048Kb vmpage_number-free 1525011238.91 ... 2018-04-29 14:21:05,694 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:21:05,695 - baro_tests.barometer - DEBUG - hugepages-mm-2048Kb vmpage_number-used 1525011208.91 - hugepages-mm-2048Kb vmpage_number-used 1525011238.91 ... 2018-04-29 14:21:05,695 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:21:05,695 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-free 1525011208.91 - hugepages-node0-2048Kb vmpage_number-free 1525011238.91 ... 2018-04-29 14:21:05,696 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:21:05,696 - baro_tests.barometer - DEBUG - hugepages-node0-2048Kb vmpage_number-used 1525011208.91 - hugepages-node0-2048Kb vmpage_number-used 1525011238.91 ... 2018-04-29 14:21:05,696 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:21:05,696 - baro_tests.barometer - INFO - OK 2018-04-29 14:21:05,696 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Hugepages. 2018-04-29 14:22:01,037 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Intel RDT Test case execution === 2018-04-29 14:22:40,968 - baro_tests.barometer - INFO - Getting CSV metrics of plugin intel_rdt on compute node 501bbb5a-f9a5-4089-8db9-eedc0edcd3ce... 2018-04-29 14:22:40,968 - baro_tests.barometer - DEBUG - Interval: 10 2018-04-29 14:22:40,968 - baro_tests.barometer - DEBUG - Plugin subdirs: ['intel_rdt-0-2'] 2018-04-29 14:22:40,969 - baro_tests.barometer - DEBUG - Plugin meter categories: ['bytes-llc', 'ipc'] 2018-04-29 14:22:54,004 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:22:54,006 - baro_tests.barometer - DEBUG - intel_rdt-0-2 bytes-llc 1525011338.91 ... 2018-04-29 14:22:54,008 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:22:54,010 - baro_tests.barometer - DEBUG - intel_rdt-0-2 ipc 1525011338.91 ... 2018-04-29 14:22:54,012 - baro_tests.barometer - ERROR - Time of last two entries differ by 20.0, but interval is 10 2018-04-29 14:22:54,017 - baro_tests.barometer - ERROR - Test case for overcloud-novacompute-1 with CSV FAILED on Intel RDT. 2018-04-29 14:23:49,248 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in Mcelog Test case execution === 2018-04-29 14:24:15,975 - baro_tests.barometer - INFO - Getting CSV metrics of plugin mcelog on compute node 501bbb5a-f9a5-4089-8db9-eedc0edcd3ce... 2018-04-29 14:24:15,976 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:24:15,976 - baro_tests.barometer - DEBUG - Plugin subdirs: ['mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'mcelog-SOCKET_0_CHANNEL_any_DIMM_any'] 2018-04-29 14:24:15,977 - baro_tests.barometer - DEBUG - Plugin meter categories: ['errors-corrected_memory_errors', 'errors-uncorrected_memory_errors'] 2018-04-29 14:24:29,992 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:24:29,993 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525011452.91 ... 2018-04-29 14:24:29,994 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:29,995 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525011453.91 ... 2018-04-29 14:24:29,995 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:29,995 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525011453.91 ... 2018-04-29 14:24:29,996 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:29,996 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525011453.91 ... 2018-04-29 14:24:29,997 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:29,997 - baro_tests.barometer - INFO - OK 2018-04-29 14:24:29,997 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:24:33,000 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-29 14:24:46,757 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:24:46,757 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525011452.911, 1525011453.911), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525011453.911, 1525011454.911), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525011453.911, 1525011454.911), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525011453.911, 1525011454.911)] 2018-04-29 14:24:46,761 - baro_tests.barometer - DEBUG - [('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-corrected_memory_errors', 1525011469.911, 1525011470.911), ('mcelog-SOCKET_0_CHANNEL_0_DIMM_any', 'errors-uncorrected_memory_errors', 1525011469.911, 1525011470.911), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-corrected_memory_errors', 1525011469.911, 1525011471.911), ('mcelog-SOCKET_0_CHANNEL_any_DIMM_any', 'errors-uncorrected_memory_errors', 1525011470.911, 1525011471.911)] 2018-04-29 14:24:46,761 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525011452.91 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-corrected_memory_errors 1525011469.91 ... 2018-04-29 14:24:46,763 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:46,763 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525011453.91 - mcelog-SOCKET_0_CHANNEL_0_DIMM_any errors-uncorrected_memory_errors 1525011469.91 ... 2018-04-29 14:24:46,764 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:46,764 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525011453.91 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-corrected_memory_errors 1525011469.91 ... 2018-04-29 14:24:46,765 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:46,766 - baro_tests.barometer - DEBUG - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525011453.91 - mcelog-SOCKET_0_CHANNEL_any_DIMM_any errors-uncorrected_memory_errors 1525011470.91 ... 2018-04-29 14:24:46,766 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:24:46,767 - baro_tests.barometer - INFO - OK 2018-04-29 14:24:46,769 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on Mcelog. 2018-04-29 14:25:40,491 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS events Test case execution === 2018-04-29 14:26:05,954 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_events on compute node 501bbb5a-f9a5-4089-8db9-eedc0edcd3ce... 2018-04-29 14:26:05,955 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:26:05,955 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_events-br0'] 2018-04-29 14:26:05,955 - baro_tests.barometer - DEBUG - Plugin meter categories: ['gauge-link_status'] 2018-04-29 14:26:19,347 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:26:19,347 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525011562.91 ... 2018-04-29 14:26:19,347 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:26:19,348 - baro_tests.barometer - INFO - OK 2018-04-29 14:26:19,348 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:26:22,351 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-29 14:26:35,447 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:26:35,448 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525011562.912, 1525011563.911)] 2018-04-29 14:26:35,450 - baro_tests.barometer - DEBUG - [('ovs_events-br0', 'gauge-link_status', 1525011578.911, 1525011579.911)] 2018-04-29 14:26:35,451 - baro_tests.barometer - DEBUG - ovs_events-br0 gauge-link_status 1525011562.91 - ovs_events-br0 gauge-link_status 1525011578.91 ... 2018-04-29 14:26:35,453 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:26:35,454 - baro_tests.barometer - INFO - OK 2018-04-29 14:26:35,458 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS events. 2018-04-29 14:27:28,331 - baro_tests.barometer - INFO - === Node overcloud-novacompute-1: Plug-in OVS stats Test case execution === 2018-04-29 14:27:53,254 - baro_tests.barometer - INFO - Getting CSV metrics of plugin ovs_stats on compute node 501bbb5a-f9a5-4089-8db9-eedc0edcd3ce... 2018-04-29 14:27:53,254 - baro_tests.barometer - DEBUG - Interval: 1 2018-04-29 14:27:53,256 - baro_tests.barometer - DEBUG - Plugin subdirs: ['ovs_stats-br0.br0'] 2018-04-29 14:27:53,256 - baro_tests.barometer - DEBUG - Plugin meter categories: ['if_dropped', 'if_errors', 'if_packets'] 2018-04-29 14:28:06,831 - baro_tests.barometer - INFO - Checking that last two entries in metrics are correspondingto interval... 2018-04-29 14:28:06,832 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525011669.91 ... 2018-04-29 14:28:06,832 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:06,832 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525011669.91 ... 2018-04-29 14:28:06,833 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:06,833 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525011670.91 ... 2018-04-29 14:28:06,833 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:06,834 - baro_tests.barometer - INFO - OK 2018-04-29 14:28:06,835 - baro_tests.barometer - INFO - Sleeping for 3 seconds to get updated entries (interval is 1 sec)... 2018-04-29 14:28:09,838 - baro_tests.barometer - INFO - Getting new metrics of compute node overcloud-novacompute-1... 2018-04-29 14:28:23,933 - baro_tests.barometer - INFO - Comparing old and new metrics... 2018-04-29 14:28:23,934 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525011669.911, 1525011670.911), ('ovs_stats-br0.br0', 'if_errors', 1525011669.911, 1525011671.911), ('ovs_stats-br0.br0', 'if_packets', 1525011670.911, 1525011671.911)] 2018-04-29 14:28:23,934 - baro_tests.barometer - DEBUG - [('ovs_stats-br0.br0', 'if_dropped', 1525011686.911, 1525011687.911), ('ovs_stats-br0.br0', 'if_errors', 1525011686.911, 1525011687.911), ('ovs_stats-br0.br0', 'if_packets', 1525011686.911, 1525011687.911)] 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_dropped 1525011669.91 - ovs_stats-br0.br0 if_dropped 1525011686.91 ... 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_errors 1525011669.91 - ovs_stats-br0.br0 if_errors 1525011686.91 ... 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - ovs_stats-br0.br0 if_packets 1525011670.91 - ovs_stats-br0.br0 if_packets 1525011686.91 ... 2018-04-29 14:28:23,935 - baro_tests.barometer - DEBUG - OK 2018-04-29 14:28:23,935 - baro_tests.barometer - INFO - OK 2018-04-29 14:28:23,936 - baro_tests.barometer - INFO - Test case for overcloud-novacompute-1 with CSV PASSED on OVS stats. 2018-04-29 14:28:37,793 - baro_tests.barometer - INFO - Mcelog is deleted from all compute nodes 2018-04-29 14:28:37,794 - baro_tests.barometer - INFO - ====================================================================== 2018-04-29 14:28:37,794 - baro_tests.barometer - INFO - +----------------------------------+ 2018-04-29 14:28:37,796 - baro_tests.barometer - INFO - | OVERALL SUMMARY | 2018-04-29 14:28:37,796 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-29 14:28:37,797 - baro_tests.barometer - INFO - | Test | Node-0 | Node-1 | 2018-04-29 14:28:37,797 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-29 14:28:37,797 - baro_tests.barometer - INFO - | OUT:Gnocchi | PASS | PASS | 2018-04-29 14:28:37,798 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | FAIL | 2018-04-29 14:28:37,799 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | FAIL | 2018-04-29 14:28:37,802 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | FAIL | 2018-04-29 14:28:37,802 - baro_tests.barometer - INFO - | IN:OVS events | FAIL | FAIL | 2018-04-29 14:28:37,803 - baro_tests.barometer - INFO - | IN:OVS stats | FAIL | PASS | 2018-04-29 14:28:37,804 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-29 14:28:37,804 - baro_tests.barometer - INFO - | OUT:AODH | PASS | PASS | 2018-04-29 14:28:37,805 - baro_tests.barometer - INFO - | IN:Mcelog | FAIL | FAIL | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:OVS events | SKIP | SKIP | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | OUT:CSV | PASS | PASS | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:Hugepages | PASS | PASS | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:Intel RDT | PASS | FAIL | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:Mcelog | PASS | PASS | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:OVS events | PASS | PASS | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - | IN:OVS stats | PASS | PASS | 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - +----------------+--------+--------+ 2018-04-29 14:28:37,806 - baro_tests.barometer - INFO - ====================================================================== 2018-04-29 14:28:37,807 - baro_tests.barometer - ERROR - Some tests have failed or have not been executed 2018-04-29 14:28:37,807 - baro_tests.barometer - ERROR - Overall Result is Fail