"Host IPMI system event log status" alarm in vCenter Server

Products

• VMware vSphere ESXi

Issue/Introduction

When host IPMI system event log status alarm is triggered repeatedly in the Hardware Status tab in vCenter Server 6.x, 7.x or 8.x, clear the IPMI System Event log file located at /var/log/ipmi.

• The Host Intelligent Platform Management Interface (IPMI) System Event Log (SEL) status alarm is triggered repeatedly on the ESXi/ESX host.
• Acknowledging the alarm removes the exclamation on the ESXi/ESX host in the Inventory.
• Hardware status alarm is present after clearing the BIOS hardware logs

Note: For additional symptoms , check the logs

In the /var/log/vmkernel.log file, entries similar to the below are seen:

sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
snmpd[19956]: Connection from UDP: [10.16.16.65]:61945
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
/usr/lib/vmware/bin/vmware-hostd[19577]: Accepted password for user root from 10.16.16.65
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
snmpd[19956]: Connection from UDP: [10.16.16.65]:61945
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff
sfcb-vmware_raw[5153]: IpmiIfcSelReadAll: failed call to IpmiIfcSelReadEntry cc = 0xff

Environment

VMware vSphere ESXi 6.x
VMware vSphere ESXi 7.x
VMware vSphere ESXi 8.x

Cause

This issue occurs when the IPMI System Event log file is full, which triggers the alarm that monitors the log file.

Resolution

To resolve this issue, ensure that the NTP settings are correct on the ESXi host, clear the IPMI System Event log file, and reset the sensors.

 

To clear the IPMI System Event log file and reset the sensors:

1. Open vCenter Server using the vSphere Client.
2. In the vCenter Server Inventory, select the ESXi/ESX host.
3. Click the Hardware Status tab.
4. Click System Event log under View.
5. Click Reset Event Log. The red alert is removed from the System Event log.
6. Click Reset Sensors to reset the host sensors.

To clear the IPMI SEL logs in ESXi 6.x and later:

    7.Connect to the ESXi host through SSH.

    8.Run this command:
       localcli command can also be used from command line to clear the IPMI SEL logs.

#localcli hardware ipmi sel clear

Alternatively, consider Restarting the management agents as well. 

Note: If the sfcbd-watchdog service is stopped, use the two below commands to start the service:

 

 

Additional Information

 

Restarting the Management agents in ESXi
Location of vCenter Server log files