Core dump file of dp-ipc55 generated.

Products

• VMware NSX

Issue/Introduction

• An application on an edge node crashed, resulting in a core dump file of dp-ipc55 being generated.
• The syslog messages below indicate that the physical network interface driver didn't complete some of its functions properly.
• It eventually led to PANIC in phys_port_set_mtu() function and the core dump file generated.

<DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="phys-port" tname="dp-ipc55" level="INFO"] Set mtu for port 1 : 9000 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="INFO"] Reconfiguring port 1 - drv net_i40e <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] i40e_phy_conf_link(): Failed to get PHY capabilities: -56#012 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] i40e_dev_sync_phy_type(): Failed to sync phy type: status=-56 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Configure failed for port 1, err: Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Port 1 setup/configure error: Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Failed to init port 1 : Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="phys-port" tname="dp-ipc55" level="WARN"] Failed to start port 1 for MTU change (mtu: 9000) ret: -95; attempting to roll back config <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="INFO"] Reconfiguring port 1 - drv net_i40e <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] update_link_aq(): Failed to get link info <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="INFO"] Device with port_id=1 already stopped <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="INFO"] Setting up port 1; driver net_i40e, tx_q: 24 rx_q: 25 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="INFO"] Requested RSS on port 1 not subset of capabilities: rss_hf 0x2db4, capa 0x7ef8 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] i40e_dev_sync_phy_type(): Failed to sync phy type: status=-56 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Port1 dev_configure = -95 <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Configure failed for port 1, err: Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Port 1 setup/configure error: Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="WARN"] Failed to init port 1 : Operation not supported <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="FATAL"] PANIC in phys_port_set_mtu(): <DATE_TIME> <HOSTNAME> NSX 7519 FABRIC [nsx@6876 comp="nsx-edge" subcomp="datapathd" s2comp="intel-rte" tname="dp-ipc55" level="FATAL"] Rollback failed. Bailing out. <DATE_TIME> <HOSTNAME> 597d6cd###### ###### - -  2024-07-24T01:41:33Z datapathd 7519 intel-rte tname="dp-ipc55" [FATAL] PANIC in phys_port_set_mtu(): <DATE_TIME> <HOSTNAME> 597d6######## ###### - -  2024-07-24T01:41:33Z datapathd 7519 intel-rte tname="dp-ipc55" [FATAL] Rollback failed. Bailing out. <DATE_TIME> <HOSTNAME> datapath-systemd-helper 7384 - -  2024-07-24T01:41:33Z datapathd 7519 intel-rte tname="dp-ipc55" [FATAL] PANIC in phys_port_set_mtu(): <DATE_TIME> <HOSTNAME> datapath-systemd-helper 7384 - -  2024-07-24T01:41:33Z datapathd 7519 intel-rte tname="dp-ipc55" [FATAL] Rollback failed. Bailing out.

Environment

VMware NSX

VMware NSX 4.1.2.4

Cause

There might be some probabilities of faulty NIC driver/firmware and hardware.

Resolution

Contact hardware vendor to check the NIC driver/firmware and hardware.