Upgrading NSX-T Data Center from 3.x to 3.1.0 failed on edge node with alert: polling switch_os timed out

Products

• VMware NSX Networking

Issue/Introduction

Symptoms:

• You are upgrading NSX-T Data Center 3.x to 3.1.0.
• In NSX-T Data Center Edge log /var/log/syslog the following messages can be seen: 
  • <3>1 2021-01-17T07:15:44.566177+00:00 edge kernel - - - [6447815.396904] INFO: task lspci:28669 blocked for more than 120 seconds.
  • <3>1 2021-01-17T07:15:44.566198+00:00 edge kernel - - - [6447815.397247] INFO: task lspci:29401 blocked for more than 120 seconds.

Environment

VMware NSX-T Data Center
VMware NSX-T Data Center 3.x

Cause

This is due to an underlying OS kernel issue which causes the timeout and failed upgrade.

Resolution

This issue is resolved in NSX-T Data Center 3.1.0.

Workaround:
Reboot the affected edge node and then retry the upgrade.