The NSX upgrade page is stuck on the loading screen.
Article ID: 436769
Updated On:
Products
Issue/Introduction
- Accessed the NSX Upgrade page in the UI and observed that it was stuck in a loading state.
- Issue was observed on NSX version 4.2.1.3, which is impacted by a known JDK issue, resulting in the service being unresponsive.
- The issue still persists even after the NSX Managers rolling reboot.
Environment
VMware NSX 4.2.0.x
VMware NSX 4.2.1.0, 4.2.1.1, 4.2.1.2, 4.2.1.3
VMware NSX 9.0.0.0
Cause
The issue occurs due to a JDK bug (JDK-8330017) where the Release Count (RC) field in ForkJoinPool's internal control structure overflows. The RC value keeps decreasing until it reaches -32768, then overflows to +32767 (ForkJoinPool.MAX_CAP), causing the thread pool to stop executing tasks.
This affects different NSX services:
- Controller service - impacts network provisioning, firewall rules, and vMotion operations
- Upgrade Coordinator service - affects upgrade operations and causes OOM errors
- Corfu service - impacts data storage and retrieval operations
Resolution
Restart the upgrade-coordinator service on all three NSX Manager nodes.
Stop the upgrade coordinator service by running the following command.root@nsxmgr01:~# service upgrade-coordinator stop
Start the upgrade coordinator service by running the following command.
root@nsxmgr01:~# service upgrade-coordinator start
check the status of the Upgrade Coordinator service by running the following command.root@nsxmgr01:~# service upgrade-coordinator status
Additional Information
Feedback
