During Migration from VCF 4.x to 5.x ESXI disconnects during upgrade after first boot. It loses the network connection
search cancel

During Migration from VCF 4.x to 5.x ESXI disconnects during upgrade after first boot. It loses the network connection

book

Article ID: 367673

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

when upgrading esxi hosts from version 7.x to 8.x in SDDC Manager ESXI disconnects during upgrade after first boot, it loses the network connection.

  • ESXI disconnected during upgraded but after first reboot it loses the network connection.
  • From CXX console unable to ping gateway, no reply.

Environment

VCF 5.1 

Cause

Mismatch between net-dvs and configstore

When checking Net-dvs has three switches where as the configstore has four. 

Resolution

 

1. SSH to the ESXI as the root user. 

2. Run the command: configstorecli config current get -c esx -g network_vds -k switches

output: Component = esx
  ConfigGroup = network_vds
         Name = switches
  Identifier = 60 15 5c 2a 3b 0e 01 66-a7 1e 45 11 a1 dc 87 30
 ModifiedTime = 2024-04-10 09:59:23
 CreationTime = 2023-12-21 09:43:55
      Version = 1.0
      Success = 0
AutoConfValue =
   UserValue = {"uuid": "60 15 5c 2a 3b 0e 01 66-a7 1e 45 11 a1 dc 87 30", "configured_max_ports": 512, "max_ports": 9216, "product": {"forwarding_class": "cswitch"}}
  VitalValue = {"uuid": "60 15 5c 2a 3b 0e 01 66-a7 1e 45 11 a1 dc 87 30", "portset_name": "DvsPortset-1"}
  CachedValue =
 DesiredValue =
     Revision = 36

    Component = esx
  ConfigGroup = network_vds
         Name = switches
  Identifier = 60 1d c2 d6 ac 29 65 cd-a2 3d 6d e2 dc 87 8b c9
 ModifiedTime = 2024-05-09 17:27:39
 CreationTime = 2024-01-25 11:04:21
      Version = 1.0
      Success = 1
AutoConfValue =
   UserValue = {"uuid": "60 1d c2 d6 ac 29 65 cd-a2 3d 6d e2 dc 87 8b c9", "configured_max_ports": 512, "max_ports": 9216, "product": {"forwarding_class": "cswitch"}, "uplinks": [{"nic": "vmnic4", "uplink_port_key": "11", "connection_cookie": 0}, {"nic": "vmnic3", "uplink_port_key": "10", "connection_cookie": 0}]}
  VitalValue = {"uuid": "60 1d c2 d6 ac 29 65 cd-a2 3d 6d e2 dc 87 8b c9", "portset_name": "DvsPortset-2"}
  CachedValue =
 DesiredValue =
     Revision = 34

    Component = esx
  ConfigGroup = network_vds
         Name = switches
  Identifier = 60 2a 54 ea ba 74 91 3da-0c 3c b0 01 ac 7e e3 aa
 ModifiedTime = 2024-05-09 17:27:39
 CreationTime = 2024-01-25 11:04:17
      Version = 1.0
      Success = 1
AutoConfValue =
   UserValue = {"uuid": "60 2a 54 ea ba 74 91 3da-0c 3c b0 01 ac 7e e3 aa", "configured_max_ports": 512, "max_ports": 9216, "product": {"forwarding_class": "vswitch"}, "uplinks": [{"nic": "vmnic0", "uplink_port_key": "2", "connection_cookie": 0}, {"nic": "vmnic5", "uplink_port_key": "3", "connection_cookie": 0}]}
  VitalValue = {"uuid": "60 2a 54 ea ba 74 91 3da-0c 3c b0 01 ac 7e e3 aa", "portset_name": "DvsPortset-0"}
  CachedValue =
 DesiredValue =
     Revision = 52

    Component = esx
  ConfigGroup = network_vds
         Name = switches
  Identifier = 60 1a 05 1b 66 a2 cc 6e-c0 ba cc 7e 82 11 d4 c2
 ModifiedTime = 2024-05-09 17:27:39
 CreationTime = 2024-01-25 11:04:19
      Version = 1.0
      Success = 1
AutoConfValue =
   UserValue = {"uuid": "60 1a 05 1b 66 a2 cc 6e-c0 ba cc 7e 82 11 d4 c2", "configured_max_ports": 512, "max_ports": 9216, "product": {"forwarding_class": "cswitch"}, "uplinks": [{"nic": "vmnic1", "uplink_port_key": "18", "connection_cookie": 0}, {"nic": "vmnic2", "uplink_port_key": "19", "connection_cookie": 0}]}
  VitalValue = {"uuid": "60 1a 05 1b 66 a2 cc 6e-c0 ba cc 7e 82 11 d4 c2", "portset_name": "DvsPortset-1"}
  CachedValue =
 DesiredValue =
     Revision = 39

 

3. Run the command: net-dvs

Output:

switch 60 2a 54 ea ba 74 91 3da-0c 3c b0 01 ac 7e e3 aa (vswitch)
switch 60 1a 05 1b 66 a2 cc 6e-c0 ba cc 7e 82 11 d4 c2 (cswitch)
switch 60 1d c2 d6 ac 29 65 cd-a2 3d 6d e2 dc 87 8b c9 (cswitch)

 

4. Identify the extra switch in the configstore and remove it. 

configstorecli config current -h
usage: configstorecli config current [options] {cmd} [cmd options]

Options:
  -h, --help show this help message and exit

Available Commands:
  {get,export,set,delete,update}
    get Get Configuration for a specific object identified by component, group, key and/or instanceid. The result of a successful get will be a valid JSON.
    export Get all configurations under a given level
    set Set Configuration for a specific object identified by component, group, key and/or instanceid.
    delete Delete Configuration for a specific object identified by component, group, key and/or instanceid.

Run command: configstorecli config current delete -c esx -g network_vds -k switches -i "60 15 5c 2a 3b 0e 01 66-a7 1e 45 11 a1 dc 87 30"

After deleting the extra switch, on the host ssh, type net-dvs cmd, this will show the switches on the host, please make sure the switches from "net-dvs" and "configstorecli get" are matching. 

 

5. Proceed with the upgrade.