SoS operations may exit due to SDDC manager ssh connection reset after 15 minutes.

Products

• VMware Cloud Foundation

Issue/Introduction

User may observe SDDC Manager ssh connection reset after 15 minutes due to which SoS operation invoked from SDDC Manager command line such as log-collection, health-check, fix-it-up may exit prematurely.
As per STIG, SDDC Manager ClientAliveInterval should be set to 900.

Environment

VMware Cloud foundation 5.x
VMware Cloud Foundation 4.4.0
Vmware Cloud Foundation 5.0.0.1

Resolution

If user observes, SDDC Manager ssh connection reset issue during SoS operations, users need to increase 'ClientAliveInterval' value to keep SSH session alive.

Below are the steps:

1. Login to SDDC manager with VCF user and change to root.
2. Take a backup of /etc/ssh/sshd_config file.
3. Open /etc/ssh/sshd_config in edit mode.
4. Update 'ClientAliveInterval' to 7200(2 hrs)

 

Earlier: ClientAliveInterval 900

After change, it should look like : ClientAliveInterval 7200
 

5. Save and close the /etc/ssh/sshd_config

6. Restart SSHD service

Command: #systemctl restart sshd

7. Check SSHD service status and make sure status is Active running.

Command: #systemctl status sshd

Output:
● sshd.service - OpenSSH Daemon
     Loaded: loaded (/usr/lib/systemd/system/sshd.service; enabled; vendor preset: enabled)
    Drop-In: /etc/systemd/system/sshd.service.d
             └─override.conf
     Active: active (running) since Thu 2023-08-17 09:56:34 UTC; 4s ago
   Main PID: 567783 (sshd)
      Tasks: 33 (limit: 19149)
     Memory: 3.0G
     CGroup: /system.slice/sshd.service
             ├─ 2346 sshd: vcf [priv]
             ├─ 2352 sshd: vcf
             ├─527353 sshd: vcf [priv]
             ├─527367 sshd: vcf@pts/0
             ├─527368 -bash
             ├─561386 su
             ├─561429 bash
             ├─562146 /bin/bash ./sos --nsx-logs --log-password
             ├─562149 python ./sos.pyc --nsx-logs --log-password
             ├─564884 sshd: vcf [priv]
             ├─564893 sshd: vcf@pts/1
             ├─564894 -bash
             ├─564957 su
             ├─564961 bash
             ├─567783 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
             └─567825 systemctl status sshd

8. Rerun SoS log collection.