The SOS Health Check Displays a RED status for SDDC and ESXi Disk Partitions in vCloud Foundation for Service Providers

Products

• VMware Cloud Foundation

Issue/Introduction

Symptoms:
When performing the command '/opt/vmware/sddc-support/sos --health-check', the SDDC services and the ESXi disk partition check are listed with a 'RED' state, similar to the following:
 

Welcome to Supportability and Serviceability(SoS) utility!
Health Check : /var/tmp/healthcheck-2017-12-13-19-32-22-44019
Health Check log : /var/tmp/healthcheck-2017-12-13-19-32-22-44019/sos.log
SDDC Manager : sddc-manager.vcf.corp.local
Services : RED
+-----+------------------------------------+----------------------+-------+
| SL# |                Area                |        Title         | State |
+-----+------------------------------------+----------------------+-------+
|  1  | SDDC : sddc-manager.vcf.corp.local |         NTP          |  RED  |
|     |                                    |      Cassandra       |  RED  |
|     |                                    |     Nodemanager      |  RED  |
|     |                                    | Nodemanager Watchdog |  RED  |
+-----+------------------------------------+----------------------+-------+
Server Information : GREEN
+-----+----------------+------------------+------------------+-----------------------+
| SL# | Host Node Name | Host IP (Public) | Host IP (Inband) |       Host Name       |
+-----+----------------+------------------+------------------+-----------------------+
|  1  |                | 192.168.100.100  | 192.168.100.100  | esxi-1.vcf.corp.local |
|  2  |                | 192.168.100.101  | 192.168.100.101  | esxi-2.vcf.corp.local |
|  3  |                | 192.168.100.102  | 192.168.100.102  | esxi-3.vcf.corp.local |
+-----+----------------+------------------+------------------+-----------------------+
NTP : GREEN
+-----+------------------------------------+------------+-------+
| SL# |                Area                |   Title    | State |
+-----+------------------------------------+------------+-------+
|  1  |    ESXi : esxi-1.vcf.corp.local    |  ESX Time  | GREEN |
|  2  |    ESXi : esxi-2.vcf.corp.local    |  ESX Time  | GREEN |
|  3  |    ESXi : esxi-3.vcf.corp.local    |  ESX Time  | GREEN |
|  4  |  NSX : nsxManager.vcf.corp.local   | NTP Status | GREEN |
|  5  |     PSC : psc-1.vcf.corp.local     | NTP Status | GREEN |
|  6  | vCenter : vcenter-1.vcf.corp.local | NTP Status | GREEN |
+-----+------------------------------------+------------+-------+
Compute : RED
+-----+------------------------------------+----------------------------+-------+
| SL# |                Area                |           Title            | State |
+-----+------------------------------------+----------------------------+-------+
|  1  |    ESXi : esxi-1.vcf.corp.local    |     Check Disk Storage     | GREEN |
|     |                                    |     ESXi Health Status     | GREEN |
|     |                                    | Check disks for partitions |  RED  |
|  2  |    ESXi : esxi-2.vcf.corp.local    |     Check Disk Storage     | GREEN |
|     |                                    |     ESXi Health Status     | GREEN |
|     |                                    | Check disks for partitions |  RED  |
|  3  |    ESXi : esxi-3.vcf.corp.local    |     Check Disk Storage     | GREEN |
|     |                                    |     ESXi Health Status     | GREEN |
|     |                                    | Check disks for partitions |  RED  |
|  4  |     PSC : psc-1.vcf.corp.local     |    Check Health Status     | GREEN |
|  5  | vCenter : vcenter-1.vcf.corp.local |    Check Health Status     | GREEN |
+-----+------------------------------------+----------------------------+-------+
Connectivity : GREEN
+-----+------------------------------------+-------------------------+-------+
| SL# |                Area                |          Title          | State |
+-----+------------------------------------+-------------------------+-------+
|  1  |    ESXi : esxi-1.vcf.corp.local    |       Ping status       | GREEN |
|     |                                    | SSH Connectivity status | GREEN |
|     |                                    | API Connectivity status | GREEN |
|  2  |    ESXi : esxi-2.vcf.corp.local    |       Ping status       | GREEN |
|     |                                    | SSH Connectivity status | GREEN |
|     |                                    | API Connectivity status | GREEN |
|  3  |    ESXi : esxi-3.vcf.corp.local    |       Ping status       | GREEN |
|     |                                    | SSH Connectivity status | GREEN |
|     |                                    | API Connectivity status | GREEN |
|  4  |  NSX : nsxManager.vcf.corp.local   |       Ping status       | GREEN |
|     |                                    |   Connectivity status   | GREEN |
|  5  |   NSX Controller : 192.168.100.7   |       Ping status       | GREEN |
|  6  |   NSX Controller : 192.168.100.8   |       Ping status       | GREEN |
|  7  |   NSX Controller : 192.168.100.9   |       Ping status       | GREEN |
|  8  |     PSC : psc-1.vcf.corp.local     |       Ping status       | GREEN |
|     |                                    |   Connectivity status   | GREEN |
|  9  | vCenter : vcenter-1.vcf.corp.local |       Ping status       | GREEN |
|     |                                    |   Connectivity status   | GREEN |
+-----+------------------------------------+-------------------------+-------+
Certificates : GREEN
+-----+-------------------------------------------+-----------------------------+--------------------------+--------------------------+-------+
| SL# |                   Entity                  |           Cert CN           |     Cert Start Date      |      Cert End Data       | State |
+-----+-------------------------------------------+-----------------------------+--------------------------+--------------------------+-------+
|  1  |        ESXi : esxi-1.vcf.corp.local       |    esxi-1.vcf.corp.local    | Nov 27 16:49:23 2017 GMT | Nov 27 16:49:23 2022 GMT | GREEN |
|  2  |        ESXi : esxi-2.vcf.corp.local       |    esxi-2.vcf.corp.local    | Nov 27 16:49:35 2017 GMT | Nov 27 16:49:35 2022 GMT | GREEN |
|  3  |        ESXi : esxi-3.vcf.corp.local       |    esxi-3.vcf.corp.local    | Nov 27 16:49:43 2017 GMT | Nov 27 16:49:43 2022 GMT | GREEN |
|  4  |      NSX : nsxManager.vcf.corp.local      |  nsxManager.vcf.corp.local  | Nov 27 17:19:19 2017 GMT | Nov 23 16:22:38 2027 GMT | GREEN |
|  5  |         PSC : psc-1.vcf.corp.local        |     psc-1.vcf.corp.local    | Nov 28 16:22:38 2017 GMT | Nov 23 16:22:38 2027 GMT | GREEN |
|  6  | SDDCMANAGER : sddc-manager.vcf.corp.local | sddc-manager.vcf.corp.local | Nov 28 16:01:59 2017 GMT | Nov 26 16:01:59 2027 GMT | GREEN |
|  7  |       VC : vcenter-1.vcf.corp.local       |   vcenter-1.vcf.corp.local  | Nov 28 16:42:02 2017 GMT | Nov 23 16:22:38 2027 GMT | GREEN |
+-----+-------------------------------------------+-----------------------------+--------------------------+--------------------------+-------+
vSAN : YELLOW
+-----+--------------------------------------------------------------+----------------------------------------+--------+
| SL# |                             Area                             |                 Title                  | State  |
+-----+--------------------------------------------------------------+----------------------------------------+--------+
|  1  |              vCenter : vcenter-1.vcf.corp.local              | Check vSAN Hardware Compatibility List | YELLOW |
|  2  | vCenter : vcenter-1.vcf.corp.local - Cluster : vRack-Cluster |    Proactive Cluster VM Create Test    | GREEN  |
|     |                                                              |   Total no. of hosts in cluster : 3    | GREEN  |
|     |                                                              |       Cluster vSAN Health Status       | GREEN  |
+-----+--------------------------------------------------------------+----------------------------------------+--------+

Legend:

 GREEN - No attention required, health status is NORMAL
 YELLOW - May require attention, health status is WARNING
 RED - Requires immediate attention, health status is CRITICAL


Health Check completed successfully for : [CONNECTIVITY-CHECK, GET-USED-IP-DETAILS, NTP-CHECK, ALARM-CHECK, GET-SERVER-DETAILS, CERTIFICATE-CHECK]
Operation failed for : [VSAN-CHECK, COMPUTE-CHECK, SERVICES-CHECK]

Environment

VMware Cloud Foundation 2.x

Cause

The sos health check is currently performing checks that are not consistent with the configuration of vCF SP 2.4.0.

Resolution

This is a known issue at this time and is to be addressed in future revisions of the product.

Workaround:
Since the SP version of vCF does not provision ESXi hosts, checking for existing partitions is not necessary for this product and these tests can be ignored.

The following can be used to confirm the pertinent SDDC Manager services:

1. Initiate an SSH session the the SDDC manager from a machine that has network access to the appliance.
2. Log in as 'root' with the appropriate password.
3. Enter the following commands and review the output to validate the service status. The entry for 'Active' should be 'active (running)'.
   1. NTP
      
      service ntpd status
       
   2. Cassandra
      
      service cassandra status
       
   3. Nodemanager
      
      service nodemanager status