VASA Providers not listed in the vCenter: Error "(sms.fault.ServiceNotInitialized)"

Products

• VMware vSAN

Issue/Introduction

Storage providers in vCenter may fail to list and report an error in the WebClient "ServiceNotInitialized'

When we look at the sps.log file, we may see the below entries:

2018-04-06T07:20:35.278Z [pool-20-thread-1] DEBUG opId=sps-PSVDCleanup-999147-409 com.vmware.vim.sms.policy.PolicyManagerImpl - Waiting for 1000 millisecs till all the providers are loaded...
2018-04-06T07:20:35.450Z [pool-24-thread-2] DEBUG opId=dam-auto-generated: StorageProvidersViewMediator:dr-2365:SmsPropertyProvider:200073:105321-598590-ngc:70017925 com.vmware.vim.storage.common.security.CommonActivationValidator - Validating session using session cookie...
2018-04-06T07:20:35.480Z [pool-22-thread-2] DEBUG opId=dam-auto-generated: StorageProvidersViewMediator:dr-2365:SmsPropertyProvider:200073:105321-598590-ngc:70017925 com.vmware.vim.sms.StorageManagerImpl - [queryArray] Received API Call: queryArray
2018-04-06T07:20:35.481Z [pool-22-thread-2] DEBUG opId=dam-auto-generated: StorageProvidersViewMediator:dr-2365:SmsPropertyProvider:200073:105321-598590-ngc:70017925 com.vmware.vim.sms.StorageManagerImpl - ProviderLoader initialization is ongoing.
2018-04-06T07:20:35.481Z [pool-22-thread-2] ERROR opId=dam-auto-generated: StorageProvidersViewMediator:dr-2365:SmsPropertyProvider:200073:105321-598590-ngc:70017925 com.vmware.vim.sms.StorageManagerImpl - [queryArray] Operation queryArray failed
(sms.fault.ServiceNotInitialized) {
   faultCause = null,
   faultMessage = null

Also, you will see an event for setContext for iofiltervpd provider, but it will not complete.

2018-04-06T07:19:00.006Z [Thread-9] DEBUG opId=sps-Main-999074-744 com.vmware.vim.storage.common.util.SimpleTimeCounter - TIMER
STARTED: VasaClientImpl : setContext for provider: https://hostname.com:9080/version.xml

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware vSAN 6.x

Resolution

This is observed when we have iofiltervpd in OFFLINE status. We will have to remove the iofiltervpds that are offline and resync the providers.
Unable to remove the storage provider or is greyed out in vCenter

If we are not able to find the iofiltervpd list in the webclient, we will have to find them in the sps.log and use the mob page to remove the entries.
VASA Provider Registration Troubleshooting