PowerCLI commands hang every few hours and the vCenter has to be rebooted.

Products

• VMware vCenter Server

Issue/Introduction

Symptoms:

The infraprofile service logs (/var/log/vmware/infraprofile/infraprofile-svcs.log) reports OutOfMemory error, the stack trace would look something like below:

java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_321]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_321]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_321]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_321]
at com.vmware.appliance.infraprofile.util.ReflectionUtil.invokeMethod(ReflectionUtil.java:124) ~[infraprofile-api-1.0.jar:?]
at com.vmware.appliance.infraprofile.core.VcConfigProvider.lambda$getCurrentConfig$1(VcConfigProvider.java:164) ~[infraprofile-core-1.0.jar:?]
at java.util.ArrayList.forEach(ArrayList.java:1259) [?:1.8.0_321]
at com.vmware.appliance.infraprofile.core.VcConfigProvider.getCurrentConfig(VcConfigProvider.java:152) [infraprofile-core-1.0.jar:?]
at com.vmware.appliance.infraprofile.vapi.impl.CurrentConfigProviderImpl.get(CurrentConfigProviderImpl.java:53) [infraprofile-api-1.0.jar:?]
at com.vmware.appliance.vcenter.settings.v1.ConfigCurrentApiInterface$GetApiMethod.doInvoke(ConfigCurrentApiInterface.java:38) [vmodl2-schema-processor-1.0.jar:?]
(...)
Caused by: java.lang.OutOfMemoryError: Java heap space

 

Environment

VMware vCenter Server 7.0.3

Cause

When a client (PowerCLI) makes a call to the vAPI-endpoint's introspection service, the vAPI-endpoint on its turn makes calls to the introspection service of all the vAPI providers behind, including the "infraprofile" vAPI provider. If infraprofile fails to respond on time, it can stall the PowerCLI cmdlet being executed.

Resolution

Currently there is no resolution to the issue.

Workaround:

To alleviate the OutOfMemory error in infraprofile service, please follow the steps mentioned in Manually increasing the heap memory on vCenter Server components in vCenter 6.x / 7.x  for vmware-infraprofile service.