Full sync between NSX global manager and local manager is failing
search cancel

Full sync between NSX global manager and local manager is failing

book

Article ID: 388014

calendar_today

Updated On:

Products

VMware NSX VMware vDefend Firewall

Issue/Introduction

  • The NSX Upgrade pre-check fails as the full sync between Global Manager (GM) and Local Manager (LM) is failing
  • When you login to the GM, browse to System > Location Manager > Locations you see the warning "Full sync is in progress on <Site Name>":

  • In the /var/log/proton/nsxapi.log of the LM you notice the below warning log followed by the stack trace:

WARN GM2LM-FULL-SYNC-RCVR-0 ConsumerService 15087 POLICY [nsx@6876 comp="nsx-manager" level="WARNING" subcomp="manager"] Error occurred during full sync java.lang.RuntimeException: com.vmware.nsx.management.policy.policyframework.exceptions.InvalidPolicyPathException: The path=[/global-infra/sites/<Site Name>/settings/firewall/security] is invalid

at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_322]
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_322]
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606) ~[?:1.8.0_322]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_322]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_322]
        at java.lang.Thread.run(Thread.java:750) [?:1.8.0_322]
Caused by: java.lang.RuntimeException: com.vmware.nsx.management.policy.policyframework.exceptions.InvalidPolicyPathException: The path=[/global-infra/sites/<Site-Name>/settings/firewall/security] is invalid
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl.sync_aroundBody0(FullSyncTaskImpl.java:114) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl$AjcClosure1.run(FullSyncTaskImpl.java:1) ~[?:?]
        at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.processWithTimer(TimedAspect.java:119) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.ajc$inlineAccessMethod$io_micrometer_core_aop_TimedAspect$io_micrometer_core_aop_TimedAspect$processWithTimer(TimedAspect.java:1) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.timedMethod(TimedAspect.java:97) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl.sync(FullSyncTaskImpl.java:53) ~[?:?]
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_322]
        ... 3 more
Caused by: com.vmware.nsx.management.policy.policyframework.exceptions.InvalidPolicyPathException
        at com.vmware.nsx.management.policy.policyframework.service.PolicyPathUtil.getPolicyPath(PolicyPathUtil.java:361) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.AbstractFsmState.handleFullStateMessage(AbstractFsmState.java:320) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.AbstractFsmState.processQueue(AbstractFsmState.java:165) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FsmDeleteStaleEntitiesState.deleteStaleEntities(FsmDeleteStaleEntitiesState.java:74) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FsmDeleteStaleEntitiesState.complete_aroundBody0(FsmDeleteStaleEntitiesState.java:64) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FsmDeleteStaleEntitiesState$AjcClosure1.run(FsmDeleteStaleEntitiesState.java:1) ~[?:?]
        at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.processWithTimer(TimedAspect.java:119) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.ajc$inlineAccessMethod$io_micrometer_core_aop_TimedAspect$io_micrometer_core_aop_TimedAspect$processWithTimer(TimedAspect.java:1) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.timedMethod(TimedAspect.java:97) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FsmDeleteStaleEntitiesState.complete(FsmDeleteStaleEntitiesState.java:63) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl.sync_aroundBody0(FullSyncTaskImpl.java:90) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl$AjcClosure1.run(FullSyncTaskImpl.java:1) ~[?:?]
        at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.processWithTimer(TimedAspect.java:119) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.ajc$inlineAccessMethod$io_micrometer_core_aop_TimedAspect$io_micrometer_core_aop_TimedAspect$processWithTimer(TimedAspect.java:1) ~[?:?]
        at io.micrometer.core.aop.TimedAspect.timedMethod(TimedAspect.java:97) ~[?:?]
        at com.vmware.nsx.management.policy.federation.fullsync.receiver.FullSyncTaskImpl.sync(FullSyncTaskImpl.java:53) ~[?:?]
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604) ~[?:1.8.0_322]

Environment

VMware NSX Federation Setup:

Local Manager version 3.x

Global Manager version 4.x

Cause

The affected site has an incorrect entry in the GlobalDfwConfiguration table of NSX GM Corfu database.

Resolution

The resolution involves performing a database edit procedure. Please open a ticket with Broadcom support to implement this procedure. 

Powered by Wolken Software