NSX showing not ready, NSX inventory Sync Agent is not running SSP UI - PACE_UFOSTORE_SUBSCRIBE not started
search cancel

NSX showing not ready, NSX inventory Sync Agent is not running SSP UI - PACE_UFOSTORE_SUBSCRIBE not started

book

Article ID: 402380

calendar_today

Updated On:

Products

VMware vDefend Firewall with Advanced Threat Prevention VMware vDefend Firewall

Issue/Introduction

  • You will see Infrastructure Sync agent status Down on SSP UI System > NSX Managers > View Details (under Connectivity Agent) and Readiness status Not Ready.
  • You may see SSP in stable state without any alarms on SSP UI.
  • site status will be NotReady.

    Ssh to SSP Installer as root

    k get sites -n nsxi-platform
    NAME                                   STATUS
    eac315f9-c475-4d0a-8e60-8d78b3acbeb4   NotReady

  • Describing site will show error similar to this.

    k describe site eac315f9-c475-4d0a-8e60-8d78b3acbeb4 -n nsxi-platform 

    -----output truncated-----

    Status:
      Conditions:
        Last Transition Time:  2025-06-26T15:06:15Z
        Message:
        Reason:                ConnectionEstablished
        Status:                True
        Type:                  ConnectionEstablished
        Last Transition Time:  2025-04-14T20:40:58Z
        Message:
        Reason:                RequiredForInterop
        Status:                True
        Type:                  SiteConditionConfiguredPlatformDeploymentConfig
        Last Transition Time:  2025-04-14T20:40:58Z
        Message:
        Reason:                Created
        Status:                True
        Type:                  CreatedNsxSspApplianceInfo
        Last Transition Time:  2025-04-14T20:41:07Z
        Message:
        Reason:                NsxConfigTOIUpdated
        Status:                True
        Type:                  NsxStreamingReady
        Last Transition Time:  2025-04-14T20:41:18Z
        Message:
        Reason:                Ready
        Status:                True
        Type:                  CommonAgentReady
        Last Transition Time:  2025-06-26T15:15:25Z
        Message:               PACE_UFOSTORE_SUBSCRIBE not started
        Reason:                UnknownError
        Status:                False
        Type:                  PaceAgentReady
        Last Transition Time:  2025-04-14T20:48:50Z

  • Site service pod logs will show error similar to this.

    k get pods -n nsxi-platform | grep site-service
    site-service-87dff7c66-44jhw                                     1/1     Running     0                72d

    k logs site-service-87dff7c66-44jhw -n nsxi-platform

    2025-06-26T15:16:23.384Z        INFO    patch   {"request": {"name":"eac315f9-c475-4d0a-8e60-8d78b3acbeb4","namespace":"nsxi-platform"}, "reconcileID": "a2256c1d-b4e9-4c3e-a690-603ac17d87f2", "changed": true, "new
    Site": {"currentState":"NotReady","message":"OnboardingInProgress","nsxInfo":{"serviceNameRef":"nsx-eac315f9-c475-4d0a-8e60-8d78b3acbeb4","version":"4.2.2.1.0.24765087","clusterStatus":"Stable","nsxClusterID":"272
    fe4b3-8277-4257-8e8d-c112181e6bb5"},"conditions":[{"type":"ConnectionEstablished","status":"True","lastTransitionTime":"2025-06-26T15:06:15Z","reason":"ConnectionEstablished","message":""},{"type":"SiteConditionCo
    nfiguredPlatformDeploymentConfig","status":"True","lastTransitionTime":"2025-04-14T20:40:58Z","reason":"RequiredForInterop","message":""},{"type":"CreatedNsxSspApplianceInfo","status":"True","lastTransitionTime":"
    2025-04-14T20:40:58Z","reason":"Created","message":""},{"type":"NsxStreamingReady","status":"True","lastTransitionTime":"2025-04-14T20:41:07Z","reason":"NsxConfigTOIUpdated","message":""},{"type":"CommonAgentReady
    ","status":"True","lastTransitionTime":"2025-04-14T20:41:18Z","reason":"Ready","message":""},{"type":"PaceAgentReady","status":"False","lastTransitionTime":"2025-06-26T15:15:25Z","reason":"UnknownError","message":
    "PACE_UFOSTORE_SUBSCRIBE not started"},{"type":"IdsEnabled","status":"True","lastTransitionTime":"2025-04-14T20:48:50Z","reason":"IdsIsEnabled","message":""}]}, "oldSite": {"currentState":"NotReady","message":"Onb
    oardingInProgress","nsxInfo":{"serviceNameRef":"nsx-eac315f9-c475-4d0a-8e60-8d78b3acbeb4","version":"4.2.2.1.0.24765087","clusterStatus":"Degraded","nsxClusterID":"272fe4b3-8277-4257-8e8d-c112181e6bb5"},"condition
    s":[{"type":"ConnectionEstablished","status":"True","lastTransitionTime":"2025-06-26T15:06:15Z","reason":"ConnectionEstablished","message":""},{"type":"SiteConditionConfiguredPlatformDeploymentConfig","status":"Tr
    ue","lastTransitionTime":"2025-04-14T20:40:58Z","reason":"RequiredForInterop","message":""},{"type":"CreatedNsxSspApplianceInfo","status":"True","lastTransitionTime":"2025-04-14T20:40:58Z","reason":"Created","mess
    age":""},{"type":"NsxStreamingReady","status":"True","lastTransitionTime":"2025-04-14T20:41:07Z","reason":"NsxConfigTOIUpdated","message":""},{"type":"CommonAgentReady","status":"True","lastTransitionTime":"2025-0
    4-14T20:41:18Z","reason":"Ready","message":""},{"type":"PaceAgentReady","status":"False","lastTransitionTime":"2025-06-26T15:15:25Z","reason":"UnknownError","message":"PACE_UFOSTORE_SUBSCRIBE not started"},{"type"
    :"IdsEnabled","status":"True","lastTransitionTime":"2025-04-14T20:48:50Z","reason":"IdsIsEnabled","message":""}]}}

Environment

SSP 5.0.0

Cause

This can happen if corfu connection was not successful due to an infra issue(network) issue.

Resolution

Validating Connectivity Between NSX Manager and SSP

    1. Login to the SSP Installer VM Use SSH to access the SSP Installer VM.

    2. Check Port Connectivity Run the following commands to verify that required ports are open:

      Run the following commands to verify that required ports are open:
      nc -vz <ssp-ingress-fqdn> 443
      nc -vz <ssp-messaging-fqdn> 9092
      Expected Output: 
      Connection to <ssp-ingress-fqdn> (<ip-address>) 443 port [tcp/https] succeeded!
      Connection to <ssp-messaging-fqdn> (<ip-address>) 9092 port [tcp/*] succeeded!.

Restarting the Site Service Pod

    1. SSH into the SSP Installer VM

    2. Identify the Site Service Pod

      k get pods -n nsxi-platform | grep site-service

      Example output:

      site-service-87dff7c66-44jhw   1/1   Running   0   72d

    3. Delete the Site Service Pod This will trigger a restart of the pod:

      k delete pod site-service-87dff7c66-44jhw -n nsxi-platform

Verifying Infrastructure Sync Agent Status

  • Navigate to the SSP UI

  • Go to: System > NSX Managers > View Details (under Connectivity Agent)

Ensure the following:
  • Infrastructure Sync Agent Status: UP
  • Readiness Status: Ready

Additional Information

If the resolution mentioned in this KB does not address your issue, refer to the Master KB for NSX Onboarding Issues, which lists all known onboarding scenarios, causes, and troubleshooting methods.
Powered by Wolken Software