Private AI Services (PAIS) agents fail to initiate conversations when Knowledge Base (KB) tools are configured

Products

• VCF Private AI Services

Issue/Introduction

- The agent interface displays a failure message during conversation attempts with KB tools enabled:
 "Parsing inference server response failed"

- Disabling the KB tool allows the agent to communicate, confirming the issue resides within the tool integration.

 

Environment

VMware Private AI Service 2.1

Resolution

1. Log into the PAIF environment CLI and activate the default static tools to pre-load Model Context Protocol (MCP) tool results refer to below doc:

https://techdocs.broadcom.com/us/en/vmware-cis/private-ai/foundation-with-nvidia/9-0/private-ai-foundation-9-x/what-is-private-ai-services/pre-loading-mcp-tool-results-in-agent-context.html

Please replace step 2 with below command:

curl -k --request POST 'https://<pais fqdn>/api/v1/compatibility/openai/v1/assistants/<tool id>' \
--header 'Accept: application/json' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer <REDACTED_SECRETS>' \
--data '{
  "metadata": {
    "x-pais-force-static-tool-execution": "true"
  }
}'

2. Retry the chat with agent .