How to validate if the custom model configurations are applied to AI worker VMs ?

Products

• VMware Tanzu Platform Core

Issue/Introduction

You are using custom model configuration in the AI tile . 

TEMPLATE """

####
PARAMETER top_k 10
PARAMETER top_p 1.0
PARAMETER repeat_penalty 1.5
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
PARAMETER temperature 1.5

Environment

VMware Tanzu Platform Core 

Resolution

1. Access the Worker VM: Use BOSH to SSH into the specific worker VM (vLLM or Ollama) where the model is deployed.
2. Run below commands to validate if changes are updated correctly :  

##source the ollama config
source /var/vcap/jobs/ollama-worker/config/env.rc

##list models 
$ /var/vcap/packages/ollama/bin/ollama ls
NAME             ID              SIZE     MODIFIED
qwen3:30b-a3b    ad8XXXXX   18 GB    17 days ago

#show modelfile -- (ur custom model file should be there)
$ /var/vcap/packages/ollama/bin/ollama show qwen3:30b-a3b --modelfile

Additional Information

To install Ollama , please refer below docs :

https://docs.ollama.com/linux

 

Understanding Ollama Provider

https://techdocs.broadcom.com/us/en/vmware-tanzu/platform/ai-services/10-4/ai/explanation-understand-ollama-config.html