"Error: pull model manifest: file does not exist" when deploying Tanzu GenAI

Products

• VMware Tanzu Application Service

Issue/Introduction

When deploying GenAI Tile, you may see it fails when running the deploy-workers errand. E.g

.
.
.
          Task 718151 | 09:32:59 | L executing post-start: ########-####-####-####-########/########-####-####-####-######## (0) (canary) (00:00:20)  
                                 L Error: Action Failed get_task: Task ########-####-####-############ result: 1 of 2 post-start scripts failed. Failed Jobs: ollama-worker. Successful Jobs: bosh-dns.  
          Task 718151 | 09:33:00 | Error: Action Failed get_task: Task ########-####-####-############ result: 1 of 2 post-start scripts failed. Failed Jobs: ollama-worker. Successful Jobs: bosh-dns.  
            
            
Stderr     Updating deployment:  
            Expected task '718151' to succeed but state is 'error'  
          Exit code 1  
          Error: failed to run job-process: exit status 1 (exit status 1)  
    

 

When checking post-start.stderr.log file in the ollama-woker folder, you may see the line: "Error: pull model manifest: file does not exist"

Cause

This happens when the model name is not correctly spelled. E.g nomic-embed-text-v1.5 instead of nomic-embed-text:v1.5 (notice the change from '-' to ':')

Resolution

Fixing the model name should fix the issue.