GenAI tile model name and model alias have to be unique
search cancel

GenAI tile model name and model alias have to be unique

book

Article ID: 423557

calendar_today

Updated On:

Products

VMware Tanzu Platform - Cloud Foundry

Issue/Introduction

As per the documentation Deploying your first model, both model name and model alias can be used by applications to make requests. 

(Optional) Enter a list of comma-separated aliases to assign to the model, for example, llama-3.1,llama. Model aliases allow client applications to make requests to the model using either the model’s name or any one of the configured model aliases.

Cause

When the model name and model alias is the same, the Apply Changes will fail with the error like below:

Task 5070 | 09:03:05 | Preparing deployment: Rendering templates (00:00:03)
                     L Error: Unable to render instance groups for deployment. Errors are:
  - Unable to render jobs for instance group 'controller'. Errors are:
    - Unable to render templates for job 'input-validator'. Errors are:
      - Error filling in template 'input-validator.erb' (line 776: The following configuration errors were found: 
      
      1. model llava:7b has been configured with an alias with the same name as the model
      2. plan llava:7b refers to models that have overlapping names and/or aliases (llava:7b), ensure model names and aliases are unique across all models in the plan)

Resolution

To resolve this issue ensure that model name and model alias for each of the models are unique.