Error: "vmconfig status is Normal, nodeconfig status is Failed.nodeconfig failed"

Products

• VMware Telco Cloud Automation

Issue/Introduction

• Deploying the Network Function with Late Binding finishes successfully.
• Node policy, not updating the configuration for the worker. 
• Node pool stuck in provisioning state

error: >
    vmconfig status is Normal, nodeconfig status is Failed.nodeconfig failed:
    [{Plugin tuned is in Waiting stage, reason: Tuned package has not been
    installed yet, lastError: }{Plugin kernelType is in Waiting stage, reason:
    waiting for status of plugin packages become Normal, lastError: }{Plugin
    fileInjection is in Waiting stage, reason: Package tuned with version
    2.13.0-3.ph3 has not been installed on node, lastError: }{Plugin postCheck
    is in Waiting stage, reason: waiting for other plugins to be ready, plugin
    tuned status is Waiting, lastError: }{Plugin packages is in Failed stage,
    reason: , lastError: signal: killed}]
  stage: Configuring

Environment

2.3

Cause

The nodeocnfig-operator is failing due to a memory constraint.

Patch nodeconfig-operator addon successfully
Unpause pkgi/nodeconfig-operator successfully
Will check nodeconfig addon status after patch
Pkgi reconcile succeeded
All nodeconfig pods are running
Enlarge nodeconfig daemon memory successfully

Resolution

Manually update the nodeconfig-operator daemon memory limit.

• Customers can update the nodeconfig-operator daemon's memory limits manually on the K8s Cluster
• The memory limits for the nodeconfig-operator need to be bumped up to 2G.

Enlarge the memory limit to 2G for nodeconfig-daemon pod on each work node.

1. SSH into the control plane of workload cluster as the capv user.
   

2. Enlarge memory limit for the nodeconfig-daemon pod by running the following command:
   
   curl -kfsSL 'https://vmwaresaas.jfrog.io/artifactory/cnf-generic-local/kb/20240911/enlarge_nc_ds_memory_limit.sh' | bash

3. The script output will print the information to indicate if the nodeconfig-daemon pod has refreshed.