Enterprise PKS Cluster creation fails with error "1 of 7 pre-start scripts failed. Failed Jobs: pks-nsx-t-prepare-master-vm"

Products

• VMware Cloud PKS

Issue/Introduction

Symptoms:

1. Enterprise PKS Cluster creation fails with error "1 of 7 pre-start scripts failed. Failed Jobs: pks-nsx-t-prepare-master-vm".
2. You see messages similar to the following in /var/vcap/sys/log/pks-nsx-t-prepare-master-vm/pre-start.stderr.log file on the master node:

Insufficient resources to allocate in edge cluster EdgeCluster/d5960b78-dd87-4a07-bb44-623efa4303c9 and pool LB_ALLOCATION_POOL for context LogicalRouter/8d24c659-da7b-48ab-9f5f-b146427f4367
 

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware PKS 1.x

Cause

1. When a T0 router is on an edge cluster with 2 Large edge nodes you should be able to create only 4 Enterprise PKS clusters of medium size load balancer using network profile. (4 Medium LB per Edge, as they are active/passive they each go on two edges).
2. If there are already 4 Enterprise PKS clusters of medium size load balancer created using the network profile on the same T0 router, the fifth cluster will fail with Insufficient resources to allocate.

Note: This limit is described in Scaling Load Balancer Resources .

Resolution

By default Enterprise PKS cluster creation will result in a small sized load balancer being created, unless a different size is specified in a network profile. Instructions for creating a medium sized load balancer via network polices can be found in Using Network Profiles (NSX-T Only) .