Orphan router groups from ondemand service instances that no longer exists

Products

• Operations Manager

Issue/Introduction

Attempting to creat new service results in no free ports in range:

[2025-06-27 17:13:09.91 (UTC)]> cf create-service p.rabbitmq ####. ############### -c {"tls": false}

Creating service instance rmq-smoke-test-instance-######### in org system / space rmq-smoke-tests-############### #########...

Service broker error: failed to create router groups: There are no free ports in range: [#####-#####]

FAILED

 

Inspection of router groups with TCP Router API reveals service instances that do not exist in perview of BOSH or service broker.

See documentation: https://techdocs.broadcom.com/us/en/vmware-tanzu/platform/tanzu-platform-for-cloud-foundry/6-0/tpcf/troubleshooting_tcp_routing.html

You can query the routing API to list TCP routers in use:

Use the routing API to list TCP routes:

$ curl api.MY-DOMAIN/routing/v1/tcp_routes -H "Authorization: bearer TOKEN"[{"router_group_guid":"######-####-#####-##############","backend_port":60000,"backend_ip":"##.##.##.##.##","port":#####,"modification_tag":{"guid":"#######-####-####-####-###########","index":1},"ttl":120}]

Alternatively you can check router groups used by CF CLI:

$ cf router-groups

Reference CLI doc: https://cli.cloudfoundry.org/en-US/v8/router-groups.html

Resolution

For any router group that does not have a corresponding service instance, execute the following command as UAA administrator - 

cf curl -X DELETE /routing/v1/router_groups/<guid>

Afterwards verify that desired router group no longer exists - 

cf curl -X GET /routing/v1/router_groups

Typically this is not normal that orphan router groups occur for ondemand service instances. If you observe repeated occurrences then raise a case with Tanzu support for further investigation.