"FATAL: terminating connection due to idle-in-transaction timeout" error when carrying out operations in Cloud Director

Products

• VMware Cloud Director

Issue/Introduction

Symptoms:

• Carrying out operations fails with the following error:

Internal Server Error - could not execute query - FATAL: terminating connection due to idle-in-transaction timeout"

• Users are unable to create routed networks,manage virtual machines due to this error
• For a failed routed network creation,the /opt/vmware/vcloud-director/logs/vcloud-container-debug.log on the Cloud Director Cells show errors of the form :

(com.vmware.vcloud.backendbase.management.system.TaskActivity,urn:uuid:d83bef55-27ac-4bcc-ba3c-77c14d8a708e)

com.vmware.vcloud.api.presentation.service.InternalServerErrorException: Internal Server Error

   at com.vmware.vcloud.networking.model.infra.NetworkInfraFactory.orgVdcFor(NetworkInfraFactory.java:155)

   at com.vmware.vcloud.networking.model.network.NsxTOrgVdcNetwork.<init>(NsxTOrgVdcNetwork.java:92)

   ... 74 more

Caused by: org.postgresql.util.PSQLException: FATAL: terminating connection due to idle-in-transaction timeout

Environment

VMware Cloud Director 10.x

Cause

The error is caused when the operation took too long to complete and the database transaction was idle. The default value which the DB transaction can be idle for is set to 5 minutes.

Resolution

To resolve the issue, increase the timeout value from the default 5 minutes in the database.

Database modifications are required and will require VMware Technical Support assistance.

Additional Information

Impact/Risks:

Any or all operations carried out can fail affecting production.

NOTE: The resolution procedure modifies the Cloud Director database. Ensure to take a backup of the database before proceeding.