Api keys disappeared from OTK database

Products

• CA API Developer Portal

Issue/Introduction

Portal  API Keys being random deleted at midnight:

Since 12 noon tonight it was no longer possible to make calls on our API gateways because the API keys were rejected. A query on the portal_apikey table showed it was empty.

Our suspicion is that the scheduled task 'Portal Bulk Sync Application' is the cause of this. After running this task manually, traffic started again.

Environment

Release : 4.3.1

Component : API PORTAL

Resolution

The task runs on one node off a cluster, if you have two separate node's not clustered using the same OTK database make sure this task  'Portal Bulk Sync Application'   only runs on one node .
If that is not possible make sure they do not run at the exact same time on both nodes.

Additional Information

see also
https://techdocs.broadcom.com/content/broadcom/techdocs/us/en/ca-enterprise-software/layer7-api-management/api-developer-portal/4-4/set-up-and-maintenance/integrate-on-premise-api-proxies.html