Frequent VSE disconnection from Portal/Registry

Products

• Service Virtualization

Issue/Introduction

Facing VSE disconnections regularly every evening around the same time and found VSE's disconnected from the Portal/Registry which are running on separate machine.

Environment

All supported Devtest releases.

Cause

It was found that the timing of VSE disconnection was matching with the timings of the scheduled scans on VSE machines.

Checking for the source of these calls revealed that the IP belongs to the security team scanning software that triggers the scan. 

Resolution

It was noticed that the VSEs are disappearing when the hprof file is getting created on the VSEs.

The hprof files analysis shows that the SSL call to xx.xx.xx.xx is causing OutOfMemory exception on these VSEs. 

=========================================================================

Heap dumped on OutOfMemoryError exception

Thread causing OutOfMemoryError exception: ActiveMQ Transport: ssl:///xx.xx.xx.xx:1234

=========================================================================

 

To resolve the issue and avoid the impact on DevTest components, the scan schedule was standardized so that DevTest components are not running during the scan time window.