DevTest v10.1 - Portal Crash - Using MySQL

book

Article ID: 101861

calendar_today

Updated On:

Products

CA Application Test Service Virtualization CA Continuous Application Insight (PathFinder) CA Service Virtualization (DevTest / LISA / VSE / Application Test)

Issue/Introduction

The DevTest v10.1 configuration was re-implemented with MySQL 5.7 in AWS (previously was using Aurora DB, a MySQL compatible Cloud-native DB) as a CA supported configuration. Requesting root cause analysis and resolution of the issue.

1. After running a few days Portal just crashes. 
2. Portal log showing these error messages over: 
2018-05-11 08:37:55,595Z (08:37) [[email protected]@6c9de47a{HTTP/1.1,[http/1.1]}{0.0.0.0:1507}] WARN org.eclipse.jetty.server.AbstractConnector - 
java.io.IOException: Too many open files 
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) 
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) 
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) 
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373) 
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:593) 
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) 
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) 
at java.lang.Thread.run(Thread.java:745) 

Soft and Hard limits for open files is set to 10240. Not an option to set this higher. 

If you refresh the login page in the browser and they saw additional file handles added for the login page over and over. 

Cause

The problem is a defect in the asset-pipeline library - specifically if you look at the release notes http://www.asset-pipeline.com/manual/#release-history for version 3.1.2 and 2.7.2 - More aggressive closing of open file handles in Servlet filter for more efficient use of resources. 

Environment

Release:
Component: ITKOTF

Resolution

Please open a new case and refer to Defect DE363628.

We have a fix for this issue.

Additional Information

This same fix will work for DevTest 10.2.4 and 10.3.0