SSO Access Gateway error : "Exception occured : java.net.SocketException: Software caused connection abort

Products

• SITEMINDER

Issue/Introduction

Webagent trace logs shows the socket connection failures at SPS.

Socket Connection Errors at SPS

Below scoket connection error are because of the unresponsive IM application server (Jboss) ,  is unable to acknowledge to SPS requests and HTTP socket created at SPS is getting closed after wait time. During this process all the HTTP socket connection reaching maximum and no new HTTP socket connections available at SPS to serve the new requests.

[04/07/2021][18:00:38][6344][4300][83aac7d3-6a33bbcf-44c53e87-6086b231-9a641632][execute][Socket Closed]
[04/07/2021][18:00:38][6344][4300][83aac7d3-6a33bbcf-44c53e87-6086b231-9a641632][execute][Retrying to send the request to backend web server.Retry count: 1]
[04/07/2021][18:00:38][6344][16020][72663da6-827a03b0-012c4ddc-65829e42-5fa70999-33e][execute][]
[04/07/2021][18:00:38][6344][4300][83aac7d3-6a33bbcf-44c53e87-6086b231-9a641632][execute][Sending request to backend = 172.16.0.1:8080 url = http://example.com:8080/iam/im/abc4/index.jsp?task.tag=PasswordServices&SMENC=UTF-8&SMTOKEN=-SM-%7bRC2%7d5fc1jcMv%2bkUCcODnduwIIZiUwYF1S7cKI0Ao1lTSvv48PDxYdSlg%3d%3d&USERNAME=xxxxxxxx&SMAUTHREASON=18&SMAGENTNAME=-SM-2xxxxxxxxxxienI6mJGrgr7Pt0IhcO&TARGET=-SM-https%3a%2f%2fim%2example.com%2fca12%2findex%2ejsp%3f]
[04/07/2021][18:00:38][6344][11156][86cfe650-21bf18d5-a3e0bbc6-2dbaf13b-978fbcdd-71a][execute][]
[04/07/2021][18:00:38][6344][19660][1aa0472a-3835131b-2b819ce6-15e99520-5c62a3c2-fc][execute][]
[04/07/2021][18:00:38][6344][4784][4a623e27-2e7ccfb1-49183e07-3f0552aa-ef5e0df4-837][ErrorPageImpl::displayMessage][Custom Error Pages : Exception occured : java.net.SocketException: Software caused connection abort: socket write error]
com.ca.proxy.apache.httpclient.conn.SPSConnectionManager.requestConnection(Unknown Source)]
 com.ca.proxy.apache.httpclient.conn.SPSConnectionManager.requestConnection(Unknown Source)]
[04/07/2021][18:00:38][6344][16060][14a4537e-576e71b0-836ea3a4-d6e25204-aaa6df9e-5dd][execute][Socket Closed]

Environment

Release : 12.8.X

Component : SITEMINDER SECURE PROXY SERVER

Cause

Post Application Server Services (JBoss) Restart

Post Application server reset all the http connection sockets getting released gracefully.

.[04/07/2021][18:53:47][13668][3968][d0e3be13-dce3a5b7-81bbed53-866f6a15-3e1e146b-440][execute][Response status code from backend webserver is 200]
[04/07/2021][18:53:47][13668][3968][d0e3be13-dce3a5b7-81bbed53-866f6a15-3e1e146b-440][Noodle::doGet][Noodle.proxyRequest succeeded.  Writing out response data if available]
[04/07/2021][18:53:47][13668][3968][d0e3be13-dce3a5b7-81bbed53-866f6a15-3e1e146b-440][releaseConnection(): ][Released connection is reusable.]
[04/07/2021][18:53:47][13668][3968][d0e3be13-dce3a5b7-81bbed53-866f6a15-3e1e146b-440][Noodle::doGet][Returned streamed content length of 616]
[04/07/2021][18:53:47][13668][3968][d0e3be13-dce3a5b7-81bbed53-866f6a15-3e1e146b-440][ProxyValve::invoke][Leaving the agent.]

Cause

During the peak hours more users accessing the backend application via Access gateway has high waiting to establish new connection socket and causes in requests drop before reaching the backend application.

Resolution

Below parameters are needed to be fine tuned and configured based on the expected number of user requests. These parameters are available in server.conf file of Access Gateway.

Default values 

http_connection_pool_min_size="10"

http_connection_pool_max_size="100"

http_connection_pool_incremental_factor="4" 

http_connection_pool_timeout="2 minutes"

http_connection_pool_wait_timeout="120"

http_connection_pool_max_attemps="3"

New connections settings to fix this issue

http_connection_pool_timeout="1 minutes"

http_connection_pool_wait_timeout="30"

http_connection_pool_max_attemps="1"

 

Additional Information

.