DevTest Performance Staging doc configurations not working as expected

Products

• Service Virtualization

Issue/Introduction

 

Running a performance test of web service call for 5 minutes with 10 instances however the script stops in 1.45 Minutes

Three Simulator Services running.

 

We are seeing the following in our coordinator logs:
2021-04-27 18:40:22,962Z (13:40) [ServerRequestResponder 21] ERROR com.itko.lisa.history.AbstractWriteSupport - **********************************************************************************************
2021-04-27 18:40:22,962Z (13:40) [ServerRequestResponder 21] ERROR com.itko.lisa.history.AbstractWriteSupport - * The maximum error count (100) was exceeded; this includes warnings.  Stopping the test!!!
2021-04-27 18:40:22,962Z (13:40) [ServerRequestResponder 21] ERROR com.itko.lisa.history.AbstractWriteSupport - * The maximum error limit is configured in the staging document's default report,
2021-04-27 18:40:22,962Z (13:40) [ServerRequestResponder 21] ERROR com.itko.lisa.history.AbstractWriteSupport - * where you can increase the limit if this volume of errors is expected behavior.
2021-04-27 18:40:22,962Z (13:40) [ServerRequestResponder 21] ERROR com.itko.lisa.history.AbstractWriteSupport - **********************************************************************************************

Seeing the following in our simulator.log filess:

2021-04-27 18:40:23,070Z (13:40) [requestDigitalSignature [Run1User1CyclePF]/3] ERROR com.itko.lisa.ws.nx.NxWSStep   - Unable to invoke request: ; nested exception is: 
 java.net.SocketException: Socket closed
AxisFault
 faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Server.userException
 faultSubcode: 
 faultString: java.net.SocketException: Socket closed
 faultActor: 
 faultNode: 
 faultDetail: 
 {http://xml.apache.org/axis/}stackTrace:java.net.SocketException: Socket closed

 {http://xml.apache.org/axis/}hostname:Server.domain.com

java.net.SocketException: Socket closed

2021-04-27 18:40:24,358Z (13:40) [requestDigitalSignature [Run1User1CyclePF]/1] ERROR com.itko.lisa.ws.nx.NxWSStep   - Unable to invoke request: ; nested exception is: 
 java.lang.IllegalStateException: Connection pool shut down
AxisFault
 faultCode: {http://schemas.xmlsoap.org/soap/envelope/}Server.userException
 faultSubcode: 
 faultString: java.lang.IllegalStateException: Connection pool shut down
 faultActor: 
 faultNode: 
 faultDetail: 
 {http://xml.apache.org/axis/}stackTrace:java.lang.IllegalStateException: Connection pool shut down

Environment

 

DevTest 10.6 and up

Component : CA Service Virtualization

Cause

 

N/A

Resolution

 

Had to change the default number of errors in the Staging doc and disable CAI (pathfinder).

Raise the max errors in the staging document value from 100 to say 99999 or bigger

Running a load test with CAI enabled. CAI will slow you down. Set lisa.pathfinder.on=false in local.properties file. Also in the staging document make sure the following is set false as well.

Need to restart all the DevTest Services.