Initiating Version Control fails with thousands of objects
search cancel

Initiating Version Control fails with thousands of objects

book

Article ID: 412829

calendar_today

Updated On:

Products

CA Automic Workload Automation - Automation Engine

Issue/Introduction

Version Control init shows unexpected behavior when running longer than 180 seconds.

During the init step, thousands of objects are uploaded, which takes longer than 180 minutes!

('POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories',) 

After 180 seconds, a pop-up appears in AWI displaying one of 2 messages: 

  1. Can't connect to any REST endpoint, please check if at least one REST is running and is reachable via the network
  2. [HTTP 500] (45110) An Automation Engine internal error occurred. No detail information available

 

According to the trace of the REST JCP a 2nd thread starts doing the same download of objects:

20240717/123333.673 - 42     U00045098 Method 'POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories', received from IP: '<IP_address>'
20240717/123333.673 - 42               Request-Headers: [Accept=application/json,Accept-Encoding=gzip,deflate,Accept-Language=en,Authorization=Basic <base64_encrypted_user_password>,Connection=keep-alive,Content-Length=83,Content-Type=application/json,Host=<URL>:8088,User-Agent=Apache-HttpClient/4.5.13 (Java/11.0.23)]
20240717/123333.675 - 42               Request-Payload:
20240717/123333.675 - 42               {"branch_name":"<Git_branch_name>","force_delete_existing_client":false}
20240717/123333.719 - 42               Login result: SUCCESS
<...180 seconds..>
20240717/123633.777 - 39     U00045098 Method 'POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories', received from IP: '<IP_address>'
20240717/123633.777 - 39               Request-Headers: [Accept=application/json,Accept-Encoding=gzip,deflate,Accept-Language=en,Authorization=Basic <base64_encrypted_user_password>,Connection=keep-alive,Content-Length=83,Content-Type=application/json,Host=<URL>:8088,User-Agent=Apache-HttpClient/4.5.13 (Java/11.0.23)]
20240717/123633.778 - 39               Request-Payload:
20240717/123633.778 - 39               {"branch_name":"<Git_branch_name>","force_delete_existing_client":false}
20240717/123633.826 - 39               Login result: SUCCESS

Starting a second REST process does not prevent the issue from happening

After the second thread started (thread 39), the initial one (thread 42) throws errors:

20240717/123709.427 - 42     U00045014 Exception 'com.automic.filesync.api.FileSyncException: "java.nio.file.NoSuchFileException: ae-filesystem/<client>/<folder>/<object>"' at 'com.automic.filesync.impl.LegacyGenericApproach.exportObjectById():204'.
20240717/123709.428 - 42     U00045015 The previous error was caused by 'java.nio.file.NoSuchFileException: "ae-filesystem/<client>/<folder>/<object>"' at 'sun.nio.fs.UnixException.translateToIOException():92'.
20240717/123709.429 - 42     U00003620 Routine 'RepositoryServiceImpl' forces trace because of error.
<...>
20240717/123709.438 - 42               ----------------------- Stack Trace -----------------------
20240717/123709.439 - 42               com.automic.filesync.api.FileSyncException: java.nio.file.NoSuchFileException: ae-filesystem/<client>/<folder>/<object>
20240717/123709.439 - 42                   at com.automic.filesync.impl.LegacyGenericApproach.exportObjectById(LegacyGenericApproach.java:204)
20240717/123709.439 - 42                   at com.automic.filesync.impl.LegacyGenericApproach.exportObjectsInFolder(LegacyGenericApproach.java:316)

 

This is the error in the AWI log:


2024-07-17 12:36:33,771 pool-2-thread-122      [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.backends.impl.dataservice.connection.RestConnectionService] - Can't connect to REST endpoint 'https://<URL>:8088': Read timed out
<...>
2024-07-17 12:39:33,876 pool-2-thread-122      [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.backends.impl.dataservice.connection.RestConnectionService] - Can't connect to REST endpoint 'https://<URL>:8088': Read timed out
2024-07-17 12:39:33,877 pool-2-thread-122      [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.framework.core.async.BaseRequestCoordinator] - This took too long. 360.208s/360.208s [request coordinator load : com.uc4.ecc.framework.commons.dialogs.modal.ModalDialog$1@3cff5906]
2024-07-17 12:39:33,877 pool-2-thread-122      [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673  [com.uc4.ecc.framework.core.pool.ContextAwareExecutorService] - This took too long. 0.001s/360.209s [Request: null]

 

Cause

DE129793

Resolution

Solution:

Update to a fix version listed below or a newer version if available.

Fix version:

Component(s): Automation Engine

Automation.Engine 24.4.2

IMPORTANT: Starting from this version, you set the AWI variable automationEngineTimeoutMilliseconds in configuration.properties to a higher value, e.g 1800000 (30 minutes), such that the loading of the Automic objects by Version Control doesn't exceed the timeout and restart.

Additional Information

A problem has been fixed that prevented the Git integration from working with many objects