Version Control init shows unexpected behavior when running longer than 180 seconds.
During the init step, thousands of objects are uploaded, which takes longer than 180 minutes!
('POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories',)
After 180 seconds, a pop-up appears in AWI displaying one of 2 messages:
Can't connect to any REST endpoint, please check if at least one REST is running and is reachable via the network
[HTTP 500] (45110) An Automation Engine internal error occurred. No detail information available
According to the trace of the REST JCP a 2nd thread starts doing the same download of objects:
20240717/123333.673 - 42 U00045098 Method 'POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories', received from IP: '<IP_address>'20240717/123333.673 - 42 Request-Headers: [Accept=application/json,Accept-Encoding=gzip,deflate,Accept-Language=en,Authorization=Basic <base64_encrypted_user_password>,Connection=keep-alive,Content-Length=83,Content-Type=application/json,Host=<URL>:8088,User-Agent=Apache-HttpClient/4.5.13 (Java/11.0.23)]20240717/123333.675 - 42 Request-Payload:20240717/123333.675 - 42 {"branch_name":"<Git_branch_name>","force_delete_existing_client":false}20240717/123333.719 - 42 Login result: SUCCESS<...180 seconds..>20240717/123633.777 - 39 U00045098 Method 'POST', URL: 'https://<URL>:8088/ae/api/v1/<client>/repositories', received from IP: '<IP_address>'20240717/123633.777 - 39 Request-Headers: [Accept=application/json,Accept-Encoding=gzip,deflate,Accept-Language=en,Authorization=Basic <base64_encrypted_user_password>,Connection=keep-alive,Content-Length=83,Content-Type=application/json,Host=<URL>:8088,User-Agent=Apache-HttpClient/4.5.13 (Java/11.0.23)]20240717/123633.778 - 39 Request-Payload:20240717/123633.778 - 39 {"branch_name":"<Git_branch_name>","force_delete_existing_client":false}20240717/123633.826 - 39 Login result: SUCCESS
Starting a second REST process does not prevent the issue from happening
After the second thread started (thread 39), the initial one (thread 42) throws errors:
20240717/123709.427 - 42 U00045014 Exception 'com.automic.filesync.api.FileSyncException: "java.nio.file.NoSuchFileException: ae-filesystem/<client>/<folder>/<object>"' at 'com.automic.filesync.impl.LegacyGenericApproach.exportObjectById():204'.20240717/123709.428 - 42 U00045015 The previous error was caused by 'java.nio.file.NoSuchFileException: "ae-filesystem/<client>/<folder>/<object>"' at 'sun.nio.fs.UnixException.translateToIOException():92'.20240717/123709.429 - 42 U00003620 Routine 'RepositoryServiceImpl' forces trace because of error.<...>20240717/123709.438 - 42 ----------------------- Stack Trace -----------------------20240717/123709.439 - 42 com.automic.filesync.api.FileSyncException: java.nio.file.NoSuchFileException: ae-filesystem/<client>/<folder>/<object>20240717/123709.439 - 42 at com.automic.filesync.impl.LegacyGenericApproach.exportObjectById(LegacyGenericApproach.java:204)20240717/123709.439 - 42 at com.automic.filesync.impl.LegacyGenericApproach.exportObjectsInFolder(LegacyGenericApproach.java:316)
This is the error in the AWI log:
2024-07-17 12:36:33,771 pool-2-thread-122 [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.backends.impl.dataservice.connection.RestConnectionService] - Can't connect to REST endpoint 'https://<URL>:8088': Read timed out<...>2024-07-17 12:39:33,876 pool-2-thread-122 [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.backends.impl.dataservice.connection.RestConnectionService] - Can't connect to REST endpoint 'https://<URL>:8088': Read timed out2024-07-17 12:39:33,877 pool-2-thread-122 [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 +LOAD 766 [com.uc4.ecc.framework.core.async.BaseRequestCoordinator] - This took too long. 360.208s/360.208s [request coordinator load : com.uc4.ecc.framework.commons.dialogs.modal.ModalDialog$1@3cff5906]2024-07-17 12:39:33,877 pool-2-thread-122 [WARN ] AutomicPreprod:<client>/<USER>/<DEPARTMENT> C2094E2638B80CE2AAD635CD4FD4E8D2-5 0000000104413673 [com.uc4.ecc.framework.core.pool.ContextAwareExecutorService] - This took too long. 0.001s/360.209s [Request: null]
DE129793
Solution:
Update to a fix version listed below or a newer version if available.
Fix version:
Component(s): Automation Engine
Automation.Engine 24.4.2
IMPORTANT: Starting from this version, you set the AWI variable automationEngineTimeoutMillise in configuration.properties to a higher value, e.g 1800000 (30 minutes), such that the loading of the Automic objects by Version Control doesn't exceed the timeout and restart.
A problem has been fixed that prevented the Git integration from working with many objects