VCF Operations for Networks Login page loads but can't login and multiple services down
search cancel

VCF Operations for Networks Login page loads but can't login and multiple services down

book

Article ID: 411963

calendar_today

Updated On:

Products

VCF Operations for Networks

Issue/Introduction

  • Unable to login as VCF Operations for Networks Login page loads but can't login and multiple services down.
  • Multiple platform appliance Services are down
(cli) show-service-status
ElasticSearch is running
HRegionServer is running
Kafka is running
NodeManager is running
SaasListener is running
Restapilayer is running
TSDB is running
DataNode is running
Problem: Launcher javaservice is not running.
VIPService is running
DatabusGateway is running
Problem: FlinkContainer javaservice is not running.
HMaster is running
QuorumPeerMain is running
JournalNode is running
NameNode is running
DFSZKFailoverController is running
ResourceManager is running
Federation is running
Nginx is running
ExpressJSApp is running
NTPSEC is running and healthy.
FoundationDB is running
  • Appliance Service are not starting via restart or manual attempt.
  • Under log files  at location /var/log/arkin/launcher you may see entries similar to this:
2025-08-04T14:06:03.485Z ERROR fdb.common.CfgStoreStats fdb-config-store-exec-20 txFailure:231 tx_failure: txType=KvGetWithVersion attempt=46
java.util.concurrent.CompletionException: com.apple.foundationdb.FDBException: Operation aborted because the transaction timed out
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331) _[_:_]
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346) _[_:_]
        at java.util.concurrent.CompletableFuture_UniApply.tryFire(CompletableFuture.java:632) _[_:_]
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) _[_:_]
        at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) _[_:_]
        at com.apple.foundationdb.NativeFuture.marshalWhenDone(NativeFuture.java:76) _[launcher-0.001-SNAPSHOT.jar:_]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [_:_]
        at java.util.concurrent.ThreadPoolExecutor_Worker.run(ThreadPoolExecutor.java:628) [_:_]
        at java.lang.Thread.run(Thread.java:829) [_:_]
Caused by: com.apple.foundationdb.FDBException: Operation aborted because the transaction timed out
        at com.apple.foundationdb.NativeFuture.Future_getError(Native Method) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.FutureVoid.getIfDone_internal(FutureVoid.java:35) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.FutureVoid.getIfDone_internal(FutureVoid.java:25) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.NativeFuture.marshalWhenDone(NativeFuture.java:63) _[launcher-0.001-SNAPSHOT.jar:_]
        ... 3 more
2025-08-04T14:06:03.485Z ERROR servicemgmt.launcher.SystemInfoControl systemInfoExecutorService-0 getUpgradeToggleState:974 Exception in getting upgrade toggle state
java.util.concurrent.ExecutionException: com.apple.foundationdb.FDBException: Operation aborted because the transaction timed out
        at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) _[_:_]
        at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999) _[_:_]
        at net.javacrumbs.futureconverter.common.internal.FutureWrapper.get(FutureWrapper.java:53) _[launcher-0.001-SNAPSHOT.jar:_]
        at net.javacrumbs.futureconverter.common.internal.FutureWrapper.get(FutureWrapper.java:53) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.vnera.servicemgmt.launcher.SystemInfoControl.getUpgradeToggleState(SystemInfoControl.java:965) [launcher-0.001-SNAPSHOT.jar:_]
        at com.vnera.servicemgmt.launcher.SystemInfoControl.testUpgradeServerReachability(SystemInfoControl.java:997) [launcher-0.001-SNAPSHOT.jar:_]
        at com.vnera.servicemgmt.launcher.SystemInfoControl.run(SystemInfoControl.java:334) [launcher-0.001-SNAPSHOT.jar:_]
        at java.util.concurrent.Executors_RunnableAdapter.call(Executors.java:515) [_:_]
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) [_:_]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [_:_]
        at java.util.concurrent.ThreadPoolExecutor_Worker.run(ThreadPoolExecutor.java:628) [_:_]
        at java.lang.Thread.run(Thread.java:829) [_:_]
Caused by: com.apple.foundationdb.FDBException: Operation aborted because the transaction timed out
        at com.apple.foundationdb.NativeFuture.Future_getError(Native Method) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.FutureVoid.getIfDone_internal(FutureVoid.java:35) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.FutureVoid.getIfDone_internal(FutureVoid.java:25) _[launcher-0.001-SNAPSHOT.jar:_]
        at com.apple.foundationdb.NativeFuture.marshalWhenDone(NativeFuture.java:63) _[launcher-0.001-SNAPSHOT.jar:_]
        ... 3 more



  • Product Data retention is set to 3 months.

Environment

VCF Operations for Networks 6.13.0
VCF Operations for Networks  6.14.0
VCF Operations for Networks 6.14.1

Cause

  • The FDB was in "Healthy (Rebalancing)" state and the Flinkcontainer and Restapi layer services were stopped as FDB had alot of data to process and was behind.
  • UI is not accessible due to large amount of data in Foundation DB data store.

Resolution

We do not support a 3 month retention period for Flows and this change needs to be reverted.

If you have encountered this issue, ensure you DO NOT perform any manual shutdown or reboot procedure of Platform Node(s).
Open a support case with Broadcom Support to review your Aria Operations for Networks deployment. For more information, see Creating and managing Broadcom support cases. 

Powered by Wolken Software