VMware vRealize Network Insight (vRNI) SNMP v3 Connections are failing with error same engine

Products

VMware Aria Operations for Networks VMware Aria Suite

Issue/Introduction

Symptoms:

1. Unable to enable SNMP for any device from vRNI UI, It shows following Alert/Error.
Refer to error screenshot as below from Setting>Account and Data source page:

2. In collector logs at location /var/log/arkin/collector/latest.log the following error/exception will be seen:

2023-06-14T19:18:43.211Z WARN core.common.DataProviderFactory collector-process-msg-exec-4 validateCredentials:489 Connection validation for GENERICSWITCH initiated with config: DS_SUB_TYPE
:DELLOS10
_collectorId:IDTT3OQEO0A7Q2XG17Q008ON2L
HOST:192.168.200.10
_snmp_host:192.168.200.10
USER:admin
PWD:_______
_snmp_metric_enabled:true
_snmp_version:_3
_snmp_sec_name:user
_snmp_context_name:
_snmp_auth_type:SHA
_snmp_auth_pass:_______
_snmp_priv_type:AES128
_snmp_priv_pass:_______
configPollingIntervalType:PRESET
configPollingInterval:10
nickName:m16 tor2
notes:
VALIDATE_ON_SUBMIT:true
dpId:GENERICSWITCH_DELLOS10_192.168.200.10
ENCRYPTED_CONFIG:true
2023-06-14T19:18:43.211Z INFO genericdevice.southbound.GDConnectionFactory collector-process-msg-exec-4 getGenericDeviceConnection:40 Getting connection for Generic Switch -- DELLOS10
2023-06-14T19:18:43.211Z INFO utils.configutils.DPOperationalConfigLoader collector-process-msg-exec-4 getIntValue:121 Using default value for dell.os10.wait.time.before.ssh.millis: 0 for GENERICSWITCH
2023-06-14T19:18:43.211Z INFO dataprovider.southbound.AbstractDPConnectionEntity collector-process-msg-exec-4 isCertValidationEnabled:141 FeatureManager check false
2023-06-14T19:18:43.212Z INFO dataprovider.southbound.AbstractDPSSHConnectionEntityGanymedImpl_SSHChannelWrapper collector-process-msg-exec-4 getNewConnection:295 New SSH connection is requested for: 192.168.200.10 Connection Reuse Flag: true

2023-06-14T19:18:53.983Z ERROR common.snmp.SNMPHelper collector-process-msg-exec-4 validate:232 error while testing snmp connection
java.lang.RuntimeException: got a same engine_id 80:00:02:a2:03:00:00:00:00:00:00 for two addresses. existing_address=192.168.200.5/161 , new_address=192.168.200.10/161
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.updateSNMPEngine(SNMPHelper.java:443) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.<init>(SNMPHelper.java:181) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.validate(SNMPHelper.java:229) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.DataProviderFactory.validateCredentials(DataProviderFactory.java:901) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.DataProviderFactory.validateCredentials(DataProviderFactory.java:464) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.collector.core.engine.SaasCommandProcessor.processMessage(SaasCommandProcessor.java:348) _[collector-0.001-SNAPSHOT.jar:_]
at com.vnera.collector.core.saascommunication.SaasListener.lambda_receiveMessage_0(SaasListener.java:116) _[collector-0.001-SNAPSHOT.jar:_]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [_:_]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [_:_]
at java.util.concurrent.ThreadPoolExecutor_Worker.run(ThreadPoolExecutor.java:628) [_:_]
at java.lang.Thread.run(Thread.java:829) [_:_]
2023-06-14T19:18:53.983Z ERROR core.common.DataProviderFactory collector-process-msg-exec-4 validateCredentials:908 snmp connection error for GENERICSWITCH: internal error while forming snmp poller task: got a same engine_id 80:00:02:a2:03:00:00:00:00:00:00 for two addresses. existing_address=192.168.200.5/161 , new_address=192.168.200.10/161
2023-06-14T19:18:53.983Z WARN core.common.DataProviderFactory collector-process-msg-exec-4 validateCredentials:1035 Total time for validation in millis: 10772 for: GENERICSWITCH
2023-06-14T19:18:53.983Z INFO core.engine.SaasCommandProcessor collector-process-msg-exec-4 processMessage:620 sending response for requestId: 0a5534b4-6cdf-4f35-a1b0-d31dc2ae9409, type:VALIDATE_DP_CREDENTIAL, resultCode:-9, timeTaken:10847
2023-06-14T19:18:53.983Z ERROR common.snmp.SNMPHelper collector-process-msg-exec-4 validate:232 error while testing snmp connection
java.lang.RuntimeException: got a same engine_id 80:00:02:a2:03:00:00:00:00:00:00 for two addresses. existing_address=192.168.200.5/161 , new_address=192.168.200.10/161
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.updateSNMPEngine(SNMPHelper.java:443) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.<init>(SNMPHelper.java:181) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.snmp.SNMPHelper.validate(SNMPHelper.java:229) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.DataProviderFactory.validateCredentials(DataProviderFactory.java:901) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.dataproviders.core.common.DataProviderFactory.validateCredentials(DataProviderFactory.java:464) _[dataproviders-0.001-SNAPSHOT.jar:_]
at com.vnera.collector.core.engine.SaasCommandProcessor.processMessage(SaasCommandProcessor.java:348) _[collector-0.001-SNAPSHOT.jar:_]
at com.vnera.collector.core.saascommunication.SaasListener.lambda_receiveMessage_0(SaasListener.java:116) _[collector-0.001-SNAPSHOT.jar:_]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [_:_]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [_:_]
at java.util.concurrent.ThreadPoolExecutor_Worker.run(ThreadPoolExecutor.java:628) [_:_]
at java.lang.Thread.run(Thread.java:829) [_:_]
2023-06-14T19:18:53.983Z ERROR core.common.DataProviderFactory collector-process-msg-exec-4 validateCredentials:908 snmp connection error for GENERICSWITCH: internal error while forming snmp
poller task: got a same engine_id 80:00:02:a2:03:00:00:00:00:00:00 for two addresses. existing_address=192.168.200.5/161 , new_address=192.168.200.10/161

Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.

Environment

VMware Aria Operations for Networks 6.10.0
VMware vRealize Network Insight 6.x

Cause

In SNMP v3, each device must be configured unique engine_id. Two devices can not be configured with same engine_id.

Resolution

Re-check engine_id configured or reconfigure new engine_id with help of switch vendor.

Workaround:

This issue sometimes also occurs when a device is added and removed then added again with different IP or FQDN.

In such case there is work around, restart collector.

Additional Information

Impact/Risks:

Users will be unable to add switch to VMware vRealize Network Insight (vRNI) GUI.