The customer is trying to connect his client machines using Cloud-enabled Management (CEM). However, when the client machines try to switch from their internal network to the external one, the client machines fail to make the proper CEM connection.
The Agent log shows a message like this one:
Operation 'CEM: Connect' failed. Protocol: HTTPS Original host: <SMPserver>.<yourdomain>.com:443Real host: <yourgatewayserver>:443Path: / Connection id: 50.5772 Communication profile id: {xxxxxxxx-DE80-4753-966E-566F747ED5CC} Throttling: 0 0 0 Error type: DNS error Error code: No such host is known (11001) Error note: Failed to resolve host name to IP address-----------------------------------------------------------------------------------------------------Date: 5/14/2020 9:41:17 AM, Tick Count: 41363468 (11:29:23.4680000), Size: 609 BProcess: AeXNSAgent.exe (5772), Thread ID: 5168, Module: AeXNetComms.dllPriority: 1, Source: NetworkOperation
ITMS 8.x
The customer was using the internal name of his gateway rather than the external one. In this example, the Internet Gateway internal name was "<yourgatewayserver>", however, the external one was "<gatewayext>.<yourdomain>.com".
The client machine was not able to resolved the internal name from its external connection. That is why the agent log message referred to:
Error type: DNS error
Error code: No such host is known (11001)
Error note: Failed to resolve host name to IP address
If we enable verbose logging on the agent logs, you should see also some entries like these:
Entry 1:Operation 'Direct: Connect' failed. Protocol: HTTPS Host: <SMPserver>.<yourdomain>.com:443 Path: / Connection Id: 50.5772 Communication profile Id: {xxxxxxxx-DE80-4753-966E-566F747ED5CC} Throttling: 0 0 0 Error type: DNS error Error code: No such host is known (11001) Error note: Failed to resolve FQDN and short host name to IP address-----------------------------------------------------------------------------------------------------Date: 5/14/2020 9:41:14 AM, Tick Count: 41360125 (11:29:20.1250000), Size: 592 BProcess: AeXNSAgent.exe (5772), Thread ID: 5168, Module: AeXNetComms.dllPriority: 8, Source: NetworkOperationEntry 2:Unable to resolve a host name <yourgateway> to IP address, error: No such host is known (11001)-----------------------------------------------------------------------------------------------------Date: 5/14/2020 9:41:17 AM, Tick Count: 41363468 (11:29:23.4680000), Size: 331 BProcess: AeXNSAgent.exe (5772), Thread ID: 5168, Module: AeXNetComms.dllPriority: 8, Source: HttpConnection
if you use Microsoft "PSPing" tool (https://docs.microsoft.com/en-us/sysinternals/downloads/psping), you can try and see if from your client machine you can have access to your gateway.
If you run PSPing.exe from the command prompt on your client machine, you should see something like this where your gateway name is not responding with the appropriate IP references if the internal name is used:
C:\Desktop\PSTools>psping.exe <YOURINTERNALGATEWAYname>.<yourdomain>.com:443PsPing v2.01 - PsPing - ping, latency, bandwidth measurement utilityCopyright (C) 2012-2014 Mark RussinovichSysinternals - www.sysinternals.comTCP connect to 1.1.1.1:443:5 iterations (warmup 1) ping test:Connecting to 1.1.1.1:443: (warmup): from 0.0.0.0:60072:The remote computer refused the network connection.Connecting to 1.1.1.1:443:: from 0.0.0.0:60073:The remote computer refused the network connection.Connecting to 1.1.1.1:443:: from 0.0.0.0:60074:The remote computer refused the network connection.Connecting to 1.1.1.1:443:: from 0.0.0.0:60075:The remote computer refused the network connection.Connecting to 1.1.1.1:443:: from 0.0.0.0:60076:The remote computer refused the network connection.TCP connect statistics for 172.16.109.78:443: Sent = 4, Received = 0, Lost = 4 (100% loss), Minimum = 0.00ms, Maximum = 0.00ms, Average = 0.00ms
Now, if you use the proper external Internet Gateway name and it is open to external communications, you should see something like this while using PSPing:
C:\Desktop\PSTools>psping.exe <YOUREXTERNALGATEWAYname>.<yourdomain>.com:443PsPing v2.01 - PsPing - ping, latency, bandwidth measurement utilityCopyright (C) 2012-2014 Mark RussinovichSysinternals - www.sysinternals.comTCP connect to 1.1.1.1:443::5 iterations (warmup 1) connecting test:Connecting to 1.1.1.1:443: (warmup): 79.11msConnecting to 1.1.1.1:443:: 79.48msConnecting to 1.1.1.1:443:: 80.64msConnecting to 1.1.1.1:443:: 81.26msConnecting to 1.1.1.1:443:: 81.11msTCP connect statistics for 172.16.239.220:443: Sent = 4, Received = 4, Lost = 0 (0% loss), Minimum = 79.48ms, Maximum = 81.26ms, Average = 80.62ms
You can also use Powershell Command Test-NetConnection <ipaddress> -port <port> to get similar results to PSPing:
ComputerName : ServerName
RemoteAddress : 1.1.1.1
RemotePort : 443
InterfaceAlias : tap06c3eff7-b0
SourceAddress : 1.1.1.2
TcpTestSucceeded : True
More information on Test-NetConnection: https://docs.microsoft.com/en-us/powershell/module/nettcpip/test-netconnection?view=windowsserver2022-ps
For the purpose of this article, we will use the troubleshooting steps that we followed. So in that way, you can validate in which area the issue may be occurring.
We will use the following names as examples:
SMP Name: <SMPserver>.<yourdomain>.com:443Internal Gateway name: <GATEWAYserver>External Gateway name: <GATEWAYEXT>.<YOURDOMAIN>.COM
The log entry with DNS error is the last connection attempt that failed for a particular network operation.
-Check if there were previous attempts to connect to the same server, which also failed.
-Look for other Operation 'CEM Connect' failed records, there could be many of them, each going a slightly different connection path (directly or through gateway or proxy, using different local and remote IP, different FQDNs or short names, etc).
The agent tries different connection paths according to restrictions and priorities, if all of them fail, then the last error is reported as the final network operation error,