restmon probe node performance not working for all nodes.

book

Article ID: 189862

calendar_today

Updated On:

Products

NIMSOFT PROBES DX Infrastructure Management

Issue/Introduction

Noticed for cluster performance both profiles seems to be working but for node performance working for us1dsecs001 but failed for <HOSTNAME>. Attached is the restmon log, can you please review what go wrong?




we are getting read time outs.
2020-04-24 02:47:57 ERROR RestAPICall - Failed to collect data from nodes for <hostname>~~2876~~ecs
2020-04-24 02:47:57 ERROR RestAPICall - java.net.SocketTimeoutException: Read timed out

2020-04-24 02:47:58 DEBUG RestAPICall - Finish RestAPICall https://<hostname>:4443/dashboard/zones/localzone status: 400 time: 30,279 milliseconds
2020-04-24 02:48:08 ERROR RestAPICall - Failed to collect data from nodes for <hostname>~~1844~~ecs
2020-04-24 02:48:08 ERROR RestAPICall - java.net.SocketTimeoutException: Read timed out

we can see the following for the US system
020-04-24 02:37:57 INFO  DataCollector - us1dsecs001~~2876~~ecs data rowcount: 5
2020-04-24 02:37:57 INFO  DataCollector - CollectAllDataAndInsertIntoDB for us1dsecs001~~2876~~ecs finished in 30285 milliseconds
2020-04-24 02:37:57 INFO  ProfileHandler - Load metric data for processing us1dsecs001~~2876~~ecs
2020-04-24 02:37:57 INFO  ProfileHandler - Loaded metric data for processing us1dsecs001~~2876~~ecs time: 277 milliseconds
2020-04-24 02:37:57 INFO  ProfileHandler - Start process metric data us1dsecs001~~2876~~ecs
2020-04-24 02:37:57 DEBUG ParserUtil - us1dsecs001~~2876~~ecs parsing for metric path values of $['totalProvisioned_gb']


2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_CPU_USAGE_PCT():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_MEMORY_USAGE():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_READ_LATENCY():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_RELATIVE_NIC_PCT():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_READ_BANDWIDTH():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_RELATIVE_MEMORY_PCT():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_WRITE_TRANSACTIONS():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_WRITE_LATENCY():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_READ_TRANSACTIONS():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 DEBUG ProfileHandler - Skipping parse for QOS_ECS_N_WRITE_BANDWIDTH():Node Performance because REST call to get data failed.
2020-04-24 02:37:57 INFO  ProfileHandler - Status: process metric data  for us1dsecs001~~2876~~ecs time: 82 milliseconds

Cause

the restmon probe profile was timing out collecting information.

Environment

UIM 8.x, 9.x. 20.x
restmon probe

Resolution

increasing the http timeout from 30000 to 60000 or 90000

profilename = <ProfileName>
type = https
username = <username>
active = yes
port = 4443
authentication = basic
hostname = <hostname>
httptimeout = 30000 (default value)

Attachments