VMware VeloCloud SD-WAN edge snmpd process memory keep increasing until 5% of total memory and restart
Article ID: 370359
Updated On:
Products
VMware VeloCloud SD-WAN
Issue/Introduction
Customer may observe that process snmpd current memory usage keep increasing until 5% of total memory and then restart:
2024-03-21T05:39:01.027 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 130 MB (4.5%)
2024-03-21T05:54:05.419 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 131 MB (4.6%)
2024-03-21T06:09:08.043 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 131 MB (4.6%)
2024-03-21T06:24:08.482 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 131 MB (4.6%)
2024-03-21T06:39:12.041 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 132 MB (4.6%)
2024-03-21T06:54:15.083 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 132 MB (4.6%)
2024-03-21T07:09:15.261 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 133 MB (4.6%)
2024-03-21T07:24:20.151 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 133 MB (4.6%)
2024-03-21T07:39:20.536 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 133 MB (4.6%)
2024-03-21T07:54:21.038 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 134 MB (4.7%)
2024-03-21T08:09:25.313 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 134 MB (4.7%)
2024-03-21T08:24:30.056 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 134 MB (4.7%)
2024-03-21T08:39:34.067 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 135 MB (4.7%)
2024-03-21T08:54:38.515 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 135 MB (4.7%)
2024-03-21T09:09:43.326 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 135 MB (4.7%)
2024-03-21T09:24:43.599 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 136 MB (4.7%)
2024-03-21T09:39:48.129 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 136 MB (4.7%)
2024-03-21T09:54:51.389 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 137 MB (4.8%)
2024-03-21T10:09:51.812 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 137 MB (4.8%)
2024-03-21T10:24:55.888 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 137 MB (4.8%)
2024-03-21T10:39:58.673 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 138 MB (4.8%)
2024-03-21T10:55:03.553 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 138 MB (4.8%)
2024-03-21T11:10:04.163 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 138 MB (4.8%)
2024-03-21T11:25:08.931 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 139 MB (4.9%)
2024-03-21T11:40:09.751 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 139 MB (4.9%)
2024-03-21T11:55:11.392 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 139 MB (4.9%)
2024-03-21T12:10:15.648 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 140 MB (4.9%)
2024-03-21T12:25:16.660 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 140 MB (4.9%)
2024-03-21T12:40:21.096 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 141 MB (4.9%)
2024-03-21T12:55:25.194 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 141 MB (4.9%)
2024-03-21T13:10:28.662 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 141 MB (4.9%)
2024-03-21T13:25:32.260 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 142 MB (5.0%)
2024-03-21T13:40:35.767 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 142 MB (5.0%)
2024-03-21T13:55:38.852 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 142 MB (5.0%)
2024-03-21T14:10:41.051 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 143 MB (5.0%)
2024-03-21T14:25:41.354 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 143 MB (5.0%)
2024-03-21T14:40:44.883 INFO [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) current memory usage: 143 MB (5.0%)
2024-03-21T14:43:37.736 WARNING [ResourceMonitor 6353(6378)] Process snmpd (pid 14691) memory threshold of 5% exceeded, restarting service
2024-03-21T14:43:38.787 INFO [ResourceMonitor 6353(6378)] Restarted service snmpd
The frequency of the restart is dependent upon the SNMP volume. In the event that the SNMP volume is substantial, snmpd might restart every couple of hours
Environment
All supported VMware VeloCloud SD-WAN versions
Cause
It's a bug of third-party open-source component net-snmp v5.8 which is employed by all VMware by Broadcom SD-WAN versions. This bug has been fixed in net-snmp v5.9.
Resolution
Permanent workaround is to use SNMP v2c instead of SNMP v3 which prevents snmpd memory leaking. In the majority of cases, customer does not need to worry about snmpd memory leaking because edge has periodical check to make sure memory consumed on snmpd does not exceed 5% of total memory. Once it exceeds 5%, edge restarts snmpd process to release its memory. However if customer is using SNMP polling OID 1.3.6.1.2.1.1.3 from edge to fetch current system uptime, upon the restart of snmpd, the value of 1.3.6.1.2.1.1.3 resets to 0 even if edged does not restart along with snmpd.
Feedback
Yes
No
Powered by
