Unable to run any debug.py commands in the gateway
search cancel

Unable to run any debug.py commands in the gateway

book

Article ID: 369627

calendar_today

Updated On:

Products

VMware VeloCloud SD-WAN

Issue/Introduction

Customer will not be able to run debug.py commands in the gateway.  GWD service will not be properly starting in the gateway. To verify the same check the following logs in dbgctl

24/06/07 20:30:00.767087,360|4|17014/69|dpdk_log_write:98 EAL: Detected 8 lcore(s)

24/06/07 20:30:00.767128,576|4|17014/70|dpdk_log_write:98 EAL: Detected 2 NUMA nodes

24/06/07 20:30:00.767784,192|4|17014/71|dpdk_log_write:98 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket

24/06/07 20:30:00.771873,792|4|17014/72|dpdk_log_write:98 EAL: Selected IOVA mode 'PA'

24/06/07 20:30:00.841667,072|4|17014/73|dpdk_log_write:98 EAL: No available hugepages reported in hugepages-1048576kB

24/06/07 20:30:00.842256,640|4|17014/74|dpdk_log_write:98 EAL: DPDK is running on a NUMA system, but is compiled without NUMA support.

24/06/07 20:30:00.842291,200|4|17014/75|dpdk_log_write:98 EAL: This will have adverse consequences for performance and usability.

24/06/07 20:30:00.842315,008|4|17014/76|dpdk_log_write:98 EAL: Please use --legacy-mem option, or recompile with NUMA support.

24/06/07 20:30:01.549809,408|4|17014/77|dpdk_log_write:98 EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list

24/06/07 20:30:01.549890,048|4|17014/78|dpdk_log_write:98 EAL: Cannot init memory

Environment

ESXI or KVM

Cause

Gateway/Edge deployed in any virtual environment will not support two or Multi NUMA nodes

Resolution

Gateway virtual machine should assigned with single NUMA node to mitigate the issue

Additional Information

In the dbgctl logs we could see the gwd process is getting initialized and failing with the following error

 

24/06/07 20:30:00.767087,360|4|17014/69|dpdk_log_write:98 EAL: Detected 8 lcore(s)

24/06/07 20:30:00.767128,576|4|17014/70|dpdk_log_write:98 EAL: Detected 2 NUMA nodes

24/06/07 20:30:00.767784,192|4|17014/71|dpdk_log_write:98 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket

24/06/07 20:30:00.771873,792|4|17014/72|dpdk_log_write:98 EAL: Selected IOVA mode 'PA'

24/06/07 20:30:00.841667,072|4|17014/73|dpdk_log_write:98 EAL: No available hugepages reported in hugepages-1048576kB

24/06/07 20:30:00.842256,640|4|17014/74|dpdk_log_write:98 EAL: DPDK is running on a NUMA system, but is compiled without NUMA support.

24/06/07 20:30:00.842291,200|4|17014/75|dpdk_log_write:98 EAL: This will have adverse consequences for performance and usability.

24/06/07 20:30:00.842315,008|4|17014/76|dpdk_log_write:98 EAL: Please use --legacy-mem option, or recompile with NUMA support.

24/06/07 20:30:01.549809,408|4|17014/77|dpdk_log_write:98 EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list

24/06/07 20:30:01.549890,048|4|17014/78|dpdk_log_write:98 EAL: Cannot init memory