This issue occurs when Global Manager (GM) is cleaned up in Logical Router (LR), the NSX Manager also cleaned up the Logical Router and the config cleanup was fine from user point of view.
However, somewhere the realized state in lower layers was holding the realization state from previously deleted Logical Router. A user created a new Logical Router with same name, then the issue was observed as new realization state creation in lower layers failed.