VMware NSX
This is as per design, the standby pool member will remain active once activated.
When the failed pool member is restored, edit the pool and make the desired pool member standby again.
You can consider the following options to manage the failover:
Custom Backup Pool Member Configuration
Weighted Member Priority (Manual Adjustment)
While these are workarounds, they do not strictly enforce the behavior outlined above, where the backup is disabled when the primary is restored.
For further insights on load balancer configurations, you can review the LB encyclopedia