After modifications are made to the bounce attack validation (BATV) policy actions, the mail server process (MTA) needs to be restarted before the changes fully take effect.
The mail server process is not being signaled to reload its configuration following changes to the BATV policy.
This is a known issue and has been addressed in SMG 10.5.2. Please update when able.
The MTA process can be manually restarted following changes to that BATV policy in a number of ways