This detach operation is what leads to the additional vmdk being left behind along with its parent folder. The detach doesn't happen during a regular machine Delete and only happens during a Machine recreate via an update deployment operation.
The behaviour is a precautionary measure against potential data loss. In certain instances, users may not be aware of the existence of image disks within the deployment canvas, as these disks are internal to the utilized image and cannot be controlled from the deployment canvas.
It is designed to prevent unintentional data loss when update deployment operations are performed which may results in disks being removed.
To workaround the issue you can manually deleted the disks from vCenter.