Currently, whenever vSANFS starts getting enabled, "vdfsd" will query CMMDS for the "NET_INTERFACE" entries on every node and picks the first healthy IP address.
This means that vSANFS doesn't always pick the IP address of the "vsan" enabled vmk. If the user has configured an isolated witness network for vSAN (which means the host can communicate with witness node via witness network, but hosts can't communicate with each other via the witness network), then the communication between hosts for vSANFS won't be established.