This issue is resolved in VMware NSX Data Center for vSphere 6.4.5
Workaround:
Name your IPSets with relevant to the edge names.
NB: If you use ":" in some of the names for the IPSets, certain versions of vCloud Director will not be able to read them. Do not use ":" in the IPSet names.