For Windows Server 2016, VMware supports the Datacenter, Standard and Essentials edition. For these editions, Server with Desktop Experience (i.e: Server with GUI) and Core installation options are supported.
Currently, Nano installation option and running Nano instances are not supported at this time.