If the ESXi nic connected to Switch port is configured as accessport, then dont give any value in vlan field under configure management network, below network adapter.
if the esxi nic connected to switch is configured with trunk port then give the VLAN tag in the vlan filed, see if that works.