Successfully migrated over the VPN server. Turns out the VPN server software was listening on the interface by name, and for whatever reason there's no real config file to edit, you have to rerun the entire setup process to reconfigure it. The interface name changed when porting the VM over to Proxmox.
In order to not lock myself out, I made a script on the existing VPN VM to shut the interface down for 10 minutes then bring it back up, this would give me a window to test connecting to the VPN server on the new VM server and if it failed at least the other one came back. Once I got it to work I then had to make sure the old one does not come back or it would cause an IP conflict.
The old VM server is more or less ready to be retired now. I won't bother converting the legacy VMs that I no longer use. If I need access to them at some point I will keep the vmdk files. At some later time I might convert those over to raw images so I can mount them if ever I need access to anything. That sounds like a job for when I get a tape drive. Just throw them on tapes and store away.
Pretty excited at all of this, been meaning to do this for so long. With Broadcom destroying VMware it felt like a good time to do it too.