You need enough RAM to give the host and the guest the amount of ram that you want to give them. So you need whatever you would normally use, plus 4 gigabytes of RAM.
I run multiple vms, including a 4GB Windows environment, on a server with 16GB and it works fine.