I did the rpm -e command, and it comes back with the error that this rpm is not installed, but the files are there, and I if I try to reinstall the same rpm it says this is already installed
You need to give rpm the package name not the rpm file name. So rpm -e MySQL will probably work. If not try 'rpm -qa | grep -i sql' and see what it's called.
This is why I dont use rpms
Well, you still would be waiting for it to compile so ;P