Check ebay for headphone amps. It basically just gives you an amplified dry signal. Don't spend big dollars on one because they're not worth it.
If you're willing to spend $100-$150, you can buy an amp modeler like a V-amp, Digitech Genesis, or Johnson J-station. You can get some decent tones out of them, maybe useful to you if you plan to record.