I have a Dell Latitude E6320. It does get hot under load, but it's usually able to maintain >2.5 GHz even under extended full load. To be honest, Even the 2520M feels slightly "slow" sometimes, despite the laptop having 8GB of RAM and a fast SSD. I guess it's not really fair to compare it to my desktop (specs below), but the 2520M does feel a bit laggy at times and seems to take noticeably longer to load certain webpages in Chrome than my desktop. I can't even imagine how a Core M would feel if my 2520M already feels a bit slow sometimes.
A few things that might help:
1. The OEM thermal paste for most OEMs (yes, that includes Apple, especially Apple) can best be described as a crime against CPU/GPUs. Grab the hardware maintenance manual for your model from Dell's website and repaste the heatsink. I just did so for my X61s and X220, and temps dropped by about 10 C.
This will help for your temps, but it doesn't really do anything for snappiness.
2. Chrome has an option for hardware acceleration. It is on by default. It often slows down performance. Try to turn it off and see if load times improve.
If it does not improve, an actual upgrade to the GPU might help, and the modern Broadwell/Skylake iGP on the U models are significant faster than the HD 3000 on the 2520M.
And, of course, the Haswell generation does have M model CPUs. The Latitude E6440 is more or less a direct successor to your E6320. It comes with Haswell M processors that should beat the 2520M in every way. Personally, I prefer a U processor as the best compromise between performance and battery life, but it in the end, your experience is what's most important, and it sounds like you value snappiness more than battery life.