No, it is designed to run at the temperature it runs at. I mean, if you are locating it in an oven, or covered in a blanket or in an attic that might be an issue.
A typical router uses between 5-15w of power, yes that causes the case to run between warm and hot.