Same happens for me. For most downloads I just use DownThemAll, but that doesn't work if you're DLing from a mirror. If I just let it sit and don't touch the download dialog box (as in minimize, surf the web, etc), it works. But that's kind of annoying to wait. :s