You could give a shot at Windows Commander, which is a file explorer replacement that allows you to browse archived files as directories. However, by the nature of zip files, your system will generally need to download the archive at least to a temp file before it is able to view the contents of the zip/cab/rar/etc.
~Ladi