I've only gotten it to work by setting the password before creating the archive, or by setting the password and then adding to the archive(where only the files added to the archive after setting the PW are locked).
So when creating an archive, go to the Advanced tab, and use the Set password button. Or when viewing an archive, go to the File menu and select Password(but this only locks new files, not existing files).