Does it pause while it's looking for drives?
If so tell it not to scan the BUS for changes, and manually set it for whatever your drives are, on the correct IDs.
If it's not that, are you sure it's your SCSI card? Your network card could cause your system to pause like that...