I'm doing BIOS engineering for a living, so I know the stats

SCSI channel init adds a second to the boot time, no more. Depending on their settings, some SCSI BIOSes add delays to give users more time to press the hotkey to enter the SCSI BIOS, or just read the output.
About the same time is regained by disabling an IDE channel, so actually, little is lost as soon as you make the SCSI BIOS be as terse as it can. LSI's have the delays and terse/verbose output modes configurable, and can be just as quick as an IDE init if you let them. On default settings, with verbose output, large timeouts and all ID positions scanned, you'll get it up to 20 seconds.
As long as the SCSI drivers loaded by the OS honor the scanning rules set in the SCSI BIOS, you won't get any extra delays during OS boot either. LSI's do, btw.