Blade Servers: What do you know?

Feb 3, 2001
5,156
0
0
Hey, we're looking at maybe migrating our infrastructure over to a set of blades (10 bay enclosure, 8 servers online with two spares at the ready), and I'd like to talk with someone who's worked with them in a production environment.

Some questions I have are:

1. Dell mentions that you can "Provision" a blade slot for a particular OS configuration for easy restore in the event of failure. How does that work? Do you keep a preconfigured 2003 server image on hand? Does it take "snapshots" of that slot's hardware at predefined intervals?

2. How does the OS see the SAN? Is it seen as a network drive or does it appear more inline with how your box would see a SCSI controller and drive?

3. How do you manage filesystems on the SAN? Does it support multiple partitions? NTFS? FAT? Proprietary? Managed through special proprietary software or through Windows' Disk Management Console?

4. MS Exchange server. I assume that you'd store the database on the SAN rather than on the blade itself, but what about recovery in the event that blade fails? This ties back to question #1. If we're dealing with snapshots, that's cool unless they're over 30 days old, in which case you could have some Kerberos problems with that machine on the domain. Not hard to fix, still, but a pain in the ass any way you look at it.

5. What about automatic failover? Can you provision a spare box to keep itself synched, configuration-wise (not file system-wise, because if a virus is what brings your server down you sure as hell don't want to have a backup of that virus :) that will automatically take over in the event the first box dies or just goes crazy? If it does, will it shut down that other box in order to prevent network problems?

If anyone's fairly nearby (southern california, I'm in Rancho Cucamonga) and has such an environment set up, I'd love to check out your setup and talk to you first hand about the pros and cons of using Blade servers over standalones.

Thanks!

Jason
 

GHacker

Senior member
Jul 7, 2001
571
0
0
:) Wow that's funny - I was looking for somewhere on the forums to ask about blades too. One of the partners in the software company I work for is splitting to do more of an ASP model and is taking me with to do the hardware and networking portion. We want to do blades and will need a more robust infrastructure than the Netgear router and unmanaged switch type of environments we've been working with. I'm also looking for good resources to help determine ISP bandwidth sizing, etc. If anyone has any recommended platforms or vendors, etc. or good resources for researching any of this stuff or even a better place to ask this question please post!

Greg
 

Future Shock

Senior member
Aug 28, 2005
968
0
0
Originally posted by: DragonMasterAlex
Hey, we're looking at maybe migrating our infrastructure over to a set of blades (10 bay enclosure, 8 servers online with two spares at the ready), and I'd like to talk with someone who's worked with them in a production environment.

Some questions I have are:

1. Dell mentions that you can "Provision" a blade slot for a particular OS configuration for easy restore in the event of failure. How does that work? Do you keep a preconfigured 2003 server image on hand? Does it take "snapshots" of that slot's hardware at predefined intervals?

2. How does the OS see the SAN? Is it seen as a network drive or does it appear more inline with how your box would see a SCSI controller and drive?

3. How do you manage filesystems on the SAN? Does it support multiple partitions? NTFS? FAT? Proprietary? Managed through special proprietary software or through Windows' Disk Management Console?

4. MS Exchange server. I assume that you'd store the database on the SAN rather than on the blade itself, but what about recovery in the event that blade fails? This ties back to question #1. If we're dealing with snapshots, that's cool unless they're over 30 days old, in which case you could have some Kerberos problems with that machine on the domain. Not hard to fix, still, but a pain in the ass any way you look at it.

5. What about automatic failover? Can you provision a spare box to keep itself synched, configuration-wise (not file system-wise, because if a virus is what brings your server down you sure as hell don't want to have a backup of that virus :) that will automatically take over in the event the first box dies or just goes crazy? If it does, will it shut down that other box in order to prevent network problems?

If anyone's fairly nearby (southern california, I'm in Rancho Cucamonga) and has such an environment set up, I'd love to check out your setup and talk to you first hand about the pros and cons of using Blade servers over standalones.

Thanks!

Jason

I just got finished configuring a $400,000 (including storage) blade system for a client, so I will try to answer your questions to the best of my ability. I am sure others will have more to chime in and correct where I get it wrong...

1) The "provisioning" feature allows the blade controller to map any blade slot to a given system image - be it Windows Server, Linux, or even basically anything. It keeps MULTIPLE server images, so that you can have certain configs for different blade functions - for example, 4 blades may act as a load balancer for your website, 8 blades might be running Apache, and another 8 might be running Oracle 10g to store the pages. All would have different configs, including OS, applications loaded, etc. You may even customize by different blade types - for example, your Apache nodes could be dual processors, but your Oracle nodes could be quad processors (providing your hw vendor offers them). And the provisioning server will happily keep that all straight, so that when you hot plug a blade it will download and customize the image as needed, reboot the target blade, and then allow it back into the cluster. Usually can all take place in less than an hour...

2) Depends upon your OS. Sounds like you are using Windows Server, so I will let someone with experience with that and SAN answer this..

3) Ditto

4) Ditto


Just a few followup thoughts - I would be very hard pressed to recommend Dell for a blade vendor, except on price. My client's company has encountered some questionable Dell blade reliability (they use Dell for all PCs and laptops, so it's not a bias against Dell - but their blades haven't cut it). Additionally, most people using blades have found that Opterons have real advantages over Xeons in terms of emitted heat, power consumption, and 64-bit performance (see Anand's tests of MySQL and DB2 UDB databases on Opterons vs. Xeons in 64-bit mode). Dell doesn't offer Opterons, and in fact is the only US vendor not to.

You might take a look at HP (and even IBM), who offer both Opterons and Xeons, in both 2 and 4 CPU configurations. HP also have some great blade white papers on their site. We are just ordering our hw now, starting with a small rack of HP BL35ps and 10 Terabytes of SAN, but we expect to double this quickly. I can let you know how it goes...and we are overseas, so unless you want a 14 hour flight to somewhere cold and rainy, I suggest finding a closer site visit...

Future Shock