just lost power in the data center

j00fek

Diamond Member
Dec 19, 2005
8,099
1
0
recovery is doing well, 2 hrs in almost backup!

(good thing for the credit unions) :p
 

Jfrag Teh Foul

Diamond Member
Jul 18, 2001
3,146
0
0
Wow... how do you even have time to post?!

Look at it this way, where I am currently working, the chowderheads that be decided to put our datacenter in a building with overhead plumbing... you guessed it a 2" main burst back in January (Friday the 13th no less). The last cost estimates I heard were around 2 mil just in server/infrastructure costs... doesn't even take into account productivity, or labor estimates.



 

ForumMaster

Diamond Member
Feb 24, 2005
7,792
1
0
Originally posted by: Jfrag Teh Foul
Wow... how do you even have time to post?!

Look at it this way, where I am currently working, the chowderheads that be decided to put our datacenter in a building with overhead plumbing... you guessed it a 2" main burst back in January (Friday the 13th no less). The last cost estimates I heard were around 2 mil just in server/infrastructure costs... doesn't even take into account productivity, or labor estimates.
damn...was there a backup? i imagine everything went; did your company recover?
btw, can't your company sue the power company for the loss? you lose uptime costs, service you could have provided plus all the labor for setting everything back.
 

AMCRambler

Diamond Member
Jan 23, 2001
7,715
31
91
Originally posted by: ForumMaster
Originally posted by: Jfrag Teh Foul
Wow... how do you even have time to post?!

Look at it this way, where I am currently working, the chowderheads that be decided to put our datacenter in a building with overhead plumbing... you guessed it a 2" main burst back in January (Friday the 13th no less). The last cost estimates I heard were around 2 mil just in server/infrastructure costs... doesn't even take into account productivity, or labor estimates.
damn...was there a backup? i imagine everything went; did your company recover?
btw, can't your company sue the power company for the loss? you lose uptime costs, service you could have provided plus all the labor for setting everything back.

No. I've never heard of any contractual agreements with power companies where electricity is guarranteed at a location unless the power company is maintaining on site backup generators for the company. If they were critical systems, there should be a UPS with emergency generators and his company should have an alternate off site data center.
 

j00fek

Diamond Member
Dec 19, 2005
8,099
1
0
how we lost it was the power is routed through the ups and into the room. a capasitor fried in the ups and it went. this is the second time in like 2 months. would be nice to get a new ups for our ibm servers lol
 

altonb1

Diamond Member
Feb 5, 2002
6,432
0
71
Originally posted by: ForumMaster
Originally posted by: Jfrag Teh Foul
Wow... how do you even have time to post?!

Look at it this way, where I am currently working, the chowderheads that be decided to put our datacenter in a building with overhead plumbing... you guessed it a 2" main burst back in January (Friday the 13th no less). The last cost estimates I heard were around 2 mil just in server/infrastructure costs... doesn't even take into account productivity, or labor estimates.
damn...was there a backup? i imagine everything went; did your company recover?
btw, can't your company sue the power company for the loss? you lose uptime costs, service you could have provided plus all the labor for setting everything back.

Why would the power company have any responsibility for a WATER pipe breaking? :sigh'
 

Jfrag Teh Foul

Diamond Member
Jul 18, 2001
3,146
0
0
Originally posted by: altonb1
Originally posted by: ForumMaster
Originally posted by: Jfrag Teh Foul
Wow... how do you even have time to post?!

Look at it this way, where I am currently working, the chowderheads that be decided to put our datacenter in a building with overhead plumbing... you guessed it a 2" main burst back in January (Friday the 13th no less). The last cost estimates I heard were around 2 mil just in server/infrastructure costs... doesn't even take into account productivity, or labor estimates.
damn...was there a backup? i imagine everything went; did your company recover?
btw, can't your company sue the power company for the loss? you lose uptime costs, service you could have provided plus all the labor for setting everything back.

Why would the power company have any responsibility for a WATER pipe breaking? :sigh'

:D

Insofar as getting everything back, that really went better than expected. We had a healthcare grade network back up and running within 2 days... albeit a skeletal version of it. The hardest thing was getting servers in-house to restore data to. Getting multiple Dell 6800's among many many other Dell servers shipped to you in a matter of hours takes more than just a little bit of work. :p

As far as cost recovery, believe it or not our equipment insurance came through in spades. Though, I wonder how many of our insurance reps came back through here within days of this with self-inflicted gunshot wounds.

 

DaiShan

Diamond Member
Jul 5, 2001
9,617
1
0
Originally posted by: j00fek
how we lost it was the power is routed through the ups and into the room. a capasitor fried in the ups and it went. this is the second time in like 2 months. would be nice to get a new ups for our ibm servers lol

Diesel generators at the powerbox FTW (well we used natural gas since we had a gas line to the building but still)
 

RagingBITCH

Lifer
Sep 27, 2003
17,618
2
76
Originally posted by: DaiShan
Originally posted by: j00fek
how we lost it was the power is routed through the ups and into the room. a capasitor fried in the ups and it went. this is the second time in like 2 months. would be nice to get a new ups for our ibm servers lol

Diesel generators at the powerbox FTW (well we used natural gas since we had a gas line to the building but still)

We used diesel too, had to fire them up like once a month or something. :)