My heart stopped for a second at work today

[Jeff7]

True. The programmer's defense was that he had that command in the program while he was developing it so he could quickly reinit the database, then forgot to disable it when he no longer needed it and released the code. Seemed logical.

Ah, yeah.

Though I (try to remember to) put //DEBUG or //REMOVE into code if I'm doing anything that's either there (or removed) just to debug, or if it's something that needs to be removed before it leaves the building.

NASA does the same sort of thing - big, highly-visible tags that say very plainly that they need to be removed before the thing gets squished into a rocket.

 

[Baked]

Death is stress free. To live is to accrue stress. I take death over stress any day of the week.

 

[airdata]

I may or may not have disconnected our ancient phone system while techs were working on it remotely and thereby erasing all extensions.

To be fair to me, we've had horrible service w\ them and afterhours isn't something they do aside from that day.

Had everything fixed in 45 minutes though : D

 

[Broheim]

this thread makes me appreciate the avaya solution we have at work.

 

[TXHokie]

I took down a major retailer website for about 90 seconds many years ago while at work due to fatfingering some SQL statements and then accidentally push out an update. Well technically only about half of their load balancing site, half the customers got thru and the other half probably was just spinning. Not sure how much sales was lost.

 

[Red Squirrel]

I've had a few scary moments like that when I was doing server management.

The most heart pounding one was the time I was trying to restore a single file from backup, for whatever reason, it started restoring EVERY FILE FROM EVERY SERVER! Funny thing is I normally restore to a separate folder but this time I decided to just restore straight to the destination as the files there were deleted anyway. Thankfully the default was to not overwrite files that are newer at the destination. I was wondering why it was taking so long but figured it was just trying to load the tape or something.

I had a few moments like that at home too when doing rm -rf on a folder and realize I'm on the wrong server.... oops.

 

[Exterous]

this thread makes me appreciate the avaya solution we have at work.

I miss our modern avaya system from my last job 🙁

but this time I decided to just restore straight to the destination as the files there were deleted anyway.

Yeah - thats usually the way things work. The one time you do it slightly different is the one time you needed to do it the normal way