I F*cked up at work yesterday **UPDATE**

OutHouse

Lifer
Jun 5, 2000
36,410
616
126
So around 12:30 the network manager calls me and wants to know what a few servers are. Well they are exchange servers, each doing a different thing related to faxing/email. He wanted to know if one of them received any incomeing mail or required an external IP. I told him no.

Well this morning got a hot line call from our other office and they were saying that our customers were complaining that they did not or are not getting emails from us.

ugggg citrix has a rush of panic now.

called the network manager and yip he made a NAT change on the firewall. {citrix wants to puke now}

Had him change it back and all the messages queued up since yesterday at 1300 were sent out. {citrix wants to slit wrist now}

I then went and explained to my boss what happend. Its totally my fault, we have 10 exchange servers and i got the one that sends out email that is only related to our automatic process confused with another that is not.


I feel like total sh*t.

***EDIT***

Tonight at 5pm the hotline rings and i answer it. It was the supervisor at our call center saying that NO customers can login to our web app. So I dig around and notice that ALL and i mean ALL web logins are GONE!!! :shocked:

So i go in my bosses office and ask him how long was he going to stay. he said well later than i thought i would be. He knew what was wrong because he did it. He ran a SQL script to do something but did not have the window scrolled all the way to the top, so it was hidding one line. and that line was....

delete webcontact_no :shocked: :shocked:

so, he stayed late tongiht to reload the sql db (90gig db)from a backup that happend on monday. I went to class.

i feel a whole lot better now.

 

zixxer

Diamond Member
Jul 6, 2001
7,326
0
0
Originally posted by: Citrix
So around 12:30 the network manager calls me and wants to know what a few servers are. Well they are exchange servers, each doing a different thing related to faxing/email. He wanted to know if one of them received any incomeing mail or required an external IP. I told him no.

Well this morning got a hot line call from our other office and they were saying that our customers were complaining that they did not or are not getting emails from us.

ugggg citrix has a rush of panic now.

called the network manager and yip he made a NAT change on the firewall. {citrix wants to puke now}

Had him change it back and all the messages queued up since yesterday at 1300 were sent out. {citrix wants to slit wrist now}

I then went and explained to my boss what happend. Its totally my fault, we have 10 exchange servers and i got the one that sends out email that is only related to our automatic process confused with another that is not.


I feel like total sh*t.

yeah wtf were you thinking...
 

Hammer

Lifer
Oct 19, 2001
13,217
1
81
what's your position? if this guy is the "network mgr", it sounds to me like he should know what's what. yeah, you messed up, but the other guy is just as responsible.
 

UDT89

Diamond Member
Jul 31, 2001
4,529
0
76
seriously its only a mistake.

the emails went out, so who cares. god forbid people remember when email didnt exist and you had to write letters and put stamps on them.

Still your boss' fault, not yours. Your boss is supposed to know more than you.........isnt that how it works?
 

OutHouse

Lifer
Jun 5, 2000
36,410
616
126
Originally posted by: Hammer
what's your position? if this guy is the "network mgr", it sounds to me like he should know what's what. yeah, you messed up, but the other guy is just as responsible.

i am one of 3 sys admins. our exchange environment is confusing and the one area that i dont feel 100% comfortable working with. I should have just told him to call the admin who exchange is his life.

no he isnt responsible, he called to get an answer and i gave him the wrong answer.
 

KLin

Lifer
Feb 29, 2000
30,427
745
126
Originally posted by: waggy
you did the important thing and admited you goofed up.

that's what it comes down to. Own up to the mistake, learn from the mistake, never make said mistake again ;).
 

ScoobMaster

Platinum Member
Jan 17, 2001
2,528
10
81
Originally posted by: KLin
Originally posted by: waggy
you did the important thing and admited you goofed up.

that's what it comes down to. Own up to the mistake, learn from the mistake, never make said mistake again ;).


Agreed!

EVERYONE makes mistakes (to varying degrees of frequency and scope, but that is not important in this discussion ;) ). The true measure of someone's character is how they deal with their mistakes. Taking RESPONSIBILTY, examining why it happened and LEARNING from your mistakes is the way to go. In this respect, failure can be transformed from a negative experience into a positive future change (something that SHOULD be taught in schools [anaylzing ones failures and LEARNING how not to repeat them] instead of pretending they don't matter to boost a child's self-esteem artificially!)

*EDIT* - See..... I made one and had to edit the post because my keyboard skills are lacking and I am too impatient to fully proofread and spell-check ;)
 

KLin

Lifer
Feb 29, 2000
30,427
745
126
Originally posted by: HonkeyDonk
wait, what did you do wrong?

did you not read his post? He gave the network manager some wrong information on how an email server was configured. The network manager made a change to the network, which prevented that email server from sending email out to the internet.
 

OutHouse

Lifer
Jun 5, 2000
36,410
616
126
Its days like today that re-enforces why i am getting sick of working in the IT field. i have been doing it for 7 years and i am just loosing my motivation. But i cant quit, i have a wife and 3 kids who depend on me for everything.

I am graduating from massage school on 19 Dec. I cant wait to build my practice on the side and hopefully in a few years match my income here and be able to quit.
 

maziwanka

Lifer
Jul 4, 2000
10,415
1
0
hey man. the mistake didnt sound too bad. you were able to take care of it quickly and you took responsibility for your actions. i would imagine that to managers its quite important to see how your employees handle mistakes and you handled it quite well.
 

djheater

Lifer
Mar 19, 2001
14,637
2
0
Originally posted by: Citrix
Its days like today that re-enforces why i am getting sick of working in the IT field. i have been doing it for 7 years and i am just loosing my motivation. But i cant quit, i have a wife and 3 kids who depend on me for everything.

I am graduating from massage school on 19 Dec. I cant wait to build my practice on the side and hopefully in a few years match my income here and be able to quit.

:thumbsup:

I know the feeling. In fact I know the feeling exactly.

I will reccomend that you refer to a written list in the future when asked something. Documentation is CYA.
 

ZoNtO

Diamond Member
Sep 27, 2003
3,709
0
0
www.rileylovendale.com
Originally posted by: purbeast0
tissue... ?

Douche bag??

At least he wasn't a pvssy about everything and admitted that it was his fault. From your original post it sounded like some of the blame should be on the other network guy too, if not all. I admire that you weren't afraid to own up to your mistake and take the consequences like a man. A lot of people don't even have the balls to do that nowadays, where has all the chivalry gone???!??!

Anyway, :beer: (cheers) to you!

^ (I don't drink)
 

psiu

Golden Member
Oct 1, 2003
1,629
1
0
Originally posted by: Citrix
Its days like today that re-enforces why i am getting sick of working in the IT field. i have been doing it for 7 years and i am just loosing my motivation. But i cant quit, i have a wife and 3 kids who depend on me for everything.

I am graduating from massage school on 19 Dec. I cant wait to build my practice on the side and hopefully in a few years match my income here and be able to quit.


I saw a movie about opening a massage parl.....err, practice, once. It had bewbies in it ;)
 

Shelly21

Diamond Member
May 28, 2002
4,111
1
0
Hey yesterday, a check printer wasn't printing in Richmond, I was like, what gives.... I try to resend that job of 76 checks 3-4 times.... no go....

Server issue it turns out, so I fired up the backup server. except the printer on the backup server was pointing to another printer in St.Louis. When I found out I made a mistake, St.Louis branch were getting 76 checks times 6-7 (I try to resend again). Wasted check stocks.... no one found out.... :D