HELP! Fsck spontaneously rebooting server...

[Jugernot]

I got a message from my boss this morning that the web server wasn't working (RH 7.3). So I tried to SSH in and couldn't. So I drove by work and found a message on the screen:

Inode 448900 has illegal blocks.

INEXPECTED INCONSISTENCY; FUN fsck MANUALLY.

So I tried running fsck -fcy /dev/hde9 ( / partition ) and it spontaneously reboots the server at some point through scanning the disc. So I tried running from my RH 7.3 disc in Rescue mode, same thing occurs.

Any ideas?

btw, The guy who usually admin's these servers was recently downsized and it is now my responsiblity, though I've told my employer that I'm not experienced enough to do the job. So please bare with me.

 

[Jugernot]

Well I installed the drive in another machine with RH 7.2 and it fsck fine, but now it rebooted after I reinstall it back in to the original machine. Damn... guess I'll check all the other paritions too.

 

[cleverhandle]

I don't really know, but this sounds more like other hardware than the drive, especially if the root partition checks out on another machine. Like maybe some flakey RAM that can't handle the stress of a file system check. I could understand the system freezing possibly, but I don't think Linux should be rebooting on errors like Windows. Maybe there's a kernel tuning that I'm unaware of, though...

 

[Jugernot]

Well see that's the thing, this server has been running with little change other than Apache and SSH revision for a year straight, 24/7!

I don't know why it's happening now... no wait, yes I do! The admin got downsized, now I"m all that's left... that is why it's happening.

 

[Bremen]

Sounds like the old admin did his job a little too well :0)

 

[Jugernot]

Well, I had it all fixed, then it started all over again. Though the problem is so sudden I doubt it's a OS or hard drive issue. I'm thinking PS, so I've switched it out.

 

[Jugernot]

Ok, some more info. The reboots are occuring when the system scans the partition on bootup after alerting that they weren't unmounted properly.

Jugs

 

[Abzstrak]

what file system is this?

If you need this server up ASAP, then tell your employer to get the old admin to come back in on an hourly basis NOW...Make sure you dont spend too long on the issue without recommending another course of action because you cant fix it (CYA)

your booting off of the RH73 disk to run fsck right?

 

[mcveigh]

how bout full system specs, hardware, filesystem types, etc?

 

[owensdj]

Jugernot, you might want to check to make sure the fan on the processor(s) is still turning. Also, run Memtest86 on your memory.