compressing pproxy log files

[imported_CyberWire]

stats are taking over an hour to run on my pproxy
i need a log compressor that may help with this time
i'm running stats on a k62-300 runnig win2k.
ive hard of a log compressor running around here
i tried one called logcomp.pl
didnt seem to work right
would bphantom or anyone else be using this script?
if i can get your settings used in proxyper.ini for logging and any settings used in the compression script(links directly anyone?) it'd be much appreciated.
i have stats running every hour right now and they werent completing
i had to zip up about a months worth of work so that stats finish sometime before the hour is up. so ppl are missing some older blocks on my stats page.. i still have the zip but wont be reinstalling the logs to my pproxy dir until i can find a compressor or something...

tia

-TC1

 

[imported_CyberWire]

bump 🙁

 

[Russ]

thecool1,

I'm having the same problem with my stats run. It's taking about 40 minutes, so I dropped it back to once an hour.

I installed Brad's script (logcomp.pl) and it works perfectly. It compresses the files from an average of about 2MB down to about 20K.

That didn't solve the problem in my case though, but if that's what's causing it in your case, the script does work fine.

Russ, NCNE

 

[imported_CyberWire]

the collecting data phase seems to take up a decent amount of time
if i can speed that up it'd help im sure

i modified the script to do a "." after it reads each log, writes an email page, and writes a host page.

I had to disable all the other pages due to the time it was taking.
so its just the main page, and the byemail and byhost pages.

russ
what are your proxyper.ini and logcomp.pl settings?
link em for me maybe? 🙂

-TC1

 

[ViRGE]

You'll definately want to talk to Brad, and possibly Mika. While TA.com's stats system is more powerful(Dual P3 550 Katami), we can pull off a statsrun of all of TA in under 5min; so I'm thinking those two have a trick up their sleeve.😉

 

[GulDukat]

thecool1 and russ:

What you could do is split the stats you report (like Mika does) into "Full Stats" and "Weekly Stats." Run the full stats twice per day (since they take a long time) and run the past week's stats 4 times per hour. That way folks can get their stats fixes throughout the day and still see how they're doing overall at least twice per day.

Gul Dukat
TA--Cardassian Empire

 

[imported_CyberWire]

I'm currently out of town and dont have access to my main email account so i will haveto wait to get into touch with them and be near enough my box to do anything they recommend. I'll be back in town on july 6th, will email then i guess..