Mika's OGR Stats are being repaired.

imported_Thunder

Senior member
Oct 14, 1999
509
0
0
For those of you who may have looked at the stats on Mika's proxy and noticed that the 14th looks considerably more normal....

There's a good reason. :) Mika has provided me with the log files and I've been systematically cleaning out the bad data.

The only reason that the 14th is the only day done is that I wanted to verify that everything I was doing was working correctly. So far, it appears so. Therefore, I'm going to continue working on them and should have the remainder done by the end of the day. (Keep in mind that I'm actually working a real job and just doing this in my "spare" time) ;)

Enjoy,

Brian
 

BoberFett

Lifer
Oct 9, 1999
37,562
9
81
Are you doing that by hand? If so, send me the logs, tell me how to pick out the bad ones, and I'll whip out a quick proggy to strip the invalid WUs.
 

imported_Thunder

Senior member
Oct 14, 1999
509
0
0
Nahhh,

I'm doing some checking by hand, but for the actual work I'm importing the files into a spreadsheet and using a couple of methods to both search for pre-8009 client submissions and impossibly high node counts. (Although so far these have been one and the same... the high node counts are coming exclusively from the 8007 client resleases).

It's taking me very little time and most of the work is just that I'm being excruciatingly careful to avoid deleting any legitimate work. I only have 2 more days to go through, so by the time you could whip anything together, I'm sure I'd be done.

Thank you very much for the offer though! :)

-Brian
 

JHutch

Golden Member
Oct 11, 1999
1,040
0
0
Hey, thanks, Thunder! That was actually something that was driving me nuts! :)

You da man!

JHutch
 

BoberFett

Lifer
Oct 9, 1999
37,562
9
81
OK, just didn't want to see you slogging through those logs by hand. :)

Thanks for doing that, it wass pretty hard to compete with those guys who could do several exa-nodes per day. ;)
 

Eug

Lifer
Mar 11, 2000
24,097
1,737
126
Maybe you can retire eugene.hsieh into bugs_are_tasty while you're at it? If not, I'll just wait for Mika to activate the account retire function.

I started with the first one, until I found out my nice little Canuck flag wouldn't be displayed. Felt like a traitor showing a Yankee flag. ;)
 

JHutch

Golden Member
Oct 11, 1999
1,040
0
0
Come on, Eug, you know all you Canadians are just members of the 51st state of the good ole USA! ;)

JHutch
 

imported_Thunder

Senior member
Oct 14, 1999
509
0
0
Yep,

Jani beat me to the punch (or is it to the boards) ;)

I just sent the last logfile to Mika and it all appears to be working just fine now. :)

It appears that the newest proxy is doing a fine job of denying pre-8009 clients (and their associated weird node counts) so all should be normal from here on out. :D

-Brian
 

Viztech

Platinum Member
Oct 9, 1999
2,807
0
0
Good work Thunder!

Now we can Really see when giantnt4vizmechthunderstorm takes 2nd place!

Maybe Jay can get his stats taken care of too, drives me nuts when it looks like we aren't doing anything. :p

viz
 

imported_Thunder

Senior member
Oct 14, 1999
509
0
0
OH! Really??

Well then... perhaps I should mention to Jay that my services are available for hire... ;)

Thunder, Freelance Intuitive Log Parser
Available for all those truly troublesome log-files.

;)

Just send 'em my way Jay and I'll make short work of 'em. :)

-Brian
 

Jator

Golden Member
Jun 14, 2000
1,445
7
81
I haven't even been paying attention to my OGR stats. I just let the automated stats script run. Now that you mention it, I do see a problem. Am I assuming that the 8007 blocks are reported incorecctly?!? If so, I can take those out, np.

Just let me know what to look for.

Jay
 

imported_Thunder

Senior member
Oct 14, 1999
509
0
0
Jator, (Jay)

Yeah, you've got it. It was rather odd, but I'd say about 1 in every 200 - 300 OGR WU's that were submitted by 8007 clients had impossibly high node counts along with them (i.e. quad or quintillion node counts in a single stub). I found no pattern to the problem in terms of the CPU/OS of the client, only the build.

Since D.Net was not counting any work from pre-8009 clients, I took the approach that you are considering. I simply deleted all lines from the key logs that were from a 8007 client (there were no submissions of OGR work to Mika's proxy from 8002-8006 clients).

-Brian
 

Mika

Senior member
Oct 13, 1999
309
0
0
Thunder: Thanks for taking the time to go through the log files!!! Much appreciated.

Mika
 

Jator

Golden Member
Jun 14, 2000
1,445
7
81
Thunder. Shoot me an e-mail and I'll see about rounding up the log files to send to you. I can get to it myself, but not til Sunday, so if you are willing, I'd be much appreciative.

Jay

P.S. Just wish my WebServer wasn't acting up right now!!! :(
 

Jator

Golden Member
Jun 14, 2000
1,445
7
81
Thunder.....

I've tried to delete only the 8007 client entries, but I somehow corrupted the file. Luckily I saved a backup copy so I haven't lost the data. Are you still willing to go through and sift through the log and pull out the bad data. If so, I'll e-mail you the log.

Jay