- Nov 4, 1999
- 24,151
- 516
- 126
Ever since I've been running SETI2 I've found it hard to compare different rigs with each other due to the longtime it takes RAC to level out (~2wks) & the varying Angle Ranges of WUs which isn't starightforward to find. RAC is useless for quick comparisions, like when you've just switched client versions, you have temporary use of another rig or want to compare many rigs.
[edit]Go to the 'To summarise' line if you want to skip the explanations,history & complaints
For me this took out some of the fun of SETI, in the old days of SETI classic (as some of us remember) with SETIQ you could open up your browser to SETIQ, checkout what WU times your rigs were getting & what AR WUs they were chewing on. Quick,simple & accurate
.
Then it was also known that the average & common AR WU was 0.417 & from that spawned the TLC benchmarking WU & benchmarking tables & others giving accurate comparisions between large numbers of different machines.
Their are many TA names in there too btw
.
Yes in your BOINC stats you can check out WU times for each machine (done in seconds :roll: ) but you can't see the AR along with it (you have to go through 2 further links to find out) so you can't make easy comparisions.
Anyway as I mentioned this has been bothering me for ages so I planned to do something about it, so about 2yrs on from when I 1st asked RattleDagger how to capture a WU I believe I finally have enough info on WU ARs. Inccidently I have searched around to see if this info was already out there but all I found was an assumption that the average AR was still 0.417, I wasn't going to assume that is still right
So today & ~3wks ago I trawled through 200 WUs that my Q6600 had done & copied & pasted the AR of each WU into excel (god that was tedious! lol). I know their are millions of WUs out their but I don't have time to look through all those
, & I felt that a mix of 200WUs 3 weeks apart would give a fair idea of what's out their.If you have data to show otherwise then send it to me & I'll add it in to the average.
I averaged the AR of all 200 WUs & ended up with a figure of 0.502711 which is almost totally useless as looking through those 200+20 WUs none of them had an AR of ~0.5! Of the 200 that I'd recorded 66 were at 0.39 AR or close (0.38-0.4), 46 at 0.44 or close (0.415-0.45), the rest above or below those groups.
To summarise, in my sample of 200 WUs the 0.39 AR WU was the most common, it's also pretty close to the average of the 2 most common ARs WU groups (0.39 & 0.44) which averaged is ironically close to 0.417 (though I haven't worked that out accurately).
So therefore I suggest that the new benchmark WU for SETI2 should be a WU of 0.39 AR, this gives the additional advantage that most people will simply be able to look through their completed WUs under 'Tasks' & get a very good idea of what times their rigs are doing them in, look for a WU with 73.xx credits. Of course that won't be as accurate as running a benchmark WU but it'll be very close (see Smokes results about that down below).
If I get enough results here from TA members (& others?) then I would like to create a benchmarking table like TLC did, our very own Thunder did 8yrs ago & SETI Spy author Roelof's Unofficial Top 200 Team Lamb Chop Benchmark Results table. (many TA names near the top there
, last updated 9/03 before he became too ill
RIP).
[edit] Preliminary table available here
Before I grab the appropriate WU I'll add a few results myself.
My rig Q6600 @3GHz, DDR2 @788 4-4-4-15 2T, 1 WU
AR 0.393746 (~73 creds), CPU time ~4412s = 1hr 13.5mins
(running alongside 3 other cores doing DC) AK v8 SSE3 client.
My 2nd rig Sempron 3100 @2.5GHz, DDR @454 3-3-3
AR 0.391117 (73.58 creds), CPU time 8914s = 2hrs 29mins
AK v8 SSE3 client.
Nick's rig E4500 (2.21GHz), 1WU
AR 0.393110 (~73 creds), CPU time ~5220s = 1hr 27mins (other core also doing SETI) Ak v8 SSE3 client.
Ali's rig XP2600 (1.92 GHz), 512KB L2, DDR333 2.5-2-2
AR 0.390633 (~74 creds), CPU time ~23,623 = 6hrs ~34mins :Q (wow I knew that'd be slow but still! lol, no 73 cred results atm )
None of the rest of my mini-fleet have completed normal AR WUs (or any) recently
.
Both the Core 2 rigs are running the optimised v8 client.[edit] Darn, but the SSE3 version not the SSSE3 one!
To find ARs, go to your BOINC SETI stats>Computers>tasks(of chosen PC)>Task ID ,on completed WUs only.[edit] Or as Bryan & Smoke have done forget the AR & just look for ~73 credit WUs
, that's a lot quicker as you don't have to look into each WU. Though I was hoping for some additional feedback on this to re-confirm that ~73 cred WUs are always WUs with an AR of ~0.39.*
I'm gonna see if I can find the info RD gave me about finding out how to 'grab' a WU.
Comments? questions?
*Credit vs WU AR, times for my Q6600 @3GHz, AKv8 SSE3 app
73.82 cred WU, AR 0.389979 (4165s)
73.82 cred WU, AR 0.390045 (3965s)
73.82 cred WU, AR 0.390062 (4342s)
73.71 cred WU, AR 0.390654 (4382s)
73.61 cred WU, AR 0.390944 (4376s)
73.59 cred WU, AR 0.391073 (3927s)
73.50 cred WU, AR 0.391539 (3924s)
73.50 cred WU, AR 0.391472 (4513s) #
73.40 cred WU, AR 0.392135 (3911s)
73.33 cred WU, AR 0.392577 (3789s) #
73.32 cred WU, AR 0.392662 (4478s)
73.27 cred WU, AR 0.392925 (4392s)
73.23 cred WU, AR 0.393219 (4500s)
72.78 cred WU, AR 0.394307 (4391s)
72.75 cred WU, AR 0.394542 (4046s)
# Biggest time difference ~720s (12mins) ,average those 2 (4151) & it's a variance of about +/- 8% ,hmm not good! Still it's better than RAC.
We definitley need a benchmark WU for accurate scoring though.
[edit]Go to the 'To summarise' line if you want to skip the explanations,history & complaints
For me this took out some of the fun of SETI, in the old days of SETI classic (as some of us remember) with SETIQ you could open up your browser to SETIQ, checkout what WU times your rigs were getting & what AR WUs they were chewing on. Quick,simple & accurate
Then it was also known that the average & common AR WU was 0.417 & from that spawned the TLC benchmarking WU & benchmarking tables & others giving accurate comparisions between large numbers of different machines.
Their are many TA names in there too btw
Yes in your BOINC stats you can check out WU times for each machine (done in seconds :roll: ) but you can't see the AR along with it (you have to go through 2 further links to find out) so you can't make easy comparisions.
Anyway as I mentioned this has been bothering me for ages so I planned to do something about it, so about 2yrs on from when I 1st asked RattleDagger how to capture a WU I believe I finally have enough info on WU ARs. Inccidently I have searched around to see if this info was already out there but all I found was an assumption that the average AR was still 0.417, I wasn't going to assume that is still right
So today & ~3wks ago I trawled through 200 WUs that my Q6600 had done & copied & pasted the AR of each WU into excel (god that was tedious! lol). I know their are millions of WUs out their but I don't have time to look through all those
I averaged the AR of all 200 WUs & ended up with a figure of 0.502711 which is almost totally useless as looking through those 200+20 WUs none of them had an AR of ~0.5! Of the 200 that I'd recorded 66 were at 0.39 AR or close (0.38-0.4), 46 at 0.44 or close (0.415-0.45), the rest above or below those groups.
To summarise, in my sample of 200 WUs the 0.39 AR WU was the most common, it's also pretty close to the average of the 2 most common ARs WU groups (0.39 & 0.44) which averaged is ironically close to 0.417 (though I haven't worked that out accurately).
So therefore I suggest that the new benchmark WU for SETI2 should be a WU of 0.39 AR, this gives the additional advantage that most people will simply be able to look through their completed WUs under 'Tasks' & get a very good idea of what times their rigs are doing them in, look for a WU with 73.xx credits. Of course that won't be as accurate as running a benchmark WU but it'll be very close (see Smokes results about that down below).
If I get enough results here from TA members (& others?) then I would like to create a benchmarking table like TLC did, our very own Thunder did 8yrs ago & SETI Spy author Roelof's Unofficial Top 200 Team Lamb Chop Benchmark Results table. (many TA names near the top there
[edit] Preliminary table available here
Before I grab the appropriate WU I'll add a few results myself.
My rig Q6600 @3GHz, DDR2 @788 4-4-4-15 2T, 1 WU
AR 0.393746 (~73 creds), CPU time ~4412s = 1hr 13.5mins
(running alongside 3 other cores doing DC) AK v8 SSE3 client.
My 2nd rig Sempron 3100 @2.5GHz, DDR @454 3-3-3
AR 0.391117 (73.58 creds), CPU time 8914s = 2hrs 29mins
AK v8 SSE3 client.
Nick's rig E4500 (2.21GHz), 1WU
AR 0.393110 (~73 creds), CPU time ~5220s = 1hr 27mins (other core also doing SETI) Ak v8 SSE3 client.
Ali's rig XP2600 (1.92 GHz), 512KB L2, DDR333 2.5-2-2
AR 0.390633 (~74 creds), CPU time ~23,623 = 6hrs ~34mins :Q (wow I knew that'd be slow but still! lol, no 73 cred results atm )
None of the rest of my mini-fleet have completed normal AR WUs (or any) recently
Both the Core 2 rigs are running the optimised v8 client.[edit] Darn, but the SSE3 version not the SSSE3 one!
To find ARs, go to your BOINC SETI stats>Computers>tasks(of chosen PC)>Task ID ,on completed WUs only.[edit] Or as Bryan & Smoke have done forget the AR & just look for ~73 credit WUs
I'm gonna see if I can find the info RD gave me about finding out how to 'grab' a WU.
Comments? questions?
*Credit vs WU AR, times for my Q6600 @3GHz, AKv8 SSE3 app
73.82 cred WU, AR 0.389979 (4165s)
73.82 cred WU, AR 0.390045 (3965s)
73.82 cred WU, AR 0.390062 (4342s)
73.71 cred WU, AR 0.390654 (4382s)
73.61 cred WU, AR 0.390944 (4376s)
73.59 cred WU, AR 0.391073 (3927s)
73.50 cred WU, AR 0.391539 (3924s)
73.50 cred WU, AR 0.391472 (4513s) #
73.40 cred WU, AR 0.392135 (3911s)
73.33 cred WU, AR 0.392577 (3789s) #
73.32 cred WU, AR 0.392662 (4478s)
73.27 cred WU, AR 0.392925 (4392s)
73.23 cred WU, AR 0.393219 (4500s)
72.78 cred WU, AR 0.394307 (4391s)
72.75 cred WU, AR 0.394542 (4046s)
# Biggest time difference ~720s (12mins) ,average those 2 (4151) & it's a variance of about +/- 8% ,hmm not good! Still it's better than RAC.
We definitley need a benchmark WU for accurate scoring though.