Let's test this rating thing.

Page 2 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

RaDragon

Diamond Member
May 23, 2000
4,123
1
71
ok, back -- i'm not sure if this works but here goes:

it looks like this rating system is being averaged.

so, let's say Paulson's first rating is 10 (cuz he likes himself ;)), and Red Dawn comes in and rates Paulson a 1. That will make Paulson's rating drop to 5.5 (but it looks like the forum's not using any decimals, so it's an even 5). Then let's say that Lozer is resurrected from the banned list, and vents by rating Paulson another 1. So that's 3 votes now. 5 + 1 = 6 (sum of the rating) divided by the number of votes (3) equals 2. So now Paulson's total rating will become a 2. Let's say another member decides to give him a break and gives him a 10 -- 2 + 10 = 12/4 = 3 (Paulson's rating jumps to a 3)...

average rating = sum of ratings (i.e., current rating + new rating) / number of votes

-- use my rating as an example to see if the formula above works. make sure to make a note of my current rating, and the number of votes (last i checked it was rating=5, votes=2)...if the next person who gives me a 1, i'll end up w/ a rating of 2.
 

Russ

Lifer
Oct 9, 1999
21,093
3
0
RaDragon,

It's not working that way. Past a certain number of raters, it starts dropping even if all tens are given.

Russ, NCNE
 

Adul

Elite Member
Oct 9, 1999
32,999
44
91
danny.tangtam.com
lets try his formula russ

new avg = my rating + new rating/votes

new = 1 + 10 / 10

new = 1.1 or just 1

it seems to be right Russ
 

Viper GTS

Lifer
Oct 13, 1999
38,107
433
136
RaDragon...

While you're onto the right idea, that's not quite right. With that equation, the numerator of the fraction can never be larger than 20. So at 20 total ratings, EVERYONE would be at a one, even if they'd gotten 10's all along. Zuni still has a relatively high average, even with ~30 ratings.

The general idea seems to be along the right track, though. You need to take it out to longer lengths to test it, though. This particular equation fails at 20 for sure, so it's not right.

Viper GTS
 

Russ

Lifer
Oct 9, 1999
21,093
3
0
Adul,

Of course on a simple equation like that, it's fine. But, let's look at Zuni's:

He started with:

A rating of 8, based on 20 users, or a raw of 160. Now, assume all did as they were told, and gave him a 10. There have been 18 new raters (he's now at 38), so that would be:

18 x 10 = 180

Add these together:

180
160

We have 340 divided by 38 for for 8.94, rounded, that would be 9.

Yet, he has dropped to 5 since the experiment began.

Russ, NCNE
 

RaDragon

Diamond Member
May 23, 2000
4,123
1
71
ok, my bad, i didn't explain the equation as well as i wrote it :(

here goes...

average = sum of ratings / # of votes

if 19 people gave me a rating of 10

the sum of ratings = (10 * 19 people) = 190

then if the next person (20th person) votes another 10

190 + 10 = 200

so the sum of the ratings is at 200 / 20 = 10.

? i'm confused, so please tell me if this makes sense. :)
 

BigToque

Lifer
Oct 10, 1999
11,700
0
76
ok, i posted my thread before i saw this, and i aint getting any answers there...

what exactly is this rating thing for?
 

ElFenix

Elite Member
Super Moderator
Mar 20, 2000
102,402
8,574
126
i just gave a ten... i wonder what happens if we all gave nines...
 

reitz

Elite Member
Oct 11, 1999
3,878
2
76
Dennis, I just dropped you to a 2. Sorry, didn't mean to; I clicked the friggen button instead of the drop-down menu :eek: My bad :eek:
 

Viper GTS

Lifer
Oct 13, 1999
38,107
433
136
Prodigy...

Even if they'd all given him one's, it shouldn't have affected the results like that.

8*20=160
1*18=18
160+18=178
178/38=4.68...

Wait a minute... The effect of us all giving him 10's was close to us all giving him one's...

Interesting...

RaDragon...

That's the way it SHOULD be figured. But obviously it's not being done right, since any & all ratings past a point have negative effects.

Viper GTS
 

Russ

Lifer
Oct 9, 1999
21,093
3
0
RaDragon,

That's the way it should work.

prodigy69,

Even if only half have him the 10, and the other half gave him a 1, if the formula was as it should be, we would not have seen a drop to 5.

Russ, NCNE
 

ElFenix

Elite Member
Super Moderator
Mar 20, 2000
102,402
8,574
126
i think we should try 8s or something. see what that does.
 

BigToque

Lifer
Oct 10, 1999
11,700
0
76
I doubt the equation is difficult at all.

sum of user ratings / number of votes.

all your results are messed up because people may be giving 4s when they are saying they are giving 10s.

the only way to control an experiment like this would be to make like 15 acounts and vote on a test account. this way, you know exactly what votes were given, how many votes were given, and what the average is.
 

Viper GTS

Lifer
Oct 13, 1999
38,107
433
136
To make it even worse, Russ, I'm on 56K dial up.

:p

Stefan...

The results don't make sense no matter what. Even if you assume we have a bunch of aholes helping us with this experiment, & they all give ones instead of tens, they shouldn't impact things the way they are.

Viper GTS
 

Russ

Lifer
Oct 9, 1999
21,093
3
0


<< all your results are messed up because people may be giving 4s when they are saying they are giving 10s >>



Stefan,

That argument doesn't work. Even giving 4's would not have dropped it this dramatically. Beyond that, we have too many users who have dropped all the way to 1 as more people have rated them.

To believe that the system IS working correctly, is to believe that everyone here HATES everyone else.

Russ, NCNE