[TO DO] Anirec - Average Rating (trusted users)

[sothis]

Feature List
---------------------
1. Average rating displayed in anirec entries, based on a set of trusted users
2. Users can nominate themselves or others to be added to the subject group
3. Staff will determine the initial group


Description
---------------------
Anime-Planet will not offer a standard average rating (which takes the scores from all user ratings and averages them). These systems are almost always abused, are tarnished by users who rate everything a 4 or 5 (or in general don't have a balanced range), etc.

We have decided to offer a different version of the average rating. Similar to "sugoi" members (a feature that is being revamped to cover more users), we will have a trusted set of users that are known to give fair and balanced range of scores. The average of these users' scores will be displayed in the anirec entry.

Users will have the ability to nominate themselves or others to be added to the list, and others will be added by default based on staff recommendation.

Regular users will still be able to give their own score, which will show up in their personal anime list for themselves or friends/random people to see.

[Tessa]

It's a good ideeea, but still, I don't think that a staff's opinion should be more realistic than a normal user opinion. I agree that there are users that give only 5 and 4, but there are also a lot of members who don't do that, and still are not observed because they just don't like to stand out.

1. Average rating displayed in anirec entries, based on a set of trusted users

I think this is a discrimination. Not you, or I, or anybody else cand chose who is better to fit in this group. Not to mention that opinions and tastes are verry various from person to person. The real score is the one given by all of the population, not just the "elite" ones.
Of course, that's just an opinion. Pls, don't take it personaly @.@

[sothis]

nobody said trusted users are only staff. there are many sites out there who have a system lilke this... yelp.com, for example, has "elite" users who are either nominated or elected by a group on the staff.

i disagree that people cant choose who would fit best into the group. i look at some people's anime lists and see every single anime rated a 5 - how is this balanced/fair, and how does it help anyone if all that does is bump up the rating? i've talked to people before about their ratings and their answer is something stupid like "i like everything i watch, so i rate it all a 5".

we are bypassing that, by only putting up a select group.

this is how statistics work too.. when you hear statistics on the news, on the web, anywhere - they aren't polling every person in the country. they use a target group of a few hundred or maybe a few thousand people, and assume that those people represent a wide sample of the population. they then say "20% of [insert country here] thinks that [whatever]"

people will be put on this group in one of two ways: either i or someone on the staff has noticed the person doing great work (and visually, from their anime list, it appears they give a fair and balanced spread of scores - not only just not giving everything a 5, but also, for example: what if the person rates every single romance anime a 5 because they like the genre? that person would probably not be a good fit to give average ratings for the community); or, we'll have a nomination form where anyone, including you, can nominate yourself or someone else. if they dont like to stand out, there's not much i can do - but that's how it works on a lot of sites. if someone really wants their opinion known and gives a fair spread of ratings, they can nominate themselves.

i would argue if we do the "real score" it will be a popularity contest, and filled with terrible ratings by people who don't fairly give things a score of 1-5 - and i dont want that on anime planet. you call it elitist, i call it keeping up the quality of content on the site, and giving people information they'd actually want.

[Drahken]

On the contrary. It's quite obvious that someone whose ratings are all at one part of the scale cannot give a realistic rating. In contrast, someone who has ratings spread fairly evenly throughout the scale, with some more toward the middle than toward either end, is clearly giving a more realistic rating to everything. Now it's true that everyone has their own preferences & one person might rate all mecah anime as 1.5 simply because they're mecha, while another might rate them all 5+ simply because they're mecha, anyone whose ratings are spread across the spectrum is much more likely to have realistic ratings overall (even if they are biased on a few). Also, it's quite probable that the group will include both a lover & a hater of each genre, thus balancing out their scores & rpoviding a more realistic all-over score.

[sothis]

i think the main key here is that it wont just be a group of 10 hand selected staff members. it's true that probably my site reviewers or anyone i know (who still has a good spread) will be chosen, but that's just because i know most of them give a good range of scores. the submission process makes it so it's not closed only to a select few - and it also means people will hopefully be motivated to not rate everything a 5 or a 1, as that disqualifies you.

[VivisQueen]

Considering the only criteria for selection is that you have a reasonable spread of ratings, this should easily make a sizable part of the AP membership eligible. In the end, for most people, it'll probably just be a matter of nominating themselves. Or that's what I'm guessing anyway.

[Tessa]

I understand your point of view.
So then, how many ppl are there going to be in this elite group?

or, we'll have a nomination form where anyone, including you, can nominate yourself or someone else.

Will my nomination be taking in consideration just as a moderator nomination?
P.S.: nominate yourself??.....I wouldan't do that. I don't know how others are, but if nobody notice me then that just means I'm not sutet for the job. [I know right now I'm contradicting myself ^^].
I still feel a bit sorry for the other users. There are kids that don't even know that the way they rate matters. So they rate just like that: all 5 (for exemple). Still, I haven't seen not even one persone like that O.O. Seriously.


On an unrelated mater: Got new set! yey

[VivisQueen]

Originally Posted by Tessa

I understand your point of view.
So then, how many ppl are there going to be in this elite group?

Will my nomination be taking in consideration just as a moderator nomination?
P.S.: nominate yourself??.....I wouldan't do that. I don't know how others are, but if nobody notice me then that just means I'm not sutet for the job. [I know right now I'm contradicting myself ^^].
I still feel a bit sorry for the other users. There are kids that don't even know that the way they rate matters. So they rate just like that: all 5 (for exemple). Still, I haven't seen not even one persone like that O.O. Seriously.


On an unrelated mater: Got new set! yey

Going by what sothis says, WHO you are doesn't matter at all. HOW you rate is what matters. If a moderator nominates someone who can't rate reasonably, and you who supposedly has never been noticed nominates yourself and you rate reasonably, then your nomination will count over the moderator's. It doesn't matter who you are.

Also, whether or not you are noticeable as a member has nothing to do with whether you rating is valid or not. It's not about 'elites' who are special in some way or like 'sugoi' members having special privileges. It's about catching those who rate reasonably. I am presuming that you could never post a damned thing on this site, nominate yourself, and when sothis sees your ratings are good, you will be selected.

Initially the group will seem small, but as more and more people nominate themselves, it'll probably start to incorporate a large section of the population. If people don't nominate themselves just because they think 'I'm not noticeable' then that's their problem. And actually kinda sad.

[sothis]

tessa, your way of thinking seems unreasonable, and perhaps it's because you aren't aware of the site statistics... you are saying that people NEED to have noticed you in order for it to be ok?

we currently have 24,754 active users on the main site - it's growing at a rate of about 140 users per day. 1,686,431 anime have been added to people's personal anime lists. by th etime you read and respond to this, that number will have gone up a lot.

are you telling me that you expect that either me or one of the site staff will have somehow found the time to go to 25,000 profiles, look carefully at every page of the person's anime list, and determine that they are a good person for the rating system?

come on, that's just silly :p

in a perfect world, or in a community of 100 users, sure, you might be noticed. btu that's not how it works on big sites. if you want to be noticed, you make yourself be noticed. there's a reason why i don't go onto my personal myspace and see 75,000 friend requests... unless someone found me through a friend, or i posted on a specific usergroup and someone had a reason to come check me out, i can't expect to bbe noticed.

there is absolutely nothing wrong with clicking a button that says "i'd like to be added to the ratings group". your scores (and ONLY your scores) will then be looked at, and you'll be added or not.

and it's not our (or your) problem that people rate things badly :p if they rate all 5s, their opinion wont help anyone looking for accurate info, and they shouldn't be included.

furthermore, your post seems to imply that there will be favoritism on the part of the moderators, and that's kind of offensive to me. i think i've always made my stance very clear and fair, and try to include everyone. i will not add people just because a moderator said so - i will add people whose scores are fair and balanced, period.

[Tessa]

My intention was definatly not to offend you. If I sounded that way: I'm verry sorry. The thing I'm more sorry about is that you actualy belive that I could offend somebody. I asure you is not my style.
The thing with the staff was just what I misunderstude because of the first post witch was rather confusing. Or maybe I'm just stupid. Sorry.