forum

Staff ratings--a new category for beatmap rating

posted
Total Posts
6
This is a feature request. Feature requests can be voted up by supporters.
Current Priority: +0
Topic Starter
D33d
I've been sitting on this idea for a few days while considering how best to articulate this, so I think that I'll try to explain it now. I'm sure that people here are aware of the division of ratings in sites such as Metacritic and gdgt, with separate categories for "official" ratings and user ratings. I believe that such a system could give a better indication of map quality, as *AT members have a very thorough understanding of what makes a map good.

Basically, the outcome of this would be that user input is retained, but then a separate rating would be given by those who are given extra recognition for being able to judge a map's quality. I know that this seems like I'm saying that the average player or mapper doesn't know enough about a map to rate it accurately, but think about it--it seems to be widely agreed that many user ratings aren't fair indications of the map itself, e.g. they're given based on the song alone, the fact that a certain mapper's popular or the fact that there's something complicated in the map that makes them sore enough to vote 1.

I decided to offer this suggestion after many discussions about the general quality of maps, the fact that low votes almost never seem to be qualified and the fact that it's quite an ask to give everybody a 1-10 scale to vote. Ragevotes and overzealously high ratings aside, different people have their own ideas of of which numbers mean "average/poor," "good/very good and "excellent/almost perfect." With a separate category that's based on the input of the mapping teams, it could become a part of their responsibility to weigh up their opinions on a map with a decent amount of thought, before casting a vote.

On top of that, I think that it could even be good to simplify user ratings to a +/- system, thus showing a more direct indication of who liked and disliked a map (5 stars seems to count as negative voting, even though it usually implies "average," while 6-7 is also some people's idea as "average" or "poor"). The staff votes could retain the ten-point system, with the staff being entrusted in being more picky with their ratings.

As this sort of system is implemented in a significant amount of journalism sites and aggregators, I see no downside to using it in this game. For want of a better word, a "professional" input could potentially give a better indication of a map's quality, or at least an indication of what staff members prefer in maps.

I apologise if this is too long-winded, but I wanted to cover enough ground to substantiate my point. If any of this is confusing, then please ask me to clarify specific points. I think that this could be a boon for helping people to choose maps to download.
deadbeat
can't believe i read all that
sounds interesting. it does bother me a lot that a lot of people rate maps based of things like song/source/mapper ;__;
Topic Starter
D33d

deadbeat wrote:

can't believe i read all that
sounds interesting. it does bother me a lot that a lot of people rate maps based of things like song/source/mapper ;__;
If you feel like reading a bit more, check out the pages that I linked, especially the Metacritic page--I believe that it illustrates my point quite well. While there are many balanced and fair reader reviews, there are a notable amount of those with terrible reasons for rating 'Bioshock: Infinite' 0-1 or 9-10. With that amount of user input, there is always going to be a lot of chaff to cut, ergo it doesn't take long for overall ratings to become skewed.

Here's my favourite pearl of wisdom:



It's like calling a beatmap horrible because it uses a pre-established structured style!
TheVileOne
I don't think the staff's opinion is that reliable. Also I don't feel very comfortable letting people be super- critical of my maps. A bad review would severely affect how many download your map. By keeping the ratings relatively similar you remove negative bias. I value neutrality more than accuracy.

I think it would be more accurate if ratings were more relevant. You can't rate 10 based on song choice if the options are Variety, Originality, Gameplay, and Balance. Make it more complex would give less incentive to give a careless rating and promote people to think about the important parts of the map. But my idea is entirely not related to yours.
Topic Starter
D33d

TheVileOne wrote:

I don't think the staff's opinion is that reliable.

I think it would be more accurate if ratings were more relevant. You can't rate 10 based on song choice if the options are Variety, Originality, Gameplay, and Balance. Make it more complex would give less incentive to give a careless rating and promote people to think about the important parts of the map. But my idea is entirely not related to yours.
Adding some sort of complexity could either make the ratings more accurate or turn away most people from rating at all--that could be risky. Even an all-around simplification of the rating process could be an improvement.

As for the staff's opinion being that reliable, if that's really the case, then why are they staff in the first place?
Soaprman
I think this would be pretty nice. Put the person's name next to their rating so we can find out which staff like the maps we like and follow their ratings on other maps.
Please sign in to reply.

New reply