forum

A skill-based player rating system [added]

posted
Total Posts
62
This is a feature request. Feature requests can be voted up by supporters.
Current Priority: +8
Topic Starter
Gerbator
While the current player ranking works fine in single player mode, I find it to be pretty useless in multiplayer mode, as it barely relates to the actual player’s skill.

I would love to see in osu! a multiplayer mode player rating based on skill, like the ELO rating system used in chess or something similar to Microsoft TrueSkill. My suggestion isn’t about replacing the current ranking system (it would be bad imo, as many players spent a lot of time grinding the ladder), but creating another one that could be used to look for players as (un)skilled as you are, or to develop competitive gaming.

Of course, it’s easier said than done. Being a developer myself, I couldn’t help thinking about how an ELO rating system could be tweaked to match osu’s gameplay, so I thought I’d share it, hoping that it helps starting some thinking about it (I actually don't care about THIS suggestion being accepted, I'd just like to see a skill-based rating ^^).

Note: this post being a wall of text, I used spoiler boxes to make it look like it’s not. That’s just an evil trap to make you read what you probably wouldn’t otherwise :twisted:


The problem

SPOILER
First, here’s what I think to be the main problems for an osu! adaptation of these algorithms:

1) Unlike chess games, there is no clearly a winner or a loser in osu multiplayer games. Here’s some examples:
- Player A gets 15.1M points and player B gets 15.2M. While the player A won, it can also be considered a draw.
- Player A misses 2 hits and get 6M points with a 98% accuracy, while player B gets 15M points with a 98% accuracy as well. No doubt player A lost, but due to the similar accuracy, there’s uncertainty about player B being better overall.
- Player A gets 6M points with a 99% accuracy and player B gets 15M points with a 95% accuracy. Cannot say for sure who’s better here…

2) Beatmap choices cannot be ignored either. Here’s some other example:
- A 4-star map isn’t relevant to rate good players, but a DT+HR 4-star map can be.
- Newcomers will obviously fail on impossible approved maps (e.g. Shotgun Symphony+). While it is possible to assess that a player who got 50% accuracy is better than another that got 40%, it’s too “borderline” to reflect the overall skill of the players.
- Player A never played a beatmap while it’s the 100th play for player B => their results cannot be compared directly.
- Some beatmaps are about streaming, other about speed or “chaos”…

3) Osu! Games are less predictable than strategy ones. Being heavily based on concentration and reflex actions, sneezing = loosing, whereas it’s not a problem in strategy games. It might have to be taken in consideration.


My suggestion to get it working with osu!

SPOILER
Considering all these points, I thought about some tweaks to the ELO rating system that could possibly work.

The general approach might look counter-intuitive: it would be about rating beatmaps, not players. Players wouldn’t be rated based on a comparison with other players, but on their performance relative to the beatmap they played on. Basically, if you S-rank a hard beatmap your rating increase, and conversely, if you get a A-rank on an easy map you were supposed to SS, your rating decrease. The reason is actually pretty simple: osu’s multiplayer mode plays like the single mode. There’s nothing like strategies to get the upper hand, besides hacking the opponents computers or making their phone ring in the middle of a combo-breaker :lol:
As a result, beatmaps should be considered the main opponent in a multiplayer game as well.

Here’s an example of what it could be in a 4-player game results:

The beatmap: an average Insane map, with a 5-star rating, and a ELO rating of 1800 people don't know of.

The players:
- Cyborg-like player: he is rated 2300 ELO, and he achieved a S-rank (8,500,000 points, 99% accuracy).
- Newcomer A: he is rated 1100 ELO, and he failed (300,000 points, 70% accuracy).
- Newcomer B: he is rated 1200 ELO, and he achieved a A-rank (3,100,000 points, 93% accuracy).
- Average/good player: he is rated 1700 ELO, and he achieved a S-rank (8,300,000 points, 95% accuracy).

The rating would be considered this way:
- “Cyborg-like player” did what he was expected to do: he has beaten the beatmap effortlessly. The beatmap was too easy for him, so its rating won’t change.
- “Newcomer A” did what he was expected to do as well: he failed badly. His rating won’t change, and the beatmap rating won’t change either.
- “Newcomer B” did a good job in getting a A-rank on this map, considering his low rating. His rating will increase, and the beatmap rating will decrease.
- Considering his rating, “Average/good player” was expected to get something like an A-rank, but he S-ranked. His rating will increase as well, while the beatmap rating will decrease.

Some other things that might have to be considered:

- The play count on the beatmap. Some “chaotic” patterns can make even skilled players fails at FCing easy beatmaps on the first attempt. It shouldn’t be as hard on the rating as failing on the 100th attempt. Conversely, SS-ranking a beatmap at the 100th attempt shouldn’t be valued the same as doing it on the first attempt.

- A skilled player gets better score overall, but he/she also get better accuracy. Both score and accuracy should be considered.

- Mods. Calculating the impact mods have on beatmap ratings might prove to be impossible. Having accurate ratings on unplayable beatmap/mods combinations might be impossible as well. I have no satisfying solution about that.


What I think to be its main "selling points"

SPOILER
As you can see, players are not rated between themselves, and I think it has numerous advantages:

- First, it solves the problems related to beatmaps being too hard or too easy. For example, beating hard 5-star beatmaps like Shotgun Symphony+ would be more rewarding than beating “easy” 5-star ones that thousands people could SS on their first attempt. With the current star-rating system, there’s no way to set hard 5-star maps apart from easy ones.

- Top players wouldn’t be too much “afraid” of playing with average players who could potentially beat them on easy maps (e.g. getting 100% accuracy instead of 99.8%) and “steal” their rating points.

- Being exclusively based on player/beatmap comparisons, the rating algorithm would work in single mode as well. It would be really useful for beta testing purpose: everything could be tested in real conditions without the players even knowing it. If the first implementation sucks, no player will be hindered. Using the rating algorithm in single player mode could also make easier the rating of old beatmaps that only a few people know of.

That's it! I look forward to your feedback, be it about my suggestion or the ugly English mistakes I probably made ^^
anongos
3) Osu! Games are less predictable than strategy ones. Being heavily based on concentration and reflex actions, sneezing = loosing, whereas it’s not a problem in strategy games. It might have to be taken in consideration.
Unfortunately, there is absolutely no way of knowing whether a player is just having a bad day or if he/she was genuinely distracted by something during play. There are some ways of being able to deduce it, like seeing what the average performance of a player is on a certain beatmap, then comparing it to the play when the player gets a distraction.

For example, let's say we split beatmaps in sections, then monitor where a player is at in terms of accuracy and points at the end of each section. Say the player finishes it with an accuracy of "A" and a total score of "B" on a section. Then while playing that beatmap again, for some reason, the player has a considerably lower accuracy and total score instead of usual on that same section. That could be considered being distracted instead of simply playing poorly. It should still reflect on the player's rating though, albeit much less than just simply playing poorly. That's because this mechanic can easily be manipulated if the play does not count toward the overall rating of the player. If it's not counted, a player can simply do bad (i.e. not touch anything at all) if he/she had a bad start, and it won't count against them.

Anyway, I've been hoping for something like this before. The only other way to make the ranking system work IMO is to have every player play every single ranked song. And we all know that it's never going to happen.

+1 support
Avedas
Yes.
waterfall
I think most people would agree that the current ranking system is not that good at representing the true skill of players. The problem is, the system for ranking beatmap difficulty is equally bad. This method seems to rely on beatmaps being ranked correctly in terms of difficulty. If that does not happen, I'm not sure how well this will work, especially given the number of 5 star songs that are extremely divergent in terms of how difficult they are.

That's just a first impression though,
Cheer-no
It would probably be a lot more balanced if the map ranking was decided by BATs upon ranking. The big problem with that - who would want to go back and determine rankings for 15,000 maps?
Topic Starter
Gerbator

waterfall wrote:

I'm not sure how well this will work, especially given the number of 5 star songs that are extremely divergent in terms of how difficult they are.

Cheer-no wrote:

The big problem with that - who would want to go back and determine rankings for 15,000 maps?
You didn't get what I was trying to say (or I explained it poorly ^^). An ELO rating of players and beatmaps wouldn't be based at all on the current beatmap ranking. A beatmap would be rated the same way players are. For example:
- if a player get a S-rank on a beatmap, it is considered the beatmap lost against this player (the beatmap rating can possibly decrease).
- if a player get a A-rank on a beatmap, the beatmap won against the player (the beatmap rating can possibly increase).

Thus, if S-rank are generally achieved by players rated > 2100 ELO, the ELO rating system will make the beatmap be rated 2100 ELO.
Conversely, if a player can barely get a S-rank on the beatmap (e.g. he/she FC with 93% accuracy), he will probably be rated about 2100 ELO as well.

There's a two-way relation between players rating and beatmaps rating, so no need to rate anything manually as this is what the ELO or TrueSkill rating systems are made for.

ps: anongos, I'll answer you later, I have to logout ^^
Waryas
Don't forget some players play with mods only.
anongos

Gerbator wrote:

Thus, if S-rank are generally achieved by players rated > 2100 ELO, the ELO rating system will make the beatmap be rated 2100 ELO.
Conversely, if a player can barely get a S-rank on the beatmap (e.g. he/she FC with 93% accuracy), he will probably be rated about 2100 ELO as well.
One more question: What will be the starting/reference point? What would constitute someone to get a rating of 2100? The way I see it, your description is when people and beatmaps generally have established ratings already. Remember that we would have to first set a solid standard for this before people and beatmaps would be able to figure out what their rating is.

Don't worry about replying fast. I can wait. (Have to go to sleep anyway. lol)
Luna
The problem that I see is that there are some maps that are really, really easy to beat but have one stupid pattern where even good players can easily miss. Thus, if for example an A counts as a loss, the ELO for the map would be artificially inflated when a few highly-rated players miss in that section. Or maps like Wizards in Winter where it is literally impossible to achieve an S despite the map being rather easy.
Point is, it's really difficult to determine the exact border between "win" and "defeat" because there are so many factors. Score, Rank, Accuracy, experience with the map, different beatmaps being challenging in different areas... Of course, there is mods as well.

But in general, if a good win/defeat algorithm can be developed, this would be awesome :D
Cirno

Gerbator wrote:

There's a two-way relation between players rating and beatmaps rating, so no need to rate anything manually as this is what the ELO or TrueSkill rating systems are made for.
Newly ranked beatmaps should, however, have an initial rating. If there is no initial rating, a large number of plays have to be devoted to "determine the initial rating" and leave no impact on player ratings. In this way, players will be discouraged from playing newly ranked maps :
Most people (especially good players who care about rating) will just wait until the map reach the rating-determining play count, and then play in order to get ELO rating. Thus players will gradually move their focus onto old, "already rated" maps, and the whole thing about mapping new stuff would be meaningless since few will play them.
Shiirn
Long story short:
There are too many aspects to osu! gameplay to quantify "skill" in a single rating system, and even if you COULD simplify them as such, there would be no efficient way to organize or base those ratings against other players.
Topic Starter
Gerbator

JesusYamato wrote:

Don't forget some players play with mods only.
Yeah I know you love HR :lol:

Actually, I think it can be dealt with. If beatmaps would get a rating for each mods combination that have been played, it would just make the rating of mods players a bit slower as every map wouldn't be rated easily.

_Void_ wrote:

The problem that I see is that there are some maps that are really, really easy to beat but have one stupid pattern where even good players can easily miss.
You've got a point. In my original post I said S-rank = win and A-rank = lose to makes things easier, but as you said it could use accuracy as well. And while the ELO rating system is limited to win/draw/lose, it's possible to detect whether the player is a clear winner/loser or not. The rating update could be weight accordingly.

Anongos and Cirno wrote:

[...]
okay then, I’ll try to be a bit more specific about how the algorithm works, but it might look a bit weird as I am not used writing math stuff in English.

First, one of the key point of the ELO rating is that it produces ratings that looks like what’s called a Gaussian or normal distribution (here’s one). In the image I linked the curve is centered on 0 and values above 4 or below -4 are rare. In chess, ELO ratings looks the same, but the curve is centered around 1200 (it’s the ELO rating of an average player), and values above 2500 ELO are rare (grandmasters).

The point is in chess, strategy game or whatever, there is always a large majority of average players, and a few exceptions (extremely bad or good). If look at the IQ of a population, you will get the same kind of distribution (centered around ~100, with few people above 130 or below 70). Well, I was trying to say that gaussian distributions are everywhere, not only in ELO ratings.

Enough theory, here’s an example: let’s suppose we start a rating similar to chess game in osu!

Step 1: all players and beatmaps are given 1200 ELO. It’s a “provisional rating” that will change really fast in the first games.

Step 2: First games are played. When a map is beaten, the player rating increase and the map rating decrease, as I said in the original post. After a few games (it’s really fast actually) and ratings updates, ratings distribution will look like the Gaussian distribution I linked you. The players skill will be approximately known, as well as beatmaps difficulty.

Step 3:
When players whose skill is known play against beatmaps whose difficulty is known, the ratings are still updated, but at a slower pace.

Now, ratings are set.

A new map is ranked! What happens?

- The beatmap is assigned 1200 ELO. It will also be a “provisional rating”. In the first games played on this map, the map rating will increase/decrease faster than usual, but the established players ratings won’t be increased or decreased (it would lead to what Cirno described).

- When the beatmap difficulty is approximately known (it would be really fast for new ranked map as only ~20 play are needed), its rating will be set to “established”. From now, players rating will be updated when they play this map.

A new players appears! What happens ?

It’s the same than beatmaps actually. As long as the player’s skill rating isn’t established, the rating of beatmaps he/she plays on won’t be increased or decreased.

Shiirn wrote:

Long story short:
There are too many aspects to osu! gameplay to quantify "skill" in a single rating system, and even if you COULD simplify them as such, there would be no efficient way to organize or base those ratings against other players.
Yeah, obviously skill cannot be perfectly represented by a number, but ELO ratings work pretty well though. You know about Starcraft II? It’s a strategy game with 3 very different races (Terran, Protoss, Zerg) and a lot of maps that alter the strategies you can use. Depending on the races combinations and the maps, the player’s skill vary greatly. Yet Starcraft II uses a modified ELO algorithm for its leagues and matchmaking system, and it works pretty well (actually, most of the game's matchmaking features are based on ELO or other similar rating systems).
samuel_old
nice idea +2 support
Kokizi
Basically what I do atm to determine one person's skill is look at their profile. the historical stats and playcount+ranked score give good clues as to how good a player is IMO.

I think this one is a pretty good feature if implemented, will give support when I'm capable to do so.
anongos
OK, now I see how it works. I didn't think it wouldn't work since there are plenty of established ways for it, we just need to tweak it to fit osu!. I was just curious since I've had no experience with any skill based rating system.
Cyclohexane
Not true everytime though, Kokizi, just look at me, my PC just broke so I'm probably not gonna get on osu! for a very long time (1 year at most) so my rank will decrease and my playcount will stay the same, while my skill won't decrease overtime (I'm not pro enough to actually lose skill if I don't play regularly).

That's why I kinda see the point of this idea and think it would be a good feature in osu!, but it seems fairly complicated to put in place.
KRZY
I like where this is going, well done :)
anongos

Mr Color wrote:

but it seems fairly complicated to put in place.
Well, yes. It is pretty complicated, but we have the advantage of looking at how other games with skill-based ratings implement theirs. There is already a bunch that is established, we just need to see how they do it then tweak it for osu!.

I don't think I'm the only one that doesn't like the current ranking system. I can see some players that play worse than I do, and yet they are like 400 ranks above me.
dvorak_old
Multiplayer basic rating system isn't hard to implement,but easy to abuse with current osu!
If there good solution for multi-account abuse , we will see in near future.

proxy?, only 1char from unique IP , pena for friend game abuse, song limit, class system, etc etc.


It is good to discuss how to make good system or idea for basic calculation :)
Waryas
How about a special MP ranking which is like ESO based on players versus players.
Backstabber

JesusYamato wrote:

How about a special MP ranking which is like ESO based on players versus players.
Topic Starter
Gerbator

dvorak wrote:

It is good to discuss how to make good system or idea for basic calculation :)
Yes!

anongos wrote:

Mr Color wrote:

but it seems fairly complicated to put in place.
Well, yes. It is pretty complicated, but we have the advantage of looking at how other games with skill-based ratings implement theirs. There is already a bunch that is established, we just need to see how they do it then tweak it for osu!.

I don't think I'm the only one that doesn't like the current ranking system. I can see some players that play worse than I do, and yet they are like 400 ranks above me.
Does anyone know of a rhythm game with a skill rating system?

JesusYamato wrote:

How about a special MP ranking which is like ESO based on players versus players.
While I know that's how it's done in most games, I thought about a player vs maps ratings for the following reasons:

- Rating players and maps in single player or multiplayer mode wouldn't make any difference: developers could use millions of single player games to beta test the multiplayer rating system efficiently. That wouldn't be possible with a player vs player rating system.

- Friends of very different level could play together: even with a high rating player winning every game, other players could increase their ratings as long as they beat some beatmaps.

- I think using beatmaps to rate players would make their ratings more stable. In the following example, A player vs player rating wouldn't work well:

Player A can:
- FC with 95% accuracy "easy" 5-star beatmaps.
- Get random and extremely low results on the hardest approved beatmaps (using "no fail" mod).

Player B can:
- FC with 90% accuracy "easy" 5-star beatmaps.
- Get random and extremely low results on the hardest approved beatmaps (using "no fail" mod).

Given their skills, easy 5-star beatmap plays are best suited to rate these players, and playing these maps, player A would be given an higher rating. But if they prefer playing beatmaps they can't beat:
- A player vs beatmap rating system would "know" these players aren't skilled enough to beat the maps. They would be expected to fail and they would fail => No ratings update.
- A player vs player rating system woud see random results (because it's much more random when you play beatmaps you're far from being able to beat) on a 5.00-star beatmaps like any other => the only fact that would be considered is that a player got 50,000 points while the other one got 100,000. Ratings would be updated, and that's bad imo. On an other map it could have been totally different.

I chose an extreme example to make things clear, but I think it would be a problem in any play on a too easy/hard beatmap. Any counter example?

ps : actually I think player vs player rating system would be feasible, but it would possibly be much harder on the dev team side.
anongos

Gerbator wrote:

Does anyone know of a rhythm game with a skill rating system?
That's not what I meant, but I get your point.
-----
Really interesting idea ;)
Too bad I ran out of my star :(
Ussuru
SPOILER
I get giggles when 1k rank player is worse then me, while he is having a good day. But I am actually sad because no way in hell I am going to play 5k easy songs, you know. And I think some people would agree with me, we just don't like easy maps, we like failing again and again until we pass a song. It's more rewarding to get 1kk here then 8kk here. And even the dumbest person on Earth will understand who is a better player, while the worse one will have an x8 point advantage. While most of people who plays on multi look at top 40 on maps and participate in marathons, tournaments and such know who is good at what but still, sometimes it is just sad.

tl;dr I kinda agree with you, though I have no idea how to improve the ranking system of yours.
Wishy
Problem is:

How do you judge how hard a map is? Some players suck at certain ARs, some others suck at streams but are incredibly pro at jumps (and the other way around). Some are really good at playing no mod but fail horribly whenever you add a mod, while there are some others that can FC maps in a single play using Hidden, HR or DT... there are lots of factors that you have to think about to see how hard a map is. And it's not like each mod is harder than the another one in every map, some maps are damn hard to do with hidden and some others (most) are just like playing no-mod, while the same can be applied with HR, there are many maps where HR actually makes the map easier since the circle size/AR is horribly low, and well DT always makes the whole thing harder but there are tons of maps that are so damn easy (even insanes) that DT just makes them fairly hard.

Your idea is quite good and stuff, but then again you have to think about what's harder, to FC an insane map or to clear it with a C using DT for example. In many cases some players can FC easily some insane maps with HR, but they get somewhat bad accuracy, but I personally think that's way harder than getting the S no-mod since it requires way more skill. Idk there are lots of factors you got to think about and it gonna end up in people discussing what's harder or not. I think the best way to solve this is to just add a ladder system like W3 or SC (I guess) already have.

Some Player Vs. Player rating system would work, since better players usually get a better score than worse players, that's a damn fact and you can see that happen in every multiplayer room you see, played a lot of multiplayer myself and the ranking is usually pretty much the same, A goes #1 or #2, B goes #1 or #2 (maybe #3), etc. Of course maybe you go sneeze and fail the map because of that, but that won't happen all the damn time, even if you are unlucky in one match, you gonna win the rest of them probably. In every game there is a factor called luck, I hate it too yeah but that's how it works, you can't remove it at all, which is why making an 1v1 system would be just fine. Having played multiplayer games with lots of top/very good/good players, I have seen how top players always (ok, 99% times) get higher scores, and with higher I mean an huge advantage, than good players, maybe they have a little fight with some very good player, but still when you're better you usually do better than a worse player, and that's a fact.
Neruell
Just finished reading all the posts, and honestly I don't understand about what kind of rating system it suppose to be. Shall it be a pretty new feature or shall it replace some rating that we already have?
Wishy
Have you ever played any RTS? Or are you familiar with ladder systems? Well the idea is something like that.
Sakura
Ladder System i think its something like:
Each player starts at a certain ammount of points, winning a game against someone else will give them points depending on the difference in points between both, and losing a game will lose points depending on the difference as well:
Example 1: Player A has 140 points, and won against Player B who has 200 points, Player B has significantly more points than Player A so player A gains many points and Player B loses many points.

Example 2: same scenario but Player B wins, this time Player B wins a small ammount of points, and Player A loses a small ammount of points.
Is this the system you're talking about? havent heard it called ladder system before so i was wondering
Neruell

Wishy22 wrote:

Have you ever played any RTS? Or are you familiar with ladder systems? Well the idea is something like that.
Is it adressed to my question? It yes, then it didn't answer my question. I do understand the rating system which is suggested here but I don't understand "where" it will work at least if it shall replace something that already exists or if it will be parallel to an exisiting "ranked" score system.
Wishy

Sakura Hana wrote:

Ladder System i think its something like:
Each player starts at a certain ammount of points, winning a game against someone else will give them points depending on the difference in points between both, and losing a game will lose points depending on the difference as well:
Example 1: Player A has 140 points, and won against Player B who has 200 points, Player B has significantly more points than Player A so player A gains many points and Player B loses many points.

Example 2: same scenario but Player B wins, this time Player B wins a small ammount of points, and Player A loses a small ammount of points.
Is this the system you're talking about? havent heard it called ladder system before so i was wondering
Basically yeah, you got 1k rating the other guy has 1,1k you win you get like 30 points he loses 30 points, if the other guy had 99k instead of 1,1k and you win you earn 999999999999 and he loses 99999999999, it's basically 1v1 and it's name ladder game since that system was used by Blizzard in their RTS and got called like that (in W3 at least).

@Neruell: It doesn't matter if it does replace this ranked score system, I think both can co-exist perfectly you just got to add a tab to sort online users by rating and that's all. It could exist like a single button you can press to get a match against another player rated like you who's looking for a rated match.
Sakura
it can be done with multiple ppl too like in MKWii btw
Neruell
If it co-exist with the already available ranking system, then ok don't mind that one. If it should replace the already available "ranked" system then I am against it.
Luna
While most of the things that Wishy were correct, this topic doesn't request a 1on1 ladder or anything. It doesn't even want to compare players directly. Instead, it treats maps like players and pretty much becomes a 1on1 player vs map ladder. From the results of playing the map, the system decides who won (player or map) and then calculate their scores like Wishy explained. So if you FC a map that has a really high rating, your own rating goes up a lot. If you fail a map that's ranked way lower than you, you will lose a lot.
Wishy
Thing is what matters is how good you are compared to other players, which can be "calculated" by rating games between players. Both would work but it'd be way more fun to play against other players instead of doing the same solo thing but now in multiplayer (or wherever you want) where you have to farm plays to get a good rating.

A good way to determine how hard something is would be to base it in player's scores, like if you see a map where in 1 out of 500 plays someone gets FC, then that map should be worth more than another one where 1 out of 100 FCs. Problem is this can be abused, then you got the retry issue (of course you gonna take data from solo! most maps are pretty much never ever played in multi rooms), and the problem of underplayed maps where you will have really few data and, from my own experience, whenever I play one of those random beatmaps that are like you do SH and get top 3, I end up quitting after 15 seconds when I see how the map goes. Though this can be solved by filtering beatmaps from 2009 or before (yes most old maps are unplayable shit) and not letting them be "rated" in "rated games". I'm saying this assuming the map being played for rated games is random and not selected by anyone.
CXu

Wishy22 wrote:

Though this can be solved by filtering beatmaps from 2009 or before (yes most old maps are unplayable shit).
No ;_;
Wishy
Well not all of them but checking out every old map gonna be a pain.
Minty Gum
A lot of times me and just 1 friend will go against each other in multiplayer mode. We'll take turns picking songs and the rule is, if you don't have the song the other person chose, you download it. Well, of course, whoever chose the song will usually win because they've played it multiple times and figured out any trick patterns, etc. And whoever just downloaded the song and is playing it for the first time might even fail/get a bad score because they've never seen the song before, and it might take them another try to get an A or whatever. Usually when I don't do so well because it's my first time, I'm like whatever, it dropped my accuracy by .02% or something. But now it will be like sacrificing my "points" if I'm doing a song for the first time, just for the fun of it >.< Even in multiplayer mode, if there's no rooms open with songs I have, I'll choose a random song in a room that seems interesting, download it, do it for the first time. This point system seems to me like it would discourage downloading a song and doing it for the first time in multiplayer. What I'm trying to say is: Will the amount of times you've played through the map effect the score? Someone who's played the map 20 times should obviously be doing better than someone of equal skill playing it the first time. Does it really matter? I don't know. Did you already discuss/find a solution to this problem? Haha, I don't know, I didn't read through this whole discussion :P Just ignore this if you already have a solution or whatever. I do like this idea a lot, it seems a bit complex, but it's definitely possible.
Sakura
I was barely explaining what a Ladder System was, plus those games usually have "unranked" "unrated" matches which dont affect your rating/points (not to be confused with unranked mods in osu! i bet the songs would still count towards your ranked score, playcount, etc)
Neruell
I would be happy if the current ranking system would be improved, rather than thinking of a new with even more problems involved.
Wishy
Actual system is pretty much about farming, you're not better for having played and FC'd almost every map.

You could just make mods give huge bonuses like DT 9999% Hidden 1% FL 5000% HR 4000% and then people ranking maps would get huge scores compared to those who just farm score with no mods, I know the numbers I put are retarded. And even with that it would be stupid since everyone gonna go play hard diffs with DT instead of Insane since they're damn easy, which in the end makes the game again about farming, the best you can do is make a whole new system where players have to compete each other in real time to raise their rank.
Zetta
I think it's a solid idea to be honest and it would be great if one day it would be implemented.
Hanyuu
Well my idea is not about directly playing against each other but it looks like this:

Only mods should be counted since playing with mods is considered to be good/skillfull by almost everyone..

The idea is once you full combo a beatmap with a mod you usually get a higher score than players with SS no mod FC. If you done that your skill rating value or ELO would rise or fall by a few points depending on how high you are in the song ranking, only counting mod plays!

Now for an example i just took a random beatmap and looked at the scores..



19 People FC this song with mods so depending on where you are, the amount of points you get is different. In this example DarkRingSystem will get the highest amount, Uan something in the middle, Yuka-san still a bit and Rost94 almost none but still something.

So how do you drop in your skill rating ELO? Well simple, when other users get a higher place in a song than you you would drop down a rank and therefore get less "skill-rating" in that. It should update your total rating then.

Okay that was the main idea.. here are just some more things to notice:


The actual value of your "skill" should be displayed as an average of .. i dont know how to say.. just an average of everything you played with mods. similar to accuracy.
This will prevent playing hundreds of maps with mods just for the reason to push your skill rating to a ridiculous high value, and thats the opposite of what a skill based rating system is about.

About the different difficulties in a beatmap set:

Easy is easy to play mods and Insane is harder to play mods. Yeah thats right and none will disagree with that but every difficulty should be considered in this system. Since there are also players that love to compete in easy diffs aswell as players that love to compete in insane diffs with mods!

The actual gain of rating there has to increase as the difficulty goes up!

Example: Easy:10% Normal:30% Hard:65% Insane:100%.
The only problem here is that it would be based on the Star Rating of the song i think. Well but i think it is okay even if now people will think something like "Some 5 Star hard diffs are pretty easy to clear with mods though".
In the end it would still be the same since the gain is determined by how many players cleared it with a mod and what their ranking is compared to the others.
So if this diff is really so easy to play alot of people are actually playing it with mods and it is not as rewarding if you are the #30 out of 50 that FC'd it with mods than if you are only one of the of the few that cleared a Insane diff, and you are the #2 out of 8 there. I hope that was not too hard too read/understand because it was hard for me to write and find the words..

All in all it would be looking something like this:

Easy diffs player got a rating of 100
Normal diffs player got a rating of 300
Hard diffs player got a rating of 500
Insane diffs player got a rating of 800

Those numbers are just an example since i didnt try to calculate anything but what is important, is that it shows a clear difference on what you play and ofcourse if you play harder things your rating is higher...

Some more things i thought about:


Since older maps are played less and less or almost never anymore they shouldnt be part of this. I dont think anyone wants to backtrack and play beatmaps that dont even fullfill the current ranking criteria. Also some maps are so old that only 1 or 2 players did it with hidden and the rest is just no mods play. You could just DT them and get #1 rankings, but well i dont know if anyone wants to do that... Also they are not fulfilling the standards of what is considered difficult or hard today anymore, at least in my eyes. What was hard 3 years ago is not anymore nowadays, some exceptions.

There should also be a requirement of when to get ranked. If someone just played 1 or 2 maps with mods they shouldnt be counted into this. Probably a requirement of at least 10 or 20 maps until you get valued in this.

Some players play hard or insane diffs most of the time and occasionaly easy and normal (or the other way around). Since it shows an average as a result it would falsify your rating. So only the difficulty level you played the most would count, just to keep the result to the truth as good as possible.

"Some beatmaps are so difficult allready to FC even without mods! Why are they not counted in this?" i thought that too but it just doesnt fit in and theres allways the regular scoreboard in that map for it! Also if you are the one to clear it with a mod.. well theres your reward right there lol (theres usually someone good/ crazy enough to do something like that :P)

Since approved maps are often very difficult i thought about them too but meh... there are some harder approved maps and there are some that are just approved because they are either long or got a too high score. So i just left them out in my idea..

In my idea everyone is at a base level and it is impossible to go into the negative. I don't know if thats a bad thing though. You play with mods to set the difficulty for yourself higher anyways so it is okay. If you would be able to drop below the ground level it would be stupid anyways because your rating would be lower that someone that hasnt played with mods ever.

Looking at that screenshot again and since there is a recent discussion about FL... just blank that out for this. Some players will think of the one beeing harder and more difficult in skill than the other. While others think the other way around.

Also last and probably most important: No mod plays are completely left out. Players that play with mods to push them to their limits usually feel superiour to others that play without mods anyways, and they probably are better aswell. Counting no mod plays in would kind of destroy this idea. This doesnt mean you're bad or anything at all if you get S or SS on a song. Its still good but i dont know how nomod play would fit in here (it probably could but then again S or SS ranks arent a problem for the majority of players and i also think it should not be counted, because it is alot harder to play with mods anyways).

Well thats all i thought about yet...
thanks for reading and i hope i didn't give to much trouble with that :?
Kert
Sorry, tl;dr
But making 96%+ HD plays/DT 93%+ e.t.c. superior to no-mod SS(or 99%+) plays is dumb. Especially on maps with high OD
IMO
Hanyuu
personaloppinion
theowest
I sure hope nobody thinks accuracy has anything to do with skills.
Waryas
Everything is a skill
Being able to not feel nervous while being specced is a skill
Being able to get good accuracy no matter the kind of map/ar/od is a skill
Being able to read any kind of AR be it low or high is a skill
Being able to play with obnoxious bg/skins is also somehow a skill
those

Hanyuu wrote:

19 People
Surely you mean 17.
theowest
a skill-based player rating which goes after who's the best

let's say 10 people have to play 10 beatmaps

each gets one top rank on it. now what can we do to find out which one of these players is the best?
take the avrage score, and avrage accuracy.
the one with the most of both wins
thelewa

theowest wrote:

I sure hope nobody thinks accuracy has anything to do with skills.
Accuracy should just be removed from the game completely

I mean what the hell, a rhythm game that requires the player to stay on rhythm? That requires absolutely no skill and it's breaking the game!
show more
Please sign in to reply.

New reply