Beatmapper rankings? [Added]

machol30

osu! Alumni

Joined January 2008

machol30 2008-03-27T02:03:05+00:00

chan wrote:
Sinistro wrote:
Maybe each beatmap after the first gets a (smallish) bonus multiplier to its rating...
I can imagine Saturos going beatmap crazy trying to improve his beatmapper ranking.

Yes, I can imagine that too.

I am thinking that you'd gain more for each ranked map than for each unranked; right?

EDIT: And I really like the idea!

Saturos

osu! Hall of Famer

1,630 posts

Here since the beginning

Saturos 2008-03-27T02:57:36+00:00

I can imagine Saturos going beatmap crazy trying to improve his beatmapper ranking.

I can't. ;x

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-03-27T07:48:43+00:00

I was thinking that only ranked beatmaps should be counted towards the beatmapper ranking.

I don't think Saturos would do anything like that. Just because he's the best player doesn't mean he would beatmap like the wind to rise to the top of the beatmapper rankings.

awp

osu! Alumni

11,869 posts

Here since the beginning

awp 2008-03-27T15:31:33+00:00

Sinistro wrote:
only ranked beatmaps should be counted towards the beatmapper ranking.

eyup

osu! Alumni

549 posts

Here since the beginning

eyup 2008-03-28T07:29:40+00:00

Looks like this one is on track to be included, so moved to Feature Requests.

Cecilthemos

osu! Alumni

509 posts

Here since the beginning

Cecilthemos 2008-04-07T01:58:27+00:00

The only problem I have with this is people giving a bad ranking to your map because it's a song they don't like or if it was too hard (I know we're supposed to make enough difficulties for even beginners, but you don't have to make it so ANYONE can beat it, I doubt a beginner could beat SSAY with Hajime) Other than that this sounds like an awesome idea and it will get more people to create amazing beatmaps.

awp

osu! Alumni

11,869 posts

Here since the beginning

awp 2008-04-07T16:08:06+00:00

Yes, but when you have 50 votes on a map, one disgruntled cretin can do little to sway the votes.

Echo

osu! Alumni

3,008 posts

Here since the beginning

Echo 2008-04-08T05:23:08+00:00

This map has been deleted on the request of its creator. It is no longer available.

James

osu! Hall of Famer

4,371 posts

Joined January 2008

James 2008-04-08T07:34:02+00:00

This ranking is based on a weighted average of all your ranked maps, with a bonus proportional to the number of ranked maps you have.

I still don't get this, is it any related to the star rating? If it is, I should stop putting 10s on any beatmap that needs a rating

peppy

19,301 posts

Here since the beginning

peppy 2008-04-08T07:35:40+00:00

James wrote:
I still don't get this, is it any related to the star rating? If it is, I should stop putting 10s on any beatmap that needs a rating

Its based mostly on star ratings, yes. So start rating properly >:|

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-08T08:06:09+00:00

Is there a hypothetical point where the bonus from one's already ranked beatmaps can surpass the importance of each beatmap's individual star rating? Is there a cap to the bonus, or perhaps does one have to have like 100+ maps ranked before that happens?

peppy

19,301 posts

Here since the beginning

peppy 2008-04-08T08:11:46+00:00

The formula used is:

(sumRatings / numberOfRatings) * (1 + 0.03ish * numberOfMapsRanked)

So at the moment there is no cap, and as it is a linear ratio multipler, should not surpass the importance of stars themselves.

James

osu! Hall of Famer

4,371 posts

Joined January 2008

James 2008-04-08T12:57:10+00:00

Okay, so I should rate songs properly now.

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-08T13:09:41+00:00

peppy wrote:
The formula used is:

(sumRatings / numberOfRatings) * (1 + 0.03ish * numberOfMapsRanked)

Wait a moment, that's just the average, right? Isn't the weighted average of the ratings supposed to be the sum of the products of each beatmap's rating times its number of ratings, divided by the total number of ratings, as in:

(Rating for map #1 * map #1's number of votes) + (Rating for map #2 * map #2's number of votes) etc.../Total number of votes for all of the beatmapper's maps?

Although it might be best for me if I shut up, since this will lower my beatmapper rank thanks to J-E-N-O-V-A...

peppy

19,301 posts

Here since the beginning

peppy 2008-04-08T13:52:42+00:00

pretty sure it works out to the exact same number.

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-08T14:05:46+00:00

peppy wrote:
pretty sure it works out to the exact same number.

No, it doesn't. With the above formula my score would be about 8,50 instead of 8,57 and awp's about 9,82 instead of 9,99, for example. I'm not sure in which way or by how much other scores would change. I believe weighting by number of votes is needed because I think the more people have voted for a beatmap, the more "consolidated" its rating is, if that makes sense.

Saturos

osu! Hall of Famer

1,630 posts

Here since the beginning

Saturos 2008-04-08T14:11:18+00:00

Nah, that formula will always remain a number between 0-10, based solely on the ratings. I did Aliento's rating using that formula really quick:

[(Rating for map #1 * map #1's number of votes) + (Rating for map #2 * map #2's number of votes) + (Rating for map #3 * map #3's number of votes)] / Sum of Play Counts = Avg weighted rating

[(7.9*120) + (8.3*44) + (8.1*75)] / (120+44+75) = Avg weighted rating

[948 + 365.2 + 607.5] / (120+44+75) = Avg weighted rating

1920.7 / 239 = Avg weighted rating

Avg Weighted Rating = 8.0364

EDIT: Seems Sinistro beat me to the post, but I gotz teh mathz0rz.

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-08T14:22:19+00:00

Saturos wrote:
I did Aliento's rating using that formula really quick:

[(Rating for map #1 * map #1's number of votes) + (Rating for map #2 * map #2's number of votes) + (Rating for map #3 * map #3's number of votes)] / Sum of ~~Play counts~~ Votes = Avg weighted rating

[(7.9*120) + (8.3*44) + (8.1*75)] / (120+44+75) = Avg weighted rating

[948 + 365.2 + 607.5] / (120+44+75) = Avg weighted rating

1920.7 / 239 = Avg weighted rating

Avg Weighted Rating = 8.0364

EDIT: Seems Sinistro beat me to the post, but I gotz teh mathz0rz.

Weird...why do I see different ratings and vote totals for Aliento's beatmaps? Specifically, 7.5*145, 7.9*68 and 7.1*52, ultimately resulting in a rating of about 8.2013.

Saturos wrote:
Nah, that formula will always remain a number between 0-10, based solely on the ratings.

Yeah, when I said "with the above formula" earlier I got a little sloppy in my expression; I actually meant the formula of the weighted average I posted with the ranked beatmap bonus multiplier, which I had left off to focus on the formula's first part. To be precise, my proposal for the beatmapper ranking formula is:

[(Rating for map #1 * map #1's number of votes) + (Rating for map #2 * map #2's number of votes) etc.../Total number of votes for all of the beatmapper's maps] * (1 + 0.03ish * numberOfMapsRanked)

awp

osu! Alumni

11,869 posts

Here since the beginning

awp 2008-04-08T16:16:55+00:00

While it's true that someone can have an unjustly high ranking because their maps only have a few votes to them, I find it likely that players are going to look at the beatmapper rankings, think "hey this person rules I'll get his/her stuff", play the beatmaps, and thusly vote on them, which should serve to balance it out a bit and result in a more accurate standing over time.

peppy

19,301 posts

Here since the beginning

peppy 2008-04-08T16:35:45+00:00

ah, nevermind what i said earlier. i was in zombie mode at work

.

i guess doing it based on weighted averages would be more fair, though.

Saturos

osu! Hall of Famer

1,630 posts

Here since the beginning

Saturos 2008-04-08T19:07:36+00:00

Sinistro wrote:
Saturos wrote:
Nah, that formula will always remain a number between 0-10, based solely on the ratings.
Yeah, when I said "with the above formula" earlier I got a little sloppy in my expression; I actually meant the formula of the weighted average I posted with the ranked beatmap bonus multiplier, which I had left off to focus on the formula's first part. To be precise, my proposal for the beatmapper ranking formula is:

[(Rating for map #1 * map #1's number of votes) + (Rating for map #2 * map #2's number of votes) etc.../Total number of votes for all of the beatmapper's maps] * (1 + 0.03ish * numberOfMapsRanked)

Just to be clear, that was directed at peppy, not you. ;x

Echo

osu! Alumni

3,008 posts

Here since the beginning

Echo 2008-04-08T19:46:46+00:00

The rating data is stored in the database as (total votes * rating) already, therefore "sumRatings" is in fact sum of (total votes * rating), and not sum of (rating).

In other words, the formula is:

SUM(total votes * rating) / SUM(votes) * bonus

peppy

19,301 posts

Here since the beginning

peppy 2008-04-12T19:24:26+00:00

Added to the site menu. Good job echo!

James

osu! Hall of Famer

4,371 posts

Joined January 2008

James 2008-04-12T19:58:16+00:00

Where?

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-12T20:08:33+00:00

It's under Rankings. You might need to refresh your page, like I did.

[nitpick] "Player" and "Mod" are in singular, but "Mappers" is in plural. [/nitpick]

Echo

osu! Alumni

3,008 posts

Here since the beginning

Echo 2008-04-12T20:15:17+00:00

You might have to Ctrl+F5, which forces most browsers to get all the content from the server instead of using local cached ones.

peppy

19,301 posts

Here since the beginning

peppy 2008-04-12T23:08:30+00:00

Sinistro wrote:
It's under Rankings. You might need to refresh your page, like I did.

[nitpick] "Player" and "Mod" are in singular, but "Mappers" is in plural. [/nitpick]

Fixed. I really need to sleep :/.

Sinistro

osu! Alumni

1,412 posts

Joined January 2008

Topic Starter

Sinistro 2008-04-19T22:34:59+00:00

Are the ranking scores being updated with each new vote? I think they've stayed the same from when they were first posted.

Echo

osu! Alumni

3,008 posts

Here since the beginning

Echo 2008-04-20T02:11:43+00:00

Sinistro wrote:
Are the ranking scores being updated with each new vote?

There is no autoupdate code in place (blame me for being lazy)... should be up in a while.

edit: ok, it's up, and *hopefully* should be working as it should... if any ranking mechanism (eg. song page/osu ranking page) fails yell at me on irc please

Beatmapper rankings? [Added]

Beatmapper rankings. Is it a good idea?

chan wrote:

Sinistro wrote:

Sinistro wrote:

James wrote:

peppy wrote:

peppy wrote:

Saturos wrote:

Saturos wrote:

Sinistro wrote:

Saturos wrote:

Sinistro wrote:

Sinistro wrote:

New reply

Beatmapper rankings? [Added]

Sign In To Proceed

Don't have an account?

Beatmapper rankings? [Added]

Beatmapper rankings. Is it a good idea?

chan wrote:

Sinistro wrote:

Sinistro wrote:

James wrote:

peppy wrote:

peppy wrote:

Saturos wrote:

Saturos wrote:

Sinistro wrote:

Saturos wrote:

Sinistro wrote:

Sinistro wrote:

New reply