forum

New ranking/modding system development

posted
Total Posts
118
Topic Starter
peppy
In the interest of getting things right as I go, I am developing the new modding/ranking system completely in the open. I will be streaming all work I do on it and releasing all the specs as I go. Feel free to follow along and ask any questions you may have.

Design Document
Live Stream

Currently available pages


real-time modding system map #1 map #2 (currently in testing stages)
active for these two maps only. not yet linked to the rest of the system. please use these for real-world testing – as in mod them properly if you are going to post anything.

modding control panel
users will come here to get new modding assignments and view updates on their previous assignments.

modding queue
may not be visible in the future, but shows the current prioritised map listing. maps will be chosen from this listing and given out to modders.

modder ranking
shows the current modder ranking. this considers past mod posts from 2012 onwards.

I'll update this post as I work more out. Planning as I go. Feel free to use the "comment" ability in the google doc to bring up any points with the design document, or reply in this thread for more general questions (or ask in twitch chat).

Note that this system is not yet active. Any actions you perform will NOT have a permanent effect in any way. Feel free to click whatever you want.
Makar
This new system seems pretty interesting, and I'm looking forward to seeing how it plays out
notnotrusselg
That's pretty cool! :D
Kragic
Looks great Peppy seems well structured aswell ;)
those
How is modder ranking calculated?
Topic Starter
peppy

those wrote:

How is modder ranking calculated?
Please read the linked design document.
[CSGA]Ar3sgice
I'm modder #7 YES
Pokie
Good to see a detailed information
Cirno
When will this system take over?
kisata
A lot of detailed information.

Hypothetical, what if more than eight maps reach the qualification critera on the same day. How are you going to have those maps staying in there for only 7 days if you're only letting through 8 a time? Wouldn't some of them stay in there longer than that. Long shot I know, but it could happen. That's the only question I have off the top of my head, and the proposal seems nice otherwise.

(And what text editor is that, looks nice?)
notnotrusselg

apaffy wrote:

(And what text editor is that, looks nice?)
Sublime Text 2.
kisata

Babycake wrote:

apaffy wrote:

(And what text editor is that, looks nice?)
Sublime Text 2.
Yeah, saw the title in the stream not too long after. Thanks.
Topic Starter
peppy

apaffy wrote:

A lot of detailed information.

Hypothetical, what if more than eight maps reach the qualification critera on the same day. How are you going to have those maps staying in there for only 7 days if you're only letting through 8 a time? Wouldn't some of them stay in there longer than that. Long shot I know, but it could happen. That's the only question I have off the top of my head, and the proposal seems nice otherwise.

(And what text editor is that, looks nice?)
They will filter out over time. The number "8" may change depending on how we can handle it. The main idea here isn't to increase the number of ranked maps, but to change the focus on which maps are ranked, giving all maps an equal chance.
Scorpiour

peppy wrote:

apaffy wrote:

A lot of detailed information.

Hypothetical, what if more than eight maps reach the qualification critera on the same day. How are you going to have those maps staying in there for only 7 days if you're only letting through 8 a time? Wouldn't some of them stay in there longer than that. Long shot I know, but it could happen. That's the only question I have off the top of my head, and the proposal seems nice otherwise.

(And what text editor is that, looks nice?)
They will filter out over time. The number "8" may change depending on how we can handle it. The main idea here isn't to increase the number of ranked maps, but to change the focus on which maps are ranked, giving all maps an equal chance.
it is a good idea for all mappers, but i'm worried about new mappers who wanna join the new system since their have no sp at all and no experience in modding.

if it is possible to help new mappers like "if you have no ranked map then point request reduce to 100 or 150" ?
Topic Starter
peppy
Star priority is not part of this system. When a modder mods a map from the queue, and if they find no issues with it, they will nominate it. THis means that even unknown mappers can get nominations via the queue.
deadbeat
what will happen with kudosu?
neonat
Only mods from the queue and assignments/session counts in the score?
Topic Starter
peppy

deadbeat wrote:

what will happen with kudosu?
kudosu will eventually be deprecated.

neonat wrote:

Only mods from the queue and assignments/session counts in the score?
please read the design document.
Mara

peppy wrote:

THis means that even unknown mappers can get nominations via the queue.
If this is going to be true, this system is going to be groovy. 8-)
Scorpiour

peppy wrote:

Star priority is not part of this system. When a modder mods a map from the queue, and if they find no issues with it, they will nominate it. THis means that even unknown mappers can get nominations via the queue.
i see..

but how about the "chance". I means, if there're thousands maps in the queue already, how about the oppotunity that the map is noticed by others?


another problem.. what about mode speicific mapsets like Mania? it may be a big trouble if i meet it.


edit : one more question: if it is much more hard for Mania/Taiko maps to gather enough support?
Topic Starter
peppy
See design doc for mode-specific stuff.

Queue priority settings can be adjusted depending on how people feel their maps are getting attention. The important part is having the framework in place.
CXu
Might want to cut of that list over posts in a mapthread, and have it expand on mouse-over:
http://puu.sh/2HntI.png

It kind of obstructs the view of everything else, and it's not really that useful in most cases.
Topic Starter
peppy
I plan on making it more useful and logical. It's by no means anywhere near final.
Andrea
I like where this is going, keep it up.
ryza

Is mod rating the same as mod score, or is it different?

If they're the same, I'm probably just confused cause the values are so low for me (lol)
NoHitter
If star priority isn't necessary for ranking maps anymore, what's stopping someone from asking three people who has qualifications in approving a map from just posting in his map without going through the queue?

What about modders who see nothing unrankable from the map, but want to give small suggestions. Based on the pending map not being updated, and if by removing it, you reset its place in the queue, mappers will be discouraged from making these fixes.

Will BATs have maximum amount of modder rank since we already are deemed qualified?
Topic Starter
peppy

NoHitter wrote:

If star priority isn't necessary for ranking maps anymore, what's stopping someone from asking three people who has qualifications in approving a map from just posting in his map without going through the queue?
This is fine assuming the map is ready for ranking (has no issues). If it has issues they will be penalised when it is bumped out of qualified criteria.

NoHitter wrote:

What about modders who see nothing unrankable from the map, but want to give small suggestions. Based on the pending map not being updated, and if by removing it, you reset its place in the queue, mappers will be discouraged from making these fixes.
Their position in queue is already low after it has been assigned modders (each mod assigned drops the position in queue). Position in queue doesn't mean much after you already have modders assigned. It is assumed to some extent that those modders will carry on looking at your map until it is ready.

NoHitter wrote:

Will BATs have maximum amount of modder rank since we already are deemed qualified?
No.
Xgor
Pretty nice system. I can't imagine myself getting that much points if the maps I get queued is not interesting to mod.

.....One question though... What will happen if let's say there is 70 nominated maps in total one day. Eight maps per day is only allowed to get ranked yet everything needs to get ranked in 7 days. Will there be a system to prevent the amount of nominated maps other than it's takes a time to get the power to nominate?
Kodora
No. Sorry, but no. As for me system have some very bad issues.

1) Forcing people to mod this will affect the mods quality. Some people may just do not want to mod maps (and ofc lose their rating). So they will write mods "just to skip this map" (like "add new combo & clap, good luck")
2) How those maps list was builded? Due to Star Priority? But sometimes people just abuse the system (maps with bad quality have SP +50, 60, 80, and most of stars are from creator). Most of modders may just do not want to mod this. How they can be forced?

I think this idea overral is nice, but still needs work a lot. Thanks.
Topic Starter
peppy
Please read the design document. This is already discussed (see the comments area if it isn't in the document itself).
Sieg
new system looks great :)
pw384
I don't know if I understand the system correctly but I am just afraid of the loss of mapper's choose-what-to-mod power.

Edit:
If this happens, there will soon be no new mappers anymore. And many of mappers may AFK. :o
Kurai
As 'qualified' maps will get a scoreboard, will they also give pp ?

I really like the concept anyway ! (People will eventually stop saying "lel BATs are corrupted they only rank their friends' map lelel").
Zare
I'd like to choose what I mod, and I'd like to do it when I have the motivation to do it.
Modding takes, depending on the mapset, about 2 hours for me. That's not something I can/want to do every day.
show more
Please sign in to reply.

New reply