sorry for 2200 words lmfao (not sorry)
Serizawa Haruki wrote:
the ever-increasing discrepancy between the number of potential ranked maps and the nomination capacity of BNs
This is the heart of the problem, and I can't see any easy solutions. Obviously, to ease the discrepancy, you have to either reduce the number of acceptable maps or increase nomination capacity, but I think the latter is the only realistic option. Still, all the versions of even that option that I can think of are hard to implement and/or have major downsides. Also, for what it's worth, I think those downsides are more or less equal in magnitude to just keeping the status quo and letting the discrepancy grow. The status quo IS a viable option in my eyes if no legitimately good alternatives emerge or if such an alternative would have to wait until Lazer (or something else that takes a bunch of dev time).
Why we can't just have fewer maps
I think the problems with reducing the pool of acceptable maps are pretty obvious (people rarely even suggest doing it in these discussions), but I'll expand upon that point a bit for good measure. To simplify the issue, if there are too many maps above a threshold, you have to either raise the threshold or reduce the overall number of maps. I think the latter is pretty obviously inherently self-destructive from a community management perspective; no maps, no game.
As for raising the threshold, I think it's clearly completely impossible to do across the entire community, so it'd have to be done at the level of the BNG. However, even if it somehow went well, it'd just make BNs opt for safer maps, which would just make the situation worse. But there's no world in which it could go well, which should be evident to any mapping drama enjoyers out there. The community doesn't exactly have a strong consensus on what's good.
The idea of raising the quality of the maps that get sent to BNs is a fun twist on this theme, but I don’t think any of these kinds of suggestions that I’ve seen so far are actually sound. There are two types of suggestions here: a separate group between mappers and BNs, and mod count requirements. Making a two-layered nomination system seems absolutely nonsensical to me at this point, because it’s been done and abolished at least twice before. Mod count requirements, on the other hand, just don’t do what the proposals want them to do. They’re incredibly easy to circumvent if you have any friends in the game, they’re well known to be pointless for experienced mappers, and they don’t even guarantee map quality because no reasonable number of mods on someone’s first map will make it good.
Increasing nomination capacity
The most obvious way to get more maps nominated is to get more BNs into the team (or let more people nominate maps in some other way), and different versions of this get suggested every once in a while. However, it seems logical that everyone who both 1) wants to be a BN and 2) meets the current requirements is either already a BN or on their way to becoming one. So, to grow the BNG, you need to grow the number of people who fulfil 1) or 2).
Making the BN position more attractive is something that comes up every once in a while, but nothing usually comes out of it. On paper, it sounds amazing: if more people want to do the job in general, the number of competent applicants will probably increase as well, so we’ll have more BNs. It’s just really hard to actually accomplish. Ideas for rewards tend to die because of the whole “money in osu!” issue, while making the job easier tends to lead to worse overall nomination quality.
Haruki's suggestion about handling underperforming BNs better seems interesting, but I’d really like to hear other BN/NAT perspectives on the situation.
To make more people meet the criteria to become a BN, you can either teach people to mod better or relax the criteria. Based on everything I’ve seen in Mentorship in the past five years, relying on volunteer teachers for an infrastructure problem like this one isn’t viable, although I do think it’s an important effort nonetheless. Relaxing the criteria, on the other hand, would certainly work, just with the side effect of inevitably reducing the overall quality of the ranked section.
That’s two mentions of reduced quality. It’s a common theme I see in a lot of proposals, but for some reason, it’s rarely addressed in the proposals themselves. Eventually, I do think that we’ll head in this direction in one way or another, but right now, I don’t think it’s a trivial issue at all. The opinion that “ranked sucks” is fairly common, and any change that further lowers the bar of what can get ranked will only exacerbate the issue. Any such change needs careful thought weighing the pros and cons against each other.
Addressing stuff from the thread
Kazuya wrote:
initial proposal
- mappers nominate their own maps
- BNs are demoted to just quality assurance
- 2 weeks in qualified, maps are ranked even if no one actually looks at them
- mod count and other requirements
- limited number of ranked maps
Mappers nominating their own maps is something I have a certain affinity for. However,
it’s unrealistic to expect enough people to volunteer to do quality assurance. Add in the fact that maps could get through qualified without being looked at by anyone and you have a recipe for disaster. Also, limiting the number of ranked maps and pushing everything out of qualified after 2 weeks are mutually exclusive unless I’m missing something here (plus limiting the number of ranked maps just makes no sense if your aim is to make it easier to rank maps).
Silverboxer wrote:
a tier of maps below Ranked
How about automatic leaderboards for anything that passes Mapset Verifier or an equivalent check (probably when the mapper clicks a dedicated button instead of on every upload to reduce server load)? Not perfect cause the lack of pp would turn a bunch of players away, although I do honestly think enabling pp would be plausible with a more robust check.
vodit51321 wrote:
global anonymous BN queue and additional context
I
responded to a part of this earlier, but I want to add some things. First, people have been complaining about the ranking process (and modding in general) being too impersonal ever since mv2 came out. An anonymous queue between mappers and the BNG would take the issue to a whole new level. I don’t think “eliminating useless communication between the mapper and nominator” is the way to go.
Also, the whole anonymity thing is getting really old in general. Sure, the queue might be FIFO, but you can still ensure that your BN friend doesn’t reject your map because of something that they’d reject a random map for but that they could overlook in a friend’s map. Also, would people have to stop putting their names in their storyboards? They trivialise the whole anonymity thing, after all, but that’d be pretty draconian.
As for the part where you assume you can just force the BNG to go along with something like this, that’s covered “a bit” later in this post.
vodit51321 wrote:
response to my earlier criticism
You're not wrong. But keep in mind these expectations are not as "unrealistic" as the idea of a fully automatic ranking process. Unless someone suggests a more reasonable system, this system is the closest we got to being fair for everyone. The two big issues of the current system are solved and now we're all left discussing the new issue it would bring. How to incentivise nominators to do the work.
I doubt anyone in this thread has the answer. That's just something osu!staff might have to figure out.
If you can’t propose a way to actually maintain your system, the fact that it might solve some current issues is cold comfort. You can’t go “hey yaspo/peppy here’s a new system can you figure out how to make it work and then implement it thanks” and expect something to come out of it.
There’s a similar issue
here:
Kazuya wrote:
Since change may not be to their advantage in most cases, I doubt that any of them would support an alternative. At most peppy can decide. I wonder what he thinks.
This is just not how the community works. Can you imagine the carnage that would ensue if peppy went “Yeah I saw this cool system on the forums and ranking is gonna work like this now. Make it happen, NAT.” out of nowhere? A system most of the NAT and BNG don’t accept can’t solve anything because it can’t be implemented.
Kazuya wrote:
minimal improvement
- 1 ranked map per month per user
I think it's pointless to suggest something like this without presenting data that shows that a significant portion of ranked maps actually come from people who rank several maps per month, because if that isn't the case, this proposal doesn't improve anything. However, anyone who maps that much obviously has a lot of passion for the game, and telling them to just stop would be a massive slap in their face. Driving away the most passionate members of the community is a bad idea.
Kazuya wrote:
- 1 BN per map
Could genuinely work, but again, only if it’s actually worth the inevitable reduction in nomination quality. It’d also make abuse easier, but that might also be fine if the quality reduction was fine. IDK. One interesting side effect of this would be that the problem presented in
the somewhat recent veto mediation proposal would be at least somewhat alleviated.
Livermorium wrote:
competition
Agree with previous posters that this is totally the wrong thing to focus on here. In the free market example that you brought up, business owners want to make their products better than others in order to make more money, while consumers want to ensure that businesses in the same field are actually competing because competition drives prices down. We, in contrast, are creating free maps for a free rhythm game. We make no profit, so we don’t need to compete, and players don’t need to pay for maps, so they don’t need us to compete.
several people wrote:
BNs’ music/map/whatever preferences
Every proposal that I’ve seen before that has tried to take away BNs’ right to freely pick the maps they want to nominate has been rejected. It’s an important part of what makes the job doable for many people. It seems to be commonly accepted in the world at large that a certain degree of freedom in the workplace leads to better results and happier workers, and I think it would be wise to take this into account in proposals regarding the function of the BNG. They’re already basically glorified RC checker robots. If people having preferences is abhorrent to you, I’d like to suggest that you come up with a system that doesn’t need people.
several people wrote:
they volunteered to nominate maps so they need to nominate maps no matter what they are
To put it bluntly, this is entitled and delusional. Every BN filled out their application in a world where BNs can choose which maps to nominate. That is what they signed up to do. You can’t just take a simplified description of what they do and pretend that it’s some sort of contract that must be followed to the letter. It’s not going to persuade anyone.
Final thoughts
This was probably obvious if you read the post, but personally, I’m a fan of the idea of automated ranking. Yes, I know that the tech isn’t there yet, and I’m all too aware of the implications for map quality. I just don’t see any plausible way to make sure that everything that’s good enough can be ranked easily without a drop in average ranked map quality. Just accepting more BNs could be an option with less of an impact on quality than fully automated ranking, but with the NAT work overhead it would come with, it’s hard for me to see it being sustainable.
Of course, you can’t mention automated ranking without also bringing up a new curated section. The standards could be as strict as they needed to be for the section to have the right vibe, and existing ranked maps could be moved into it as needed. With some increased visibility for the new section on the site, we could have a world in which everyone could rank all the barely decent maps they wanted and the really epic maps would have an appropriate spotlight.
Or you could say “fuck it” and go in the other direc- actually, no. I don’t think that’s possible right now. The community has been constantly moving away from how things were in, for example, 2016, so doing a complete 180 would be way too jarring. As far as I can tell, right now, our options are either not doing anything or adding a bunch of BNs and accepting the quality drop, along with some other smaller-scale adjustments that may be possible. Those proposals for anonymous global queues and quality assurance only BNGs have been seen and rejected over and over again over the years. I don’t think posting them again is gonna do very much.