forum

QAT/BN Rework Proposal.

posted
Total Posts
8
Topic Starter
Laxxer
In order to create a well functioning system we must first conclude what the issues are, and how we can design a system to tackle those issues. No matter how well though out or planned we create a system however, there will inevitably be conflict. Because of this, we must come to a conclusion that is both inclusive to a wide variety of mappers' styles and a system that still maintains quality. The following proposal focuses on:

  1. Inclusive and diverse mapping styles
  2. Quality control
  3. Fair and accurate BN evaluations
  4. A more precise, agreed upon definition of quality
  5. Lesser conflict and controversy


Lets begin:


Instead of having two teams where one is 'better' or has more privileges than the other, there will be two teams that work together.

Team #1: Members in this team will be responsible for nominating, and qualifying beatmaps. They will not be allowed to veto, disqualify, or reset nominations of a beatmap unless it is for an objective, unrankable issue.

Team #2: Members of this team will be responsible for checking qualified (or nominated maps) and determine if they are suitable for ranked. They will reset nomination, veto, or disqualify for objectively unrankable issues as well as subjective issues. This team will not be allowed to push forward maps.

There will also be selected members who will also be responsible for evaluating BN's.


Everybody will be apart of the "beatmap management team", and will be filed into either team one or team two. This means we will have one half of the team pushing forward maps, and the other half ensuring quality. Any disputes between teams will be settled with a vote.


With this system we will have an equal level of pushing forward unique maps, as well as an equal level of 'quality assurance'. Although it may seem redundant (i.e why don't we just allow everybody to have all privileges) the reason this will be better is because each map going through the qualified section will have at least four pairs of experienced eyes on it.(see below). Members in 'team #1' will be able to voice their opinions of a map, as well as any community member, but the actual action of disqualifying/vetoing/resetting nomination will only be allowed by members in team #2. Keep in mind every 2 weeks - a month members in team #1 will switch with the members in team #2. (Hopefully by switching often, after a few cycles a generally agreed upon definition of quality is achieved, or at least we will have a better idea of which maps are suitable and unsuitable for ranked. By continually adding BN's, this viewpoint may change. (It will never settle in one place, it's unrealistic to try that without encountering the same issues as before).

Each map will require two nominations as well as 2 'checks' once in the qualified section.

Members in team #2 will now need to check qualified maps and either give it a pass, or disqualify it. The current system will still take place, however once a map is in qualified section there will now be two ways for it to get disqualified.

1) If a map in the qualified section fails to receive 2 approved checks from members in team #2
2) If a member in team #2 decides to disqualify the map directly



As said before, assuming the situation in which a team #2 disqualifies a map for subjective reasoning, and other team members disagree with it, a vote on whether or not the disqualification reason is valid or not will take place amongst all group members.



The BMT will be evaluated on their proficiency in pushing forward, as well as holding back maps.

A 'three-strike' system will take place. A BMT member will get one strike if they had one of their nominations reset for objective issues. The members selected to evaluate BN's may also choose to kick BN's for more specific, individual reasons.

A BMT member may also get a strike, assuming they are in team #2, if they are not active in checking qualified maps, or if the people in charge of evaluating BN's have individualized reasons.


Tests will always be open.

Similar to many other proposals, they will be open all the time. If you get denied, however, you will have to wait a time period proposed by the people evaluating your test (same people in charge of evaluating BN's.) For example, if they believe you are close to ready but still need practice, you may only need to wait 2 weeks. If they believe you could use a lot of work, you may have to wait 3 months.


This is all I have for my proposal. It's quite wild and probably wont see the light of day however, I wanted to share it nonetheless.
abraker

Ashton wrote:

In order to create a well functioning system we must first conclude what the issues are
So, what are the issues? I don't see them explained anywhere.

Ashton wrote:

Team #1: Members in this team will be responsible for nominating, and qualifying beatmaps. They will not be allowed to veto, disqualify, or reset nominations of a beatmap unless it is for an objective, unrankable issue.
so like current BN?

Ashton wrote:

Team #2: Members of this team will be responsible for checking qualified (or nominated maps) and determine if they are suitable for ranked. They will reset nomination, veto, or disqualify for objectively unrankable issues as well as subjective issues. This team will not be allowed to push forward maps.
so like current QAT?

Ashton wrote:

There will also be selected members who will also be responsible for evaluating BN's.
so like current staff?

Ashton wrote:

Each map will require two nominations as well as 2 'checks' once in the qualified section.
So basically like current 2 BN nominations + now there will be an additional requirement that 2 QAT need to check the map

Ashton wrote:

As said before, assuming the situation in which a team #2 disqualifies a map for subjective reasoning, and other team members disagree with it, a vote on whether or not the disqualification reason is valid or not will take place amongst all group members.
sounds familiar. . .

Ashton wrote:

The members selected to evaluate BN's may also choose to kick BN's for more specific, individual reasons.
What does "individual reasons" mean?



What you did is basically described the current system, merged in widely agreed proposals like making tests always open, and require an QAT equivalent group have two recorded checks for qualified maps. You also failed to address how this will fix whatever issues you are referring to, which you failed to explain. Much improvement, very innovation!
Topic Starter
Laxxer
No, not like current bn or qat


There will be two teams that work together, by restricting one team to only one responsibility and one team to the other, maps will be pushed forward as well as held back at a reasonable rate and with the voting system, a generally agreed upon ideology of quality will be achieved.


The reason this is very similar to the old system is because I believe the old system was fine, but only needed improvement. The idea of creating a completely new system will only continue the cycle of inevitable argument. This system is beneficial as it gives both teams an equal amount of opportunity to share there opinions on a map, where before the qat had all the pressure to determine a maps wellness.


Also, this thread was way overdue so it will not be incorporated or even seen by a qat member
abraker
Out of everything you have said, none of it explains how what you proposed is any different from what we have now. The only thing you have said is that it's different.
Topic Starter
Laxxer

abraker wrote:

Out of everything you have said, none of it explains how what you proposed is any different from what we have now. The only thing you have said is that it's different.


Hey the two qat checks and the bn test wait time


Also the fact there are two teams, with an equal amount of power that switch every month or so


Also, to answer u from before, individualized reasons would be ‘person has disqualified too many maps for subjective reasoning and lost the vote immensely’ or ‘person was acting like Baka in forums’
abraker
That's practically the current system. Please explain the problems the current BN/QAT system is facing and how this proposal is supposed to fix it because you miserably fail doing that in the main post.
Topic Starter
Laxxer

abraker wrote:

That's practically the current system. Please explain the problems the current BN/QAT system is facing and how this proposal is supposed to fix it because you miserably fail doing that in the main post.


Current issues are conflict and a muddied view on what quality is. With only one side of the team allowed to make the final decision, we are shadowing a lot of the opinions of other members.


That’s why by separating the team into two teams with an equal day in things, after some time of disqualifying and voting we will determine a common denominator of what is acceptaple, effectively wiping out much conflict within the mapping scene. As new members join the bmt, it allows for more opinions to gather which will either further solidify or change what the general consensus of quality is.
abraker
That is entirely wrong. That is not why Ephemeral plans to disband the QAT.

Also what happens if the maps in qualified never receive the two checks? Do they stay in qualified forever?
Please sign in to reply.

New reply