Probation was created as a reevaluation for bns with a potential to improve, but is now becoming more seen as pressure to avoid iconning maps that could receive dqs or bubble pops. With changes to the QAT system right around the corner, how probation is currently handled isn’t something that should be further neglected.
The current system
Very generally, the probation system goes like this:
This is what probation appears as on a surface level. It’s not a secret that DQs and bubble pops largely influence your evaluation. This isn’t unreasonable, especially if you’re getting consistent pops or dqs. But there’s no telling what proportion of bubble pops or dqs count as “underperforming.” As a result, bns are pressured to perform as closely to perfect as possible, by nominating safer maps, or maps from more experienced mappers, even if it’s against their will. This is the root of the problems with the system.
It’s also not a secret that more than just dqs or bubble pops are being considered. Reviewing on a case-by-base basis makes sense, because it’s not a one size fits all situation. But it isn’t doing us any good if we don’t know what specifically QAT / management are looking at when we’re being evaluated.
Personally under probation, I felt like I only vaguely figured out what was evaluated, based off a mixture of rumors and experiences from other BN and QAT. I myself had my previous reasons for being kicked to improve upon (which still felt vague) but I couldn't see anything for newer bns to focus on. This whole ordeal made probation super super stressful for me, and lead to me trying to be perfect, which I know isn't a realistic expectation. Also, it made it a bit of a mystery as to why some of the people didn't pass. Probation doesn't need to be stressful or mysterious.
Other perspectives
Most of these problems can be fixed with more transparency. I’ve talked with 6 other people who have gone through the probation system, 5 from those who have passed. Despite this, 4 out of 6 people found the process to be vague and provide a lack of transparency, overall viewing it as a stressful experience. The other 2 perspectives both passed probation without seeing it very negatively, and also received little to no dqs or bubble pops. Given that every bn will go through probation at least once (when they join the bng), 4/6 is not a good proportion of people who see probation to be overall negative or stressful. Since new bns are welcomed into the bng under probation after all, if a bn is to struggle through probation, it doesn’t make the bng seem very welcoming.
Proposed changes to the system
Google doc link, where I wrote most of this
Discussion about potential changes would be awesome.
*Changed "QAT" -> "QAT / management" in some places to refer to newer system
The current system
Very generally, the probation system goes like this:
- Bns are notified that evaluations are starting
- Based off of modding performance evaluated by QATs under a case-by-case basis, if you have underperformed then you are placed on probation
- During probation, go about your bn duties with knowledge you’re being evaluated
- If you’re still underperforming by discretion of the qat, you fail probation. If you’ve improved you pass probation. If you weren’t active enough, usually this will get extended.
This is what probation appears as on a surface level. It’s not a secret that DQs and bubble pops largely influence your evaluation. This isn’t unreasonable, especially if you’re getting consistent pops or dqs. But there’s no telling what proportion of bubble pops or dqs count as “underperforming.” As a result, bns are pressured to perform as closely to perfect as possible, by nominating safer maps, or maps from more experienced mappers, even if it’s against their will. This is the root of the problems with the system.
It’s also not a secret that more than just dqs or bubble pops are being considered. Reviewing on a case-by-base basis makes sense, because it’s not a one size fits all situation. But it isn’t doing us any good if we don’t know what specifically QAT / management are looking at when we’re being evaluated.
Personally under probation, I felt like I only vaguely figured out what was evaluated, based off a mixture of rumors and experiences from other BN and QAT. I myself had my previous reasons for being kicked to improve upon (which still felt vague) but I couldn't see anything for newer bns to focus on. This whole ordeal made probation super super stressful for me, and lead to me trying to be perfect, which I know isn't a realistic expectation. Also, it made it a bit of a mystery as to why some of the people didn't pass. Probation doesn't need to be stressful or mysterious.
Other perspectives
Most of these problems can be fixed with more transparency. I’ve talked with 6 other people who have gone through the probation system, 5 from those who have passed. Despite this, 4 out of 6 people found the process to be vague and provide a lack of transparency, overall viewing it as a stressful experience. The other 2 perspectives both passed probation without seeing it very negatively, and also received little to no dqs or bubble pops. Given that every bn will go through probation at least once (when they join the bng), 4/6 is not a good proportion of people who see probation to be overall negative or stressful. Since new bns are welcomed into the bng under probation after all, if a bn is to struggle through probation, it doesn’t make the bng seem very welcoming.
Proposed changes to the system
- Write a set of “probation guidelines” that cover what the QAT / management will use to evaluate you
We’re told generally throughout our bn careers that our activity, attitude, and our ability to successfully push maps to ranked is being considered, but we already know that. We don't really know what skills we need to focus on obtaining in order to bridge the gap between being a probationary and a full bn. Proficiency in finding unrankable issues? How active should we be? etc.
These thing need to be written out formally and should be posted with probation warnings (next proposed change), notifications of bn evaluations, and would also be very useful to find within the bn guidelines. - Warn bns that they’re in danger of being put on probation so it doesn’t come across as a surprise
I got this idea from somewhere else, I forget where. Approaching the date of your revaluation results, there’s a lot of uncertainty as to whether or not you’re doing everything correctly, which in a way makes the revaluation feel like a doomsday. It would be a lot more helpful to have some final warning that you need to improve something before you get surprise-attacked by probation status. - Give detailed information as to why each bn is being probationed
How can you know how to pass probation if you don’t know what to improve? I mentioned earlier that probation isn’t one-size-fits-all but due to the vague process, that’s how it feels like it’s being treated right now. Bns will likely perform better in probation if they know what they did wrong beforehand, and know what they can further improve by the time they’re evaluated again. To compliment this, bns should be able to openly discuss their evaluations with QAT / management person on the subject of their evaluations. (If evaluations happen one month from the evaluation announcement, this can happen like a week or two before the evaluations happen). - Consider bubble pops less than dqs in evaluations
By weighting bubble pops as evenly as dqs, I don’t feel like we’re thinking about the reason why we have a 2 nominator system in place. In a two nominator system, the two different bns’ perspectives basically ensure that each map is reviewed as thoroughly as possible; if bn #1 doesn’t find an issue with a set, by the time it gets qualified bn #2 is more than likely to have found that issue, because two bns are likely to have different mindsets and processes when modding a map. No map will be perfect after the first bn mod, and dqs are generally seen as a "bigger deal" in most peoples' eyes anyways.
Additionally, nominations are reset pretty inconsistently between a number of different issues, especially when it comes to issues such as missnaps, tags, or spreads, so it would add a tiny bit more fairness to the process. - Don’t consider dqs or pops for complex timing in evaluations
Or at least consider them less. Complex timing is not an easy to come by skill that shouldn’t be realistically expected for every bn. Usually when you’re told to ask someone about timing on a map, you hear the same 5 or so names thrown around. I’ve even heard them described as “scary” to nominate because nowadays timing dqs are almost inevitable once your map gets qualified.
To be clear, simple things like offset and blatantly wrong timing should be taken into consideration. Timing often gets dqed for pretty trivial, small improvements however which makes these maps less attractive to bns. - Add the ability to request extensions ahead of time
This is kind of an afterthought to what I talked about in most of the post, but I’ve seen a lot of people become worried about their bn status if their on probation while a big event is happening in their life, or recently, if they had to judge for MWC / some other big event (mostly through #absence_notices in the bn server). Real life should always take priority over circle clicking. It would be a lot more relieving if you were able to tell a QAT / management person that low activity was to be expected, and request be evaluated next month instead.
Of course if this is a thing, I feel like more limitations would be needed on that prospective bn.
Google doc link, where I wrote most of this
Discussion about potential changes would be awesome.
*Changed "QAT" -> "QAT / management" in some places to refer to newer system