Problem:
The current BN entrance evals are confusing, demoralizing and feel like a complete shot in the dark if you're able to make it in or not. Currently the best way to get BN when you start from scratch is to mod a couple of maps (potentially hurting them, if you do not know how to mod exactly), submit an eval, get vague feedback back, refine modding, submit eval again, get feedback, etc.
This process is not only extremely inefficient, taking not only a lot of frankly wasted effort every time it's repeated (from both applicant and evaluators), but it's also demotivating for the applicant to have to go through the cycle of thinking they're good enough, getting rejected with some pointers, thinking they're good enough again, getting rejected again, and so on and so forth. BN evals require some modding knowledge that only really the evaluators / people who have passed it can really grasp exactly - it has some very vague concepts that you would almost never learn on your own and, even if specifically given to you, can cause a fair bit of confusion and take some real getting used to.
Alternatively, you can learn from someone who knows how to mod already and is willing to spend their time and effort to help you improve your own modding, which is assuming you have a connection to someone who has that knowledge. This is a much more efficient way, but it's gated by a bunch of social engineering and games and whatnot.
Solution:
Merge the two things together. Make BN evals clearer by tying them to a group modding mentorship system so that people get quick feedback on the things they've done wrong and can have a compendium of things available to understand what (specifically the BN type of) modding is all about. This would not only make applying a lot simpler and easier to understand, but would also take away a lot of the NAT's workload - which is individual evaluation of many "easy fail" candidates, as well as make their work have clear timeframes and not pile up.
System implementation / archetyping:
BN applicants sign up at the start of a 2 month cycle if they have over the minimum kudosu amount.
NAT review entrants and deny people with poor behavior - this is already done in BN evaluations, just on a case-by-case basis.
People who pass this preliminary check get put into a group chat / crash course where you have resources that can help you understand the modding process. These include, but are not limited to: prerecorded explanatory videos, direct chat with the mentoring team where not only you can ask individual questions but also discuss things with the other applicants, weekly discord calls with example mods by the mentoring team, etc.
Every 2 weeks, the applicants would have a mini-eval where they submit a single mod and get it judged by the mentoring team, then have custom feedback as to what they did right and wrong with their mods (this not only is less work than a regular eval since it's only one map, but it's also direct feedback of a mod you basically JUST did, which can help your modding almost immediately). You can skip ONE of these exams but not any more, due to any reason (not available, out of town, illness, boredom, etc), if you skip two or more you're kicked from the cycle and the group chat. This is to prevent people from getting in who are not committed to being a BN since it's a lot of consistent work.
At the end of the cycle, you take a full eval, reduced to just another mini-eval if you've done well in the last couple, and if you pass, you get into the BNG as a probation BN. If you have a neutral / barely failed score you're welcome to stay in the group chat for next cycle. If you fail poorly on this last eval, you have to take 1-2 cycles off, to avoid overloading the groups.
This is a revised version of what my personal experience was: I constantly failed BN evaluations myself, and felt extremely in the dark about why and what to improve on. Then, with Seto Kousuke's "experiment", I and a couple of others were given a chance to get into the BNG after a months' worth of modding lessons and personalized tests and it was not only an opportunity that taught me a lot, but I've never looked back, being a BN who's never been probationed since.
This should be a much better way to proceed with the evaluation process, if not to get people invested in modding through personal interactions, not only with mentors but also with their "classmates", then to not have them just throw darts at the eval process until they finally make their modding just right, which has not only been extremely frustrating in my personal experience but has also been a common gripe I have seen repeated over and over by other people similarly frustrated with this process.
What would the mentors have to gain with this? This could be answered with a range of things, as it's really up to the NAT / staff, but my proposal is to give mentors in this process, if they're volunteering BNs, half or more of their minimum activity already guaranteed, or to give them Discord Nitro or some other form of small payment, especially if they're NATs and already have a reduced minimum activity.
I'd love to hear if anyone has any frustrations with the current evaluation system and whether they would consider this a better approach to things.
Cheers,
Dada
The current BN entrance evals are confusing, demoralizing and feel like a complete shot in the dark if you're able to make it in or not. Currently the best way to get BN when you start from scratch is to mod a couple of maps (potentially hurting them, if you do not know how to mod exactly), submit an eval, get vague feedback back, refine modding, submit eval again, get feedback, etc.
This process is not only extremely inefficient, taking not only a lot of frankly wasted effort every time it's repeated (from both applicant and evaluators), but it's also demotivating for the applicant to have to go through the cycle of thinking they're good enough, getting rejected with some pointers, thinking they're good enough again, getting rejected again, and so on and so forth. BN evals require some modding knowledge that only really the evaluators / people who have passed it can really grasp exactly - it has some very vague concepts that you would almost never learn on your own and, even if specifically given to you, can cause a fair bit of confusion and take some real getting used to.
Alternatively, you can learn from someone who knows how to mod already and is willing to spend their time and effort to help you improve your own modding, which is assuming you have a connection to someone who has that knowledge. This is a much more efficient way, but it's gated by a bunch of social engineering and games and whatnot.
Solution:
Merge the two things together. Make BN evals clearer by tying them to a group modding mentorship system so that people get quick feedback on the things they've done wrong and can have a compendium of things available to understand what (specifically the BN type of) modding is all about. This would not only make applying a lot simpler and easier to understand, but would also take away a lot of the NAT's workload - which is individual evaluation of many "easy fail" candidates, as well as make their work have clear timeframes and not pile up.
System implementation / archetyping:
BN applicants sign up at the start of a 2 month cycle if they have over the minimum kudosu amount.
NAT review entrants and deny people with poor behavior - this is already done in BN evaluations, just on a case-by-case basis.
People who pass this preliminary check get put into a group chat / crash course where you have resources that can help you understand the modding process. These include, but are not limited to: prerecorded explanatory videos, direct chat with the mentoring team where not only you can ask individual questions but also discuss things with the other applicants, weekly discord calls with example mods by the mentoring team, etc.
Every 2 weeks, the applicants would have a mini-eval where they submit a single mod and get it judged by the mentoring team, then have custom feedback as to what they did right and wrong with their mods (this not only is less work than a regular eval since it's only one map, but it's also direct feedback of a mod you basically JUST did, which can help your modding almost immediately). You can skip ONE of these exams but not any more, due to any reason (not available, out of town, illness, boredom, etc), if you skip two or more you're kicked from the cycle and the group chat. This is to prevent people from getting in who are not committed to being a BN since it's a lot of consistent work.
At the end of the cycle, you take a full eval, reduced to just another mini-eval if you've done well in the last couple, and if you pass, you get into the BNG as a probation BN. If you have a neutral / barely failed score you're welcome to stay in the group chat for next cycle. If you fail poorly on this last eval, you have to take 1-2 cycles off, to avoid overloading the groups.
This is a revised version of what my personal experience was: I constantly failed BN evaluations myself, and felt extremely in the dark about why and what to improve on. Then, with Seto Kousuke's "experiment", I and a couple of others were given a chance to get into the BNG after a months' worth of modding lessons and personalized tests and it was not only an opportunity that taught me a lot, but I've never looked back, being a BN who's never been probationed since.
This should be a much better way to proceed with the evaluation process, if not to get people invested in modding through personal interactions, not only with mentors but also with their "classmates", then to not have them just throw darts at the eval process until they finally make their modding just right, which has not only been extremely frustrating in my personal experience but has also been a common gripe I have seen repeated over and over by other people similarly frustrated with this process.
What would the mentors have to gain with this? This could be answered with a range of things, as it's really up to the NAT / staff, but my proposal is to give mentors in this process, if they're volunteering BNs, half or more of their minimum activity already guaranteed, or to give them Discord Nitro or some other form of small payment, especially if they're NATs and already have a reduced minimum activity.
I'd love to hear if anyone has any frustrations with the current evaluation system and whether they would consider this a better approach to things.
Cheers,
Dada