Well, currently, I believe that both Nao and Fycho’s opinions make sense.
For me, here’s the contradiction:
(1) Nao prefers to build a rewarding system based on BN activity which will raise BNs’ enthusiasm on nominating and then make a more active BNG, while
(2) Fycho believes that (at least in standard mode) rewards based on the activity may cause the “farming” of rewards and then a drop on nominating quality.
So personally, I think what we need is a rule based on a quantitive balance between the “activity”, “nominating quality” and “rewards”. Of course both saying “reward BNs” and “BNs will farm for reward” are too sweeping and will not help much on the discussion and the comprehension between normal people, or even some of the BNs, and QATs.
Here is what I decide to do: I’d like to add a new wiki page named “Beatmap Nominator Evaluation” and write some terms mainly based on Nifty’s original proposal and opinions I’ve seen in this thread and try to give them some balanced and optimized executable terms. They are mainly some terms having exactly the critical numbers to define “active”, “nominating quality”, “rewards”, etc. These terms are based on my working experiences in the BNG and some thoughts from worldwide mappers.
There are also some of my advice for the evaluating algorithm of BNG too (I’m still not sure if QATs using this to evaluate BNG members though...)
Hope my advice can help, and any kind of suggestions are welcome.
(Since I’m not an original speaker of English, terms I proposed will definitely need a better wording. Also since I’m a std mapper I may not that clear about what’s the situation of other game modes, please correct me if I’ve fucked up on that......)
(Also I assume that the evaluation will take place roughly every month.)
PageBeatmap Nominator Evaluation
The Beatmap Nominator Evaluation is an evaluation of members in the Beatmap Nomination Group, executed by the Quality Assurance Team. The Quality Assurance Team will take the activity, attitude and proficiency into account, looking at how many mods and icons a Beatmap Nominator has placed and whether he or she successfully pushed beatmaps to the Ranked section.
This page serves to give a detailed explanation on how the Beatmap Nominator Evaluation works.
Glossery terms
• Active: In a Beatmap Nominator Evaluation cycle, a Beatmap Nominator is considered as “active” if he or she has reached both of the 2 conditions below:
* Nominated at least 3 maps (2 maps for osu!taiko, osu!catch and osu!mania game mode) in total, and
* At least 2 of the maps (1 map for osu!taiko, osu!catch and osu!mania game mode) he or she has nominated have (has) been successfully pushed to the Ranked section.
• Inactive: If a Beatmap Nominator is not considered as “active” in a Beatmap Nominator Evaluation cycle, then he or she will be considered as “inactive” in this cycle.
• Deducted point: A Beatmap Nominator will receive 1 deducted point if he or she has violated the Beatmap Nominator Rules while nominating a beatmap.
• The number of nomination, maps that have been successfully pushed to Ranked section and the deducted point will be reset to zero for all Beatmap Nominators when a Beatmap Nominator Evaluation is completely finished (that means all members in the Beatmap Nomination Group are properly evaluated, and the corresponding measures are taken for every Beatmap Nominator based on his or her results of the evaluation)
Evaluation
• In a Beatmap Nominator Evaluation cycle, a Beatmap Nominator passes the Beatmap Nominator Evaluation if he or she meets both of the conditions below:
* He or she is considered as active, and
* He or she has accumulated no more than X deducted points, where X = [N/2] and N is the number of maps he or she has nominated in this cycle.
If a Beatmap Nominator doesn’t pass the Beatmap Nominator Evaluation, then he or she fails the Beatmap Nominator Evaluation.
• If a Beatmap Nominator passes an evaluation...
* If he or she is a Beatmap Nominator in probation: this Beatmap Nominator will become a full member of the Beatmap Nominators once he or she passes the evaluation.
* If he or she is a full member of the Beatmap Nominators: he or she will maintain his or her full member identity of the Beatmap Nominators.
* A Beatmap Nominator will be rewarded an one month osu!supporter tag if he or she passes one cycle of the Beatmap Nominator Evaluation, as an appreciation of his or her hard works and contributions to the osu! modding and mapping.
• If a Beatmap Nominator fails an evaluation...
* If he or she is a Beatmap Nominator in probation: this Beatmap Nominator will be dismissed from the Beatmap Nomination Group and cannot apply for the Beatmap Nominators until the next available cycle for his/her desired game mode.
* If he or she is a full member of the Beatmap Nominators: he or she will be put into the probation.