See also: Becoming a Beatmap Nominator § Application process
Evaluations of those who apply to become a Beatmap Nominator (BN) as well as current Beatmap Nominators are both carried out by members of the Nomination Assessment Team (NAT). These evaluations follow a set format to ensure that every application and nominator will be reviewed regularly. All evaluations take place on the BN website.
Each evaluation has two phases: individual and group. These phases differ in the details of how they work for applications or regular BN evaluations and will be detailed below.
Three NAT members are assigned to each evaluation, but additional members may join in the conversation during the group phase if there are elements of the evaluation that need further discussion on things the initial assigned NAT members cannot come to a consensus on.
If an assigned NAT member is unavailable or otherwise cannot do an assigned evaluation, their task can be randomly reassigned to another NAT member from the BN website.
References to Discord in this article pertain to the BN Discord server, which has limited entry to the BN, NAT, GMT, and former members for organisation, discussion, and group socialisation.
Every BN is reviewed regularly by members of the NAT.
For Nominators on probation, or that have been issued an activity warning, their next evaluation will be scheduled for roughly 1 month after being placed on probation or receiving their warning.
For full Beatmap Nominators without recent warnings, their evaluations will be scheduled to occur every 3 months.
The duration between evaluations is automatically scheduled by the BN website. However, if there is a substantial cause for concern about a BN's performance at a sooner date, NAT members can also manually schedule an evaluation to happen sooner than normal.
Just like applications, current BN evaluations are randomly assigned to 3 evaluators and will be announced in the respective mode's NAT Discord channels.
The individual phase will show on the BN website 2 weeks before it is due, letting NAT members know what evaluations are upcoming to aid them in managing their workload appropriately. During the individual phase, NAT members can submit their evaluations on the Beatmap Nominator's performance. These evaluations will account for the BN's nominations, any nomination resets that happened on their nominations, as well as check on the BN's overall modding across a sample of their nominated maps. NAT members will also be checking for whether the BN is following the Beatmap Nominator rules and expectations appropriately.
After three NAT members have submitted their evaluations, the evaluation will be moved to the group phase. During the group phase, NAT members will discuss their evaluations with each other, come to a consensus, and write evaluation feedback. The results and feedback will vary depending on the BN. If it is found a BN is not performing up to standard, they may either be given a warning or placed on probation depending on the severity of the issue.
Once the feedback is written and reviewed, it will be sent and accompany any group changes needed if the BN is moved from the probationary Beatmap Nominators to the full Beatmap Nominators, or vice versa. The feedback will be delivered by the Nomination Assessment Team bot as an announcement message.
Warnings and being placed on probation due to subpar performance as a full Beatmap Nominator are effective for roughly one year. If a BN has reoccurring issues down the line after being warned or placed on probation recently, they may be removed from the Beatmap Nominators on future evaluations.
Each Beatmap Nominator's activity is checked automatically by the BN website on the 1st of every month. If it has found that there are nominators not meeting the activity requirements, they will be flagged and posted in their respective mode's NAT channel for NAT members to review by the "bnsite" Discord bot. Review will include whether the BN has posted an absence notice recently, and a double check to ensure the website check is accurate to the BN's activity status.
If it is found the BN is indeed not meeting activity, they will be either warned or removed depending on severity. Beatmap Nominators who were removed for activity in this way may apply again without any cooldowns, provided they apply with 3 mods instead of 2 to show they have come back to being active as a modder again.
Beatmap Nominators can resign from the group at any time via the BN website. When this happens, three NAT members will be assigned to evaluate the nominator one last time, in order to determine if the resignation is on "good" terms or on "standard" terms. This evaluation is given a 24-hour deadline and announced to the NAT members in their respective Discord channel. Beatmap Nominators who resign on good terms may be able to fast-track back to being a full BN if they choose to apply again within 1 year of resignation. Those who resign on standard terms will have to start from probation if they pass their reapplication.
Generally, good- and standard-term evaluations are relatively simple. Beatmap Nominators who have not been recently warned or placed on probation, and were not about to be warned for issues, will usually resign on good terms. Standard terms is typically used for nominators who have been warned recently, are on probation, or were about to be warned for issues on their upcoming current BN evaluation.
Once a consensus for the resignation terms has been reached, the NAT will send the BN an announcement message via the Nomination Assessment Team bot informing them of their status and when they can reapply to become a BN if they so choose.
In addition to BN evaluations by NAT members, mock evaluations may also be given out to Beatmap Nominators for new BN application evaluations. In mock evaluations, nominators will submit individual evaluations alongside the NAT, but it will not determine the final result for the application unless the NAT evaluators cannot come to their own consensus. For mock evaluations they participated in, nominators will be able to read the individual evaluations in an anonymised format once the application is archived.
Mock evaluations allow the NAT to scout for future NAT members, as well as for Beatmap Nominators to see how the NAT evaluates applications and learn from them if joining the NAT in the future is something they are interested in. As such, there are no consequences for not completing them.