Make sense of the scoring criteria and how to apply them consistently.
Understanding Review Rubrics
Effective reviewing depends on applying consistent criteria across all applications. This guide explains the review rubric system and how to use it well.
What Is a Review Rubric?
A rubric is a set of criteria that defines what you should look for and how to weigh different aspects of an application. In Applly, the core rubric is the 0–10 score combined with qualitative notes and a recommendation.
Many organizations will provide you with supplemental rubric guidance outside of the Applly platform — in the form of a reviewer guide, scoring matrix, or onboarding document. If you haven't received any rubric guidance from the organization, reach out to your program contact before you begin reviewing.
The 0–10 Scale
Applly uses a 0–10 numeric scoring scale. Here is a general interpretation guide:
| Score | Meaning |
|---|---|
| 9–10 | Exceptional — standout application, clear fit for the program |
| 7–8 | Strong — well-developed application, compelling case |
| 5–6 | Adequate — meets requirements but lacks distinction |
| 3–4 | Weak — significant gaps or concerns |
| 1–2 | Poor — does not meet program criteria |
| 0 | Ineligible or incomplete |
Use the full range to differentiate between applications. Clustering all scores in a narrow range (e.g., 6–8 for everything) makes it harder to identify the strongest applicants.
Avoiding Reviewer Bias
To review consistently and fairly:
- Read the full application before scoring — don't let early impressions lock in a score
- Score based on the application as written, not what you imagine the applicant might have meant
- Apply the same criteria to every application regardless of the applicant's background or identity
- If you have a conflict of interest with a particular applicant, notify the organization administrator immediately and recuse yourself from that review
Calibration
If the organization has scheduled a reviewer calibration session (where reviewers score a sample application together), participate fully. Calibration sessions help ensure that all reviewers are interpreting the criteria in the same way, which leads to a fairer outcome for all applicants.