Who is grading?
Pick your name to start. Both graders independently grade the same 360 responses, in the same order — you will never see the other grader's scores.
Before you start
- Grade only the visible model response. Judge each field independently.
- You and the other grader are scoring the same 360 responses so that agreement can be measured. Do not discuss individual items or edge cases until you have both marked your grading complete — comparing notes early destroys that measurement.
- Model identity, prompt variant, and domain are hidden by design. Do not try to infer them.
- Answers autosave as you move between items. You can go back and edit any item until you mark your grading complete.
- The full rubric is on the rubric page, and a condensed version is collapsible on every grading screen.