What is Standard setting?

Standard setting is the formal process of deciding where a cut score belongs. It uses a documented method — Angoff, bookmark, contrasting groups — with a panel, a written definition of the borderline candidate, and a record of the judgements, so that the resulting threshold can be defended rather than merely asserted.

The methods, in one line each

Angoff: judges estimate, item by item, the probability that a borderline candidate answers correctly, and the estimates are summed. Bookmark: items are ordered by difficulty and judges place a bookmark where a borderline candidate would stop succeeding. Contrasting groups: people already classified as competent or not competent by independent evidence sit the test, and the cut is placed where the two distributions are best separated.

None of them discovers a true standard. Each of them documents a defensible judgement, which is the most that can honestly be claimed and considerably more than most organisations have.

The record is the deliverable

What survives a challenge is not the number but the file: who was on the panel and why they were qualified, the borderline definition they worked to, the rounds of estimates, what data was shown between rounds, the final recommendation, and the business decision that accepted or adjusted it.

Set a review date at the same time. A standard set against a job that has since changed is a standard for a job nobody does.

Not the same as norming

Norming describes how a population performed. Standard setting decides what performance is good enough. Norming is descriptive and empirical; standard setting is a judgement about consequences and cannot be derived from data alone.