---
title: "What does Sackett et al. (2022) actually say about selection test validity?"
description: "A 2022 re-analysis found that meta-analyses of hiring tests had corrected for range restriction too aggressively, overstating how well those tests predict job performance. Correcting the error cut most published validity estimates by .10 to .20 and moved structured interviews to the top of the ranking, ahead of cognitive ability tests."
canonical: https://www.assessall.com/guides/evidence/sackett-2022-validity-re-estimates
updated: 2026-09-29
source: AssessAll
---

# What does Sackett et al. (2022) actually say about selection test validity?

A 2022 re-analysis found that meta-analyses of hiring tests had corrected for range restriction too aggressively, overstating how well those tests predict job performance. Correcting the error cut most published validity estimates by .10 to .20 and moved structured interviews to the top of the ranking, ahead of cognitive ability tests.

**Citation:** Sackett, P. R., Zhang, C., Berry, C. M. & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068.

**Source:** [Journal of Applied Psychology 107(11), 2040–2068 — doi:10.1037/apl0000994](https://doi.org/10.1037/apl0000994)

## What the source says

> Key findings are that most of the same selection procedures that ranked high in prior summaries remain high in rank, but with mean validity estimates reduced by .10–.20 points. Structured interviews emerged as the top-ranked selection procedure.
> — Abstract

> We conclude that our selection procedures remain useful, but selection predictor–criterion relationships are considerably lower than previously thought.
> — Abstract, final sentence

## What it does not say

- **Claim:** That assessments do not work, or that testing has been debunked. **Correction:** The abstract's own closing sentence is that selection procedures remain useful. The finding is about the size of the coefficients, not about whether the instruments predict anything.
- **Claim:** That the ranking of predictors was overturned. **Correction:** The same sentence says most procedures that ranked high before remain high in rank. What changed at the top is that structured interviews overtook cognitive ability; most of the order below that is stable.
- **Claim:** That the revised figures are what you would observe in your own hiring data. **Correction:** They are still corrected operational validities, corrected less aggressively. An observed correlation in one employer's pipeline will normally be lower again, because that pipeline has already been filtered.

## Revised operational validity estimates, as reported by SIOP's own publication

| Predictor | Revised validity |
|---|---|
| Structured interviews | .42 |
| Job knowledge tests | .40 |
| Empirically keyed biodata | .38 |
| Work sample tests | .33 |
| Cognitive ability tests | .31 |
| Interests (fit-based) | .24, up from .10 in the 1998 table |

These per-predictor figures are not in the paper's abstract, and the article itself is paywalled. The values above are as reported in TIP (Trends and Issues in Psychology) 60(3), the magazine of the Society for Industrial and Organizational Psychology, in an article by Patrick Gavan O'Shea and Adrienne Fox Luscombe of HumRRO — read at source on 16 September 2026. Where a figure matters to a decision, buy or borrow the paper rather than trusting any secondary table, this one included.

## What the error was

Validity coefficients are routinely corrected upwards because the people in a validation study are not a random slice of applicants — they have usually already been hired, which narrows the spread of scores and shrinks the correlation. The correction is legitimate. The size of the correction depends on an assumption about how much narrowing occurred, and meta-analyses carried that assumption in an artifact distribution.

The 2022 paper's contribution is to show that those distributions were built in ways that systematically overstated the narrowing, principally by applying restriction estimates derived from predictive designs to concurrent studies, where selection on the measure had not happened at all. The abstract describes and critiques five such approaches and concludes that each has significant issues that often result in substantial overcorrection.

## Why it matters commercially rather than academically

Almost every validity number circulating in assessment marketing traces back to the meta-analytic tradition this paper corrects. A vendor quoting a headline coefficient from before 2022 is quoting a figure its own field has since revised downward, and the revision is not small: .10 to .20 on a scale where the whole useful range is roughly .1 to .5.

The practical consequence is not to stop testing. It is that a business case built on the older numbers is overstated by a knowable amount, and that the comparison between instruments has changed at the top — a well-run structured interview is now the benchmark a test has to beat rather than the soft complement to it.

## Four years on, the revision has not reached the market — one dated instance

It is easy to assert that vendors still quote the old table and harder to show it, so here is one instance with a date on it, recorded as an observation about a page rather than a judgement about a company. On 29 September 2026 the science page at adaface.com/science published five coefficients — general mental ability .51, work sample tests .54, unstructured interviews .38, job experience .18, years of education .10 — under two headings, "Rooted in 85 years of research" and "Bringing the research into 2024".

All five are the 1998 values. The first heading is that paper's own subtitle, so the sourcing is transparent; the second dates the page two years after the revision. Against the figures reported for this 2022 re-analysis, cognitive ability moves from .51 to .31 and work samples from .54 to .33, and the predictor now at the top of the ranking, the structured interview at .42, does not appear on that page at all.

The point of recording it is not that one vendor is careless. It is that the 1998 table is the default in this market, that reproducing it is the path of least resistance for anybody writing a science page, and that the gap between a field's current estimate and its marketing estimate is now measurable in years. AssessAll is not exempt: this site found a superseded interrater-reliability coefficient still live on its own sample-report page on 28 September 2026, a day after correcting it elsewhere, and the correction is logged with its date. The only defence against coefficient drift is a dated correction log a reader can inspect, which is what this index is for.

So the question to ask a vendor, including this one, is two words long: as of when. A validity figure without a year attached is not a strong claim presented modestly; it is an undated one.

---

Source: https://www.assessall.com/guides/evidence/sackett-2022-validity-re-estimates