# Assessment Validity Checker

Audit a proposed assessment for construct validity, reliability, and alignment to...

- Repository: https://github.com/GarethManning/education-agent-skills (939 stars)
- Category: Engineering
- License: see repository
- Last updated: 2026-10-22
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -g -a claude-code -y`
Codex: `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -g -a codex -y`
Cursor: `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -g -a cursor -y`
Gemini CLI: `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -g -a gemini-cli -y`
Claude Code plugin marketplace: `/plugin marketplace add GarethManning/education-agent-skills`

## Description

Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives. Use when reviewing or quality-assuring assessments before deployment.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Assessment Validity Checker

## What This Skill Does

Evaluates a proposed assessment against three dimensions: validity (does it measure what it claims to measure?), reliability (would different markers agree on the score?), and authenticity (is the task meaningful and does it require genuine demonstration of the intended learning?). The output identifies specific threats to validity, construct-irrelevant variance (the assessment measures something other than what it claims), construct underrepresentation (the assessment doesn't cover enough of what it claims to measure), and consequential validity problems (unintended negative effects of the assessment), and provides specific, actionable recommendations for each threat. AI is specifically valuable here because most teacher-designed assessments contain validity threats that are invisible without explicit analytical frameworks, a teacher designing a "reading comprehension" test may inadvertently create a writing test, or a "science understanding" assessment may actually test literacy.

## Evidence Foundation

The rest: https://github.com/GarethManning/education-agent-skills/blob/HEAD/skills/curriculum-assessment/assessment-validity-checker/SKILL.md