
Prompt Set QA
Gate a prompt universe for schema and provenance completeness, target or campaign...
Install
npx skills add elvisun/newsjack --skill prompt-set-qa -g -a claude-code -y- Repository
- elvisun/newsjack1.7k
- Category
- AI and agents
- Updated
- 10d ago
- License
- MIT
- Context cost
- Mediumabout 1,563 tokens
- Runs scripts
- No, instructions only
What it does
Gate a prompt universe for schema and provenance completeness, target or campaign contamination, evidence entailment, naturalness, one-concept clarity, architecture consistency, aided status, answer leakage, and semantic duplicates. Use after realistic prompt generation and before human panel selection.
Prompt Set QA
Decide pass, revise, quarantine, or reject. Do not quietly repair upstream work.
This skill inherits the ethical floor from skills/ETHICS.md. It enforces anti-hallucination, provenance, blinding, and decay-aware review. Anti-spray and human-send are not applicable.
Inputs
Require:
prompt_universe.json;prompt_architecture.json;- evidence excerpts and source metadata;
- the versioned contamination register;
- deterministic normalization, lexical scan, exact-hash, and similarity-pair results;
- optional blind human decisions.
Reject inputs that include baseline visibility, current rankings, target performance, answer-derived target pages, or selectors' preferred outcomes.
Run deterministic checks first
Check:
- schema and provenance completeness;
- unique IDs and resolved references;
- target, product, domain, people, slogan, proprietary-category, campaign, flattering-claim, and competitor terms;
- forbidden answer-derived fields;
- Unicode normalization, language, length, and one-concept shape;
- exact normalized hashes;
- lexical similarity candidate pairs;
- embedding pairs when a fixed model/version is available;
- architecture coverage, budget, and aided/lane consistency.
Deterministic target or campaign matches are hard failures in unaided core prompts. B0 target aliases pass only through a declared allowed exception. Embedding similarity may nominate a pair; it may never auto-delete.
Review semantically
For each candidate, judge:
- evidence-to-prompt entailment;
- naturalness and role/locale authenticity;
- whether both variants preserve one canonical intent;
- proximity, journey, act, expected-answer, and aided-status consistency;
- commercial leading or recommendation forcing;
- semantic slogan or flattering-claim leakage;
- whether answer-derived language entered core;
- whether a similar prompt changes a material constraint.

