Ad Test Designer
Use when the user asks to "design an A/B test", "set up a creative/landing test", "run...
Install
npx skills add aaron-he-zhu/aaron-marketing-skills --skill ad-test-designer -g -a claude-code -y- Repository
- aaron-he-zhu/aaron-marketing-skills3k
- Category
- Design
- Updated
- 3d ago
- License
- Apache-2.0
- Context cost
- Mediumabout 2,329 tokens
- Runs scripts
- No, instructions only
What it does
Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants, use ad-creative-builder; not for reading back one shipped change, use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试
Ad Test Designer
Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, effect size, uncertainty, practical-effect status, and guardrail state. This skill owns experiment design + statistical interpretation. It may apply an owner-approved, precommitted action rule, but it never treats a p-value or helper output as an automatic business decision. It does not produce variants (ad-creative-builder), read back one already-shipped change (paid-measurement-loop), or do cross-channel reporting (performance-analyzer).
Quick Start
Design an A/B test for two landing-page hero variants. Baseline CVR is 3%, I want to detect a 15% lift. Goal is DR.
I have 4 RSA creative variants to test on a prospecting set. Build the variant matrix, sample size, and run duration.
Here's my finished test results CSV (variant, sessions, conversions). Is the winner significant, promote or kill?


