Skills

Ad Test Designer

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run...

Install

npx skills add aaron-he-zhu/aaron-marketing-skills --skill ad-test-designer -g -a claude-code -y
Category
Design
Updated
3d ago
License
Apache-2.0
Context cost
Mediumabout 2,329 tokens
Runs scripts
No, instructions only

What it does

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, and a documented effect/uncertainty read from own exported results. It applies only a precommitted owner-approved action rule; the statistical helper never chooses a business action. Not for producing variants, use ad-creative-builder; not for reading back one shipped change, use paid-measurement-loop. 广告AB测试设计/实验设计/显著性判定/增效测试

Ad Test Designer

Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, effect size, uncertainty, practical-effect status, and guardrail state. This skill owns experiment design + statistical interpretation. It may apply an owner-approved, precommitted action rule, but it never treats a p-value or helper output as an automatic business decision. It does not produce variants (ad-creative-builder), read back one already-shipped change (paid-measurement-loop), or do cross-channel reporting (performance-analyzer).

Quick Start

Design an A/B test for two landing-page hero variants. Baseline CVR is 3%, I want to detect a 15% lift. Goal is DR.
I have 4 RSA creative variants to test on a prospecting set. Build the variant matrix, sample size, and run duration.
Here's my finished test results CSV (variant, sessions, conversions). Is the winner significant, promote or kill?

Skill Contract

Read the whole SKILL.md on GitHub

More in Design