# Send Experiment Designer

Use when the user asks to "design an email A/B test", "set up a multivariate...

- Repository: https://github.com/aaron-he-zhu/aaron-marketing-skills (3046 stars)
- Category: Design
- License: Apache-2.0
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add aaron-he-zhu/aaron-marketing-skills --skill send-experiment-designer -g -a claude-code -y`
Codex: `npx skills add aaron-he-zhu/aaron-marketing-skills --skill send-experiment-designer -g -a codex -y`
Cursor: `npx skills add aaron-he-zhu/aaron-marketing-skills --skill send-experiment-designer -g -a cursor -y`
Gemini CLI: `npx skills add aaron-he-zhu/aaron-marketing-skills --skill send-experiment-designer -g -a gemini-cli -y`
Claude Code plugin marketplace: `/plugin marketplace add aaron-he-zhu/aaron-marketing-skills`

## Description

Use when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email result statistically and practically material?"; produces a falsifiable hypothesis, one-variable-per-cell matrix, sample-size/MDE/duration/power plan, and an effect/uncertainty read from own ESP data. Applies only a precommitted owner-approved action rule; the helper never chooses a business action. Not for EQS/vetoes or writing the email. 邮件AB测试设计/多变量测试/发送时间测试/留出组/显著性判定

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Send Experiment Designer

Designs email experiments across four modes and reads them out: a falsifiable hypothesis, a variant matrix that isolates **one** variable per cell, a sample-size / minimum-detectable-effect / run-duration / power plan, and a documented effect/uncertainty read. It may apply an owner-approved precommitted action rule, but statistical output alone never chooses a business action.

**Mode set (pick one):**

| Mode | Isolated variable | Primary metric |
|------|-------------------|----------------|
| `a-b` | one change, subject *or* preheader *or* CTA *or* creative | open (subject) / click / CTOR (CTA/creative) |
| `multivariate` | 2+ factors crossed (e.g. subject × CTA), one variable per cell | the goal metric, powered per cell |
| `send-time` | deploy hour/day; subject, segment, creative held constant | same-window engagement (open/click) |
| `hold-out` | send vs no-send (randomized control receives nothing / current default) | conversion or revenue-per-recipient (incremental lift) |

Default the mode from the request when it is unambiguous (e.g. "test two subject lines" → `a-b`, "best hour to send" → `send-time`, "measure incremental revenue" → `hold-out`); state the picked mode back and proceed.

**Scope guard:** this skill owns email **experiment design + the significance read** only. It scores the SEND **E (Engagement)** lever as a test signal, it does **not** compute the profile-weighted **EQS** or run the `S1/S2/N1/D1` vetoes ([email-quality-auditor](../email-quality-auditor/SKILL.md) does), and it does **not** write the subject/preheader/body/CTA under test ([email-creative-builder](../../engage/email-creative-builder/SKILL.md) does). Design here, produce there, gate there.

## Quick Start

The rest: https://github.com/aaron-he-zhu/aaron-marketing-skills/blob/HEAD/email/deliver/send-experiment-designer/SKILL.md