# Media Crawler

Install, authenticate, configure, operate, and troubleshoot the external MediaCrawler...

- Repository: https://github.com/tsingyuai/growth-lab (1975 stars)
- Category: AI and agents
- License: Apache-2.0
- Last updated: 2026-09-28
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add tsingyuai/growth-lab --skill media-crawler -g -a claude-code -y`
Codex: `npx skills add tsingyuai/growth-lab --skill media-crawler -g -a codex -y`
Cursor: `npx skills add tsingyuai/growth-lab --skill media-crawler -g -a cursor -y`
Gemini CLI: `npx skills add tsingyuai/growth-lab --skill media-crawler -g -a gemini-cli -y`

## Description

Install, authenticate, configure, operate, and troubleshoot the external MediaCrawler client shared by Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu collectors. Xiaohongshu uses the separate browser-first xiaohongshu-mcp Collector. Use when auditing this client, onboarding a supported platform account, selecting search/detail/creator modes, enabling comments or media, locating outputs, or diagnosing crawler failures.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# MediaCrawler

This is the shared tool layer. Read [operations.md](references/operations.md) before changing the external checkout. Then invoke exactly one platform Skill:

- [Douyin](../media-crawler-douyin/SKILL.md)
- [Kuaishou](../media-crawler-kuaishou/SKILL.md)
- [Bilibili](../media-crawler-bilibili/SKILL.md)
- [Weibo](../media-crawler-weibo/SKILL.md)
- [Tieba](../media-crawler-tieba/SKILL.md)
- [Zhihu](../media-crawler-zhihu/SKILL.md)

MediaCrawler does not support Twitter/X or Reddit. Do not imply otherwise.

## Contract

1. If install or authentication is missing, invoke [onboard-growth-lab](../../models/onboard-growth-lab/SKILL.md). Do not duplicate the global audit here.
   Onboarding must obtain the user's explicit ban-risk acknowledgement before login or crawling, require existing-Chrome CDP with no browser or Cookie fallback, and verify each enabled platform with a non-empty minimal real read. Installation, a persisted profile, or a visible login alone is not readiness.
2. Treat `${MEDIACRAWLER_DIR:-${GROWTHLAB_CLIENT_ROOT:-$HOME/.growth-lab/clients}/MediaCrawler}` as an external checkout. Never vendor it or commit its browser profile, cookies, databases, or downloaded data.
3. Before a run, record upstream commit, platform, crawl type, keywords/IDs, config changes, login type, comment/media flags, and destination.
4. Modify only the documented platform config and `config/base_config.py`; show the diff before running. Restore unrelated example values.
5. Run serially and conservatively. Never silently retry risk-control or authentication errors.
6. Copy the required output into the invoking Model's `memory/<model>/...`; leave source provenance beside it. A Collector does not invent a new Memory owner.
7. Apply the upstream non-commercial learning license and each target platform's terms.

## Standard invocation

The rest: https://github.com/tsingyuai/growth-lab/blob/HEAD/collectors/media-crawler/SKILL.md