Media Crawler
Install, authenticate, configure, operate, and troubleshoot the external MediaCrawler...
Install
npx skills add tsingyuai/growth-lab --skill media-crawler -g -a claude-code -y- Repository
- tsingyuai/growth-lab2k
- Category
- AI and agents
- Updated
- 1mo ago
- License
- Apache-2.0
- Context cost
- Lightabout 613 tokens
- Runs scripts
- No, instructions only
What it does
Install, authenticate, configure, operate, and troubleshoot the external MediaCrawler client shared by Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu collectors. Xiaohongshu uses the separate browser-first xiaohongshu-mcp Collector. Use when auditing this client, onboarding a supported platform account, selecting search/detail/creator modes, enabling comments or media, locating outputs, or diagnosing crawler failures.
MediaCrawler
This is the shared tool layer. Read operations.md before changing the external checkout. Then invoke exactly one platform Skill:
MediaCrawler does not support Twitter/X or Reddit. Do not imply otherwise.
Contract
- If install or authentication is missing, invoke onboard-growth-lab. Do not duplicate the global audit here. Onboarding must obtain the user's explicit ban-risk acknowledgement before login or crawling, require existing-Chrome CDP with no browser or Cookie fallback, and verify each enabled platform with a non-empty minimal real read. Installation, a persisted profile, or a visible login alone is not readiness.
- Treat
${MEDIACRAWLER_DIR:-${GROWTHLAB_CLIENT_ROOT:-$HOME/.growth-lab/clients}/MediaCrawler}as an external checkout. Never vendor it or commit its browser profile, cookies, databases, or downloaded data. - Before a run, record upstream commit, platform, crawl type, keywords/IDs, config changes, login type, comment/media flags, and destination.
- Modify only the documented platform config and
config/base_config.py; show the diff before running. Restore unrelated example values. - Run serially and conservatively. Never silently retry risk-control or authentication errors.
- Copy the required output into the invoking Model's
memory/<model>/...; leave source provenance beside it. A Collector does not invent a new Memory owner. - Apply the upstream non-commercial learning license and each target platform's terms.
