# Apify Ultimate Scraper

Universal AI-powered web scraper for any platform.

- Repository: https://github.com/apify/agent-skills (2481 stars)
- Category: Marketing
- License: see repository
- Last updated: 2026-10-30
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add apify/agent-skills --skill apify-ultimate-scraper -g -a claude-code -y`
Codex: `npx skills add apify/agent-skills --skill apify-ultimate-scraper -g -a codex -y`
Cursor: `npx skills add apify/agent-skills --skill apify-ultimate-scraper -g -a cursor -y`
Gemini CLI: `npx skills add apify/agent-skills --skill apify-ultimate-scraper -g -a gemini-cli -y`
Claude Code plugin marketplace: `/plugin marketplace add apify/agent-skills`

## Description

Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Search, Google Trends, Reddit, Airbnb, Yelp, and 15+ more platforms. Use for lead generation, brand monitoring, competitor analysis, influencer discovery, trend research, content analytics, audience analysis, review analysis, SEO intelligence, recruitment, or any data extraction task.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Universal web scraper

AI-driven data extraction from ~100 Actors across 15+ platforms via the Apify CLI.

**Rules for every `apify` command:**
1. Pass `--json` for machine-readable output (stable across CLI versions).
2. Pass `--user-agent apify-agent-skills/apify-ultimate-scraper` for telemetry attribution.
3. Redirect stderr with `2>/dev/null` (stderr contains progress messages that break JSON parsers).

## Prerequisites

- Apify CLI v1.5.0+ (`npm install -g apify-cli`)
- Authenticated session (see below)

## Authentication

If a CLI command fails with an auth error, authenticate using one of these methods:

1. **OAuth (interactive):** `apify login` (opens browser)
2. **Environment variable:** `export APIFY_TOKEN=your_token_here`
3. **From .env file:** `source .env` (if the file contains `APIFY_TOKEN=...`)

Generate token: https://console.apify.com/settings/integrations

## Workflow

### Step 1: Understand goal and select Actor

Identify the target platform and use case. Read `references/actor-index.md` to find the right Actor.

If the task involves a multi-step pipeline, also read the matching workflow guide:

The rest: https://github.com/apify/agent-skills/blob/HEAD/skills/apify-ultimate-scraper/SKILL.md