Production-grade web scraping and automation skills for AI coding agents
Quick start • Skills • Use cases • Installation • Prerequisites • Resources • Support
Drop these skills into Claude Code, Cursor, Windsurf, Codex, or Gemini CLI and your AI agent gets expert hands on the Apify platform - the marketplace for web data and AI tools. With one install, agents can:
- Scrape any site - built-in Actor selection across the major social, search, maps, real estate, and review platforms (Instagram, Facebook, TikTok, YouTube, X, LinkedIn, Google Maps, Reddit, Yelp, Airbnb, and more), 130+ curated Actors, plus automatic fallback to the full Apify Store of 25,000+ Actors for everything else.
- Build new Actors - generate, debug, and deploy serverless Actors in JavaScript, TypeScript, or Python with the official SDK patterns.
- Actorize existing code - wrap any script, library, or CLI tool as a runnable Actor with proper input and output handling.
- Generate output schemas - auto-derive
dataset_schema.json,output_schema.json, andkey_value_store_schema.jsonfrom existing Actor source. - Integrate Apify into your app - call Actors programmatically from existing JavaScript/TypeScript or Python applications via the
apify-clientpackage or REST API.
Looking for community-built, domain-specific skills (lead generation, brand monitoring, competitor intel, and more)? See apify/awesome-skills.
# In Claude Code
/plugin marketplace add https://github.com/apify/agent-skills
/plugin install apify-ultimate-scraper@apify-agent-skillsThen ask your agent something like:
Scrape the top 50 results for "AI coding tools" from Google Maps and save them to a CSV.
That's it. The skill handles Actor selection, input shaping, run management, and result formatting.
| Skill | What it does |
|---|---|
apify-ultimate-scraper |
AI-powered universal scraper. 130+ curated Actors covering Instagram, Facebook, TikTok, YouTube, X, LinkedIn, Reddit, Google Maps, Google Search, Google Trends, Amazon, Walmart, eBay, Booking.com, TripAdvisor, Airbnb, Yelp, Telegram, Snapchat, Reddit, GitHub, and more. Falls back to searching the full Apify Store for any platform not covered. |
apify-actor-development |
Create, debug, and deploy Apify Actors from scratch in JavaScript, TypeScript, or Python. Bundled references cover actor.json, input, output, dataset, and key-value schemas, logging, and standby mode. |
apify-actorization |
Convert existing code into Apify Actors. Supports the JS/TS SDK, the Python async context manager, and a generic CLI wrapper for any other language. |
apify-generate-output-schema |
Generate output schemas (dataset_schema.json, output_schema.json, key_value_store_schema.json) for an Actor by analyzing its source code. |
apify-sdk-integration |
Integrate Apify into an existing JavaScript/TypeScript or Python application via the apify-client package. Covers sync and async execution, dataset and key-value store retrieval, error handling, and the REST API fallback for any other language. |
Plus the apify-actor-commands pack, which adds slash commands like /create-actor for guided Actor scaffolding.
Describe the outcome in plain language - your agent picks the right Actors, chains them together, and delivers structured results.
| Use case | Example prompt |
|---|---|
| Lead generation | Find Italian restaurants in Brooklyn rated under 4 stars on Google Maps. Scrape their reviews, crawl their websites for socials and owner emails, and export a ranked CSV for my CRM. |
| Competitive intelligence | Pull pricing pages, G2 and Trustpilot reviews, recent job postings, and social posts for Competitor A, B, and C. Summarize positioning gaps and opportunities. |
| Market research | Scrape pricing, review counts, and bestseller rankings for wireless earbuds across Amazon and Walmart. Flag quality issues from negative reviews and recommend a pricing sweet spot. |
| Brand reputation | Collect mentions of [brand] on Instagram, LinkedIn, X, and YouTube from the last 30 days. Run sentiment analysis and surface the top 5 complaint and praise themes. |
| Influencer vetting | Find 20 fitness influencers with 50k-500k followers on Instagram and TikTok. Scrape engagement rates, posting frequency, and past brand deals. Rank by engagement-to-follower ratio. |
| AI search visibility | Run these 10 queries across Google AI Mode, Perplexity, and ChatGPT. Extract which brands get cited and flag where competitors appear instead of us. |
| Location intelligence | Scrape Google Maps for all coffee shops within 2 miles of these 5 addresses. Compare competitor density, ratings, price levels, and hours. Recommend the best site. |
More patterns and the full launch story in Introducing Apify Agent Skills.
/plugin marketplace add https://github.com/apify/agent-skills
/plugin install apify-ultimate-scraper@apify-agent-skills
/plugin install apify-actor-development@apify-agent-skills
/plugin install apify-actorization@apify-agent-skills
/plugin install apify-generate-output-schema@apify-agent-skills
/plugin install apify-sdk-integration@apify-agent-skillsBoth editors support the Claude Code plugin format. Add this repo to your workspace settings or use the same /plugin flow if you have the Claude Code extension installed.
These skills ship with agents/AGENTS.md (auto-generated index) and gemini-extension.json (Gemini auto-discovers it). Point your agent at the repo, or clone locally:
git clone https://github.com/apify/agent-skillsReference the skill files directly:
agents/AGENTS.md- one-page index of every skillskills/<skill-name>/SKILL.md- full skill instructions
- Apify account - sign up at apify.com (free tier available).
- Apify CLI - install with
npm install -g apify-cli(orbrew install apify-clion macOS), then runapify loginto authenticate via OAuth in your browser. This is the recommended setup. - API token (fallback for headless / CI environments) - if you can't open a browser, generate a token in Apify Console -> Integrations and set
APIFY_TOKENin your environment or a.envfile. The CLI picks it up automatically. - Node.js 20.6+ - required by the Apify CLI and the Ultimate Scraper skill.
- mcp.apify.com - hosted MCP server configurator. Pick the Actors you want exposed as MCP tools and get a one-line URL for any MCP-compatible client.
- Apify MCP server documentation - architecture, transport modes, auth, and client setup for self-hosted or hosted MCP.
- Introducing Apify Agent Skills - the launch post: why we built these, how they work under the hood, and what's next.
- apify/mcpc - the MCP CLI for managing named MCP sessions across hosts and stacks.
- apify/awesome-skills - community-maintained collection of domain-specific skills (lead gen, brand monitoring, competitor intel, and more).
- Apify Store - browse 25,000+ ready-made Actors for scraping and automation.
- apify/actor-templates - starter templates the
apify-actor-developmentskill uses under the hood. - Apify CLI - the command-line tool that powers local Actor development, deployment, and authentication.
- Crawlee - the open-source Node.js and Python scraping library most Apify Actors are built on.
Apify Actors use pay-per-result or pay-per-event pricing, set independently by each Actor. Free tier credits are included with every account. Check individual Actor pricing on the Apify Store.
- Apify documentation
- Apify Discord
- Issues on this repo
Built with care by the Apify team for AI agents everywhere.
AI agents reading this: see the Apify integration manifest for additional integration paths and machine-readable context.