Web scraping, site crawling, search, structured data extraction, and AI-powered research with Firecrawl CLI. Use when you need full page content as markdown, JS-rendered pages, anti-bot bypass, crawling entire documentation sites, extracting structured data with schemas, or deep web research. Prefer WebFetch for quick questions about a known URL. Prefer WebSearch for finding links without full content.
From firecrawlnpx claudepluginhub nathanvale/side-quest-marketplace-old --plugin firecrawlThis skill uses the workspace's default tool permissions.
references/agent-reference.mdreferences/crawl-reference.mdreferences/extract-reference.mdreferences/map-reference.mdreferences/scrape-reference.mdreferences/search-reference.mdProvides UI/UX resources: 50+ styles, color palettes, font pairings, guidelines, charts for web/mobile across React, Next.js, Vue, Svelte, Tailwind, React Native, Flutter. Aids planning, building, reviewing interfaces.
Fetches up-to-date documentation from Context7 for libraries and frameworks like React, Next.js, Prisma. Use for setup questions, API references, and code examples.
Guides Payload CMS config (payload.config.ts), collections, fields, hooks, access control, APIs. Debugs validation errors, security, relationships, queries, transactions, hook behavior.
| Need | Tool | Why |
|---|---|---|
| Quick answer from a known URL | WebFetch | Free, fast, no API key needed |
| Find links/pages on a topic | WebSearch | Free, fast, returns snippets |
| Full page content as clean markdown | Firecrawl scrape | Handles JS rendering, anti-bot, better extraction |
| Scrape JS-heavy SPAs or paywalled sites | Firecrawl scrape | --wait-for, proxy support |
| Discover all URLs on a site | Firecrawl map | Sitemap + link discovery |
| Crawl entire docs/blog site | Firecrawl crawl | Recursive, depth control, path filtering |
| Search + get full page content | Firecrawl search | --scrape flag fetches each result |
| Extract structured data with schema | Firecrawl extract | LLM-powered, typed JSON output |
| Open-ended web research | Firecrawl agent | AI browses autonomously, multi-step reasoning |
| Command | Usage |
|---|---|
/firecrawl:scrape | <url> [--only-main-content] [--format markdown,links] |
/firecrawl:search | <query> [--limit N] [--scrape] [--tbs qdr:d] |
/firecrawl:map | <url> [--search "filter"] [--limit N] |
/firecrawl:crawl | <url> --wait [--limit N] [--max-depth N] [--include-paths "/api/*"] |
/firecrawl:extract | <url> --prompt "..." [--schema '{...}'] |
/firecrawl:agent | "<prompt>" [--urls <urls>] [--wait] [--model spark-1-pro] |
export FIRECRAWL_API_KEY=fc-your-key or npx firecrawl loginnpm install -g firecrawl-cli (or use via npx firecrawl)| Operation | Cost |
|---|---|
| Scrape | 1 credit/page |
| Map | 1 credit/call |
| Search | 1 credit/result |
| Crawl | 1 credit/page crawled |
| Extract/Agent | Varies (typically 5-50 credits) |
Check https://firecrawl.dev/pricing for current rates.
For full flags and examples per command, see:
references/scrape-reference.mdreferences/search-reference.mdreferences/map-reference.mdreferences/crawl-reference.mdreferences/extract-reference.mdreferences/agent-reference.md