Skip to main content
Web scraping and crawling for LLM-ready content. Firecrawl gives agents the ability to scrape, crawl, and search the web — converting pages into clean markdown, HTML, or structured JSON that can be used as automation context.

Setup

  1. Go to Integrations and find Firecrawl
  2. Click Connect
  3. Enter your Firecrawl API key (get one here — free tier available)
  4. Click Save — Proliferate will test the connection automatically

Available tools

ToolDescription
firecrawl_scrapeScrape a single URL to clean markdown/HTML. Supports tag filtering, mobile emulation, and main-content-only mode.
firecrawl_batch_scrapeScrape multiple URLs in parallel with built-in rate limiting
firecrawl_crawlCrawl a website following links, with configurable depth and page limits. Returns a job ID for status checking.
firecrawl_mapDiscover all URLs on a site without extracting content
firecrawl_searchWeb search with optional content scraping of results. Filterable by language, country, and source.
firecrawl_extractLLM-powered structured data extraction using JSON schema definitions
firecrawl_deep_researchExplore multiple sources for comprehensive analysis on a topic
firecrawl_check_crawl_statusCheck progress of an asynchronous crawl job
firecrawl_check_batch_scrape_statusCheck progress of a batch scrape job

Use cases

  • Scrape documentation sites or changelogs to enrich automation context (e.g., “what changed in the latest release?”)
  • Extract structured data from third-party services (pricing pages, API status pages) for automated monitoring
  • Search the web for bug reports or solutions when an automation is investigating an error
The tools listed above may not be exhaustive and can change as Firecrawl updates their MCP server. See Firecrawl documentation for the latest.