Firecrawl batch scrape and extract
Scrape multiple URLs and optionally extract information using an LLM. Needs urls.
Inputs
- URLs
- A list of text valuesRequired · urls
- Webhook
- A webhook specification objectOptional · webhook
- Max concurrency
- Maximum number of concurrent scrapesOptional · maxConcurrency
- Ignore invalid URLs
- If invalid URLs are specified in the urls array, they will be ignoredOptional · ignoreInvalidURLs
- Formats
- Output formats to include in the responseOptional · formats
- Only main content
- Only return the main content of the page excluding headers, navs, footers, etc. This is a deterministic HTML-level…Optional · onlyMainContent
- Only clean content
- BetaOptional · onlyCleanContent
- Include tags
- Tags to include in the outputOptional · includeTags
- Exclude tags
- Tags to exclude from the outputOptional · excludeTags
- Max age
- Returns a cached version of the page if it is younger than this age in millisecondsOptional · maxAge
- Min age
- When set, the request only checks the cache and never triggers a fresh scrapeOptional · minAge
- Headers
- Headers to send with the requestOptional · headers
- Wait for
- Specify a delay in milliseconds before fetching the content, allowing the page sufficient time to loadOptional · waitFor
- Mobile
- Set to true if you want to emulate scraping from a mobile deviceOptional · mobile
- Skip tls verification
- Skip TLS certificate verification when making requestsOptional · skipTlsVerification
- Timeout
- Timeout in milliseconds for the requestOptional · timeout
- Parsers
- Controls how files are processed during scrapingOptional · parsers
- Actions
- Actions to perform on the page before grabbing the contentOptional · actions
- Location
- Location settings for the requestOptional · location
- Remove base64images
- Removes all base 64 images from the markdown output, which may be overwhelmingly longOptional · removeBase64Images
- Block ads
- Enables ad-blocking and cookie popup blockingOptional · blockAds
- Proxy
- Specifies the type of proxy to use (basic, enhanced or auto)Optional · proxy
- Store in cache
- If true, the page will be stored in the Firecrawl index and cacheOptional · storeInCache
- Lockdown
- If true, serves the request from Firecrawl's cache only and never makes an outbound request to the target URLOptional · lockdown
- Redact pii
- Redact personally identifiable information from returned markdownOptional · redactPII
- Profile
- A valueOptional · profile
- Threat protection
- Per-request [Threat Protection](https://docs.firecrawl.dev/features/threat-protection) overrideOptional · threatProtection
- Audit metadata
- User attribution included with SIEM logging events when SIEM Logging is enabled for the organizationOptional · auditMetadata
- Zero data retention
- If true, this will enable zero data retention for this batch scrapeOptional · zeroDataRetention
Pricing
- Price
- Usage based, at the cost the provider reports for the call
- Billing
- Billed at the cost the provider reports for the call, never above $625. Your agent sees the maximum before running.
- Price checked
- 5 October 2026
Call
Your agent reads the schema and the price with inspect_tool before it runs the tool.
- MCP call
- cURL command
- TypeScript
- Tool ID
Alternatives
Connect your agent to 2,400+ tools for free
Sign in with Google or GitHub. No card required.