Map a website

The provider receives limit (1 to 100 processed URLs). Needs url. Served by Tavily.

Inputs

1 required

URL: The root URL to begin the mappingRequired · url
Instructions: Natural language instructions for the crawlerOptional · instructions
Max depth: Max depth of the mappingOptional · max_depth
Max breadth: Max number of links to follow per level of the tree (i.e., per page)Optional · max_breadth
Limit: Total number of links the crawler will process before stoppingOptional · limit
Select paths: Regex patterns to select only URLs with specific path patterns (e.g., `/docs/.*`, `/api/v1.*`)Optional · select_paths
Select domains: Regex patterns to select crawling to specific domains or subdomains (e.g., `^docs\.example\.com$`)Optional · select_domains
Exclude paths: Regex patterns to exclude URLs with specific path patterns (e.g., `/private/.*`, `/admin/.*`)Optional · exclude_paths
Exclude domains: Regex patterns to exclude specific domains or subdomains from crawling (e.g., `^private\.example\.com$`)Optional · exclude_domains
Allow external: Whether to include external domain links in the final results listOptional · allow_external
Timeout: Maximum time in seconds to wait for the map operation before timing outOptional · timeout
Include usage: Credit usage is always requested for actual-cost billingOptional · include_usage

Price: Usage based, at the cost the provider reports for the call
Billing: Billed at the cost the provider reports for the call, never above $0.16. Your agent sees the maximum before running.
Price checked: 3 November 2026

Your agent reads the schema and the price with inspect_tool before it runs the tool.

Website crawl & map