# On-page crawl OnPage API checks websites for 60+ customizable on-page parameters defines and displays all found flaws and opportunities for optimization so that you can. Needs target. Served by DataForSEO. OnPage API checks websites for 60+ customizable on-page parameters defines and displays all found flaws and opportunities for optimization so that you can easily fix them. It checks meta tags, duplicate content, image tags, response codes, and other parameters on every page. You can find the full list of OnPage API check-up parameters in the Pages section. Starts a bounded crawl. The reservation settles from pages actually crawled. Use the On-Page summary/pages tools with the returned id. - Tool ID: `dataforseo/on-page-crawl` - Name in the catalog: On Page Crawl - Provider: [DataForSEO](/providers/dataforseo.md) - Capability: [Site audit (on-page)](/tools/seo/site-audit.md) - Price: from $0.00015 per page - Authentication: an authorised Agentik workspace is required for execution, including zero-price tools. ## Pricing contract The provider’s price, with no markup. Billed for measured usage. ```json { "model": "per_unit", "amountUsd": 0.00015, "unitsPath": "tasks.0.result.0.crawl_status.pages_crawled", "maxUnits": 100, "maxUnitsField": "max_crawl_pages", "multipliers": [ { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00015 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0003 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0003 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00045 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0051 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0054 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0015 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00165 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00165 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0018 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0051 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": false }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0054 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00045 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0006 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0006 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00075 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0051 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": false }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0054 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0018 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00195 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00195 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": false }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0021 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.0051 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": false }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": false } ], "setUsd": 0.00525 }, { "all": [ { "field": "load_resources", "equals": true }, { "field": "enable_javascript", "equals": true }, { "field": "enable_browser_rendering", "equals": true }, { "field": "calculate_keyword_density", "equals": true }, { "field": "enable_content_parsing", "equals": true } ], "setUsd": 0.0054 } ] } ``` Pricing source: [https://docs.dataforseo.com/v3/appendix/user_data/](https://docs.dataforseo.com/v3/appendix/user_data/). Account tariff on_page/task_post; bounds applied to inputs; actual cost from provider response.. Price verification date: 2026-10-10. ## Complete input schema ```json { "type": "object", "properties": { "target": { "type": "string", "description": "target domain required field domain name should be specified without https:// and www. if you specify the page URL, the results will be returned for the domain included in the URL", "maxLength": 2000, "minLength": 1 }, "start_url": { "type": "string", "description": "the first url to crawl optional field Note: you should specify an absolute URL if you want to crawl a single page, specify its URL in this field and additionally set the max_crawl_pages parameter to 1 you can also use the live Instant Pages", "maxLength": 2000, "minLength": 1 }, "force_sitewide_checks": { "type": "boolean", "description": "enable sitewide checks when crawling a single page optional field set to true to get data on sitewide checks when crawling a single page; default value: false" }, "priority_urls": { "type": "array", "description": "urls to be crawled bypassing the queue optional field URLs specified in this array will be crawled in the first instance, bypassing the crawling queue; Note: you should specify the absolute URL; you can specify up to 20 URLs; all URLs in th", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 20, "minItems": 1 }, "max_crawl_depth": { "type": "integer", "description": "crawl depth optional field the linking depth of the pages to crawl; for example, starting page of the crawl is level 0, pages that have links from that page are level 1, etc." }, "crawl_delay": { "type": "integer", "description": "delay between hits, ms optional field the custom delay between crawler hits to the server default value: 2000" }, "store_raw_html": { "type": "boolean", "default": true }, "enable_content_parsing": { "type": "boolean", "default": true }, "support_cookies": { "type": "boolean", "description": "support cookies on crawled pages optional field set to true to support cookies when crawling the pages default value: false" }, "accept_language": { "type": "string", "description": "language header for accessing the website optional field all locale formats are supported (xx, xx-XX, xxx-XX, etc.) Note: if you do not specify this parameter, some websites may deny access; in this case, pages will be returned with the \"ty", "maxLength": 2000, "minLength": 1 }, "browser_preset": { "type": "string", "description": "preset for browser screen parameters optional field if you use this field, you don't need to indicate browser_screen_width, browser_screen_height, browser_screen_scale_factorpossible values: desktop, mobile, tabletdesktop preset will apply ", "maxLength": 2000, "minLength": 1 }, "browser_screen_width": { "type": "integer", "description": "browser screen width optional field you can set a custom browser screen width to perform audit for a particular device; if you use this field, you don't need to indicate browser_preset as it will be ignored; Note: to use this parameter, set" }, "browser_screen_height": { "type": "integer", "description": "browser screen height optional field you can set a custom browser screen height to perform an audit for a particular device; if you use this field, you don't need to indicate browser_preset as it will be ignored; Note: to use this parameter" }, "browser_screen_scale_factor": { "type": "number", "description": "browser screen scale factor optional field you can set a custom browser screen resolution ratio to perform audit for a particular device; if you use this field, you don't need to indicate browser_preset as it will be ignored; Note: to use t", "maximum": 3 }, "respect_sitemap": { "type": "boolean", "description": "respect sitemap when crawling optional field set to true if you want to follow the order of pages indicated in the primary sitemap when crawling; default value: false Note: if set to true, the click_depth value in the API response will equa" }, "custom_sitemap": { "type": "string", "description": "custom sitemap url optional field the URL of the page where the alternative sitemap is located Note: if you want to use this parameter, respect_sitemap should be true", "maxLength": 2000, "minLength": 1 }, "crawl_sitemap_only": { "type": "boolean", "description": "crawl only pages indicated in the sitemap optional field set to true if you want to crawl only the pages indicated in the sitemap if you set this parameter to true and do not specify custom_sitemap, we will crawl the default sitemap default" }, "enable_www_redirect_check": { "type": "boolean", "description": "check if the domain implemented the www redirection optional field set to true if you want to check if the requested domain implemented the www to non-www or non-www to www redirect; default value: false" }, "disable_cookie_popup": { "type": "boolean", "description": "disable the cookie popup optional field set to true if you want to disable the popup requesting cookie consent from the user; default value: false" }, "validate_micromarkup": { "type": "boolean", "default": true }, "allow_subdomains": { "type": "boolean", "description": "include pages on subdomains optional field set to true if you want to crawl all subdomains of a target website default value: false" }, "allowed_subdomains": { "type": "array", "description": "subdomains to crawl optional field specify subdomains that you want to crawl example: [\"blog.site.com\", \"my.site.com\", \"shop.site.com\"] Note: to use this parameter, the allow_subdomains parameter should be set to false; otherwise, the conte", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 100, "minItems": 1 }, "disallowed_subdomains": { "type": "array", "description": "subdomains not to crawl optional field specify subdomains that you don't want to crawl example: [\"status.site.com\", \"docs.site.com\"] Note: to use this parameter, the allow_subdomains parameter should be set to true", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 100, "minItems": 1 }, "check_spell_language": { "type": "string", "description": "language of the spell check optional field supported languages: 'hy', 'eu', 'bg', 'ca', 'hr', 'cs', 'da', 'nl', 'en', 'eo', 'et', 'fo', 'fa', 'fr', 'fy', 'gl', 'ka', 'de', 'el', 'he', 'hu', 'is', 'ia', 'ga', 'it', 'rw', 'la', 'lv', 'lt', 'm", "maxLength": 2000, "minLength": 1 }, "check_spell_exceptions": { "type": "array", "description": "words excluded from spell check optional field specify the words that you want to exclude from spell check maximum word length: 100 characters maximum amount of words: 1000 example: \"SERP\", \"minifiers\", \"JavaScript\"", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 100, "minItems": 1 }, "checks_threshold": { "type": "object", "description": "custom threshold values for checks optional field you can specify custom threshold values for the parameters included in the checks object of OnPage API responses; Note: only integer threshold values can be modified; for example, the high_l", "properties": {}, "additionalProperties": { "type": "integer" } }, "disable_sitewide_checks": { "type": "array", "description": "prevent certain sitewide checks from running optional field specify the following checks to prevent them from running on the target website: \"test_page_not_found\" \"test_canonicalization\" \"test_https_redirect\" \"test_directory_browsing\"exampl", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 100, "minItems": 1 }, "disable_page_checks": { "type": "array", "description": "prevent certain page checks from running optional field specify certain checks to prevent them from running and impacting the onpage_scoreexample: \"disable_page_checks\": [\"is_5xx_code\", \"is_4xx_code\"]", "items": { "type": "string", "maxLength": 2000, "minLength": 1 }, "maxItems": 100, "minItems": 1 }, "switch_pool": { "type": "boolean", "description": "switch proxy pool optional field if true, additional proxy pools will be used to obtain the requested data; the parameter can be used if a multitude of tasks is set simultaneously, resulting in occasional rate-limit and/or site_unreachable " }, "return_despite_timeout": { "type": "boolean", "description": "return data on pages despite the timeout error optional field if true, the data will be provided on pages that failed to load within 120 seconds and responded with a timeout error; default value: false" }, "tag": { "type": "string", "description": "user-defined task identifier optional field the character limit is 255 you can use this parameter to identify the task and match it with the result you will find the specified tag value in the data object of the response", "maxLength": 255 }, "max_crawl_pages": { "type": "integer", "minimum": 1, "maximum": 100, "default": 5, "description": "Maximum pages Agentik authorizes the upstream crawler to fetch." }, "load_resources": { "type": "boolean", "default": false }, "enable_javascript": { "type": "boolean", "default": false }, "enable_browser_rendering": { "type": "boolean", "default": false }, "calculate_keyword_density": { "type": "boolean", "default": false } }, "required": [ "target" ], "additionalProperties": false, "allOf": [ { "if": { "properties": { "enable_browser_rendering": { "const": true } }, "required": [ "enable_browser_rendering" ] }, "then": { "properties": { "enable_javascript": { "const": true }, "load_resources": { "const": true } }, "required": [ "enable_javascript", "load_resources" ] } } ] } ``` ## Published example This is the provider tool’s published example. Replace example values with the user’s requested inputs, respecting the schema; do not execute an example merely to test a connection. ```json { "tool_id": "dataforseo/on-page-crawl", "input": { "target": "dataforseo.com", "max_crawl_pages": 5, "load_resources": true, "enable_javascript": false, "enable_browser_rendering": false, "calculate_keyword_density": true, "enable_content_parsing": true, "store_raw_html": true, "validate_micromarkup": true } } ``` ## Execute and retrieve Inspect again before execution, explain the price and obtain the required authority. Use MCP run_tool or POST /v1/run with this tool ID, valid input and an idempotency key. Save the returned run ID and follow the actual state. If Agentik answers that the tool is temporarily unavailable, do not retry it blindly; use discovery to propose an alternative. This tool uses deferred settlement. Follow its returned task/run instructions; preserve the existing reservation until the result is reconciled. A partial or uncertain result can still have consumed provider resources. Consult [billing](/docs/billing.md), [idempotency](/docs/idempotency.md) and [asynchronous results](/docs/async.md). [Provider documentation](https://docs.dataforseo.com/v3/on_page/task_post/) [REST inspection](https://api.agentik.cc/v1/tools/dataforseo/on-page-crawl) · [OpenAPI](/openapi.json) · [Connection guide](/connect.md) --- [HTML page](/providers/dataforseo/on-page-crawl) · [Agent index](/llms.txt)