crawl4ai_web_map $0.001 per call

List every URL of a site without crawling it. A site's URLs from the sources that already know them: its sitemaps, the links on its home page and the newest Common Crawl indexes (mode full adds the Wayback Machine). One call, 1 to 3 seconds for most sites. Each row: url, sources, last_seen, depth. (Crawl4AI · Open web & SEO data)

For AI agents: call crawl4ai_web_map
POST https://toll402.dev/v1/p/crawl4ai.web.map
{
 "domain": "docs.crawl4ai.com",
 "max_urls": 5
}
Answers 402 with x402 payment requirements; pay with any x402 client (@x402/fetch, x402 for Python, toll402-client, toll402-mcp) or send a prepaid-credits key as x-toll402-key (https://toll402.dev/credits). Paid per call via x402 (USDC on Base) or with a prepaid-credits key (x-toll402-key, card at /credits); charged only on success. Start at /llms.txt or connect the MCP server: npx -y toll402-mcp · remote https://toll402.dev/mcp.

Input schema

{
 "type": "object",
 "properties": {
  "domain": {
   "type": "string",
   "description": "the site's host; a leading https:// is dropped, www and the bare host are one site",
   "examples": [
    "docs.crawl4ai.com"
   ]
  },
  "mode": {
   "type": "string",
   "description": "full adds the Wayback Machine, up to 20 s more",
   "default": "fast",
   "enum": [
    "fast",
    "full"
   ]
  },
  "max_urls": {
   "type": "integer",
   "default": 5000
  },
  "include": {
   "type": "string",
   "description": "keep only matching URLs: a path prefix (/docs) or a glob with * over the path"
  },
  "include_subdomains": {
   "type": "boolean",
   "default": false
  }
 },
 "additionalProperties": true,
 "required": [
  "domain"
 ]
}

MCP

{"mcpServers":{"toll402":{"command":"npx","args":["-y","toll402-mcp"],"env":{"TOLL402_WALLET_KEY":"0x..."}}}}

All tools · OpenAPI