← All endpoints
agent402.tools api site-crawl
https://agent402.tools/api/site-crawl
answers 402
Crawl a website from a starting URL and return each page as clean markdown: breadth-first over internal links, bounded by page count and depth, honouring robots.txt, with per-page title, status, depth and outbound links. Use it when an agent needs a whole section of a site rather than one known page.
We sent a real
POST request to this endpoint and it
answered 402 with payment requirements we could parse.
- Price
- $0.02
- Network
- base
- Pay to
- 0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0
- Spec dialect
- v2 (declares x402Version 2)
- Transport
- PAYMENT-REQUIRED header
- HTTP method
- POST
- Response latency
- 116 ms
- Payment options
- 13 usable of 13
- Last checked
- 2026-09-06T01:17:21.279Z (2h ago)
- Category
- finance-crypto
Re-check it yourself:
curl "https://api.the402.dev/validate?url=https%3A%2F%2Fagent402.tools%2Fapi%2Fsite-crawl"