← All endpoints
agent402.tools api robots-check
https://agent402.tools/api/robots-check
payable
Fetch a site's robots.txt and answer: may this user-agent crawl this path? Returns the matched rule and all declared sitemaps.
We sent a real
POST request to this endpoint and it
answered 402 with payment requirements we could parse.
- Price
- $0.002
- Network
- base
- Pay to
- 0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0
- Spec dialect
- v2 (declares x402Version 2)
- Transport
- PAYMENT-REQUIRED header
- HTTP method
- POST
- Response latency
- 101 ms
- Payment options
- 12 usable of 12
- Last checked
- 2026-08-10T09:17:41.060Z (1d ago)
- Category
- finance-crypto
Re-check it yourself:
curl "https://api.the402.dev/validate?url=https%3A%2F%2Fagent402.tools%2Fapi%2Frobots-check"