← All endpoints
api.webbersites.com seo robots-check
https://api.webbersites.com/api/seo/robots-check
payable
robots.txt + llms.txt checker: crawler access verdicts for major search AND AI bots (Googlebot, Bingbot, GPTBot, ClaudeBot, PerplexityBot, CCBot, Google-Extended and more), declared sitemaps, syntax warnings, and llms.txt / llms-full.txt presence with structure summary. ?url=any page on the site
We sent a real
GET request to this endpoint and it
answered 402 with payment requirements we could parse.
- Price
- $0.001
- Network
- base
- Pay to
- 0xdd5fcEa81CA6f1EB39FEd5B973DE794293B81ba6
- Spec dialect
- v2 (declares x402Version 2)
- Transport
- PAYMENT-REQUIRED header
- HTTP method
- GET
- Response latency
- 306 ms
- Payment options
- 1 usable of 1
- Last checked
- 2026-08-10T09:09:25.799Z (1d ago)
- Category
- finance-crypto
Re-check it yourself:
curl "https://api.the402.dev/validate?url=https%3A%2F%2Fapi.webbersites.com%2Fapi%2Fseo%2Frobots-check"