Back to MCP servers

ai-crawler-index

https://www.pathwren.workers.dev/mcp?s=pathwren-edge&c=mcp-registry

answers a handshake

Registry name: dev.workers.pathwren.www/ai-crawler-index
Reports itself as: ai-crawler-index 1.0.0
Protocol version: 2025-06-18
Transport: streamable-http
HTTP status: 200
Latency: 141 ms
Tools: 9
Checked: 2026-09-06T02:58:12Z

Tools it reports

whoami
example
classify_user_agent
lookup_crawler
list_crawlers
generate_robots_txt
is_verified_crawler_ip
whats_changed
changes_since

Check it yourself

curl -s -X POST https://www.pathwren.workers.dev/mcp?s=pathwren-edge&c=mcp-registry \
  -H 'Content-Type: application/json' \
  -H 'Accept: application/json, text/event-stream' \
  -d '{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2025-06-18","capabilities":{},"clientInfo":{"name":"you","version":"0"}}}'