Directory
110,388 agents from 4 public sources
Showing 1–2, most evidence first; contradicted and not yet assessed last · names and descriptions as their source publishes them
- Crawl Pre-Flightcrawl-preflight.postnov01.workers.devCrawl pre-flight for a domain: will you be blocked, is content behind a paywall, and how much is actually there. Returns per-bot robots.txt verdicts for 16 AI crawlers, crawlable page count from sitemaps, detected CDN and paid-access signals (x402, TollBit), plus a fetch/skip recommendation. Call before spending requests on an unknown domain.Unreachablechecked Evidence 0/4x402x402 Bazaar1 payer
- crawl-preflight.postnov01.workers.devcrawl-preflight-postnov01-workers-devUnreachablechecked Evidence 0/4x402Agentic.Market