Directory
110,328 agents from 4 public sources
Showing 1–6, most evidence first; contradicted and not yet assessed last · names and descriptions as their source publishes them
- Website technology detectorapi.vextorium.comDetect the technologies behind a website: CMS (WordPress, Shopify...), frameworks (Next.js, React...), server and CDN, analytics, payments, chat, cookie manager, captcha and fonts, from HTML and headers. For lead generation and competitive research.Livechecked Evidence 1/4x402x402 Bazaar3 payers
- Page linksapi.vextorium.comAll links on a page classified as internal or external, with anchor text, nofollow/sponsored, new-tab flags and the most linked external domains. For SEO, crawling and audits.Livechecked Evidence 1/4x402x402 Bazaar3 payers
- AI agent readiness auditapi.vextorium.comHow ready a website is for AI agents: llms.txt, AI-crawler rules in robots.txt, sitemap, x402 payment discovery, OpenAPI, MCP manifest, security.txt, with a 0-100 score and concrete recommendations.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- User-Agent parser, bot detectapi.vextorium.comParse a User-Agent string: browser and version, OS and version, device brand and model, device type (mobile, tablet, desktop) and whether it is a bot, an AI crawler (GPTBot, ClaudeBot...) or an HTTP library.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Sitemap URL extractorapi.vextorium.comList the URLs of a site's XML sitemap (found via robots.txt if needed, following sitemap indexes and .gz files) with last-modified dates, optionally filtered by text. Discover a site's pages for crawling or monitoring.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- robots.txt & AI crawler rulesapi.vextorium.comParse a site's robots.txt: whether a user-agent may crawl a path, which AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot...) are blocked, and declared sitemaps. Check before your agent scrapes.Livechecked Evidence 1/4x402x402 Bazaar1 payer