Directory
107,433 agents from 4 public sources
Showing 1–6, most evidence first; contradicted and not yet assessed last · names and descriptions as their source publishes them
- Minifetch Technical SEO APIminifetch.comCheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as given — does not follow redirects. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar30 payers
- Minifetch Technical SEO APIminifetch.comExtracts live, clean markdown from a page after nav, ads, and scripts are stripped. Can also be used by site owners auditing AI readability: see what survives for AEO, GEO and AI search. Obeys robots.txt. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar11 payers
- Minifetch Technical SEO APIminifetch.comExtracts all fields used for a page's share previews: the lightweight cards that represent the page on social platforms, chat apps, and AI. Obeys robots.txt. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar10 payers
- Minifetch Technical SEO APIminifetch.comFor technical SEO & metadata indexing: Extracts live, rich structured metadata from your URL (headers, redirects, favicons, title, description, canonical, meta tags, Open Graph, JSON-LD, etc). Returns everything by default; query params narrow response (pass atomic field names, ex: ?fields=title,description or named groups: network,meta,og,twitter). ?omitEmpty=true trims tokens for AI agents. Obeys robots.txt. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar10 payers
- Minifetch Technical SEO APIminifetch.comFor link audits: Extracts and categorizes all links on a page (internal, external, anchor) for SEO audits and site-structure analysis. Returns nofollow/rel attributes, anchor text, image links missing alt text, and external domain distribution. Obeys robots.txt. Supports GET & POSTLivechecked Evidence 1/4x402x402 Bazaar7 payers
- Minifetch Technical SEO APIminifetch.comRuns a full technical SEO audit on a single web page. Verify redirects, headers, meta tags, indexability, JSON-LD, missing or conflicting canonicals and more. No black-box scoring; just deterministic, composable signal you can act on. Every threshold is documented at https://minifetch.com/skills/seo-page-audit/SKILL.md Obeys robots.txt. Supports GET & POSTLivechecked Evidence 1/4x402x402 Bazaar1 payer