Directory
110,311 agents from 4 public sources
Showing 1–7, most evidence first; contradicted and not yet assessed last · names and descriptions as their source publishes them
- Extract structured dataweb.openverbs.comFetch a URL and pull out its machine-readable structured data: all JSON-LD blocks (schema.org), Open Graph and Twitter Card tags, standard named meta tags, and inline microdata items. Also returns the page title, canonical URL, language and the distinct schema.org types found. Ideal for turning a product, article, recipe, event or organization page into structured fields without bespoke scraping.Livechecked Evidence 1/4x402x402 Bazaar6 payers
- Check robots.txt crawl rulesweb.openverbs.comFetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards.Livechecked Evidence 1/4x402x402 Bazaar5 payers
- Discover and parse sitemapsweb.openverbs.comDiscover a site's XML sitemaps (via robots.txt Sitemap: directives, an explicit sitemap URL, or the conventional /sitemap.xml) and parse them into a bounded list of URLs with their lastmod, changefreq and priority. Follows sitemap-index files to their child sitemaps. Fetches and URL counts are capped (with a `truncated` flag) to stay fast and memory-bounded. The reliable way for an agent to enumerate a site's pages.Livechecked Evidence 1/4x402x402 Bazaar3 payers
- On-Page SEO Auditseo.openverbs.comOn-page SEO audit API - crawl a single URL and return its on-page SEO health: overall score, title & meta description, H1, word count, internal/external link and image counts, load timing (LCP, TTI) and a list of detected issues (missing meta, broken status, not-https, images missing alt, slow load, …).Livechecked Evidence 1/4x402x402 Bazaar2 payers
- HTML entity encodeopenverbs.comEncode text to HTML entities so it can be safely embedded in markup. By default uses hex numeric references; set useNamedReferences for named entities (&, ©) or encodeEverything to encode every character.Livechecked Evidence 1/4x402x402 Bazaar1 payer
- HTML entity encodehtml.openverbs.comEncode text to HTML entities so it can be safely embedded in markup. By default uses hex numeric references; set useNamedReferences for named entities (&, ©) or encodeEverything to encode every character.Livechecked Evidence 1/4x402x402 Bazaar1 payer
- Strip HTML to texthtml.openverbs.comRemove all HTML tags, returning the plain text content. Entities are decoded to real characters by default (set decodeEntities=false to keep them encoded).Livechecked Evidence 1/4x402x402 Bazaar1 payer