← All headings
Web scraping & browsers
2,168 listings from 1,017 providers, 1,715 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 451–475, one row per provider, those answering first · names and descriptions as their source publishes them
- web-scraper-api-production-bf20.up.railway.app/scrape/textweb-scraper-api-production-bf20.up.railway.appFetch a URL and extract clean main-content text with title, description, word count, and char count; boilerplate (nav/footer/sidebar/ads) is stripped.Livechecked Evidence 1/4x402x402 Bazaar3 payers1 more from web-scraper-api-production-bf20.up.railway.app
- AEO Inspectoraeoinspector.comCan ChatGPT, Perplexity and other AI crawlers read this site? Input: ?url=example.com. Crawls the homepage plus up to 9 sitemap pages and returns a 0-100 score, an A-F grade, prioritized fixes (each with a curl verify command), paste-ready llms.txt/robots.txt snippets, and result, fixes.txt and badge URLs. Checks robots.txt for 21 AI crawlers, bot blocks, browser-vs-crawler fetch gaps and JSON-LD. $0.05 USDC on Base. Doesn't measure brand mentions in AI answers (use /api/v1/report).Livechecked Evidence 1/4x402x402 Bazaar3 payers
- FastAFapi.fastaf.coScrape a public webpage for AI agents: convert a web page URL into markdown, HTML, links or images, with optional JavaScript rendering and AI extraction or summary. Supports web content retrieval for research and RAG; response format follows the requested options. Provided by Scrape a public webpage. Price: $0.005000 USDC per successful call. Docs: https://fastaf.coLivechecked Evidence 1/4x402x402 Bazaar3 payers1 more from fastaf.co
- SiteCheckapi.sitecheck-api.workers.devSEO and sharing metadata of one web page, read from its HTML without JavaScript: final URL and status, title and description with their lengths, canonical, robots meta, lang, hreflang, Open Graph and Twitter card tags, JSON-LD types and objects, favicon, heading outline, word count, and an issues list of plain sentences. robots.txt is respected.Livechecked Evidence 1/4x402x402 Bazaar3 payers5 more from sitecheck-api.workers.dev
- EDGAR Fundamental Scoresfundamental-scores-x402.onrender.comFetch a public http(s) web page and get its readable main content (boilerplate, nav and ads stripped via Mozilla Readability) as plain text and markdown, plus title, description, byline, site name, language, published time, word count and up to 200 absolute links. HTML and text pages up to 2 MB; 15 s timeout; follows up to 5 redirects. Honours robots.txt for User-Agent FundamentalScoresReader. No logins, paywalls or JavaScript rendering. Bad URLs (400), private/internal hosts (400) and robots.txLivechecked Evidence 1/4x402x402 Bazaar3 payers
- Stormapstormap.aiUse when the question is how well ChatGPT, Claude, Perplexity and Gemini can find, read and cite a web page: 0-100 score, letter grade, pass/fail checks (answer-bot access in robots.txt, server-rendered text, title and meta, JSON-LD, canonical, llms.txt, sitemap) and a prioritized fix list with points per fix. Blocking training crawlers does not lower the score. Errors: 400 bad_input, 502 site unreachable. Failed calls are not charged.Livechecked Evidence 1/4x402x402 Bazaar3 payers1 more from stormap.ai
- AgentReaderagent-reader.agent-reader.workers.devGet structured metadata for any public web page in one call: title, meta description, canonical URL, Open Graph and Twitter card tags, favicons, JSON-LD schema types, language and the heading outline. Use it to build link previews and social cards, classify or dedupe URLs, and run SEO and AI-readability audits - far cheaper than fetching and parsing the whole page.Livechecked Evidence 1/4x402x402 Bazaar3 payers
- fetchharbor.benlab.download/scrapefetchharbor.benlab.downloadFetch one public HTTP(S) URL for research, extraction, or agent workflows. Returns the final URL, upstream status, content type, and decoded content. Private, local, metadata, and reserved destinations are blocked; redirects are revalidated and response size and duration are bounded.Livechecked Evidence 1/4x402x402 Bazaar3 payers
- how.is/v1/botshow.isPartner tier of the dns.pizza bot observatory: every network (ASN), named crawler, TLS (JA4) fingerprint and firewall rule seen in the last 7 days, refreshed hourly. The public tier is free at https://dns.pizza/bots.Livechecked Evidence 1/4x402x402 Bazaar3 payers2 more from how.is
- readfetch.comFetch a public URL and return its main readable content as Markdown or plain text, plus title, author, published date and site name. Strips navigation, ads and boilerplate. No JavaScript rendering by default (cheaper than readfetch_scrape); one Chromium fallback when plain HTTP is blocked. Prefer readfetch_fetch when you need raw status, headers, or non-HTML bytes; readfetch_scrape when the article only appears after JavaScript runs.Livechecked Evidence 1/4x402x402 Bazaar3 payers5 more from readfetch.com
- NovaPathinstructional-decision-engine-x402.vercel.appRead one or two permitted public HTTPS pages or text-layer PDFs in one paid request. Return clean bounded text, original URLs, retrieval times, content hashes and reading limits. No model call or provider key required from the buyer. Respect robots and access restrictions; any failed requested read prevents settlement. No browser rendering, OCR or login.Livechecked Evidence 1/4x402x402 Bazaar3 payers1 more from instructional-decision-engine-x402.vercel.app
- Ausca Browser Sessionausca.comLease one ordinary remote browser with standard CDP access for 10, 30, or 60 minutes. No automation, proxy, stealth, or target-success promise.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- FiatDockfiatdock.comRead any public web page as clean text: title, description, canonical URL, the readable body with scripts, styles and navigation stripped, the first 50 links resolved to absolute URLs, and a word count. One URL in, up to 100,000 characters out; redirects are not followed, and a page with no readable text (JavaScript-only) is 422 and not charged. Pay-per-call via x402. An empty body is answered for the published example page (https://example.com/); send {"url":"https://…"} for any other page.Livechecked Evidence 1/4x402x402 Bazaar2 payers3 more from fiatdock.com
- agent-tools-7936.onrender.com/audit/siteagent-tools-7936.onrender.comUse to check whether AI agents can find and read a website: robots.txt AI-bot blocks, extractable main content, llms.txt, sitemap, structured data, OpenAPI/MCP/x402. Score 0-100 with a fix list. Errors (never charged): 400 bad input, 422 source could not be fetched or parsed, 429 rate limited (30/min), 502 upstream failed.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Agent Weatherapi.agentweather.ioPay per call, solves one question: What public crawler/agent-access files does this domain serve? Raw robots.txt groups, Content-Signal, llms.txt, well-known JSON, security.txt, TDM headers. Example: GET /v1/access-policy/cloudflare.com → {readings:[{kind, http_status, sha256}], changes_7d[]}Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Agent Reputation402.com.trThe payer-trust mirror of x402-seller-check. Reads a wallet's outgoing USDC payments on Base over 90 days: distinct sellers paid (breadth), total payments and USDC (depth), and whether it ever paid the same payee twice. Breadth with no depth in a short burst is the crawler/sampler pattern; a repeat or sustained payer is the opposite. Sees only Base USDC; absence reads as 'thin', never bad. Not financial advice.Livechecked Evidence 1/4x402x402 Bazaar2 payersCoinbase-attested wallet
- TariffMonkeetariffmonkee.comAI crawler traffic analysis from real server logs (up to 20,000 lines): hits by crawler and operator, with reverse-DNS checks that flag IPs claiming a crawler User-Agent that do not belong to that operator. Optional revenue band from a rate the caller supplies.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Oblique Marketsapi.oblique.marketsUse when an agent needs the readable text of a public page without running a browser or parsing HTML itself. Returns URL, title, meta description and cleaned body text of one public web page as bounded JSON. $0.03.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from oblique.markets
- MiniFrame Toolstools.miniframe.com.brUse when a page will not read correctly with a plain fetch — a single-page app, content loaded by JavaScript, or markup so noisy the text is buried. Fetches it with a headless browser (rendering JavaScript) and returns the main readable content as clean Markdown — ideal to feed an LLM as context. JSON body { url } (public http/https), optional include_images (default false). Returns title, final_url (after redirects), markdown and word_count. Private/internal targets are blocked.Livechecked Evidence 1/4x402x402 Bazaar2 payers2 more from miniframe.com.br
- Agent Toolsagent-tools.jbarkules.workers.devFormat conversion for data pipelines and publishing: CSV to JSON, JSON to CSV, HTML to markdown, markdown to HTML, HTML to plain text. JSON body {from, to, input}.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Sitemap URL Extractorsitemap-url-extractor.underscoredone.comGive this API a link to any website's sitemap.xml file and it will fetch and parse it, returning every URL found inside. If the sitemap links to other sitemaps (called sitemap indexes), it will follow and extract those too. Each URL is returned with any extra information available, such as when the page was last updated and how often it changes. Useful for SEO audits, content inventories, broken link checks, and competitive research.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- x402engine.app/api/web/scrapex402engine.appx402engine — Scrape any URL and get clean markdown content — ideal for extracting readable text from web pagesLivechecked Evidence 1/4x402x402 Bazaar2 payers
- SiteCheck Shop & Socialapi.shopsocial-api.workers.devSearches the public Apify Store for scraper actors by keyword: name, author, short description, and 30-day user count. Lists actors only; it does not run them or return product data.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from shopsocial-api.workers.dev
- scribe.vimabrosta.com/v1/convertscribe.vimabrosta.comConvert a document: HTML to Markdown or text, Markdown to HTML or text, a public URL to clean Markdown, text, or HTML (scripts, styles, and boilerplate removed), or a PDF (base64 or URL, 5MB, 200 pages) to text. Returns the converted document with its title or page count. $0.01.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- HubVibehubvibe-io.comFull website audit in one call: accessibility (WCAG 2.1 A/AA via axe-core), on-page SEO, HTTP security headers and page speed / page weight, from a single browser load of one URL. Cheaper than four separate calls; if any part cannot run, nothing is billed. Use a single audit route when you need only one of the four.Livechecked Evidence 1/4x402x402 Bazaar2 payers2 more from hubvibe-io.com