← All headings
Web scraping & browsers
2,168 listings from 1,017 providers, 1,715 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 476–500, one row per provider, those answering first · names and descriptions as their source publishes them
- SiteCheck Agent Intel & Devapi.fadeandco.workers.devWeb search via DuckDuckGo's public HTML results page: ranked titles, direct result URLs and snippets, no ads. No relevance score (DuckDuckGo does not publish one). DuckDuckGo often answers with an empty page; the tool retries, and if it still gets none the list is empty and 'note' says so.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Payload Checkseenly-payload-check.vercel.appPayload Check: data-quality filter for agents. Send any payload (tool/API output, scrape, LLM answer, code, JSON, CSV) and get a 0-100 score, pass/warn/fail, tags and issues: invalid/truncated JSON (auto-repair), schema mismatches, syntax errors, captcha/404 scrapes, LLM refusals, placeholders, repetition, mojibake. Deterministic, no LLM, not stored. Free allowance: 10 calls/day per client network with no payment: add header "X-Free-Allowance: use" (or ?free=1) to a valid request.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Agent Toolsagents.crowdspark.meFormat conversion for data pipelines and publishing: CSV to JSON, JSON to CSV, HTML to markdown, markdown to HTML, HTML to plain text. JSON body {from, to, input}.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Agent Miner Toolsagent-api-production.tim1712.workers.devUse before spending tokens, money or crawler capacity fetching an unfamiliar web resource. Resolves redirects (manually, bounded, re-validated per hop) and returns deterministic HTTP/resource facts — final URL, status, content type and length, response time, a bounded HTML title/canonical peek, and a lightweight generic-bot robots.txt indication — so an agent can decide whether a normal web fetch is worthwhile. It does not scrape, render JavaScript, or judge safety.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- mcp-x402.onrender.com/gate/squeezeos/api/web/read-markdownmcp-x402.onrender.comURL to Markdown API and converter for AI agents — convert any public HTTPS URL to clean Markdown, HTML-to-text, and LLM-ready web content with no separate scraper account or API key.Livechecked Evidence 1/4x402x402 Bazaar2 payers5 more from mcp-x402.onrender.com
- content.hugen.tokyo/content/linkscontent.hugen.tokyoExtract and classify all hyperlinks from a web page — internal vs external using eTLD+1 domain matching. Returns up to 200 internal and 200 external links with counts. No web crawler setup needed. Accepts USDC payments on Base and SolanaLivechecked Evidence 1/4x402x402 Bazaar2 payers1 more from hugen.tokyo
- x402-trends-server.onrender.com/api/scrapex402-trends-server.onrender.comScrape a public webpage and extract clean readable text. Use this web scraping endpoint when an AI agent needs page content for summarization, research, retrieval, content extraction, indexing, or downstream analysis without parsing raw HTML.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Hermes Commerceagent.kihustle.techFast deterministic check that a public URL is alive: HTTP status, redirects, content-type, size, and title. Built for agent workflows before paying for deeper crawls.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Forest Infrahttp--forest-gas-station-mainnet--lcjl27p8lmjs.code.runCheck the current operational HTTP health of one public URL or API endpoint with a bounded GET or HEAD probe. Returns reachability, status code, redirects, content type and size basics; it does not scrape page content, run JavaScript or test private networks. Base mainnet USDCLivechecked Evidence 1/4x402x402 Bazaar2 payers
- Forest Agent Toolshttp--forest-gas-station-mainnet--lcjl27p8lmjs.code.runPreflight one public Apify Actor before a paid automation run using only public Store and default-build OpenAPI metadata. Forest checks agentic-payment eligibility, pricing/budget signals and top-level input compatibility without starting an Actor, buying credit, authenticating or making an external payment. Base mainnet USDCLivechecked Evidence 1/4x402x402 Bazaar2 payers
- AGMMagmm.co.ukDomain in, a grade from A to F out: how readable a website is to AI crawlers and answer engines (robots.txt, llms.txt, sitemap, JSON-LD, MCP and x402 readiness). Public files only, no LLM. $0.05 USDC per request.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- agentbit.app/v1/website/agent-readinessagentbit.appAudit any website for AI-agent and AI-crawler readiness: HTTPS, robots.txt and AI bot rules (GPTBot, ClaudeBot, PerplexityBot), llms.txt, sitemap, title/meta, schema.org JSON-LD, security headers. Returns a 0–100 score with failed checks, issues and concrete recommendations.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Pocket Networkagent.pocket.networkFetch a web page and return its title and raw HTML (up to 200,000 characters). No browser engine is used and JavaScript is not executed, despite the name. POST /v1/render with {url} and get one JSON object back. Pages are cached for 5 minutes. Pay per request in USDC; no account, no API key.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from pocket.network
- VoidFeedvoidfeed.aiReturns clean, normalized datasets of AI model benchmarks, pricing, leaderboard scores, and Ethereum EIPs, parsed from sources that are costly to scrape.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- URL to Markdownx402-seller-pmlm.onrender.comURL to markdown: read any web page as clean, LLM-ready markdown. Use when an agent has a URL (article, docs, blog, product page) and needs the text without HTML, scripts or menus, e.g. to scrape article text or feed a page to an LLM. Pass url (https). Returns title, description, publish date, markdown, word count, headings and links. 0.004 USDC/call; failed calls are free.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- QuickBuildquickbuild.quynguyenbac.workers.devLaunchCheck full report for one public URL: status code, HTTPS/redirects, title/description, Open Graph/Twitter card, robots.txt/sitemap/noindex, plus up to 50 links checked for breakage, og:image load check, desktop 1280x800 and mobile 390x844 JPEG screenshots, edge TTFB and real-browser load time, image alt text, heading outline, mobile overflow, and a P1-P3 prioritized fix list. Read-only. Unreachable sites are not charged.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from quynguyenbac.workers.dev
- Bot Bazaarbot-bazaar.fly.devAnalyze an x402 endpoint category against empirical Base USDC crawler telemetry ($0.01 auto-buy ceiling, indexing cost, break-even sweeps).Livechecked Evidence 1/4x402x402 Bazaar2 payers2 more from bot-bazaar.fly.dev
- Agent Web Toolsagent-web-tools.agent-web-tools.workers.devMay this agent crawl this URL? robots.txt verdict per RFC 9309.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Avasis Agent Platformagents.avasis.aiRead any public web page as clean, LLM-ready markdown in one call: main content (nav/ads/scripts stripped), title, description, author, published date, canonical, language, outgoing links, word count, approx tokens and a content_sha256 for change detection (pass since_sha256 to get changed:true|false). HTML, plain text, JSON and XML. Redirects followed (5 max), 2 MB cap, 8 s budget, 60 s cache. Page 4xx/5xx -> 424, non-text -> 415, private hosts -> 400: never charged. USDC on Base, no API key.Livechecked Evidence 1/4x402x402 Bazaar2 payers
- Agent Extraction APIfreetier-agent-api.pages.devFreeTier Website to RAG pack: Turn any web page into clean AI-ready data in one call: the page as markdown, a RAG-ready index for retrieval, and page metadata (title, description). Built for agents that need to read, quote and answer from a URL. Info: https://freetier-agent-api.pages.dev/packs/website-to-ragLivechecked Evidence 1/4x402x402 Bazaar2 payers1 more from freetier-agent-api.pages.dev
- Fresh402api.fresh402.comUse Extract to read one static public HTML, JSON or text URL without registering a watch; opt-in feed_mode:entries projects RSS2/Atom. Scope HTML with CSS, exclude noisy fields and bound returned text; no JavaScript rendering or linked-page crawling. Version comparisons belong to Check or Smart Diff. x402 $0.010 USDC on Base.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from fresh402.com
- Web Page to Markdownryumoon-x402-tools.ryumoon.workers.devWeb page to markdown: read any public URL as clean, LLM-ready Markdown. Strips nav, ads and cookie banners; returns main-content Markdown plus title, author, date and word count. Charged only on success.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from ryumoon.workers.dev
- api.0mod.com/api/v1/url-markdownapi.0mod.comURL to Markdown — hybrid edge fetch + Cloudflare Browser Run JS rendering at $0.001 USDC for AI agents. Fetches any public URL in ~70ms at the edge (auto-falling back to headless Browser Run for JS SPAs or render=true), strips script/style/nav/footer boilerplate, and returns clean LLM-ready Markdown with title, word_count, char_count and rendered flag; no API key.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from 0mod.com
- 159-65-130-200.sslip.io/api/url-to-markdown159-65-130-200.sslip.ioConvert a web page URL to clean Markdown and metadata. Deterministic, no LLM. Input: {"url"}. Output: {url, finalUrl, metadata:{title,description,author,date,language,canonicalUrl}, markdown, links, wordCount}. Strips nav, footer, scripts. No JavaScript rendering or login pages. Private addresses refused. Docs: https://159-65-130-200.sslip.io/docs/Livechecked Evidence 1/4x402x402 Bazaar2 payers3 more from sslip.io
- Web Scraping to Markdownx402.agentindex.worldWeb scraping API: scrape a web page and read it as Markdown. Fetch URL content as Markdown: read any web page and get clean Markdown - navigation, ads and boilerplate stripped, links resolved, plus a real token count. The same extraction /search uses on result pages, exposed standalone for a URL you already have. Try GET /web-read/sample. Free preview of the real result in the unpaid 402 response. No result, no charge.Livechecked Evidence 1/4x402x402 Bazaar2 payers1 more from agentindex.world