← All headings
Web scraping & browsers
2,172 listings from 1,017 providers, 1,716 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 701–725, one row per provider, those answering first · names and descriptions as their source publishes them
- AUTOGROK Deskdesk.grokaiapps.comExtract the readable text of a web page as clean markdown. Fetches one public http(s) HTML page and returns its main content as markdown, plus title, meta description, byline and a short excerpt, with menus and page clutter removed. Useful for summarizing, quoting, or feeding a page to an LLM or RAG index without a browser. Not for logged-in, paywalled or non-HTML URLs (such as PDFs); private hosts are refused.Livechecked Contradictedx402x402 Bazaar1 payer
- OrionCMD Checksapi.orioncmd.comRun a full website security audit with a prioritized fix list for a client or vendor review. $2 USDC on Base per call. Runs every OrionCMD check plus HTTPS redirect, www/apex, security.txt, robots.txt and sitemap. Returns the A-F grade, score and an action plan sorted critical to low. Don't use this for one quick check; single checks start at $0.01.Livechecked Contradictedx402x402 Bazaar1 payer
- LinkProoflinkproof.zopip.comLinkProof site policies: for up to 5 sites, fetch robots.txt, llms.txt, llms-full.txt, ai.txt and /.well-known/security.txt in parallel. Parses robots.txt rules for common AI crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot and others) and whether a given path is allowed, lists sitemap URLs, and parses security.txt contact and expiry. Each file is size-capped; cookie or file contents beyond a short preview are not returned.Livechecked Contradictedx402x402 Bazaar1 payer
- api.liquidagent.ai/v1/leads/enrichapi.liquidagent.aiBulk business enrichment: send 1-100 websites or US phone numbers. Each input returns the business, graded email, contact, socials and website tech. $0.01 per input that finds a business; misses are free. USDC on Base or Arc.Livechecked Contradictedx402x402 Bazaar1 payer
- Browserbasex402-browserbase-com · x402.browserbase.comHeadless browser sessions + web searchLivechecked Contradictedx402Agentic.Market
- com.see-geo/seegeosee-geo.comAudit any website for AI visibility: graded report, findings with fixes, AI crawler access check.Unreachablechecked Evidence 3/4MCPWebsiteMCP Registry
- RoboWriteai.robowrite/mcp · www.robowrite.aiHosted RoboWrite MCP server: recover briefs and drafts, run the reviewed URL-to-Markdown workflow.Unreachablechecked Evidence 3/4MCPWebsiteMCP Registry
- Bot403com.bot403/bot403 · bot403.comInvisible bot shield for HTML forms: the browser solves a proof of work and your server checks it.Degradedchecked Evidence 2/3MCPWebsiteMCP Registry
- UXUS Agent Services: wallet lookup, entity labels, caller IDio.github.Dcroyalty/uxus · uxus.financeFree wallet lookup, ENS, labels, caller ID. Paid x402: search, scrape, XRP yield and lending gradesUnreachablechecked Evidence 2/4MCPWebsiteMCP Registry1 more from uxus.finance
- PageDigest — Web Page Summarizer & Structured Extractorio.github.SuBai520-QWQ/pagedigest · 4021-agqz5x3ybel4f5yrdnvpaqbzgi.instabox.techPay-per-call web page summarizer: $0.01 via x402 (USD₮0, X Layer). Free sampling available.Degradedchecked Evidence 2/4MCPMCP Registry
- Tuper Site Checkapp.tuper/site-check · mcp-check.tuper.appCheck a website in a real browser, or check if AI agents can use it: score, problems, report link.Unreachablechecked Evidence 2/4MCPWebsiteMCP Registry
- ApiFlash MCP by usefulapiio.usefulapi/apiflash · apiflash.usefulapi.ioCapture website screenshots and extract page HTML or text with ApiFlash; check your quota.Unreachablechecked Evidence 2/4MCPWebsiteMCP Registry1 more from usefulapi.io
- Scrapedvmkit--scrape.dvmkit.aiFetch a public web page as markdown using a fast browser, without anti-bot escalation. Returns inline markdown with a truncation flag. Costs $0.003 on success.Degradedchecked Evidence 1/4x402x402 Bazaar8 payers1 more from dvmkit.ai
- api.rafidsystem.com/api/v1/x402/websites/auditapi.rafidsystem.comPerform a bounded, passive technical website inspection covering measurable SEO, performance, accessibility, security, UX and crawlability indicators; unavailable checks are reported honestly. Paid per call via x402; no API key required.Degradedchecked Evidence 1/4x402x402 Bazaar1 payer1 more from rafidsystem.com
- Web Page Extractweb-extract.x402tookit.comFetch a public https page and return its HTML tables as header and row arrays, with captions and row/column spans resolved.Degradedchecked Evidence 1/4x402x402 Bazaar1 payer1 more from x402tookit.com
- TrollBridgemini-tollbooth.onrender.comPage-to-text scraper ($0.02) — fetch any public page and get clean readable text, title, and links as JSON. Optional ?crawl=1 follows same-origin links (up to 10 pages). Honest fetch, not a JS renderer. Toll: $0.02 USDC on Base or Solana.Unreachablechecked Evidence 1/4x402x402 Bazaar1 payer
- io.github.mlartab/agentwebintelagentwebintel.up.railway.appProxy-rotated web scraping and cross-platform intelligence for AI agents.Unreachablechecked Evidence 1/4MCPMCP Registry
- AIsa On-Page Auditone.aisa/seo-onpage · aisa.oneCrawl a site: pages, resources, links, duplicates, tags, Lighthouse and raw HTML.Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry
- SmartFetchio.github.Friezaaaa/smartfetch · smartfetch-production-ea53.up.railway.appHTML/PDF/Markdown, browser render, screenshots, site intel, URL map & batch via Base/Solana x402.Unreachablechecked Evidence 1/4MCPMCP Registry
- FigurePagescom.figurepages/figurepages · figurepages.comPublish self-contained HTML/SVG pages to private, shareable URLs and control who can view them.Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry
- stagenth · 网页数据com.stagenth/web · stagenth.comWeb scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.Unreachablechecked Evidence 1/3MCPMCP Registry1 more from stagenth.com
- Repondea Page Monitorcom.repondea/page-monitor · repondea.comRead saved website changes, compare before and after, and cite source URLs and observation dates.Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry
- Mags Tack Website MCPcom.magstackonline/site-mcp · magstackonline.comSearch and read public Mags Tack pages with source URLs.Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry
- Puptra PDF Snapshotcom.saastemly/puptra-pdf-snapshot · puptra-pdf-snapshot.saastemly.comOne-call URL-to-PDF and full-page screenshot API with Puppeteer's page.pdf()/page.screenshot()...Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry1 more from saastemly.com
- cash.forage/forageforage.cashWeb search and URL-to-markdown for agents. Pay per call in USDC on Base, no signup.Unreachablechecked Evidence 1/3MCPWebsiteMCP Registry