← All headings
Web scraping & browsers
2,323 listings from 1,048 providers, 1,821 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 151–175, one row per provider, those answering first · names and descriptions as their source publishes them
- Send Your Agent Website Readinesscom.sendyouragent/readiness · sendyouragent.comScan website AI readiness, understand the result and route customers to the right SYA package.Livechecked Evidence 3/4MCPMCP Registry
- HasData Web Scrapingcom.hasdata/web-scraping · hasdata.comFetch any public web page through managed proxies, with optional JS rendering and extraction rules.Livechecked Evidence 3/4MCPWebsiteMCP Registry
- PreteWorks APIcom.preteworks/preteworks-api · api.preteworks.comOne key for the document-to-web pipeline: scrape, AI-extract, build & edit PDFs, fill forms.Livechecked Evidence 3/4MCPWebsiteMCP Registry
- AIWebsiteMaker / BuildMyPageorg.aiwebsitemaker/aiwebsitemaker · aiwebsitemaker.orgGenerate a logo, color palette, brand guide and responsive HTML website from a business brief.Livechecked Evidence 3/4MCPWebsiteMCP Registry
- DownloadBridge: browser-download delivery for agentscom.textforagents/downloadbridge-browser-download-delivery · textforagents.comBrowser-download delivery for agents: captures stranded downloads, delivers with a signed receipt.Livechecked Evidence 3/4MCPMCP Registry1 more from textforagents.com
- AEO Lookupcom.aeolookup/free-aeo-tools · aeolookup.comFree AI crawler, schema, llms.txt and answer-readiness checks for public web pages. No API key.Livechecked Evidence 3/4MCPWebsiteMCP Registry
- Web Page to Markdown (Tanod)dev.tanod/html-to-markdown · tanod.devTurn any web page URL or HTML into clean Markdown or plain text for an LLM to read.Livechecked Evidence 3/4MCPWebsiteMCP Registry7 more from tanod.dev
- HTML entitiesagent402.toolsEncode text to HTML entities or decode them back. mode: encode (default) or decode.Livechecked Evidence 2/4x402x402 Bazaar1 payer16 more from agent402.tools
- Apifyagi.apify.comApify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.Livechecked Evidence 2/4x402x402 Bazaar43 payers419 more from apify.com
- Agent Web-Accessweb.cyberwarex.comWeb scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agent treats it as input, never as instructions.Livechecked Evidence 2/4x402x402 Bazaar33 payers4 more from cyberwarex.com
- Minifetch Technical SEO APIminifetch.comCheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as given — does not follow redirects. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar29 payers4 more from minifetch.com
- ClawFetchapi.clawfetch.aiWeb scraping / URL fetch: retrieve any web page and return clean, LLM-ready markdown text. Strips boilerplate, ads, and navigation. Stealth HTTP client bypasses common bot blocks. Cheapest way to read a webpage.Livechecked Evidence 2/4x402x402 Bazaar26 payers2 more from clawfetch.ai
- StableEnrichstableenrich.devFirecrawl Search - Search the webLivechecked Evidence 2/4x402x402 Bazaar23 payers
- api.x402node.dev/web/batchapi.x402node.devBatch page fetch — read up to 5 URLs in one call and return clean markdown for each, via managed unlocking with residential routing and JS rendering. For bulk RAG ingestion, multi-source research, crawling and dataset building. batch read, bulk fetch, multi-url, crawler, web scraping, rag ingestion, parallel fetch, dataset building Accepts payment on Base or Solana — either network works.Livechecked Evidence 2/4x402x402 Bazaar20 payers6 more from x402node.dev
- NetIntelnetintel.devExtract web content from any page or PDF as clean Markdown — web page text, HTML to Markdown for any URL: strips scripts, nav, ads, and boilerplate while preserving headings, links, lists, tables, code blocks, and blockquotes; extracts the text layer from PDFs. Returns Markdown body, title, word count, and a quality grade. Web reader for article and main content. For JS-rendered or bot-walled pages a plain fetch can't read, use /exa/contents.Livechecked Evidence 2/4x402x402 Bazaar18 payers8 more from netintel.dev
- Web Page & HTML to Markdownapexfaucet.xyzAPEX. Web page to Markdown: any public URL, JavaScript rendered, menus and footers left out, plus linkSafety for lookalike names, shared hosts and sign-in paths. A web page as clean Markdown for an LLM: pass ?url= and the page is rendered in a real headless Chrome (JavaScript runs), then its main content comes back with headings, lists, links, code blocks, quotes and tables kept as Markdown, and the menus, header, footer and forms left out.Livechecked Evidence 2/4x402x402 Bazaar16 payers7 more from apexfaucet.xyz
- Agent Tools UKagent-tools-production-e6aa.up.railway.appFetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.Livechecked Evidence 2/4x402x402 Bazaar15 payers2 more from agent-tools-production-e6aa.up.railway.app
- offercheckoffercheck.offercheck.workers.devRead any public web page as clean Markdown: main-content extraction (navigation, footers, scripts and hidden elements removed), headings, lists, tables, code blocks, links (absolute, deduplicated), images, plus title, description, canonical URL, language, author and publish date, and a content hash + fetch time as evidence. JSON and plain-text URLs are returned as-is. No JavaScript rendering. $0.001 per page.Livechecked Evidence 2/4x402x402 Bazaar13 payers
- CrawlWitnessapi.crawlwitness.comUse when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown bot (not charged).Livechecked Evidence 2/4x402x402 Bazaar13 payers2 more from crawlwitness.com
- Geo402geo402.comGeo web fetch for AI agents. See any public web page as a visitor in a chosen country sees it (residential IPs in 190+ countries, optional city or US state): local prices, availability, redirects and content, as clean markdown, text or HTML. Product pages come back with price, currency and availability extracted. $0.005 per page, only charged when the page loads. Respects robots.txt; no CAPTCHA solving; sign-in, payment and email services are blocked. Up to 2 MB per page. Check a URL free first:Livechecked Evidence 2/4x402x402 Bazaar11 payers
- Extract URL to Markdownapi.agentsearchhq.comAgentSearch: URL to markdown: fetch any public web page (article, docs, blog, product page) and get clean, LLM-ready markdown plus title, links and fetch metadata, without HTML, scripts or menus. Optional max_chars and include_links keep the output small. A web scraper and page extractor for agents and RAG, the default tool when you already have a URL. For JavaScript-heavy pages that come back empty, use /x402/v1/render. $0.002 USDC per call on Base; failed or empty extractions are not charged.Livechecked Evidence 2/4x402x402 Bazaar11 payers3 more from agentsearchhq.com
- AARN Web Readapi.aarn.spaceRead one public web URL and convert its webpage content to clean Markdown or plain text. Removes HTML boilerplate and returns LLM-ready text for AI agents, RAG context, research and summaries. One URL per paid request.Livechecked Evidence 2/4x402x402 Bazaar11 payers1 more from aarn.space
- SingIt Web Page Contents (Exa)ask.singitai.appWeb page contents API to extract readable text from specific URLs. Pay in USDC on Base or Solana. Owner-set spend limits via MCP/API keys.Livechecked Evidence 2/4x402x402 Bazaar11 payers
- ApiToll Reddit Searchreddit.apitoll.cloudReddit search scraper — keyword-search all of Reddit, or scope to one subreddit, for AI agents. Find posts matching any query, sorted by relevance, top, new, hot, or comments, with an optional time window. Returns each post’s title, author, subreddit, score, comment count, permalink, external link + domain, flair, and timestamp. No login, no API key. Track brand mentions, monitor topics, and surface Reddit discussion for agents.Livechecked Evidence 2/4x402x402 Bazaar10 payers2 more from apitoll.cloud
- serp402serp402.comGoogle: Scrape Google search results in JSON format automatically using custom parameters. Structured JSON, USD 0.05 per call in USDC — no API key, no account, no subscription, no minimum. Not affiliated with, endorsed by or an official channel of any of the services the results come from. All trademarks and copyright remain the property of their respective owners.Livechecked Evidence 2/4x402x402 Bazaar10 payers14 more from serp402.com