← All headings
Web scraping & browsers
2,071 listings from 983 providers, 1,680 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 151–175, one row per provider, those answering first · names and descriptions as their source publishes them
- HTML entitiesagent402.toolsEncode text to HTML entities or decode them back. mode: encode (default) or decode.Livechecked Evidence 2/4x402x402 Bazaar1 payer18 more from agent402.tools
- Apifyagi.apify.comApify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation. Use these tools, called Actors, to extract structured data from social media, e-commerce sites, search engines, maps, travel sites, or any other website. Turn the open web into a real-time data source for your research, lead generation, and monitoring.Livechecked Evidence 2/4x402x402 Bazaar45 payers422 more from apify.com
- Agent Web-Accessweb.cyberwarex.comWeb scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agent treats it as input, never as instructions.Livechecked Evidence 2/4x402x402 Bazaar30 payers4 more from cyberwarex.com
- Minifetch Technical SEO APIminifetch.comCheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as given — does not follow redirects. Supports GET & POSTLivechecked Evidence 2/4x402x402 Bazaar29 payers4 more from minifetch.com
- StableEnrichstableenrich.devFirecrawl Search - Search the webLivechecked Evidence 2/4x402x402 Bazaar27 payers
- ClawFetchapi.clawfetch.aiWeb scraping / URL fetch: retrieve any web page and return clean, LLM-ready markdown text. Strips boilerplate, ads, and navigation. Stealth HTTP client bypasses common bot blocks. Cheapest way to read a webpage.Livechecked Evidence 2/4x402x402 Bazaar25 payers2 more from clawfetch.ai
- api.x402node.dev/web/batchapi.x402node.devBatch page fetch — read up to 5 URLs in one call and return clean markdown for each, via managed unlocking with residential routing and JS rendering. For bulk RAG ingestion, multi-source research, crawling and dataset building. batch read, bulk fetch, multi-url, crawler, web scraping, rag ingestion, parallel fetch, dataset building Accepts payment on Base or Solana — either network works.Livechecked Evidence 2/4x402x402 Bazaar20 payers6 more from x402node.dev
- NetIntelnetintel.devExtract web content from any page or PDF as clean Markdown — web page text, HTML to Markdown for any URL: strips scripts, nav, ads, and boilerplate while preserving headings, links, lists, tables, code blocks, and blockquotes; extracts the text layer from PDFs. Returns Markdown body, title, word count, and a quality grade. Web reader for article and main content. For JS-rendered or bot-walled pages a plain fetch can't read, use /exa/contents.Livechecked Evidence 2/4x402x402 Bazaar17 payers8 more from netintel.dev
- Agent Tools UKagent-tools-production-e6aa.up.railway.appFetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.Livechecked Evidence 2/4x402x402 Bazaar14 payers2 more from agent-tools-production-e6aa.up.railway.app
- offercheckoffercheck.offercheck.workers.devRead any public web page as clean Markdown: main-content extraction (navigation, footers, scripts and hidden elements removed), headings, lists, tables, code blocks, links (absolute, deduplicated), images, plus title, description, canonical URL, language, author and publish date, and a content hash + fetch time as evidence. JSON and plain-text URLs are returned as-is. No JavaScript rendering. $0.001 per page.Livechecked Evidence 2/4x402x402 Bazaar13 payers
- CrawlWitnessapi.crawlwitness.comUse when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown bot (not charged).Livechecked Evidence 2/4x402x402 Bazaar12 payers6 more from crawlwitness.com
- SingIt Web Page Contents (Exa)ask.singitai.appWeb page contents API to extract readable text from specific URLs. Pay in USDC on Base or Solana. Owner-set spend limits via MCP/API keys.Livechecked Evidence 2/4x402x402 Bazaar12 payers
- ApiToll Reddit Searchreddit.apitoll.cloudReddit search scraper — keyword-search all of Reddit, or scope to one subreddit, for AI agents. Find posts matching any query, sorted by relevance, top, new, hot, or comments, with an optional time window. Returns each post’s title, author, subreddit, score, comment count, permalink, external link + domain, flair, and timestamp. No login, no API key. Track brand mentions, monitor topics, and surface Reddit discussion for agents.Livechecked Evidence 2/4x402x402 Bazaar11 payers2 more from apitoll.cloud
- AARN Web Readapi.aarn.spaceRead one public web URL and convert its webpage content to clean Markdown or plain text. Removes HTML boilerplate and returns LLM-ready text for AI agents, RAG context, research and summaries. One URL per paid request.Livechecked Evidence 2/4x402x402 Bazaar11 payers1 more from aarn.space
- Web Page to Markdownpaid-md.hihat.workers.devRead any public web page as clean, LLM-ready Markdown. URL to markdown web scraper: fetches the page, strips navigation, ads, scripts, cookie banners and boilerplate, keeps the main content with headings, lists, links and tables. Use it to read, quote or summarise an article, docs page, blog post, product page or GitHub issue from a URL. Typically 90-99% fewer tokens than raw HTML; token counts returned in headers.Livechecked Evidence 2/4x402x402 Bazaar10 payers2 more from hihat.workers.dev
- serp402serp402.comGoogle: Scrape Google search results in JSON format automatically using custom parameters. Structured JSON, USD 0.05 per call in USDC — no API key, no account, no subscription, no minimum. Not affiliated with, endorsed by or an official channel of any of the services the results come from. All trademarks and copyright remain the property of their respective owners.Livechecked Evidence 2/4x402x402 Bazaar10 payers14 more from serp402.com
- x240.jvnclk88.workers.dev/scrapex240.jvnclk88.workers.devWeb scraping - fetch any URL, get clean text backLivechecked Evidence 2/4x402x402 Bazaar10 payers10 more from jvnclk88.workers.dev
- Bot403com.bot403/bot403 · bot403.comInvisible bot shield for HTML forms: the browser solves a proof of work and your server checks it.Live, sign-in requiredchecked Evidence 2/3MCPWebsiteMCP Registry
- Crawlieapp.crawlie/crawlie · crawlie.appTechnical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.Live, sign-in requiredchecked Evidence 2/3MCPWebsiteMCP Registry
- Liciumio.github.Licium-ai/licium · www.licium.aiClean rows from public pages that break ordinary scrapers, plus a bounty board where agents earn.Livechecked Evidence 2/4MCPWebsiteMCP Registry
- HTML meta tag count, markup discardedio.github.sadri-dridi/html-meta-n · agent-observatory-sensor.nolimit-observatory.workers.devHTML meta tag count, markup discardedLivechecked Evidence 2/4MCPMCP Registry19 more from nolimit-observatory.workers.dev
- io.gmapsscraper/mcpgmapsscraper.ioScrape Google Maps business data from any MCP client — names, phones, emails, websites, ratings.Livechecked Evidence 2/3WebsiteMCP Registry
- Bizcrawcom.bizcraw/bizcraw · bizcraw.comWeb scraping and AI sales workspace with scoped CRM, scraping, knowledge and sales workflow tools.Live, sign-in requiredchecked Evidence 2/3MCPWebsiteMCP Registry
- AgentScrapeio.github.hshintelligence/agent-scrape · agent-scrape.healingsunhaven.workers.devPay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.Livechecked Evidence 2/4MCPWebsiteMCP Registry
- io.github.abhibavishi/rankparse-mcpmcp.rankparse.comSEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl.Live, sign-in requiredchecked Evidence 2/4MCPMCP Registry