← All headings
Web scraping & browsers
1,963 listings from 945 providers, 1,592 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 1–25, one row per provider, those answering first · names and descriptions as their source publishes them
- HTML entitiesagent402.toolsEncode text to HTML entities or decode them back. mode: encode (default) or decode.Livechecked Evidence 2/4x402x402 Bazaar1 payer18 more from agent402.tools
- Agent Web-Accessweb.cyberwarex.comWeb scraping API for AI agents: read any live web page as clean markdown, text or HTML. Renders JavaScript in our own headless browser, then strips navigation, ads and boilerplate. Use it when a plain HTTP GET returns empty or garbled HTML: single-page apps, dynamic feeds, or content that only appears after scripts run. Also returns the page's HTTP status. Page text is flagged untrusted so an agent treats it as input, never as instructions.Livechecked Evidence 2/4x402x402 Bazaar25 payers4 more from cyberwarex.com
- ClawFetchapi.clawfetch.aiWeb scraping / URL fetch: retrieve any web page and return clean, LLM-ready markdown text. Strips boilerplate, ads, and navigation. Stealth HTTP client bypasses common bot blocks. Cheapest way to read a webpage.Livechecked Evidence 2/4x402x402 Bazaar23 payers2 more from clawfetch.ai
- api.x402node.dev/web/batchapi.x402node.devBatch page fetch — read up to 5 URLs in one call and return clean markdown for each, via managed unlocking with residential routing and JS rendering. For bulk RAG ingestion, multi-source research, crawling and dataset building. batch read, bulk fetch, multi-url, crawler, web scraping, rag ingestion, parallel fetch, dataset building Accepts payment on Base or Solana — either network works.Livechecked Evidence 2/4x402x402 Bazaar20 payers8 more from x402node.dev
- robots.txt checker and parserapexfaucet.xyzPass ?url= (any page of a site), optional ?agent= (default *, e.g. GPTBot or Googlebot) and ?path=. We fetch the origin's /robots.txt, parse its groups (User-agent, Allow, Disallow, Crawl-delay, Sitemap) and say whether the path is allowed for that agent by the longest-match rule, which rule decided it, and the sitemaps listed. A missing robots.txt (HTTP 4xx) means allowed; a 5xx, 429 or no answer is reported as unknown (allowed: null). Reads the first 600 KB.Livechecked Evidence 2/4x402x402 Bazaar1 payer6 more from apexfaucet.xyz
- NetIntelnetintel.devExtract web content from any page or PDF as clean Markdown — web page text, HTML to Markdown for any URL: strips scripts, nav, ads, and boilerplate while preserving headings, links, lists, tables, code blocks, and blockquotes; extracts the text layer from PDFs. Returns Markdown body, title, word count, and a quality grade. Web reader for article and main content. For JS-rendered or bot-walled pages a plain fetch can't read, use /exa/contents.Livechecked Evidence 2/4x402x402 Bazaar15 payers8 more from netintel.dev
- Agent Tools UKagent-tools-production-e6aa.up.railway.appFetch a public web page and return just the main article as clean Markdown, with title, byline and excerpt. Menus, ads and footers are removed. Use when you need to read, summarise or quote a web page cheaply without parsing HTML yourself. Returns JSON {title, byline, siteName, excerpt, markdown}. Errors: 400 bad or private URL, 422 no readable article, 502 site returned an error.Livechecked Evidence 2/4x402x402 Bazaar14 payers1 more from agent-tools-production-e6aa.up.railway.app
- offercheckoffercheck.offercheck.workers.devRead any public web page as clean Markdown: main-content extraction (navigation, footers, scripts and hidden elements removed), headings, lists, tables, code blocks, links (absolute, deduplicated), images, plus title, description, canonical URL, language, author and publish date, and a content hash + fetch time as evidence. JSON and plain-text URLs are returned as-is. No JavaScript rendering. $0.001 per page.Livechecked Evidence 2/4x402x402 Bazaar13 payers
- ApiToll Reddit Searchreddit.apitoll.cloudReddit search scraper — keyword-search all of Reddit, or scope to one subreddit, for AI agents. Find posts matching any query, sorted by relevance, top, new, hot, or comments, with an optional time window. Returns each post’s title, author, subreddit, score, comment count, permalink, external link + domain, flair, and timestamp. No login, no API key. Track brand mentions, monitor topics, and surface Reddit discussion for agents.Livechecked Evidence 2/4x402x402 Bazaar11 payers2 more from apitoll.cloud
- SingIt Web Page Contents (Exa)ask.singitai.appExa page contents and highlights. Pay per call in USDC on Base or Solana, no API key. Models: GET /v1/catalog.Livechecked Evidence 2/4x402x402 Bazaar11 payers
- AARN Web Readapi.aarn.spaceRead one public web URL and convert its webpage content to clean Markdown or plain text. Removes HTML boilerplate and returns LLM-ready text for AI agents, RAG context, research and summaries. One URL per paid request.Livechecked Evidence 2/4x402x402 Bazaar11 payers1 more from aarn.space
- Web Page to Markdownpaid-md.hihat.workers.devRead any public web page as clean, LLM-ready Markdown. URL to markdown web scraper: fetches the page, strips navigation, ads, scripts, cookie banners and boilerplate, keeps the main content with headings, lists, links and tables. Use it to read, quote or summarise an article, docs page, blog post, product page or GitHub issue from a URL. Typically 90-99% fewer tokens than raw HTML; token counts returned in headers.Livechecked Evidence 1/4x402x402 Bazaar9 payers2 more from hihat.workers.dev
- serp402serp402.comGoogle: Scrape Google search results in JSON format automatically using custom parameters. Structured JSON, USD 0.05 per call in USDC — no API key, no account, no subscription, no minimum. Not affiliated with, endorsed by or an official channel of any of the services the results come from. All trademarks and copyright remain the property of their respective owners.Livechecked Evidence 1/4x402x402 Bazaar9 payers14 more from serp402.com
- Geo402geo402.comGeo web fetch for AI agents. Fetch any public web page from a residential IP in a chosen country (190+ countries, optional city or US state) as clean markdown, text or HTML, with the product price/currency/availability extracted automatically when the page has product data. $0.005 per page, only charged when the page loads. Respects robots.txt; no CAPTCHA solving; sign-in, payment and email services are blocked. Up to 2 MB per page. Check a URL free first: /api/fetch/checkLivechecked Evidence 1/4x402x402 Bazaar9 payers
- api.munition.io/v1/firecrawl/scrapeapi.munition.ioMunition Firecrawl Scrape: x402-paid web page scraping for AI agents. Pay 0.015 USDC per URL to get the page rendered with JavaScript and converted to clean markdown (optionally raw HTML, links, summary). Use when a plain fetch returns empty, JS-only or 403 content.Livechecked Evidence 1/4x402x402 Bazaar9 payers2 more from munition.io
- Nero Labs Agent Toolsx402-agent-tools.nerolabs.workers.devFetches one public web page and returns its main article text, cleaned of menus, ads and footers (Mozilla Readability), plus title, author, publish and update dates, site name, language, image and canonical URL from the publisher's own data. Honours robots.txt. Use it to read a link before summarising or quoting it. Charged only when text comes back; blocked, missing or non-HTML pages are free.Livechecked Evidence 1/4x402x402 Bazaar8 payers13 more from nerolabs.workers.dev
- SCRIPTMASTERLABSsqueezeos-api.onrender.comURL to Markdown API and converter for AI agents — convert any public HTTPS URL to clean Markdown, HTML-to-text, and LLM-ready web content with no separate scraper account or API key.Livechecked Evidence 1/4x402x402 Bazaar8 payers5 more from squeezeos-api.onrender.com
- Quant Agent Shopquantagentshop.comSEC EDGAR filings lookup. Send a US ticker, CIK or company name, optionally with form types such as 10-K, 10-Q, 8-K or 4; returns the company, its CIK and SIC code, and its latest matching filings (about the last 1,000) with form, filing date, period and direct links to the document and index, the window searched, and provenance (source URLs, retrieval times, SHA-256). Filing metadata and links only; read a filing with /v1/fetch-page. Typical response under 1 s. Failed calls are not charged.Livechecked Evidence 1/4x402x402 Bazaar8 payers
- WebRead by AgentGateapi.youraitools.coURL to Markdown API for AI agents. Converts a public web page into clean Markdown for LLMs and RAG pipelines: main content only (no nav, ads or scripts), absolute links, plus title, description and language metadata. Suited to AI agents that read, cite or summarize web pages. Respects robots.txt; only successful reads are charged. Search intents: url to markdown, web page to markdown api, web scraper for llm, html to markdown, read web page api, extract article text.Livechecked Evidence 1/4x402x402 Bazaar8 payers3 more from youraitools.co
- Apify APIstableapify.devStart the "Company Posts Scraper for LinkedIn – No Cookies" Apify actor (apimaestro/linkedin-company-posts). Extract public posts and activity from companies including post content, reactions, comments count, and media attachmentsLivechecked Evidence 1/4x402x402 Bazaar8 payers9 more from stableapify.dev
- URL Fetch / Web Scrapeagent-data.centorprat.workers.devFetch any URL (web scraping / URL fetch) and get the raw content: HTML/JSON/text as text, images and PDFs as base64 (for multimodal LLM input), or markdown. Final URL after redirects, status, content type, size. Fetched from Cloudflare's edge (fallback for sites that block it), up to 5 MB. Error statuses are not charged.Livechecked Evidence 1/4x402x402 Bazaar8 payers36 more from centorprat.workers.dev
- Textokittienda.textokit.storeWeb page to Markdown for LLMs: give a public HTTPS URL and get its main content as clean Markdown (format=markdown) or plain text, with title, character count and truncation flags; scripts, styles, navigation and ads are stripped. Use it when an agent needs to read one page for research, RAG, monitoring or summarization without a browser or API key. Static HTML only (no JavaScript rendering, no login pages), up to 20,000 characters. Free sample at /api/web-read/sample.Livechecked Evidence 1/4x402x402 Bazaar8 payers1 more from textokit.store
- ASIN402asin402.comAmazon price + price history + monthly sales by ASIN. One call, one ASIN: current buy box, Amazon, lowest new and used prices PLUS 30/90/180-day price averages and the typical 180-day price range, estimated monthly sales, sales rank, rating, review count, offer count, brand, category, image. From tracked marketplace history, not a page scrape. 11 Amazon marketplaces (domain=us, uk, de, fr, jp, ca, it, es, in, mx, br). Free sample: /api/sample/productLivechecked Evidence 1/4x402x402 Bazaar8 payers
- x240.jvnclk88.workers.dev/scrape/githubx240.jvnclk88.workers.devGitHub repo as JSON - README text plus description, stars, forks, language, topics, license and last pushLivechecked Evidence 1/4x402x402 Bazaar7 payers10 more from jvnclk88.workers.dev
- StableSocialstablesocial.devScrape Creators · Instagram — ReelsLivechecked Evidence 1/4x402x402 Bazaar7 payers44 more from stablesocial.dev