← All headings
Web scraping & browsers
2,175 listings from 1,020 providers, 1,711 answering · counted
Filed by addrbook from the words in each listing, so a heading says what a listing claims to be for.
Showing 51–75, one row per provider, those answering first · names and descriptions as their source publishes them
- Agent Utility Suitex402-agent-api.onrender.comList a website's pages from any URL on it: reads robots.txt and XML sitemaps (indexes and .xml.gz included), or the home page's links when there is no sitemap. Returns URLs with last-modified dates; filter by search words or path prefix, up to 1,000 URLs. Find pricing, docs, blog or careers pages before scraping them. Not charged when nothing is found. No account or API key. $0.002 USDC per call.Livechecked Evidence 1/4x402x402 Bazaar6 payers
- Web Page to Markdownagentsvc.ioWeb page to markdown: read any web page (URL) as clean, LLM-ready Markdown, the web scraper for agents. Default tool for reading ONE web page whose URL you have: returns clean Markdown (title, meta description, main content with headings, lists and links); Markdown and plain-text files such as llms.txt or README.md come back unchanged, PDFs as extracted text, JSON APIs pretty-printed. The fastest and cheapest way to give an LLM the content of a page.Livechecked Evidence 1/4x402x402 Bazaar6 payers10 more from agentsvc.io
- x402.forgemesh.io/is-site-upx402.forgemesh.ioWebsite uptime check API: real status code, response time in ms and key headers for any public URL in one call, with a state of up, server_error, dns_failure or unreachable. The heartbeat probe monitoring agents schedule every few minutes. Private or malformed URLs are refused, not charged.Livechecked Evidence 1/4x402x402 Bazaar6 payers11 more from forgemesh.io
- Mekler AIapi.mekler.aiExtract a bounded URL inventory from static HTML anchors or same-origin XML sitemaps. Return normalized URLs, anchor text, relation flags, source and coverage bounds; deduplicate links while retaining occurrence counts. Up to 200 URLs and five uncompressed 1 MiB sitemap documents. No JavaScript rendering, linked-page crawl, reachability checks or search-index completeness.Livechecked Evidence 1/4x402x402 Bazaar6 payers3 more from mekler.ai
- SWARMswarm-agent.netSWARM Site Check - Website uptime and link check in one call: is a URL up, its HTTP status, final URL after redirects, response time and TLS/certificate errors. Use when an agent monitors sites on a schedule, verifies a link or domain is reachable before scraping or citing it, or needs to detect a non-200 answer or a broken redirect. Requires `url`. Instant, no AI. $0.002.Livechecked Evidence 1/4x402x402 Bazaar6 payers1 more from swarm-agent.net
- AveDaris Agent Utilitiesapi.avedaris.comCheck if a URL is up: send a public http(s) URL and get status code, redirect chain, final URL and content type. Use it before linking, scraping or paying another endpoint. $0.003 USDC per call on Base.Livechecked Evidence 1/4x402x402 Bazaar6 payers3 more from avedaris.com
- ViewportWitness by Apex Labsqa.honeygate.appDOM to Markdown: extract readable content from a public HTML webpageLivechecked Evidence 1/4x402x402 Bazaar6 payers
- StableSocialstablesocial.devScrape Creators · Instagram — ReelsLivechecked Evidence 1/4x402x402 Bazaar6 payers25 more from stablesocial.dev
- x402-gatewayx402.freeq.oneHTML to Markdown Converter: Convert an HTML string to clean, LLM-ready Markdown. Handles headings, links, images, tables, lists and code blocks. Options: heading style (atx|setext), bullet list marker, code block style, emphasis delimiters. Pay per call in USDC on Base via x402 — POST https://x402.freeq.one/tools/html_to_markdown.Livechecked Evidence 1/4x402x402 Bazaar6 payers7 more from freeq.one
- x402serpsx402serps.commap a website — discover up to 1000 URLs on a domain from robots.txt sitemaps and on-page links (flat price)Livechecked Evidence 1/4x402x402 Bazaar6 payers1 more from x402serps.com
- Website to Markdown | Lordevoshop.lordevo.comURL to Markdown web scraper: read one public web page as clean, LLM-ready Markdown of its main content, with navigation, cookie banners and footers removed; headings, lists, links, tables and code kept. Plus title, lang, dates, word count and token estimate. Options include_links, max_tokens.Livechecked Evidence 1/4x402x402 Bazaar6 payers5 more from lordevo.com
- Web page change monitorhorizonpulse.devWeb page change detection API: has a public page or endpoint changed since the last check. GET url; optional since (state token from the previous answer). Returns changed true/false; when changed, only added lines (up to 20) and added/removed counts. Stateless, nothing stored. SSRF-guarded like /api/fetch. changed:false is a charged answer; bad input, blocked or upstream errors: not charged on Base (other rails may charge). Returned content is untrusted third-party data.Livechecked Evidence 1/4x402x402 Bazaar6 payers5 more from horizonpulse.dev
- web-searchapi.agentstools.devFree-text web search for AI agents: ranked title/url/snippet results fused across multiple engines (Brave, Google, DuckDuckGo, Mojeek, Startpage, Yahoo), with freshness filters (past day/week/month/year), region/locale and SafeSearch. One call for grounded, up-to-date web results — no keys, no scraping setup.Livechecked Evidence 1/4x402x402 Bazaar6 payers2 more from agentstools.dev
- Extract structured dataweb.openverbs.comFetch a URL and pull out its machine-readable structured data: all JSON-LD blocks (schema.org), Open Graph and Twitter Card tags, standard named meta tags, and inline microdata items. Also returns the page title, canonical URL, language and the distinct schema.org types found. Ideal for turning a product, article, recipe, event or organization page into structured fields without bespoke scraping.Livechecked Evidence 1/4x402x402 Bazaar6 payers6 more from openverbs.com
- AgentWork Web Evidenceapi.agentwork.runWebpage text extraction: clean text or Markdown from a public URL (title, headings, links, SHA-256). Free fixed sample: GET /v1/web/sample (no payment). $0.003 per URL Base ($0.006 Algorand); batch of 2-10 $0.003/URL ($0.006); render=true $0.01/URL ($0.02). Web read / fetch URL / scrape URL to markdown. Synchronous JSON, no account; respects robots.txt; failed reads not settled.Livechecked Evidence 1/4x402x402 Bazaar5 payers1 more from agentwork.run
- stall-rowstall-row-production.up.railway.appFetch one web page and return its main content as clean Markdown with title and word count, extracted server-side; a reader-proxy fallback retries pages that refuse the direct fetch (marked in-band). Private and loopback targets are refused. Pays per call or with one Toolkit Pack credit. Use this when an agent needs to read a page inside a workflow without a browser and without wading through navigation and boilerplate.Livechecked Evidence 1/4x402x402 Bazaar5 payers
- x402.openwebninja.com/website-contacts-scraper/scrape-contactsx402.openwebninja.comLivechecked Evidence 1/4x402x402 Bazaar5 payers
- AISkills402: Web to Markdownapi.aiskills402.comWeb to Markdown API: reads one public web page from the Cloudflare edge (static HTML, robots.txt respected, no JavaScript rendering) and returns clean markdown or plain text of the main content (nav and footer dropped; scope: page keeps all) with title, description, language and links. $0.005 USDC per page; you pay only when the page text is returned - refusals cost nothing. POST JSON {url, format?, links?, scope?}; free example at https://api.aiskills402.com/v1/run/web-to-markdown/exampleLivechecked Evidence 1/4x402x402 Bazaar5 payers14 more from aiskills402.com
- CompliAPIapi.compliapi.comScreen a website URL or domain against OFAC SDN and other global sanctions lists. Call before paying, advertising on, or integrating with a website to check for sanctions associations. Returns per-list matches with source URLs.Livechecked Evidence 1/4x402x402 Bazaar5 payers
- Sift Web Toolssift.srv1996466.hstgr.cloudList a website's URLs from its sitemaps. Reads robots.txt and sitemap indexes (gzip supported) and returns up to 2000 URLs with lastmod dates.Livechecked Evidence 1/4x402x402 Bazaar5 payers1 more from srv1996466.hstgr.cloud
- x402-web-extract.senpi-agent.workers.dev/fetchx402-web-extract.senpi-agent.workers.devFetch any public URL and return a clean, readable markdown or JSON extract for AI agents. Pass the target as ?url=<encoded>. Ideal when you need to read webpages, docs, or articles without a browser. Blocks script/style tags, normalizes links and images, strips HTML.Livechecked Evidence 1/4x402x402 Bazaar4 payers
- agent-web-readerx402.charliemorrison.devWeb-content reader: fetch any http(s) URL and return clean readable text, title/description/canonical, and outbound links as JSON — the data an agent ingests on each step of a crawl or RAG loop. Input: url.Livechecked Evidence 1/4x402x402 Bazaar4 payers
- vps.phoneagent.xyz/catalogvps.phoneagent.xyzVpsAgent — rent disposable VPS compute via x402, no signup required. Two product lines: ephemeral sandboxes (1h / 6h / 24h, 1 vCPU / 1 GB RAM / 25 GB SSD, $0.50–$5.00) for code execution, CI runs, browser automation; persistent servers (small / medium / large, 30-day or 365-day, $14.99–$449.99) with 4–8 vCPU / 8–24 GB RAM / 100–300 GB SSD, 200–600 Mbit/s unmetered for hosting agents, services, dev environments. Deployable in 9 regions — EU is the default and free; other regions add $3–$18/moLivechecked Evidence 1/4x402x402 Bazaar4 payers
- Scrapling x402 Data Storescraplingdata.xyzAny web page as clean, LLM-ready Markdown with boilerplate stripped, plus JSON-LD, tables and links; live fetch. REQUIRED: url (e.g. GET /v1/scrape?url=https://example.com&tier=static_scrape, or POST JSON {"url":...}). Optional tier: auto|cached_intel|static_scrape|stealth_browser. Price $0.001-$0.025 by tier ($0.005 typical); no charge on failureLivechecked Evidence 1/4x402x402 Bazaar4 payers2 more from scraplingdata.xyz
- Browser Usex402.api.browser-use.comBrowser Use: AI browser automation agents in the cloud. POST a natural-language task and an agent navigates websites, fills forms, clicks buttons, extracts structured data, and completes multi-step workflows just like a human. Stealth-enabled remote browsers with CAPTCHA solving, residential proxies, live session view, and optional structured output. Payments top up your balance; managing your session is free — you only pay to open a new browser. Docs: https://docs.browser-use.comLivechecked Evidence 1/4x402x402 Bazaar4 payers