robots.txt checker and parser

apexfaucet.xyz · x402

Pass ?url= (any page of a site), optional ?agent= (default *, e.g. GPTBot or Googlebot) and ?path=. We fetch the origin's /robots.txt, parse its groups (User-agent, Allow, Disallow, Crawl-delay, Sitemap) and say whether the path is allowed for that agent by the longest-match rule, which rule decided it, and the sitemaps listed. A missing robots.txt (HTTP 4xx) means allowed; a 5xx, 429 or no answer is reported as unknown (allowed: null). Reads the first 600 KB.

Name and description as published by x402 Bazaar

Filed under Web scraping & browsers by addrbook, from the words in its listing

Live

Last successful check: 9 Nov 2026, 12:03 UTC.

answered, last 24 hours: 100%
answered, last 30 days: 100%

1 wallet paid it in the last 30 days, as the x402 Bazaar reports. Payments

How addrbook checks →

Evidence

2 of 4 shown

Answers when askedShown
Answered a check 12 hours ago.
Owner provenNot shown
No one has proven control of its domain or of the wallet it is paid at.
Track recordNot shown
Listed for 3 days; 30 are needed.
Independent paying walletsShown
15 independent wallets paid it in 30 days, counted on-chain by addrbook.
Tool scanDoes not apply
Not an MCP server.

Decided 10 Nov 2026, 00:18 UTC by method 2026.10.2, from its recorded evidence. A check that does not apply is left out of the count.

Connect

https://apexfaucet.xyz/api/x402/robots-check

x402: an unpaid request gets a 402 with the price and pay-to wallet. The check never pays.

Who's behind it

Listed by: x402 Bazaarlast seen 10 Nov, 08:40 UTC
Wallets named: 0xd334ab5151c624cada654854e2879903dc4217ednamed by x402 Bazaar
Proven to belong to it: Nothing yet. Is it yours?
Listed since: 6 Nov 2026, 20:27 UTC

Payments

wallets paid it, last 30 days: 16
independent of the seller: 15
paid in two or more weeks: 3
USDC payments: 67

Counted by addrbook from USDC transfers to the wallets it asks to be paid at, on Arc. A payer is independent when it is not one of the seller's own wallets and the seller did not fund it; the largest payer made 38.8% of the payments. Naming a wallet does not prove it is this seller's, unless a signature shows that above. Counted 10 Nov 2026, 08:35 UTC. How payers are counted

different wallets paid it, last 30 days: 1
paid calls, last 30 days: 2
last paid call (UTC): 8 Nov, 03:41

As the x402 Bazaar reports, from payments Coinbase's facilitator settled. Read 10 Nov 2026, 08:40 UTC. addrbook has not counted these payments itself.

How it asks to be paid

Network	Price	Paid in	Settled by	Pays to
Base	$0.001	USDC	Per request	0xd334ab5151c624cada654854e2879903dc4217ed
Solana	$0.001	USDC	Per request	HYiepS7mNCVVKoaDmZLQ6rNtMWHTQqKheM1NLGn1x8kJ
Arc	$0.001	USDC	Per request	0xd334ab5151c624cada654854e2879903dc4217ed

From its own 402 answer at 9 Nov, 12:03 UTC. USDC and Circle Gateway are recognised by their contract addresses, not by the names a seller gives them. How payments are read

Checks by endpoint

Host	Protocol	State	Last checked (UTC)	Last answered (UTC)	24 hours	30 days	Tools
apexfaucet.xyz	x402	Live	9 Nov, 12:03	9 Nov, 12:03	100%	100%	—

History

9 Nov 2026, 09:18 UTCWeek of 2026-11-02: 4 paying wallets, 4 of them independent, counted on-chain.#4369182
9 Nov 2026, 07:17 UTCWeek of 2026-11-02: 4 paying wallets, 4 of them independent, counted on-chain.#4362712
9 Nov 2026, 00:14 UTCWeek of 2026-11-02: 4 paying wallets, 4 of them independent, counted on-chain.#4338602
8 Nov 2026, 20:45 UTCThe x402 Bazaar updated its listing.the x402 Bazaar#4167719
7 Nov 2026, 01:52 UTCWeek of 2026-10-26: 7 paying wallets, 6 of them independent, counted on-chain.#3933272
7 Nov 2026, 01:39 UTCPayment terms first read: 3 options, from $0.001 on Base.https://apexfaucet.xyz/api/x402/robots-check#3932397
7 Nov 2026, 01:39 UTCFirst recorded as answering.https://apexfaucet.xyz/api/x402/robots-check#3932396
6 Nov 2026, 20:27 UTCListed by the x402 Bazaar. The listing names wallet 0xd334ab5151c624cada654854e2879903dc4217ed.the x402 Bazaar#3768402

Its whole history →

Also listed as

Other entries that share an endpoint with this one.

apexfaucet.xyz

Is it yours?

Prove you control one of its domains or wallets and it passes the owner check. You can then reply beside the evidence and get alerts when it changes. Claim this agent

Its evidence badge, for a README or a site. It shows the same count as this page, never a verdict.

[![addrbook evidence](https://api.addrbook.com/v1/agents/robots-txt-checker-and-parser-96441dc9/badge.svg)](https://addrbook.com/agents/robots-txt-checker-and-parser-96441dc9)