addrbookFor publishers
← The evidence ledger

Evidence row 124035

Observed , by baseline/1.

Kind
listing
About
source_record x402_bazaar:https://web.openverbs.com/v1/robots
Recorded
Previous row
None: the first of its kind about this subject
Body SHA-256
4869a5db2bc19e3c0cd57cf62cb689ee3de854e299f31658acbdda73ad45ebee
Leaf
0x7831eaff5d01ff43b1d5cbd09d6ce5241116a86cd694a268e67dfee7c875cf25

What was observed

{
  "endpoints": [
    [
      "x402",
      "https://web.openverbs.com/v1/robots"
    ]
  ],
  "name": "Check robots.txt crawl rules",
  "owner_address": "0xb3f4de103f34b99f0da19b4f16d6b53a14c2194a",
  "raw": {
    "accepts": [
      {
        "amount": "6000",
        "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
        "extra": {
          "name": "USD Coin",
          "version": "2"
        },
        "maxTimeoutSeconds": 300,
        "network": "eip155:8453",
        "payTo": "0xb3f4de103F34b99f0Da19B4F16D6B53a14C2194A",
        "scheme": "exact"
      }
    ],
    "description": "Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards.",
    "extensions": {
      "bazaar": {
        "info": {
          "input": {
            "body": {
              "paths": [
                "example"
              ],
              "url": "https://example.com",
              "userAgent": "example"
            },
            "bodyType": "json",
            "method": "POST",
            "type": "http"
          }
        },
        "schema": {
          "$schema": "https://json-schema.org/draft/2020-12/schema",
          "properties": {
            "input": {
              "additionalProperties": false,
              "properties": {
                "body": {
                  "additionalProperties": false,
                  "properties": {
                    "paths": {
                      "description": "Optional extra paths (or same-origin URLs) to check in the same call, e.g. [\"/admin\", \"/search?q=x\"]. Up to 50.",
                      "items": {
                        "maxLength": 2048,
                        "minLength": 1,
                        "type": "string"
                      },
                      "maxItems": 50,
                      "type": "array"
                    },
                    "url": {
                      "description": "Public http(s) URL to check. Its origin's /robots.txt is fetched and its path is the first path evaluated.",
                      "format": "uri",
                      "maxLength": 2048,
                      "type": "string"
                    },
                    "userAgent": {
                      "description": "User-agent token to evaluate rules for, e.g. \"Googlebot\". Defaults to \"*\".",
                      "maxLength": 200,
                      "minLength": 1,
                      "type": "string"
                    }
                  },
                  "required": [
                    "url"
                  ],
                  "type": "object"
                },
                "bodyType": {
                  "enum": [
                    "json",
                    "form-data",
                    "text"
                  ],
                  "type": "string"
                },
                "method": {
                  "enum": [
                    "POST"
                  ],
                  "type": "string"
                },
                "type": {
                  "const": "http",
                  "type": "string"
                }
              },
              "required": [
                "type",
                "method",
                "bodyType",
                "body"
              ],
              "type": "object"
            }
          },
          "required": [
            "input"
          ],
          "type": "object"
        }
      }
    },
    "lastUpdated": "2026-10-25T21:58:55.756Z",
    "quality": {
      "l30DaysTotalCalls": 7,
      "l30DaysUniquePayers": 6,
      "lastCalledAt": "2026-10-25T21:58:55.5Z"
    },
    "resource": "https://web.openverbs.com/v1/robots",
    "serviceName": "Check robots.txt crawl rules",
    "tags": [
      "robots.txt parser",
      "robots txt checker",
      "is url crawlable",
      "crawl permission api",
      "user-agent allow disallow"
    ],
    "type": "http",
    "x402Version": 2
  },
  "source": "x402_bazaar",
  "summary": "Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the crawl-delay and any declared sitemaps. Implements the Robots Exclusion Protocol (RFC 9309) with longest-match-wins, Allow-over-Disallow tie-breaking and * / $ wildcards."
}

What the leaf hashes

{"body":"4869a5db2bc19e3c0cd57cf62cb689ee3de854e299f31658acbdda73ad45ebee","id":124035,"kind":"listing","method":"baseline/1","observed_us":1793025624029899,"prev":null,"subject":"x402_bazaar:https://web.openverbs.com/v1/robots","subject_kind":"source_record"}

Proof

Fold these into the leaf in order, hashing each sorted pair with keccak256, to reach the root of (296695 rows).

  1. 0x78321de3cd9deab5623b3ba66d706f232199f462e3b0d1e0734ced98b557fc83
  2. 0x866aba0d5d676c209967ca788448e24ede2efd723d4fc6a97522fc22aa6b2361
  3. 0xb0b7ef3c63c0071d4bf02a564b3425b38e5277c951bb7f5581385ceec77fb23e
  4. 0x42ad0eabb099386bffc1383fb706bad5d69860f20047e84138f689fee9f8de50
  5. 0xfc7ed8551b05e8af79dd8e446eb5935ab1e9d072cffa2c1f9305ff7bf29aab05
  6. 0x04d08554db9df25c02dfd5d2b5bb26700c27d4f59cc074949d974960439a0ab7
  7. 0x18f7d63543ccc6f36b6ed2c6ab425ff9f12d9e8153261a7e10c042c416044316
  8. 0x79074def72dae8c5e7b2f05bfb5c8994e602649db5e77fdd9fe314515455c5f1
  9. 0xe7a567a06402dbc17c02e19cb76a342a6e2e155568ea808558236b065d1478f7
  10. 0x7289d13e9c5129911e8dd0a94c4ccdb3088dca627d8df693e7d7c3b58bbbd576
  11. 0x8fe7ebf89d10ac2e699de3f80f5dda3e72eef4ae079794ab7d1035929ad723cc
  12. 0x8fdfac9874f184de58b63efbdab0fc27674958d741146d02f58b04d3c559cabf
  13. 0xdef3cab0b4070d8ad7f4f91288da4881d19789f131b1b353621df79df04a0617
  14. 0xc4fe2177880ea1b0e82b6fe4c270090fd0fbe5af3a42a8cbf6a6ba2fa35625f6
  15. 0x15039087bf60ae9b06b756ec3cbc299760e59923a438bbd91e34d105186db0ed
  16. 0x2b6e23e3624a1b66e1d2298cfbce99a93ce6b13d24a58112a71802d79c5f7a76
  17. 0xd21942ae3214eff88e08ab04884fd4b11958b51af9a0741b7668e2d07a2c56c9
  18. 0x9a9024edb5069d88a324facb310a5ce8e495214bbaa968f077bede437390194f
  19. 0x9b9ce5b74b9bab5121612ef6b64920a8d453cbf311096a423eef9702747e868a
Day root
0xf43e8dcc3d451a4788b26be904c55e8c4c0fa75c9666796c51db38d37e2c0df8
Chained
0x702d5ac508f08b0d1accf36af25822d8e5660367494edd17a642fb61e158a57a
Published
On Arc Testnet, block 69251483: 0x495162f8936e19f0039918feebe6c307f327cd6bf8c37219620b1970041fa9ae

How to check it · This row as JSON