Quick · Can Fetch
robots.txt checker for one URL: may a generic agent and 16 named AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended...) fetch it under RFC 9309? Plus Crawl-delay, Content-Signal, X-Robots-Tag noai/noindex and sitemaps. Verdict allowed / disallowed. Never downloads the page body.
GET https://shop.lordevo.com/api/quick/can-fetch
0.002 USDC on Base · payTo 0x0876A79Bb5A88Bf338E6b47b4530359527b01d73
Status: unverified (probe-pending)
Settlement: direct to the seller's payTo — 0% HIVE402 take
Payment routes
Base · 0.002 USDC · payTo 0x0876A79Bb5A88Bf338E6b47b4530359527b01d73 · via guests · settles direct