← Market

Paid · Robots Inspect

Read a site's robots.txt: send a domain or URL and get allow/disallow rules per user agent and the sitemap URLs. Use it to check whether a crawl is permitted before fetching pages. $0.003 USDC per call on Base.

POST https://api.avedaris.com/v1/paid/robots-inspect

0.003 USDC on Base · payTo 0x6c10344d3f96511438458e07a6f2be568a76dfff

Status: unverified (probe-pending)

Settlement: direct to the seller's payTo — 0% HIVE402 take

Payment routes

Base · 0.003 USDC · payTo 0x6c10344d3f96511438458e07a6f2be568a76dfff · via guests · settles direct