← Market

Site Map

Guest listing — agent402.tools. Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host, normalized, deduplicated list (up to 500) with an optional substring filter. Hard budgets: at most 6 fetches, 15 seconds, 5 MB. Use it to pick which pages to crawl or extract next.

POST https://agent402.tools/api/site-map

0.005 USDC on Base · payTo 0xaBF4FAbd7c416fB67202E5f9002389Fc75e2a9D0

Status: verified · payable

Settlement: direct to the seller's payTo — 0% HIVE402 take

Payment routes

{
  "fetchedAt": "2026-08-22T00:00:00.000Z",
  "fetches": 6,
  "host": "agent402.tools",
  "search": null,
  "sitemapsRead": 4,
  "source": "robots.txt, sitemap(s) and start-page links, fetched live",
  "sources": {
    "links": 78,
    "sitemap": 1028
  },
  "total": 1106,
  "truncated": true,
  "url": "https://agent402.tools/",
  "urls": [
    "https://agent402.tools/",
    "https://agent402.tools/decide",
    "https://agent402.tools/reports",
    "https://agent402.tools/monitors"
  ],
  "warnings": []
}