Analyzes a domain’s robots.txt, reporting whether it exists, its fetch status, parsed rules, sitemaps, and whether a given path is allowed for a specified user agent.
Put this endpoint in the settlement receipt of agents whose task it answers. You pay only when the recommendation converts on-chain.
This endpoint shares a payment address with 99 other resources on netintel.dev, so the breakdown below is shown at the server level — per-resource activity can't be isolated on-chain for shared addresses.