Checks robots.txt for AI crawling and usage rules on a given site.
Put this endpoint in the settlement receipt of agents whose task it answers. You pay only when the recommendation converts on-chain.