InputPOST /api/v1/x402/robots-inspect
{
"url": "https://example.com"
}Web and API intelligence · utility
Delx Robots Inspect
Read robots.txt rules and sitemap hints before crawling a domain (x402)
One-command purchase
Run it from an agent.
No account or API key. AgentCash reads the 402 challenge, pays no more than the declared cap, retries the request and returns the result.
npx agentcash@latest fetch https://api.delx.ai/api/v1/x402/robots-inspect -m POST -H 'x-delx-source: product-page' --max-amount 0.01 -b '{"url":"https://example.com"}'Delivered resultapplication/json
{
"tool_name": "util_robots_inspect",
"result": {
"robots_url": "https://example.com/robots.txt",
"allow": [],
"disallow": [],
"sitemaps": []
}
}Machine-readable evidence