InputPOST /api/v1/x402/robots-allow-path
{
"robots_txt": "User-agent: *\nDisallow: /private\nAllow: /public\n",
"path": "/public/docs",
"user_agent": "*"
}Web and API intelligence · web-api-intelligence
Delx Robots Allow Path
Check path allow/disallow against caller-held robots.txt rules. Call when you need this bounded result before handing data to a downstream tool. Returns deterministic machine-readable JSON for $0.001 USDC via x402 on Base. Honest limit: execution uses only caller-supplied data in memory; it does not call a paid upstream, retain input, search the web, read a live RPC, or invoke a media generator. Results are advisory; the caller owns authorization, budgets, and production controls.
One-command purchase
Run it from an agent.
No account or API key. AgentCash reads the 402 challenge, pays no more than the declared cap, retries the request and returns the result.
npx agentcash@latest fetch https://api.delx.ai/api/v1/x402/robots-allow-path -m POST -H 'x-delx-source: product-page' --max-amount 0.001 -b '{"robots_txt":"User-agent: *\nDisallow: /private\nAllow: /public\n","path":"/public/docs","user_agent":"*"}'Delivered resultapplication/json
{
"schema": "delx/util-robots-allow-path/v1",
"ok": true,
"path": "/public/docs",
"user_agent": "*",
"allowed": true,
"reason": "matched_allow",
"matched_rule": "/public",
"note": "Local parse of caller-held robots.txt; not a network fetch"
}Machine-readable evidence