InputPOST /api/v1/x402/robots-allow-path
{
"robots_txt": "User-agent: *\nDisallow: /private\nAllow: /public\n",
"path": "/public/docs",
"user_agent": "*"
}Web and API intelligence · web-api-intelligence
Delx Robots Allow Path
Check path allow/disallow against caller-held robots.txt rules — first-party local utility for agent preflight and proven micro-utils expansion. Returns deterministic machine-readable JSON for $0.001 USDC via x402 on Base. Execution is first-party, local-only, stateless, and memory-only with no paid upstream, no input retention, no web search, no live RPC, and no mediagen. Results are advisory; the caller owns authorization, budgets, and production controls. Sibling of Delx routes that already converted externally (random, hash, URL, FX families).
One-command purchase
Run it from an agent.
No account or API key. AgentCash reads the 402 challenge, pays no more than the declared cap, retries the request and returns the result.
npx agentcash@latest fetch https://api.delx.ai/api/v1/x402/robots-allow-path -m POST -H 'x-delx-source: product-page' --max-amount 0.001 -b '{"robots_txt":"User-agent: *\nDisallow: /private\nAllow: /public\n","path":"/public/docs","user_agent":"*"}'Delivered resultapplication/json
{
"schema": "delx/util-robots-allow-path/v1",
"ok": true,
"path": "/public/docs",
"user_agent": "*",
"allowed": true,
"reason": "matched_allow",
"matched_rule": "/public",
"note": "Local parse of caller-held robots.txt; not a network fetch"
}Machine-readable evidence