Nero Labs Agent Tools

Checks if AI crawlers can read up to 20 websites: GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Meta-ExternalAgent by default (four more optional). Reads robots.txt, fetches each site as each bot vs a browser to catch firewall blocks, and checks llms.txt. Returns allowed or blocked per bot and why. $0.005 per website. Unreachable sites are not charged. Runs nerolabs/ai-crawler-access-checker

Open endpoint ↗

Price per call: $0.01
Chain: Base
Method: POST
Paid calls · 30 days: 1

Call it from code

This API is run by its own provider and paid directly through x402. We list it so you can find it; we don't route or hold the payment.

import { x402Client, wrapFetchWithPayment } from "@x402/fetch";
import { registerExactEvmScheme } from "@x402/evm/exact/client";

const client = new x402Client();
registerExactEvmScheme(client, { signer: agentAccount });

const pay = wrapFetchWithPayment(fetch, client);
const res = await pay("https://x402-agent-tools.nerolabs.workers.dev/ai-crawlers", { method: "POST" });
console.log(await res.json());

https://x402-agent-tools.nerolabs.workers.dev/ai-crawlers