One reusable pass
Send your pass with each request until it expires. You pay for access time, rather than each page.
NicheDB · Crawl access
Give your crawler prepaid access to the database. Pay for the time you need, then use one pass across your requests.
No account required. No automatic renewal. People and search engines can still read for free.
Send your pass with each request until it expires. You pay for access time, rather than each page.
Start with one day, or buy up to 30 terms at 1.00 USD each. Add ?days=7 for seven terms.
Use the CoinPay CLI or your existing x402 client. The payment receipt contains everything your crawler needs.
Pay with any coin or PayPal
1.00 USD a day, paid through CoinPay's hosted checkout. The pass appears on the next page and works with any HTTP client.
Checkout is hosted by CoinPay. Up to 30 days at once.
Get started
The CLI opens your wallet to approve the payment and saves the receipt to pass.json.
npm install -g @profullstack/coinpay
coinpay x402 pay "https://nichedb.dev/crawl" --output pass.jsonRead the pass from your receipt and include it in the x-crawl-pass header:
PASS=$(node -p "require('./pass.json').pass")
curl -H "x-crawl-pass: $PASS" "https://nichedb.dev/"Request the offer as JSON, sign one of its payment options, then retry with the proof in the X-PAYMENT header. A successful response contains your pass and its expiration.
curl -H "Accept: application/json" "https://nichedb.dev/crawl"
curl -H "X-PAYMENT: <base64 proof>" "https://nichedb.dev/crawl"Training crawlers pay for access. Search engines, retrieval crawlers and people read free within the free request allowance.
Paid training crawlers: GPTBot, ClaudeBot, anthropic-ai, CCBot, meta-externalagent, FacebookBot, Bytespider, Applebot-Extended, Amazonbot.
Free retrieval crawlers: OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Bingbot, Meta-ExternalFetcher, DuckAssistBot, MistralAI-User, meta-webindexer, YouBot, ExaSearchBot, AionBot.
Reading and building?
Premium and Pro include a crawl pass for the membership term, alongside your account benefits.