Turn websites into
LLM-ready data
Clean markdown, structured JSON, and reliable metadata
from any page, in one API call.
Works with
Built for developers
Simple APIs, powerful results. Get structured
data from any website in seconds.
// npm install @crawlkit-sh/sdkimport { CrawlKit } from '@crawlkit-sh/sdk';const crawlkit = new CrawlKit({ apiKey: 'ck_...' });const page = await crawlkit.scrape({ url: 'https://example.com', options: { waitFor: '#content' }});# CrawlKit
Transform any website into structured, AI-ready data with a single API call.
## Getting Started
Install the SDK and start scraping:
Skip the complexity,
ship faster
No more tangled scraping scripts or brittle integrations.
One simple request, LLM-ready data in seconds.
Build with any stack
CrawlKit is a pure HTTP API. No SDK lock-in, no platform coupling. Use it from any language, any runtime, any environment.
See all integrationsTransparent pricing
Know exactly what you pay for.
No hidden fees, no surprise charges.
We take care of the complexity
Crawling, rendering, anti-bot handling, and scaling
so you can focus on building products, not infrastructure.
CrawlKit turns raw web pages into clean, structured data optimized for AI models and downstream pipelines.
CrawlKit only returns data when pages are fully loaded, so you never deal with partial or broken outputs.
Pay as you go. Scale for less.
CrawlKit uses simple, credit-based pricing.
Buy more credits, pay less per request — no usage penalties, no surprises.
- Unlimited API calls
- All endpoints included
- Proxy rotation built-in
- Credits never expire
- Priority support
Start free with 100 credits. Upgrade anytime with volume discounts.
Start free (100 credits)What you can build
From RAG pipelines to price monitoring,
CrawlKit powers real-world web data workflows.
RAG Applications
Build AI knowledge bases from any website. Feed clean, structured data directly into your LLM pipelines.
AI
Price Monitoring
Track competitor prices and inventory in real-time. Get structured data for your analytics dashboard.
E-commerce
Content Aggregation
Aggregate news, blogs, and articles from multiple sources. Build your own curated content feeds.
Media
Lead Generation
Extract contact information and company data from business directories and websites.
Sales
Research & Analysis
Collect datasets for academic research, market analysis, and competitive intelligence.
Research
Dataset Collection
Build training datasets for ML models. Extract structured data at scale with consistent formatting.
MLOutputs designed for LLM workflows
Structured JSON, clean markdown, and reliable metadata -
ready for pipelines.
1{2 "success": true,3 "data": {4 "markdown": "# Welcome to Example\n\nThis is...",5 "html": "<h1>Welcome</h1><p>Content...</p>",6 "metadata": {7 "title": "Example Domain",8 "description": "Example website for testing",9 "ogImage": "https://example.com/og.png"10 },11 "links": {12 "internal": ["/about", "/contact", "/blog"],13 "external": ["https://iana.org"]14 },15 "stats": { "fetchTime": 245, "parseTime": 12 },16 "creditsUsed": 1,17 "creditsRemaining": 984718 }19}
