Supercharging your building in the AI era
Paritok drops in and non-destructively compresses tools, files, and history on the fly for longer sessions and smaller bills.
The gateway
One environment variable
That is the entire integration.
export ANTHROPIC_BASE_URL=http://127.0.0.1:8080Your agent sends
Tool schemas, history, file reads. Unchanged.
Paritok rewrites
Filters, compresses, summarizes. Tags everything it touches.
Upstream bills less
Response comes back untouched. Refs expand on demand.
How it saves
Three levers stack.
46 schemas, every one sent in full, every single turn
Tool schemas
Agents ship 70+ tools in full JSON on every request. We keep the relevant ones, stub the rest.
Frozen per conversation, so the block stays cache-stable.
every read and tool result, at full size
File reads & output
Our 4B model knows a function signature from a debug line. Identifiers, paths and errors survive.
Small per turn. Compounds hard across a session.
turns accumulate, every one re-sent
Stale history
Turns beyond a recent window get summarized once your context budget fills. Recent turns are left untouched.
Ours runs on a budget you set, not when the model runs out of room.
read_original(ref)gateway_search_tools(q)Nothing is ever discarded
Lossy on the wire, recoverable when it counts. The agent asks for the exact bytes and gets them — locally, without burning a turn.
Built with Paritok
People build on Paritok
Three winning projects from the token-efficiency hackathon.
Compounding
Use more, save more
Every file you read stays in history and is re-sent. So compression keeps paying, turn after turn.
Across a session
The longer it runs, the more comes off
Saved across the whole session, against an average 96,500-token request at $3 / 1M with caching priced into both sides at 0.1×.
Your ceiling
How high it goes depends on your setup
Your numbers
Put your own volume in
The engine
Code-native 4B compression model
| Compressor | Quality retained | Compression rate | Agent-trained | Keeps identifiers | Weights | Per-token fee |
|---|---|---|---|---|---|---|
| Uncompressed baseline | 100.0% | 100.0% | ✕ | — | n/a | free |
| LLMLingua-2 | not evaluated | ~40.0% | ✕ | ◑ | MIT | free |
| gpt-4.1-mini (prompt) | 85.6% | 50.2% | ✕ | ◑ | closed | paid |
| Paritok-4B-v1⭐ | 86.5% | 25.7% | ✓ | ✓ | Apache-2.0 | free |
SWE-bench Lite, end-to-end: an agent scaffold receives its context through each compressor, then attempts the issue. Quality retained = solve rate ÷ uncompressed baseline. Compression rate is lower-is-harder.
The benchmark is a floor, not a ceiling
That 86.5% is the raw model with recall disabled — the honest, reproducible floor. What you deploy is the gateway, where every segment is tagged and read_original pulls back anything the benchmark left on the table.
Pricing
Two ways to deploy
Self-host
The whole stack on your own hardware.
- ✓Gateway + 4B model, both open
- ✓~2.5GB at Q4 — any 8GB card runs it
- ✓Tool filter runs on CPU — no GPU at all
- ✓GitHub & Discord support
Hosted GPU
Same gateway, compression on our GPUs.
- ✓Managed, always-on endpoint
- ✓No GPU to buy or rent (~5× faster than RTX 4060)
- ✓Usage dashboard
- ✓No credit card
- ✓GitHub & Discord support