Most AI tasks no longer need a frontier model Read launch post

142 open models, one API

Pick a job, then compare its open models on public benchmarks and Serverless price.

Chat, structured output and reading images
Model MMLU-Pro, answers right Time per request Serverless price Size
Qwen3.5 4B Qwen 59.3% Not timed $0.305 in · $1.53 out per 1M tokens 4.7B
Qwen3 4B Instruct 2507 Qwen 53.3% Not timed Run in your cloud 4.0B
Qwen3 0.6B Qwen 23.7% Not timed Run in your cloud 752M
4 more models served
Chat, structured output and reading images: 4 more models served
Model MMLU-Pro, answers right Time per request Serverless price Size
donut base finetuned cord v2 naver-clova-ix Not measured Not timed Run in your cloud 110M
donut base finetuned docvqa naver-clova-ix Not measured Not timed Run in your cloud 110M
Florence 2 FT DocVQA mynkchaudhry Not measured Not timed Run in your cloud 271M
Qwen3.6 27B Qwen Not measured Not timed Run in your cloud 27.8B

Translation 2 models

Translation
Model WMT24++, 1,488 segments, chrF++ Time per request Serverless price Size
MADLAD-400 3B google 44.6 Not timed $0.999 in · $5.00 out per 1M tokens 2.9B

Classify text and yes/no decisions 11 models

Classify text and yes/no decisions
Model AG News, labelled correctly Time per request Serverless price Size
deberta v3 base zeroshot v2.0 MoritzLaurer 88.1% Not timed Run in your cloud 184M
ModernBERT base zeroshot v2.0 MoritzLaurer 84.3% Not timed Run in your cloud 150M
gliclass instruct large v1.0 knowledgator 76.9% Not timed $0.19 per 1M tokens 439M
gliclass large v1.0 knowledgator 76.3% Not timed Run in your cloud 438M
gliclass large v3.0 knowledgator 74.3% Not timed Run in your cloud 439M
gliclass small v1.0 knowledgator 72.8% Not timed Run in your cloud 144M
Show 3 more models Show fewer models
Classify text and yes/no decisions: 3 more models
Model AG News, labelled correctly Time per request Serverless price Size
gliclass base v1.0 knowledgator 71.9% Not timed Run in your cloud 186M
bart large mnli facebook 67.1% Not timed Run in your cloud 407M
nli deberta v3 base cross-encoder 65.0% Not timed Run in your cloud 184M

Doc to Markdown and OCR 6 models

Doc to Markdown and OCR
Model olmOCR-Bench, checks passed Time per request Serverless price Size
LightOnOCR 2 1B lightonai 77.7% Not timed $2.00 per 1,000 pages 1.0B
MinerU2.5 Pro 2604 1.2B opendatalab 59.1% Not timed Run in your cloud 1.2B
PaddleOCR VL 1.5 PaddlePaddle 51.7% Not timed Run in your cloud 959M
docling 31.7% Not timed $0.398 per 1,000 pages 80M

Speech to text 2 models

Speech to text
Model LibriSpeech, 256 clean clips, word error rate Time per request Serverless price Size
whisper large v3 turbo openai 1.7% Not timed $0.00276 per audio minute 809M

Detect 8 models

Detect
Model COCO, average precision Time per request Serverless price Size
grounding dino base IDEA-Research 0.486 Not timed $0.31 per 1,000 images 233M
owlv2 base patch16 ensemble google 0.434 Not timed $0.233 per 1,000 images 155M
owlv2 large patch14 ensemble google 0.428 Not timed Run in your cloud 438M
grounding dino tiny IDEA-Research 0.403 Not timed Run in your cloud 172M
Florence 2 base ft microsoft 0.295 Not timed Run in your cloud 232M
Florence 2 large microsoft 0.294 Not timed Run in your cloud 777M
Florence 2 base microsoft 0.279 Not timed Run in your cloud 232M

Image search and image classify 10 models

Image search and image classify
Model Flickr30k image to text, nDCG@10 Time per request Serverless price Size
CLIP ViT H 14 laion2B s32B b79K laion 0.862 Not timed Run in your cloud 986M
marqo fashionSigLIP Marqo 0.838 Not timed Run in your cloud 203M
siglip so400m patch14 224 google 0.838 Not timed Run in your cloud 877M
siglip2 base patch16 224 google 0.816 Not timed $0.0231 per 1M tokens $0.0143 per 1,000 images 375M
clip vit large patch14 openai 0.782 Not timed Run in your cloud 428M
CLIP ViT B 32 laion2B s34B b79K laion 0.774 Not timed Run in your cloud 151M
clip vit base patch32 openai 0.716 Not timed Run in your cloud 151M
Show 1 more model Show fewer models
Image search and image classify: 1 more model
Model Flickr30k image to text, nDCG@10 Time per request Serverless price Size
marqo ecommerce embeddings B Marqo 0.608 Not timed Run in your cloud 203M
1 more model served
Image search and image classify: 1 more model served
Model Flickr30k image to text, nDCG@10 Time per request Serverless price Size
Qwen3 VL Embedding 2B Qwen Not measured Not timed Run in your cloud 2.1B

Guardrails 3 models

Guardrails
Model ToxicChat, F1 Time per request Serverless price Size
gliguard LLMGuardrails 300M fastino 0.576 Not timed $0.0929 per 1M tokens 208M
granite guardian 3.0 2b ibm-granite 0.247 Not timed $0.15 in · $0.60 out per 1M tokens 2.5B

Redact (PII) 3 models

Redact (PII)
Model SPIA, F1 Time per request Serverless price Size
NuNER Zero numind 0.463 Not timed $0.05 per 1M tokens 449M
gliner multi pii v1 urchade 0.377 Not timed $0.04 per 1M tokens 289M

Knowledge graph 4 models

Knowledge graph
Model FewRel, F1 Time per request Serverless price Size
gliner2 large v1 fastino 0.435 Not timed $0.186 per 1M tokens 486M
gliner2 base v1 fastino 0.400 Not timed $0.0929 per 1M tokens 208M
glirel large v0 jackboyla 0.264 Not timed Run in your cloud 467M

Rerank and request routing 22 models

Rerank and request routing
Model AskUbuntu, nDCG@10 Time per request Serverless price Size
mxbai rerank large v2 mixedbread-ai 0.691 Not timed Run in your cloud 1.5B
bge reranker v2 m3 BAAI 0.676 Not timed Run in your cloud 568M
gte reranker modernbert base Alibaba-NLP 0.670 Not timed Run in your cloud 150M
bge m3 BAAI 0.666 Not timed $0.0743 per 1M tokens $3.72 per 1M pairs 568M
Qwen3 VL Reranker 2B Qwen 0.666 Not timed $0.149 per 1,000 images $222.80 per 1M pairs 2.1B
mxbai rerank base v2 mixedbread-ai 0.664 Not timed Run in your cloud 494M
mLateOn lightonai 0.663 Not timed Run in your cloud 307M
Show 13 more models Show fewer models
Rerank and request routing: 13 more models
Model AskUbuntu, nDCG@10 Time per request Serverless price Size
jina reranker v2 base multilingual jinaai 0.655 Not timed Run in your cloud 278M
Qwen3 Reranker 0.6B Qwen 0.652 Not timed $0.017 per 1M tokens 596M
bge reranker large BAAI 0.640 Not timed Run in your cloud 560M
jina colbert v2 jinaai 0.639 Not timed Run in your cloud 559M
Reason ModernColBERT lightonai 0.634 Not timed Run in your cloud 149M
mxbai colbert large v1 mixedbread-ai 0.630 Not timed Run in your cloud 335M
answerai colbert small v1 answerdotai 0.626 Not timed Run in your cloud 33M
ms marco MiniLM L 12 v2 cross-encoder 0.614 Not timed Run in your cloud 33M
ms marco MiniLM L 6 v2 cross-encoder 0.603 Not timed Run in your cloud 23M
bge reranker base BAAI 0.593 Not timed Run in your cloud 278M
colbertv2.0 colbert-ir 0.591 Not timed Run in your cloud 110M
GTE ModernColBERT lightonai Not measured Not timed $0.149 per 1M tokens $7.43 per 1M pairs 149M
R3 rerank 0.6b tencent Not measured Not timed $0.017 per 1M tokens 596M
1 more model served
Rerank and request routing: 1 more model served
Model AskUbuntu, nDCG@10 Time per request Serverless price Size
mxbai edge colbert v0 32m mixedbread-ai Not measured Not timed Run in your cloud 32M

Multi-vector 9 models

Multi-vector
Model 8 retrieval sets, mean nDCG@10 Time per request Serverless price Size
mLateOn lightonai 0.561 Not timed Run in your cloud 307M
Reason ModernColBERT lightonai 0.519 Not timed Run in your cloud 149M
answerai colbert small v1 answerdotai 0.466 Not timed Run in your cloud 33M
jina colbert v2 jinaai 0.462 Not timed Run in your cloud 559M
bge m3 BAAI Not measured Not timed $0.0499 per 1M tokens 568M
3 more models served
Multi-vector: 3 more models served
Model 8 retrieval sets, mean nDCG@10 Time per request Serverless price Size
colbertv2.0 colbert-ir Not measured Not timed Run in your cloud 110M
mxbai colbert large v1 mixedbread-ai Not measured Not timed Run in your cloud 335M
mxbai edge colbert v0 32m mixedbread-ai Not measured Not timed Run in your cloud 32M

Sparse embeddings 12 models

Sparse embeddings
Model 8 retrieval sets, mean nDCG@10 Time per request Serverless price Size
splade v3 naver 0.456 Not timed Run in your cloud 110M
opensearch neural sparse encoding v1 opensearch-project 0.448 Not timed Run in your cloud 133M
bge m3 BAAI Not measured Not timed $0.0408 per 1M tokens 568M
Splade PP en v2 prithivida Not measured Not timed $0.0256 per 1M tokens 110M
7 more models served
Sparse embeddings: 7 more models served
Model 8 retrieval sets, mean nDCG@10 Time per request Serverless price Size
granite embedding 30m sparse ibm-granite Not measured Not timed Run in your cloud 30M
opensearch neural sparse encoding doc v2 distill opensearch-project Not measured Not timed Run in your cloud 67M
opensearch neural sparse encoding doc v2 mini opensearch-project Not measured Not timed Run in your cloud 23M
opensearch neural sparse encoding doc v3 distill opensearch-project Not measured Not timed Run in your cloud 67M
opensearch neural sparse encoding v2 distill opensearch-project Not measured Not timed Run in your cloud 67M
splade cocondenser selfdistil naver Not measured Not timed Run in your cloud 110M
splade mini rasyosef Not measured Not timed Run in your cloud 11M

Named entities 16 models

Named entities
Model CoNLL-2003, F1 Time per request Serverless price Size
gliner small v2.5 gliner-community 0.669 Not timed Run in your cloud 166M
modern gliner bi base v1.0 knowledgator 0.664 Not timed Run in your cloud Not listed
gliner medium v2.5 gliner-community 0.664 Not timed Run in your cloud 209M
gliner large v2.5 gliner-community 0.655 Not timed Run in your cloud 459M
gliner biomed large v1.0 Ihor 0.644 Not timed $0.15 per 1M tokens 478M
gliner bi base v2.0 knowledgator 0.640 Not timed Run in your cloud Not listed
gliner medium v2.1 urchade 0.611 Not timed Run in your cloud 195M
Show 8 more models Show fewer models
Named entities: 8 more models
Model CoNLL-2003, F1 Time per request Serverless price Size
NuNER Zero numind 0.607 Not timed $0.05 per 1M tokens 449M
gliner multi v2.1 urchade 0.602 Not timed $0.0907 per 1M tokens 289M
gliner small v2.1 urchade 0.596 Not timed Run in your cloud 153M
gliner large news v2.1 EmergentMethods 0.553 Not timed Run in your cloud 445M
gliner large v2.1 urchade 0.548 Not timed Run in your cloud 445M
gliner2 large v1 fastino 0.540 Not timed $0.186 per 1M tokens 486M
gliner multi pii v1 urchade 0.538 Not timed $0.04 per 1M tokens 289M
gliner2 base v1 fastino 0.519 Not timed $0.0929 per 1M tokens 208M
Evaluation
Accuracy
Each model run on SIE against the public dataset named in its column
8 retrieval sets
The mean over NFCorpus, FiQA2018, SciFact, SCIDOCS, CQADupstackPhysicsRetrieval, CosQA, StackOverflowQA and LegalBenchConsumerContractsQA
3 ViDoRe v3 sets
The mean over Vidore3ComputerScienceRetrieval, Vidore3FinanceEnRetrieval and Vidore3PharmaceuticalsRetrieval
Time
SIE timed on a GPU server with the client alongside, one request at a time
Prices
Serverless list prices

Run these models on Serverless or in your own cloud

SIE Cluster

Kubernetes in your own cloud, backed by our engineers.

  • Terraform modules for your cloud
  • Apache-2.0, same engine as Serverless
  • GPU workers scale to zero between jobs
  • Separate worker pools for each tenant
Agent prompt Deploy SIE to our AWS account with the superlinked/sie/aws Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Google Cloud project with the superlinked/sie/google Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Azure subscription with the superlinked/sie/azure Terraform module. Docs: superlinked.com/docs/deployment.Deploy SIE to our Alibaba Cloud account with the superlinked/sie/alicloud Terraform module. Docs: superlinked.com/docs/deployment.

SIE Local

The open-source server on your own machine.

  • Runs on your NVIDIA GPU
  • One container, no cluster
  • Process your data fully offline
  • Same SDK and model IDs as Serverless
docker run --gpus all -p 8080:8080 ghcr.io/superlinked/sie-server:latest-cuda12-default

Talk to us

Tell us about your use case and we'll get back to you shortly.

Apply for an inference grant

Free capacity on our hosted cluster for selected projects. Tell us what you run and we reply by email.