Open-source AI benchmark

Which AI model knows
Appwrite best?


GPT 5.3 Codex	$1.75Input: $1.75/1M tokens Output: $14.00/1M tokens	97%	99%	98.8%	94.6%	99.3%	98.5%	100%	99.7%	95.5%	90.4%
Claude Opus 4.6	$5.00Input: $5.00/1M tokens Output: $25.00/1M tokens	96.2%	100%	100%	94.3%	94.3%	99.7%	100%	100%	88.5%	91.2%
Kimi K2.5	$0.45Input: $0.45/1M tokens Output: $2.20/1M tokens	95.3%	100%	99.3%	94.1%	99.7%	93.5%	100%	98.5%	89%	87.3%
Gemini 3.1 Pro (Preview)	$2.00Input: $2.00/1M tokens Output: $12.00/1M tokens	93.6%	99.5%	98.5%	80.2%	100%	94.5%	96%	95%	95.5%	87.9%
GLM 5	$0.80Input: $0.80/1M tokens Output: $2.56/1M tokens	92.2%	99.5%	99.3%	84.6%	93.8%	92.5%	99%	92%	89.5%	83.9%
GPT 5.4	$2.50Input: $2.50/1M tokens Output: $15.00/1M tokens	91%	100%	93%	80.9%	89%	89.3%	99.5%	98.2%	95%	80.4%
Grok 4.1 Fast	$0.20Input: $0.20/1M tokens Output: $0.50/1M tokens	89.9%	90%	92.5%	90%	84.7%	88.3%	99%	92.5%	85%	87.9%
Qwen 3.5 397B A17B	$0.39Input: $0.39/1M tokens Output: $2.34/1M tokens	88.3%	94.8%	92.5%	80%	88%	83%	94%	96.7%	84.5%	83.9%
MiniMax M2.5	$0.30Input: $0.30/1M tokens Output: $1.20/1M tokens	87.8%	98%	87.2%	76.1%	93.8%	89%	83.5%	99%	88%	80.4%
DeepSeek V3.2	$0.25Input: $0.25/1M tokens Output: $0.40/1M tokens	83.8%	88.5%	89.5%	76.5%	83%	89.3%	93.5%	81%	75%	80.5%

Last update: Mar 7, 2026Scores combine auto-scored MCQs and AI-judged free-form questions

Above 85% is recommended, below 50% is not advised

Beyond the leaderboard

A closer look at how each model performs across every dimension we test.

Loading charts...

Ask

We ask each model 191 questions across 9 Appwrite services to highlight AI's impact on projects.

Answer

10 models respond with and without Appwrite docs, testing both raw knowledge and assisted intelligence.

Score

Answers are scored deterministically using multi-choice and by an AI judge for open-ended questions.

Evaluation modes

Context changes everything

We test each model with and without Appwrite's docs. The gap reveals how well it leverages context.

Without Skills.md

How do I create a document?

Sure, here's an example code how you can create a document in Appwrite Databases:

import Appwrite from 'appwrite';

const appwrite = new Appwrite();
appwrite.setEndpoint('https://cloud.appwrite.io/v1');

// Removed in Appwrite 1.0
await appwrite.database.createDocument(
  'collectionId', { title: 'Hello' }
);

Cannot read properties of undefined 'createDocument'

Param "databaseId" is not optional.

Project is not accessible in this region.

With Skills.md

How do I create a document?

Great question! Here's how to create a row - newer replacement of a document, using the Appwrite's web SDK:

import { Client, TablesDB, ID } from 'appwrite';

const client = new Client()
  .setEndpoint('https://<REGION>.cloud.appwrite.io/v1')
  .setProject('<PROJECT_ID>');

const tables = new TablesDB(client);
await tables.createRow({
  databaseId: '<DATABASE_ID>',
  tableId: '<TABLE_ID>',
  documentId: ID.unique(),
  data: { title: 'Hello', content: 'World' }
});