Link Search Menu Expand Document

Welcome to RealTime QA

Check the latest results Make a new submission

Check out the GitHub Check out the paper

Latest results

Multiple Choice Track

ModelSubmission Time (GMT)OriginalNOTA
gemini-2.5-pro2026-01-24 03:00:0020.010.0
gpt-4.12026-01-24 03:00:0010.020.0
llama-4-maverick2026-01-24 03:00:0010.020.0
gpt-5.22026-01-24 03:00:0010.010.0
gemini-3-pro-preview2026-01-24 03:00:0010.010.0
gemini-3-pro-preview + Google Custom Search2026-01-24 03:00:0010.00.0
claude-haiku-4.52026-01-24 03:00:0010.00.0
claude-haiku-4.5 + Google Custom Search2026-01-24 03:00:0010.00.0
gpt-4.1 + Google Custom Search2026-01-24 03:00:000.00.0
gpt-5.2 + Google Custom Search2026-01-24 03:00:000.00.0
gemini-2.5-pro + Google Custom Search2026-01-24 03:00:000.00.0
claude-sonnet-4.52026-01-24 03:00:000.00.0
claude-sonnet-4.5 + Google Custom Search2026-01-24 03:00:000.00.0
llama-4-scout2026-01-24 03:00:000.00.0
llama-4-scout + Google Custom Search2026-01-24 03:00:000.00.0
llama-4-maverick + Google Custom Search2026-01-24 03:00:000.00.0

Generation Track

ModelSubmission Time (GMT)EMF1
llama-4-scout2026-01-24 03:00:0030.034.5
gpt-5.22026-01-24 03:00:0030.031.8
llama-4-maverick2026-01-24 03:00:0030.030.0
llama-4-maverick + Google Custom Search2026-01-24 03:00:0020.029.4
llama-4-scout + Google Custom Search2026-01-24 03:00:0020.028.7
gpt-4.1 + Google Custom Search2026-01-24 03:00:0020.028.6
gpt-5.2 + Google Custom Search2026-01-24 03:00:0020.028.3
gpt-4.12026-01-24 03:00:0020.024.0
gemini-3-pro-preview2026-01-24 03:00:0020.024.0
gemini-3-pro-preview + Google Custom Search2026-01-24 03:00:0010.018.6
gemini-2.5-pro + Google Custom Search2026-01-24 03:00:0010.018.5
claude-sonnet-4.5 + Google Custom Search2026-01-24 03:00:0010.018.4
claude-haiku-4.5 + Google Custom Search2026-01-24 03:00:0010.018.2
gemini-2.5-pro2026-01-24 03:00:0010.010.6
claude-sonnet-4.52026-01-24 03:00:0010.010.0
claude-haiku-4.52026-01-24 03:00:0010.010.0

(see previous results)

Make a new submission

  1. Download the latest set of RealTime QA (link)

  2. Submit your model predictions. (submission form)

    Submission examples (.jsonl file) are available here