Aleph Alpha

@Aleph__Alpha

We create specialized large language models for a sovereign Europe. Join us: jobs.ashbyhq.com/AlephAlpha #artificialintelligence, #writtenbyahuman

Heidelberg, Germany

Aleph Alpha
@Aleph__Alpha
13h
Pre-training is expensive. We make it efficient. Our blog post explains our hierarchical approach to scaling pre-training. We’ll guide you through the choices we make at different GPU counts, taking a 30B-A3B MoE model from 16 - 512 B200 GPUs with 35% MFU & near-linear scaling.
7
Aleph Alpha
@Aleph__Alpha
Sep 28
On our benchmark of politically sensitive prompts, Qwen3.6-35B-A3B agrees with CCP framing 70% of the time. DeepSeek-R1: 60%. Western baselines: ~2%. NVIDIA's Nemotron Cascade 2: 18%. But Nemotron is not under Chinese jurisdiction. Here is what happened. 🧵
1
Aleph Alpha
@Aleph__Alpha
Sep 24
Reasoning models think in English, even on German prompts. We asked what it costs to make one think in German. Answer: a valley. Small doses of German reasoning data hurt, large doses mostly recover.
14
Aleph Alpha
@Aleph__Alpha
Sep 16
Hot off the press: We are becoming the first transatlantic sovereign AI solution together with our partner @cohere. More talent, more compute, and more innovation power to offer trustworthy AI at the security level that governments and enterprises need – across the globe.
3
Aleph Alpha
@Aleph__Alpha
Sep 10
Training and evaluating LLMs is hard: it’s a multi-stage process, with different methods, data, and evals at each stage. In our new post, @SohirMaskey and @_wsascha_ study when intermediate evals become predictive of final model quality in a 30B MoE. 🧵tinyurl.com/8zh8hvjp
1