Aleph Alpha

@Aleph__Alpha

Our Specialized Sovereign Large Language Model for Mission Critical Environments is here: aleph-alpha.com/en/kolibri/

Heidelberg, Germany

Pinned
Aleph Alpha
@Aleph__Alpha
Oct 3
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.
435
Aleph Alpha
@Aleph__Alpha
Oct 29
Parsy is currently the best parsing model in the world. Read on for how we built this model on top of our parsing harness. 🧵
2
Aleph Alpha
@Aleph__Alpha
Oct 27
How does the community evaluate multilingual capabilities of LLMs? Mostly by translating evaluation datasets, since most of them are predominantly in English. How does translation change what the eval actually measures?
3
Aleph Alpha
@Aleph__Alpha
Oct 22
Scaling RL environments and their infrastructure comes with several challenges. We documented our experiences while building Kolibri: stalling GPUs, images filling the disks, crashed sandboxes scored as wrong answers, and reward hacks.
5
Aleph Alpha
@Aleph__Alpha
Oct 21
Kolibri 1 now runs natively in Transformers 5.20! We are still overwhelmed by all the community feedback. You can now spin up our Kolibri models in just a few lines of code using 🤗transformers. Special thanks go to Luca Motz (@LucaMotz3141) and Harry Mellor (@hmellor_) for
3