Thomas Kollar

@tkollar

Head of AI @ Wayve; ex-Research Manager @ TRI; ex-Amazon; ex Apple. CMU / MIT

san jose, ca

tkollar.github.io

Joined October 2008

Thomas Kollar
@tkollar
Jun 19, 2024
Building language models is difficult and requires high quality preprocessing, modeling, evaluation and large scale training. As significant collaborators in this project at TRI, the resulting 7B model DCLM-7B is a significant achievement. It is a competitor to Mistral 7B and
Vaishaal Shankar
@Vaishaal
Jun 18, 2024
I am really excited to introduce DataComp for Language Models (DCLM), our new testbed for controlled dataset experiments aimed at improving language models. 1/x
Thomas Kollar
@tkollar
Jun 15, 2024
By first developing some of the best Vision-Language Models with Prismatic at TRI: github.com/TRI-ML/prismat… OpenVLA was able to quickly build some of the best generalist policies for robotics. Code, data and weights are all open-source: openvla.github.io This is a great
Moo Jin Kim
@moo_jin_kim
Jun 14, 2024
✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇
00:00
Thomas Kollar
@tkollar
Apr 22, 2024
Over the last year at TRI we’ve been training Large Language Models, including results in the following areas: Scaling: arxiv.org/abs/2403.08540 Alignment: arxiv.org/abs/2402.12366 As a part of upcoming work, we are sharing back with the open source community and releasing a
Sedrick Keh
@sedrickkeh2
Apr 22, 2024
📢 Releasing TRI's open-source Mamba-7B trained on 1.2T tokens of RefinedWeb! Mamba-7B is the largest fully recurrent Mamba model trained and is a state-of-the-art recurrent LLM. 🚀🚀🚀 huggingface.co/TRI-ML/mamba-7…
Thomas Kollar
@tkollar
Mar 27, 2024
At TRI, we are looking to build Robotics Foundation Models, or what we call Large Behavior Models (LBMs). Large scale robotics datasets, such as DROID are a part of the strategy to enable broadly capable LBMs that include language, vision and action: droid-dataset.github.io
Chelsea Finn
@chelseabfinn
Mar 20, 2024
Introducing a new, fully open robotics dataset! - 76k episodes - 564 unique scenes - 100 contributors - 13 labs/institutions - 3 continents droid-dataset.github.io A short 🧵 on the backstory
00:00
Thomas Kollar
@tkollar
Mar 19, 2024
After a long adventure, the DROID dataset is finally out!
Karl Pertsch
@KarlPertsch
Mar 19, 2024
Access to *diverse* training data is a major bottleneck in robot learning. We're releasing DROID, a large-scale in-the-wild manipulation dataset. 76k trajectories, 500+ scenes, multi-view stereo, language annotations etc Check it out & download today! 💻: droid-dataset.github.io
00:00