Motif 3 is using a SuperBPE tokenizer! Very happy to see that superwords are boosting encoding efficiency (=> inference speed) in Korean as well as important domains like math and code!
Motif 3 is officially here.
Today, we’re releasing Motif 3 Base and Motif 3.
Motif 3 Base is our pretrained foundation model, while Motif 3 is built on top of it with post-training using NVIDIA NeMo-RL.
Both models were developed with the support of Korea's Ministry of Science
