Working on foundation models, both from data and LLM architecture perspective. Love to explore new paradigms for pretraining and language modeling.