Log inSign up
user avatar

jietang

Z.ai
@jietang
Professor @ Tsinghua, Founder of Z.ai. AGI, LLM. “The value of a man should be seen in what he gives and not in what he is able to receive.”―Einstein
Beijing
keg.cs.tsinghua.edu.cn/jietang/
Joined May 2008
413
Following
67.5K
Followers
RepliesMedia
  • user avatar
    jietang
    Z.ai
    @jietang
    2h
    cool comment: FLOPs were intelligence; parameters were knowledge!
    user avatar
    Liam Fedus
    Periodic Labs
    @LiamFedus
    Aug 20
    An excellent history of scaling laws from @jietang. In 2020, we explored the limits of sparsity in Switch Transformers by routing each token to only 1 out of 2048 experts (in retrospect, a bold choice). The model had fewer than 3B activated parameters, but 1.6T total parameters
    Image
  • user avatar
    jietang
    Z.ai
    @jietang
    Aug 19
    Thoughts About Scaling Law Scaling, but not only of parameters. Every model release now ends with the same question: how many parameters? It isn't a question that can be answered on its own. Parameter count is only meaningful alongside three others — how much data you have,
  • user avatar
    jietang
    Z.ai
    @jietang
    Aug 14
    GLM-5.3 is coming. focusing on coding.
    user avatar
    Z.ai
    @Zai_org
    Aug 14
    Introducing GLM-5.3: Built to Code. Ready for Cyber Defense. - Top-tier coding and agentic capabilities, achieved through post-training on the 743B base model - A major leap in cybersecurity, setting a new standard among open models Tech Blog: z.ai/blog/glm-5.3
    Image