1. X
  2. Tsinghua KEG (THUDM)
Log inSign up
Tsinghua KEG (THUDM)
238 posts
user avatar
Tsinghua KEG (THUDM)
@thukeg
#ChatGLM #GLM130B #CodeGeeX #CogVLM #CogView #AMiner The Knowledge Engineering Group (KEG) and THUDM at @Tsinghua_Uni @jietang @ericdongyx
github.com/THUDM
Joined July 2022
169
Following
4,281
Followers
RepliesRepliesMediaMedia

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • Pinned
    user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Aug 14, 2024
    #VisualAgentBench: 4o, 4o-mini, 3.5-sonnet currently have an edge as visual foundation agents for now, but open models InternVL & GLM-4V are catching up fast, a similar story to LLMs as agents as revealed in #AgentBench back in Aug 2023. arxiv.org/pdf/2408.06327
    Image
    8.9K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Aug 4, 2022
    Introducing GLM-130B, an open bilingual (English&Chinese) language model with 130 billion parameters, designed for users with a single A100 (40G*8) or V100 (32G*8) server. #GLM130 #LLM #GPT3 Learn more & download: keg.cs.tsinghua.edu.cn/glm-130b/ github.com/THUDM/GLM-130B
    Image
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Mar 14, 2023
    ChatGLM-6B & ChatGLM! ChatGLM-6B is an open CN&EN model w/ 6.2B paras (optimized for Chinese QA & dialogue for now). Trained for 1T tokens, SFT, Feedback Bootstrap, & RLHF. w INT4 quantization, we can deploy on one 2080Ti card (6GB GPU mem required). github.com/THUDM/ChatGLM-…
    Image
    110K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Sep 20, 2022
    Introducing #CodeGeeX, an open 13B multilingual code generative model capable of 1) generation of 15 programming languages & 2) translating btw on one click! Learn more: keg.cs.tsinghua.edu.cn/codegeex/ Search "codegeex" in #VSCode FOR FREE! DEMO: models.aminer.cn/codegeex/playg… Results next:
    Image
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Oct 16, 2023
    #CogVLM: open vision language models - deep fusion btn LLM & image encoder w/ visual experts! CogVLM-17B tops 14 cross-modal benchs, beats #BLIP2, #PaLI-17B/X-55B, #PaLM-E-84B. Paper: github.com/THUDM/CogVLM HF🤗: huggingface.co/THUDM/CogVLM/t… @_akhaliq @osanseviero @huggingface
    Image
    Image
    Image
    Image
    82K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Oct 10, 2022
    GLM-130B reaches INT4 quantization w/ no perf degradation, allowing effective inference on 4*3090 or 8*2080 Ti GPUs, the most ever affordable GPUs required for using 100B-scale models? Paper: arxiv.org/abs/2210.02414 Model weights & code & demo & lessons: github.com/THUDM/GLM-130B
    Image
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Mar 23, 2023
    ChatGLM-6B is on the top spot of the 🤗 7-day trending? 220K downloads in a few days, and counting! A big thank you to @huggingface @_akhaliq @osanseviero @yvrjsharma @ClementDelangue and everyone! HF: huggingface.co/THUDM/chatglm-… GH: github.com/THUDM/ChatGLM-…
    Image
    50K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Apr 11, 2023
    LoRA & P-Tuning-v2 & other supports added for ChatGLM-6B. Much fewer resources required for tuning your own models! The open-source community is the lead! Check out those efforts here:
    Image
    ChatGLM-6B/README_en.md at main · zai-org/ChatGLM-6B
    From github.com
    39K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Jul 25, 2023
    #CodeGeeX2-6B: 2nd gen. code generation model for 100+ lang. Free #VSCode & #JetBrains plugins (10M lines gen-ed per day). It is based on #ChatGLM2-6B with extra 600B code training. huggingface.co/THUDM/codegeex… @huggingface @_akhaliq @osanseviero @ClementDelangue @code @kdd_news
    Image
    47K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Oct 2, 2022
    Thanks! The model weights & source code are freely available at keg.cs.tsinghua.edu.cn/codegeex/ Search "codegeex" in #VSCode FOR FREE!!
    user avatar
    AK
    @_akhaliq
    Sep 30, 2022
    The @Gradio Demo for CodeGeeX, a large-scale multilingual code generation model with 13 billion parameters, pre-trained on a large code corpus of more than 20 programming languages is now on @huggingface Spaces demo: huggingface.co/spaces/THUDM/C…
    Image
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Nov 8, 2023
    How to #RLHF for LLMs: #PPO or #DPO? Introducing #BPO (black-box prompt optimization) to align LLMs without model training. 1) ChatGPT + BPO > ChatGPT 2) GPT-4 + BPO > GPT-4 3) Vicuna + BPO > Vicuna + PPO/DPO 4) Vicuna + DPO + BPO > Vicuna + DPO arxiv.org/pdf/2311.04155…
    Image
    30K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Oct 16, 2023
    CogVLM: vision language models w/ visual experts that tops 14 cross-modal benchmarks. Paper, model, code @HuggingFace🤗: huggingface.co/THUDM/CogVLM/t…
    Image
    user avatar
    Felix @ ICML 2026 🇰🇷
    @felix_red_panda
    Oct 16, 2023
    List of contemporary GPT4V-like open source models - Blip2 - Llava1.5 - CogVLM by @thukeg - StableVL by @vilm_hq (not out yet) - @skunkworks_ai 's model (not out yet) Did I miss any?
    44K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    Oct 30, 2023
    OPEN #ChatGLM3-6B: the 3rd gen 1) tops 44 tasks among <10B models 2) supports tool/function call, code interpreter, agent tasks, 32K github.com/THUDM/ChatGLM3 🤗huggingface.co/THUDM/chatglm3… #ChatGLM-6Bs: 10M 🤗downloads, thank YOU! @huggingface @ClementDelangue @_akhaliq @osanseviero
    Image
    Image
    47K
  • user avatar
    Tsinghua KEG (THUDM)
    @thukeg
    May 18, 2023
    #ChatGLM-6B v1.1: improved *English* dialogue & translation ability, in addition to Chinese. => #VisualGLM-6B: a multimodal conversational language model that supports 1) images, 2) Chinese, and 3) English w/ #ChatGLM-6B & BLIP2-Qformer. github.com/THUDM/ChatGLM-…
    Image
    32K
Advertisement
Advertisement