1. X
  2. Noah Constant
Log inSign up
Noah Constant
48 posts
Image
user avatar
Noah Constant
@noahconst
Research Scientist @GoogleDeepMind
Joined March 2021
126
Following
725
Followers
RepliesRepliesMediaMedia
  • Pinned
    user avatar
    Noah Constant
    @noahconst
    Jun 4
    Replying to @GoogleMagenta
    We had so much fun building MRT2.  Proud to see it go live.  Here's a chord steering example.  Name that tune anyone?
    Image
    00:00
  • user avatar
    Noah Constant
    @noahconst
    Aug 21, 2025
    Made a walkthrough vid for Magenta RealTime “Audio Injection”! The notebook takes ~10m to spin up, but totally worth it for the surreal experience 🎤💻🎧⁉️
    Image
    00:00
  • user avatar
    Noah Constant
    @noahconst
    Apr 5, 2024
    Ever wonder why we don’t train LLMs over highly compressed text? Turns out it’s hard to make it work. Check out our paper for some progress that we’re hoping others can build on. arxiv.org/abs/2404.03626 With @blester125, @hoonkp, @alemi, Jeffrey Pennington, @ada_rob, @jaschasd
    arXiv logo
    arxiv.org
    Training LLMs over Neurally Compressed Text
    In this paper, we explore the idea of training large language models (LLMs) over highly compressed text. While standard subword tokenizers compress text by a small factor, neural text compressors...
  • user avatar
    Noah Constant
    @noahconst
    Dec 21, 2022
    Want your image generation model to stop misspelling everything? Try giving it access to character-level input features! arxiv.org/abs/2212.10562
    Image

Log in or sign up for X

See what’s happening and join the conversation

Continue with phone
or
Log in with username or email
Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Advertisement
Advertisement