Log inSign up
MatX
43 posts
Image
user avatar
MatX
@MatXComputing
High-throughput chips for LLMs.
Mountain View, California
matx.com
Joined July 2023
42
Following
4,511
Followers
  • Pinned
    user avatar
    MatX
    @MatXComputing
    Feb 24
    Our goal is to make the best chips physically possible for the large model needs of frontier labs. The MatX One chip delivers higher throughput than any announced product while also achieving the lowest latency. @reinerpope joined @BloombergTV this morning to discuss:
    Image
    00:00
    user avatar
    Reiner Pope
    MatX
    @reinerpope
    Feb 24
    We’re building an LLM chip that delivers much higher throughput than any other chip while also achieving the lowest latency. We call it the MatX One. The MatX One chip is based on a splittable systolic array, which has the energy and area efficiency that large systolic arrays
    40K
  • MatX reposted
    user avatar
    Dwarkesh Patel
    @dwarkesh_sp
    May 22
    New blackboard lecture w @reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of
    Image
    00:00
    928K
  • MatX reposted
    user avatar
    Dwarkesh Patel
    @dwarkesh_sp
    Apr 29
    Did a very different format with @reinerpope – a blackboard lecture where he walks through how frontier LLMs are trained and served. It's shocking how much you can deduce about what the labs are doing from a handful of equations, public API prices, and some chalk. It’s a bit
    Image
    00:00
    1.3M
  • MatX reposted
    user avatar
    Reiner Pope
    MatX
    @reinerpope
    Apr 20
    Intelligence per picojoule, with @itsclivetime and @dylan522p (0:00) Intro (1:22) What is codesign? (2:49) Codesign example: Swish vs ReLU (4:22) Are DeepSeek papers codesign? (6:45) Predicting where ML research will go (8:06) Should researchers hate your chips? (9:34) Can you
    Image
    00:00
    146K
  • MatX reposted
    user avatar
    Reiner Pope
    MatX
    @reinerpope
    Apr 15
    I chatted with @ysmulki about MatX, chip design and where silicon designed for LLMs is headed (8:17) Tightly coupling SRAM and HBM on one chip (14:03) More MoE FLOPS, smaller KV cache load (16:08) Numerics: from 32-bit to 4-bit (19:02) Targeting both training and inference
    Image
    00:00
    70K
  • MatX reposted
    user avatar
    John Collison
    Stripe
    @collision
    Feb 26
    Reiner Pope (@MatXComputing) just raised a $500m round led by @leopoldasch and Jane Street to build faster AI chips. I enjoyed having him on Cheeky Pint so I could ask all my questions about how chip design actually works, where the speed-up comes from, and how the industry will
    Image
    00:00
    54K
  • user avatar
    MatX
    @MatXComputing
    Feb 24
    Replying to @MatXComputing
    Watch the full interview:
    Image
    Watch Google Alum Raises $500M to Compete With Nvidia - Bloomberg
    From bloomberg.com
    2.2K
  • MatX reposted
    user avatar
    Reiner Pope
    MatX
    @reinerpope
    Feb 24
    Replying to @blip_tm and @austinlyons
    Put your KVs in HBM! Contexts are growing ~infinitely long, and HBM is the best place to fit them. Definitely won't be underutilized: *everyone* is running out of HBM capacity.
    2.2K
  • MatX reposted
    user avatar
    Reiner Pope
    MatX
    @reinerpope
    Feb 24
    We’re building an LLM chip that delivers much higher throughput than any other chip while also achieving the lowest latency. We call it the MatX One. The MatX One chip is based on a splittable systolic array, which has the energy and area efficiency that large systolic arrays
    3M
  • MatX reposted
    user avatar
    tensorpro
    MatX
    @tensorpro
    Jan 13
    We trained models with MXFP4-quantized attention, but it turns out this can break causal modeling. Our latest post explains why this happens and how to fix it.
    Image
    Future leakage in block-quantized attention | MatX
    From matx.com
    32K
  • MatX reposted
    user avatar
    James Hill-Khurana
    MatX
    @jtvhk
    Mar 18, 2025
    Replying to @jtvhk
    Join us in Waterloo to chat systems at Whoopsie Daisy Drinks:
    Image
    ML Systems with MatX · Luma
    From luma.com
    3.8K
  • MatX reposted
    user avatar
    James Hill-Khurana
    MatX
    @jtvhk
    Mar 18, 2025
    I'll be in Toronto and Waterloo over the next week, I'd love to chat and tell you a bit more about what we're doing at MatX (and say hi); please feel free to reach out!
    6.1K
  • MatX reposted
    user avatar
    James Hill-Khurana
    MatX
    @jtvhk
    Mar 18, 2025
    Excited to say I joined @MatXComputing late last year! The team is exceptionally thoughtful and the problems are both difficult and fun: from µarch, compilers, and models, to the systems we are building.
    Image
    8.7K

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
Advertisement
Advertisement