Log inSign up
Benjamin Warner profile banner
user avatar

Benjamin Warner

@benjamin_warner
Research @SophontAI. Previously answerdotai. Vaccines save lives.
benjaminwarner.dev
Joined September 2011
513
Following
2,442
Followers
RepliesMedia
  • Pinned
    user avatar
    Benjamin Warner
    @benjamin_warner
    Dec 19, 2024
    Today we released ModernBERT, the first encoder to reach SOTA on most common benchmarks across language understanding, retrieval, and code, while running twice as fast as DeBERTaV3 on short context and three times faster than NomicBERT & GTE on long context.
    Image
  • user avatar
    Benjamin Warner
    @benjamin_warner
    Aug 5
    What are the odds that there isn't a framework and that's why the WH won't release it or require open models to be tested against it?
    user avatar
    MTS
    @MTSlive
    Aug 4
    SITUATION UPDATE: The White House has exempted open models from its new framework to test frontier AI capabilities before release, per Axios.
  • user avatar
    Benjamin Warner
    @benjamin_warner
    Jul 30
    Congratulations to Liquid on a strong open-source encoder release. Looks like ModernBERT has some competition😄 My read from Liquid's benchmarks: - for multilingual try mmBERT, ModernBERT, & LFM-E - for english-only try ModernBERT & LFM-E
    user avatar
    Liquid AI
    @liquidai
    Jul 28
    Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU. > LFM2.5-Encoder-230M: about 3.7x faster than ModernBERT-base on CPU at 8,192 tokens. Under 30s per forward pass, versus over a minute and a half. >
    Image
    00:00