1. X
  2. Ryan Marten
Log inSign up
Ryan Marten
658 posts
user avatar

Ryan Marten

@ryan_marten
Building @harborframework and @terminalbench
San Francisco
ryanmarten.com
Joined June 2022
2,110
Following
2,874
Followers
RepliesRepliesArticlesArticlesMediaMedia
  • Pinned
    user avatar
    Ryan Marten
    @ryan_marten
    Jul 23
    Article cover image
    Article
    Continuous Benchmarks
    Benchmarks are not static artifacts. They are software and we should maintain them like software. The process for building a benchmark was: Come up with an idea for a frontier capability test Take...
  • user avatar
    Ryan Marten
    @ryan_marten
    5h
    GLM 5.3 is the newest member to the cost-accuracy pareto for Terminal-Bench 3.0, replacing Grok 4.6 Impressive improvement from GLM 5.2 (4.6%) to GLM 5.3 (32.4%)!
    Image
  • user avatar
    Ryan Marten
    @ryan_marten
    Aug 14
    Congrats to Z.ai for the strong performance on Terminal-Bench 3.0! One of the biggest pieces of feedback we have gotten for TB3 is to increase the timeouts. We calibrated timeouts against frontier models during development, but inference speed can still be a
    Image
    Image
    user avatar
    Z.ai
    @Zai_org
    Aug 14
    Introducing GLM-5.3: Built to Code. Ready for Cyber Defense. - Top-tier coding and agentic capabilities, achieved through post-training on the 743B base model - A major leap in cybersecurity, setting a new standard among open models Tech Blog: z.ai/blog/glm-5.3
  • user avatar
    Ryan Marten
    @ryan_marten
    Aug 12
    Grok 4.6 now on the Terminal-Bench 3.0 Leaderboard!
    Image
  • user avatar
    Ryan Marten
    @ryan_marten
    Aug 12
    run SWE-marathon through harbor!
    user avatar
    Rishi Desai
    @rishi_desai2
    Aug 11
    Replying to @rishi_desai2
    A big criticism of v1.0 was that it was too hard to run. v1.1 fixes that. The full eval now runs with one bash script on vanilla Harbor (no fork!). We also added longer agent timeouts, closed-internet sandboxes, an agent-visible wall-clock timer, and stronger verifiers.
    Image
    00:00

Log in or sign up for X

See what’s happening and join the conversation

Continue with phone
or
Log in with username or email
Terms·Privacy·Cookies·Accessibility·Ads Info·© 2026 X Corp.
Advertisement
Advertisement