Log inSign up
XLANG NLP Lab profile banner
user avatar

XLANG NLP Lab

@XLangNLP
developing embodied AI agents that empower users to use language to interact with digital and physical environments to carry out real-world tasks.
xlang.ai
Joined July 2023
36
Following
1,588
Followers
RepliesMedia
  • Pinned
    user avatar
    XLANG NLP Lab
    @XLangNLP
    Jun 26
    Two years ago, we built OSWorld 1.0 — the benchmark that became the standard for computer-use agents. Agents now score 83.5% on it. Problem solved? Not even close. 🚀Today we introduce OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks. What's new:
    Image
    00:00
  • user avatar
    XLANG NLP Lab
    @XLangNLP
    Jul 25
    Congrats the Claude team on the big jump on OSWorld! Worth flagging this 70.6% is partial-credit scoring — under strict binary task-level success (OSWorld 1.0-style), Opus 5 is still only ~30%. We're working on improving task quality so task-level binary success becomes more
  • user avatar
    XLANG NLP Lab
    @XLangNLP
    Aug 15, 2025
    Check out our latest open-source project, OpenCUA, for Computer Use Agents (CUAs)! Find the code, annotation tool, the largest CUA dataset, scalable training recipe, and state-of-the-art model on OSWorld at: opencua.xlang.ai.
    user avatar
    Xinyuan Wang
    @xywang626
    Aug 15, 2025
    We are super excited to release OpenCUA — the first from 0 to 1 computer-use agent foundation model framework and open-source SOTA model OpenCUA-32B, matching top proprietary models on OSWorld-Verified, with full infrastructure and data. 🔗 [Paper] arxiv.org/abs/2508.09123 📌
    Image
  • user avatar
    XLANG NLP Lab
    @XLangNLP
    Jun 17, 2025
    🔥New Computer Agent Arena Leaderboard Updates (2k+ user votes)! 🤔Which VLMs act better as computer use agents (CUAs)? 1, Claude Sonnet 4 🥇 2, Claude 3.7 Sonnet 🥈 3, UI-TARS-1.5 🥉 4, Operator More insights in the thread 👇 arena.xlang.ai
    Image