Skip to content
@xlang-ai

XLANG Lab

Developing embodied AI agents that empower users to use language to interact with digital and physical environments to carry out real-world tasks.

Welcome to the Executable Language Grounding (XLANG) Lab! We are part of the HKU NLP Group at the University of Hong Kong. XLang focuses on building language model agents that transform (“grounding”) language instructions into code or actions executable in real-world environments, including databases (data agent), web applications (plugins/web agent), and the physical world (robotic agent) etc,. It lies at the heart of language model agents or natural language interfaces that can interact with and learn from these real-world environments to facilitate human interaction with data analysis, web applications, and robotic instruction through conversation. Recent advances in XLang incorporate techniques such as LLM + external tools, code generation, semantic parsing, and dialog or interactive systems.

Pinned Loading

  1. OpenCUA OpenCUA Public

    [NeurIPS 2025 Spotlight] OpenCUA: Open Foundations for Computer-Use Agents

    Python 839 108

  2. OSWorld OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Python 3.1k 532

  3. aguvis aguvis Public

    [ICML2025] Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

    Python 391 30

  4. OpenAgents OpenAgents Public

    [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

    Python 4.9k 530

  5. Spider2 Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    HTML 871 151

  6. instructor-embedding instructor-embedding Public

    [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

    Python 2k 157

Repositories

Showing 10 of 33 repositories
  • OSWorld-V2 Public

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    xlang-ai/OSWorld-V2's past year of commit activity
    Python 313 Apache-2.0 47 11 7 Updated Sep 16, 2026
  • OSWorld Public

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    xlang-ai/OSWorld's past year of commit activity
    Python 3,147 Apache-2.0 532 155 46 Updated Sep 14, 2026
  • osworld_image Public
    xlang-ai/osworld_image's past year of commit activity
    Shell 3 0 0 0 Updated Sep 14, 2026
  • CUA-Gym-Hub Public

    CUA-Gym-Hub: mock web apps as reproducible RL training environments for computer-use agents

    xlang-ai/CUA-Gym-Hub's past year of commit activity
    JavaScript 74 13 0 1 Updated Sep 3, 2026
  • FineVLA Public

    Scalable annotation pipeline for action-aglined fine-grained instruciton for Visual-language-Action model

    xlang-ai/FineVLA's past year of commit activity
    Python 93 Apache-2.0 1 1 0 Updated Sep 2, 2026
  • Qwen-CUA Public

    Qwen-CUA: Native Computer Use for (Almost) Everything — a screenshot-driven agent that operates computers with keyboard and mouse, jointly developed by the Qwen Team and XLang Lab.

    xlang-ai/Qwen-CUA's past year of commit activity
    207 Apache-2.0 12 2 0 Updated Aug 26, 2026
  • CUA-Gym Public

    Scalable pipeline for synthesizing verifiable RLVR training data for computer-use agents

    xlang-ai/CUA-Gym's past year of commit activity
    Python 200 18 6 1 Updated Aug 13, 2026
  • Spider2 Public

    [ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

    xlang-ai/Spider2's past year of commit activity
    HTML 871 MIT 150 119 6 Updated Aug 12, 2026
  • xlang-ai.github.io Public

    The official website of xlang.ai

    xlang-ai/xlang-ai.github.io's past year of commit activity
    TypeScript 3 0 0 0 Updated Aug 5, 2026
  • OSWorld-G Public

    [NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis

    xlang-ai/OSWorld-G's past year of commit activity
    TypeScript 178 Apache-2.0 9 11 2 Updated Jun 18, 2026