Skip to content
@LUMIA-Group

LUMIA: Language Understanding and Machine Intelligence Algorithms

LUMIA is a research group lead by Zhouhan Lin in Shanghai Jiao Tong University.

Popular repositories Loading

  1. MemoryDecoder MemoryDecoder Public

    The official implementation of the paper "Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models" (NeurIPS 2025 Poster).

    Python 78 12

  2. MLPMemory MLPMemory Public

    The official implementation of the paper "MLP Memory: A Retriever-Pretrained Memory for Large Language Models". (ICLR 2026)

    Python 73 6

  3. Leveraging-Self-Supervised-Learning-for-AVSR Leveraging-Self-Supervised-Learning-for-AVSR Public

    Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition (ACL 2022)

    Python 67 13

  4. rasat rasat Public

    Forked from ServiceNow/picard

    The official implementation of the paper "RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL"(EMNLP 2022)

    Python 64 17

  5. OrderedGNN OrderedGNN Public

    The official implementation of the paper "Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing" (ICLR 2023).

    Python 48 5

  6. FourierTransformer FourierTransformer Public

    The official Pytorch implementation of the paper "Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator" (ACL 2023 Findings)

    Python 40 1

Repositories

Showing 10 of 37 repositories
  • ncp_olmo_eval Public

    Official vLLM evaluation for OLMo and NCP-ArchPreview: GSM8K, SciQ, Core88, RULER, and HELMET

    LUMIA-Group/ncp_olmo_eval's past year of commit activity
    Python 21 Apache-2.0 0 1 0 Updated Sep 11, 2026
  • DynaKV Public

    Official implementation of the paper "One Size Does Not Fit All: Token-Wise Adaptive Compression for KV Cache" (EMNLP2026))

    LUMIA-Group/DynaKV's past year of commit activity
    0 0 0 0 Updated Aug 28, 2026
  • LUMIA-Group/LUMIA-Group.github.io's past year of commit activity
    Vue 1 1 0 0 Updated Aug 24, 2026
  • MLPMemory Public

    The official implementation of the paper "MLP Memory: A Retriever-Pretrained Memory for Large Language Models". (ICLR 2026)

    LUMIA-Group/MLPMemory's past year of commit activity
    Python 73 Apache-2.0 6 0 0 Updated Aug 22, 2026
  • Depth-Attention Public

    Depth-Attention: Cross-Layer Value Mixing for Language Models

    LUMIA-Group/Depth-Attention's past year of commit activity
    Python 10 Apache-2.0 0 0 0 Updated Aug 7, 2026
  • MemSFT Public

    The official implementation of the paper "MemSFT: Mitigating Alignment Tax with an External Parametric Memory".

    LUMIA-Group/MemSFT's past year of commit activity
    Python 26 Apache-2.0 0 0 0 Updated Aug 3, 2026
  • LUMIA-Group/MemoryDecoder-at-Scale's past year of commit activity
    Python 30 Apache-2.0 2 0 0 Updated Jul 31, 2026
  • LUMIA-Group/MemoryPretrain's past year of commit activity
    0 0 0 0 Updated Jul 22, 2026
  • Fourier-Compressor Public Forked from whyisverysmart/Fourier-Compressor

    Official implementation of "Fourier Compressor: Frequency-Domain Visual Token Compression for Vision-Language Models". (ECCV 2026)

    LUMIA-Group/Fourier-Compressor's past year of commit activity
    Python 1 Apache-2.0 3 0 0 Updated Jul 3, 2026
  • PonderLM-2 Public

    Official implementation of the paper "PonderLM-2: Pretraining LLM with Latent Thoughts in Continuous Space"

    LUMIA-Group/PonderLM-2's past year of commit activity
    Python 15 Apache-2.0 2 0 0 Updated May 6, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Python Vue

Most used topics

Loading…