This repo integrates a series of research projects focused on enhancing cognition abilities or injecting domain knowledge for LLMs via structurization:
- Enhancing LLM’s Cognition via Structurization, NeurIPS-24.
- Structure-aware Domain Knowledge Injection for Large Language Models, ACL-25.
- 2025.8: Structure-aware Domain Knowledge Injection for Large Language Models has been published as a long paper at ACL 2025 main conference!
- 2025.3: Released pretrained StruXGPT-v1-Qwen-7B and StruXGPT-v2-Llama2-7B at huggingface. Have fun with them!
- 2024.8: Upload the codebase. Data and weights are coming.
Install the dependencies:
pip install -r requirements.txt
Click a paper below to see the detailed instructions on how to run the code in examples/* to reproduce the results.
- Enhancing LLM’s Cognition via Structurization
- Structure-aware Domain Knowledge Injection for Large Language Models
If you use this code in your research, please kindly cite the following papers
@article{liu2024enhancing,
title={Enhancing LLM's Cognition via Structurization},
author={Liu, Kai and Fu, Zhihang and Chen, Chao and Zhang, Wei and Jiang, Rongxin and Zhou, Fan and Chen, Yaowu and Wu, Yue and Ye, Jieping},
journal={Advances in Neural Information Processing Systems},
volume={38},
year={2024}
}
@article{liu2024structure,
title={Structure-aware Domain Knowledge Injection for Large Language Models},
author={Liu, Kai and Chen, Ze and Fu, Zhihang and Jiang, Rongxin and Zhou, Fan and Chen, Yaowu and Wu, Yue and Ye, Jieping},
booktitle={Proceedings of the 63nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
pages={29443--29464},
year={2025}
}