MoRE

GLUE: GLUE Benchmark
BoolQ, CB: SuperGLUE Benchmark
SciTail: SciTail Dataset on Hugging Face

Title

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning

cd script
sh finetune_more.sh

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
data		data
peft		peft
script		script
transformers		transformers
.gitattributes		.gitattributes
MoRE_framework.pdf		MoRE_framework.pdf
README.md		README.md
finetune.py		finetune.py
framework.png		framework.png
metrics.py		metrics.py
rank.py		rank.py
trainer.py		trainer.py