MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning

Annual Meeting of the Association for Computational Linguistics (ACL), pp. 3052–3064

Abstract

Pengjie Ren, Chengshun Shi, Shiguang Wu, Mengqi Zhang, Zhaochun Ren, Maarten de Rijke, Zhumin Chen, Jiahuan Pei. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

Authors 8

1. Pengjie Ren

   Shandong University

   Affiliation as printed

   Shandong University

2. Chengshun Shi

   Shandong University

   Affiliation as printed

   Shandong University

3. Shiguang Wu

   Shandong University

   Affiliation as printed

   Shandong University

4. Mengqi Zhang

   Shandong University

   Affiliation as printed

   Shandong University

5. Zhaochun Ren Aachen

   Leiden University

   Affiliation as printed

   Leiden University

6. Maarten de Rijke

   University of Amsterdam

   Affiliation as printed

   University of Amsterdam

7. Zhumin Chen

   Shandong University

   Affiliation as printed

   Shandong University

8. Jiahuan Pei

   Centrum Wiskunde & Informatica

   Affiliation as printed

   Centrum Wiskunde & Informatica