LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
About this project
LoRA: Low-Rank Adaptation of Large Language Models This repo contains the source code of the Python package loralib and several examples of how to integrate it with PyTorch models, such as those in Hugging Face. We only support PyTorch for now. See our paper for a detailed description of LoRA. LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu\, Yelong Shen\, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen Paper: https://arxiv.org/abs/2106.09685 Video explainer: https://www.youtube.com/watch?v=DhRoTONcyZE Update 2/2023: LoRA is now supported by the State-of-the-art Parameter-Efficient Fine-Tuning (PEFT) library by Hugging Face. LoRA…
Technologies
Project health
GitHub
Reviews
Built by
Maintain microsoft/LoRA? Claiming verifies admin access through your GitHub account and gives you control of this listing.
