Will LoRA Fine-Tuning Also Be Effective? #2
Description
From the code, it seems that all LLM parameters need to be updated. Have you tried partial parameter update methods like LoRA?
{{ message }}
From the code, it seems that all LLM parameters need to be updated. Have you tried partial parameter update methods like LoRA?