LoRA Without Forgetting: Freezing and Sparse Masking for Low-Rank Adaptation [Preliminary Version]
Juzheng Zhang, Jiacheng You, Ashwinee Panda, and Tom Goldstein
In Sparsity in LLMs (SLLM): Deep Dive into Mixture of Experts, Quantization, Hardware, and Inference, 2025