Fine-tuning & Alignment

LoRA's Low-Rank Assumption: When It Holds, When It Breaks

An analysis of LoRA's low-rank hypothesis, approximation error bounds, diagnostics, and practical rank selection under distribution shift.