⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’
Excalidraw Data
Text Elements
LoRA Architecture
x
Input
(k × 1)
W₀
(Frozen)
Pretrained Weights
d × k
A
Down-project
r × k
B
Up-project
d × r
h
Output
(d × 1)
h = W₀x + (α/r)·BAx
• A, B: Trainable adapters
• r: Rank (hyperparameter)
• α: Scaling factor
Parameter Savings
Full Fine-tune: d × k params
LoRA: r × k + d × r params
Pretrained Path
LoRA Adapter Path