Notes
- Inserts additional layers into the original model
- Only 0.01% of the original size
- 1D vectors are added
- Greatly reduces training time
- Increased scalability, as multiple fine tuned models can be served by the same hardware
Links
Efficient LLM Finetuning with T-Few