Lo RA
LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique that adapts a large pretrained model by freezing its original weights and injecting small, trainable low-rank matrices into its layers. Only these added matrices — a tiny fraction of the model's total parameters — are trained, dramatically…
5 resources across 2 libraries
Glossary Terms(4)
Fine Tuning
Fine-tuning is the process of taking a pretrained machine learning model and continuing its training on a smaller, task- or domain-specific dataset to adapt it…
LoRA
LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique that adapts a large pretrained model by freezing its original weights and injecting s…
Stable Diffusion XL
Stable Diffusion XL (SDXL) is a text-to-image diffusion model released by Stability AI in 2023, a larger and higher-fidelity successor to the original Stable D…
Catastrophic Forgetting
Catastrophic forgetting is the tendency of a neural network to abruptly lose previously learned knowledge when it is trained on new data or tasks, because the…