Model Quantization
Model quantization is a technique that reduces the numeric precision used to represent a model's weights and activations, shrinking its size and speeding up inference with minimal accuracy loss.
4 resources across 1 library
Glossary Terms(4)
Small Language Model (SLM)
A Small Language Model (SLM) is a language model with a relatively small parameter count — typically from a few hundred million up to a few billion parameters…
Model Distillation
Model distillation is a technique for training a smaller, faster "student" model to replicate the behavior of a larger, more capable "teacher" model, transferr…
Model Quantization
Model quantization is a technique that reduces the numeric precision used to represent a model's weights and activations, shrinking its size and speeding up in…
Model Pruning
Model pruning is a technique that removes redundant or low-impact parameters from a trained neural network, reducing its size and computational cost while aimi…