Instruction Tuning
Instruction tuning is a fine-tuning method that trains a pretrained language model on a curated set of (instruction, response) pairs so it learns to follow natural-language directions rather than merely continuing text. It is the standard step that converts a raw next-token-prediction base model into a usable…
2 resources across 1 library
Glossary Terms(2)
Instruction Tuning
Instruction tuning is a fine-tuning method that trains a pretrained language model on a curated set of (instruction, response) pairs so it learns to follow nat…
Constitutional AI
Constitutional AI (CAI) is a training method developed by Anthropic in which a model is guided by a written set of principles ('a constitution') and trained to…