RLHF
Reinforcement Learning from Human Feedback (RLHF) is a training technique used to align language models with human preferences by having people rank or rate model outputs, training a reward model on those preferences, and then using reinforcement learning to fine-tune the language model to produce outputs that score…
5 resources across 1 library
Glossary Terms(5)
Fine Tuning
Fine-tuning is the process of taking a pretrained machine learning model and continuing its training on a smaller, task- or domain-specific dataset to adapt it…
RLHF
Reinforcement Learning from Human Feedback (RLHF) is a training technique used to align language models with human preferences by having people rank or rate mo…
AI Ethics
AI ethics is the interdisciplinary field concerned with identifying and addressing the moral and societal implications of designing, deploying, and using AI sy…
AI Safety
AI safety is the field focused on ensuring AI systems behave reliably, predictably, and in accordance with human intentions, avoiding unintended harmful behavi…
Jailbreak
In the context of AI, a jailbreak is a prompting technique or crafted input designed to bypass an LLM's built-in safety training and content policies, coaxing…