Orca
Orca is a series of research language models from Microsoft that use explanation-tuning — training on step-by-step reasoning traces distilled from a larger teacher model like GPT-4 — to teach smaller models more robust reasoning ability than standard instruction tuning produces.
4 resources across 1 library
Glossary Terms(4)
Orca (model)
Orca is a series of research language models from Microsoft that use explanation-tuning — training on step-by-step reasoning traces distilled from a larger tea…
Zephyr (model)
Zephyr is a series of open large language models from Hugging Face fine-tuned from Mistral 7B using distilled supervised fine-tuning and Direct Preference Opti…
StableLM
StableLM is a family of open-source language models developed by Stability AI, released in multiple sizes and generations to provide permissively licensed, tra…
Dolly (model)
Dolly is an open-source instruction-following large language model released by Databricks, notable as one of the first LLMs whose instruction-tuning dataset wa…