OPT
OPT (Open Pre-trained Transformer) is a family of open-source decoder-only language models released by Meta AI in 2022, ranging from 125 million to 175 billion parameters, designed to replicate GPT-3-class performance with full transparency.
3 resources across 1 library
Glossary Terms(3)
GPT-J
GPT-J is a 6-billion-parameter open-source autoregressive language model released by EleutherAI in 2021, notable as one of the first freely available GPT-3-cla…
GPT-NeoX
GPT-NeoX (specifically GPT-NeoX-20B) is a 20-billion-parameter open-source autoregressive language model released by EleutherAI in 2022, along with its accompa…
OPT (model)
OPT (Open Pre-trained Transformer) is a family of open-source decoder-only language models released by Meta AI in 2022, ranging from 125 million to 175 billion…