BERT
BERT (Bidirectional Encoder Representations from Transformers) is an encoder-only Transformer language model released by Google AI in 2018 that learns deep bidirectional representations of text by jointly conditioning on both left and right context, and was a breakthrough for a wide range of natural language…
5 resources across 1 library
Glossary Terms(5)
BERT
BERT (Bidirectional Encoder Representations from Transformers) is an encoder-only Transformer language model released by Google AI in 2018 that learns deep bid…
RoBERTa
RoBERTa (Robustly Optimized BERT Pretraining Approach) is an encoder-only language model released by Facebook AI Research in 2019 that improves on BERT by refi…
T5
T5 (Text-to-Text Transfer Transformer) is an encoder-decoder Transformer model introduced by Google Research in 2019 that reframes every NLP task — translation…
Wav2Vec
Wav2Vec is a family of self-supervised speech representation learning models developed by Facebook AI Research (Meta AI), which learn useful audio representati…
Vision Transformer (ViT)
Vision Transformer (ViT) is an image classification architecture introduced by Google Research in 2020 that applies the Transformer architecture — originally d…