Editing Embedding (section)

=== Contextualized embeddings ===
These embeddings are based on the representation of words or phrases in a specific context, such as the [[transformer]] models. These embeddings capture the dynamic and complex meaning of words in different situations, by using deep neural networks that can encode both the left and the right context of a word. They also allow for fine-tuning and transfer learning, which can improve the performance of downstream NLP tasks.