Module 3: Transformers

Module 3: Transformers#

What to learn in this module#

In this module, we will learn about transformers - a modern architecture that revolutionized NLP. We will learn:

  • Transformers architecture that revolutionized NLP

  • BERT and its bidirectional understanding of context

  • Sentence-BERT for generating sentence embeddings

  • Flan-T5 for instruction-tuned text generation

  • Instruction Embedding for better task adaptation

Contents