Sequence Models

RNN and Transformer architectures.

Learning Objectives

• Understand RNN and LSTM
• Master attention mechanism
• Learn Transformer architecture

Topics

1. RNN / LSTM / GRU

2. Attention Mechanism

3. Transformer Architecture

Resources

• The Illustrated Transformer