Convolutional Neural Networks (CNN) — for text classification

Recurrent Neural Networks (RNN)

Vanishing / Exploding gradient problem

Long Short-Term Memory (LSTM)

Gated Recurrent Unit (GRU)

Bidirectional RNNs

Sequence-to-Sequence (Seq2Seq) models

Encoder-Decoder architecture

Attention mechanism (Bahdanau, Luong)

Self-attention

Multi-head attention

Positional encoding

The Transformer architecture

BERT & variants (RoBERTa, ALBERT, DistilBERT)

GPT & autoregressive language models

T5, BART (seq2seq transformers)

Large Language Models (LLMs) — architecture level