Book 8 — Natural Language Processing

Text representation through attention.

Text Representation

• Tokenization
• Bag of words & TF-IDF
• Word embeddings (Word2Vec, GloVe)

Sequence Models

• RNN, LSTM, GRU
• Seq2Seq
• Attention
• Transformers

Status

Complete deep-dive coverage of text representation, subword tokenization, Word2Vec, GloVe, recurrent sequence models, Attention mechanisms, and Transformer foundations.