Fundamentals · Part 8How LLMs Work
Reading "Attention Is All You Need", the 2017 Transformer Paper
A guided reading of the 2017 Transformer paper: encoder, decoder and cross-attention, how it was trained, what it scored, and which choices survived.
Tagged: Cross attention
1 article.