Transformers.md

People

Lucas Beyer (Twitter: @lucasbey)

• Transformer tutorial slides (must-read): Link
• Talks Collection

Explaination / Visualization

• Understanding and Coding the Self-Attention Mechanism of Large Language Models From Scratch from Sebastian Raschka

  Click to show image

  

• Transformer Explainer

  Click to show image

  

• Transformer Circuits Thread

  Click to show image

  

• The Annotated Transformer

  Click to show image

  

Practice

• Transformer Puzzles from Professor Alexander Rush. Also check out his Puzzle collection.