..
Attention Is All I Need
today’s side quest will be focused on the following youtube video: deep learning introduction by none other than openai founding member karpathy.
the goal here is to get my hands on the core paper attention is all you need and hopefully have a crappy baby gpt.
off to work