• 0 Posts
  • 4 Comments
Joined 1 year ago
cake
Cake day: July 9th, 2023

help-circle


  • The math involved in LLMs is not complex for anyone that has passed undergrad Calc and Linear Algebra classes. If you know derivatives, the chain rule and some matrix basics you can figure them out with enough studying.

    The hard part about LLMs is not the math but the neural net architecture innovations they brought (eg self-attention)