materials.md

In order

• Vectors
  • Extra: tensors, Einstein notation
• Gradient descent
  • $y=x^2$
  • Backpropagation
• Linear regression
• Nonlinearities
• Hidden layer
  • Exercise with functions
• Logistic regression
  • Logistic function
  • Log-loss
• MLP and non-linear slits (with examples)

All other stuff

• Various gradient optimizers

• Convolutions

• ImageNet networks

• Residual networks

  • Neural networks as Ordinary Differential Equations

• LSTMs as evergreen architecure

• How to implement a YOLO (v3) object detector from scratch in PyTorch: Part 1

Random but interesting stuff

• Game of life (and variants) in PyTorch
• Guide to Restricted Boltzmann Machines Using PyTorch

Maybe useful

https://github.com/trekhleb/homemade-machine-learning/blob/master/README.md