Here I implement ResNet50 from scratch. ResNet50 to inspect techniques like batch normalization, train and test augmentation, a few initialization methods, weight decay, etc.
Some interesting observations are collected in the notebook "interesting_observations.ipynb"