A Recipe for Training Neural Networks(opens in a new tab)
A step-by-step process for training a network without silent bugs: inspect the data by hand, build the full training and evaluation pipeline around a simple model, overfit a small batch, then add regularization and tune, checking each step before moving on.