How can we reduce the training error and validation error?

1. Early Stopping
2. Model Ensembles
3. Regularization

Regularization : Add term to loss

Regularization : Dropout

Regularization : Data Augmentation

Regularization : DropConnect

Regularization : Fractional Pooling

Regularization : Stochastic Depth