The Moment That Speeds Up Neural Network Training
Training a neural network is like sledding down a hill: you need the right speed to avoid getting stuck or flying off the track. In the popular momentum method (like inertia), a constant value of 0.9 is typically used.