Chrome icon Install the ML Dictionary Chrome Extension and discover a new machine learning concept on every tab 🎉🙌
Logo ml2

Learning Rate

Learning Rate is a hyperparameter which determines to what extent newly acquired information overrides old information. As the goal is to find the minimum error, learning rate that is too high will make the learning jump over minima, and if it is too low, the learning rate will either take too long to converge or get stuck in an undesirable local minima.

Made by AI Summer Internship ☀️