Editing Learning Rate (section)

== Overview ==
The learning rate determines the step size during the [[stochastic gradient descent]] process. A high learning rate allows the model to learn faster, at the cost of possibly overshooting the minimum point of the [[Loss function|loss function]]. A low learning rate allows the model to converge reliably, but at the cost of slower learning speed.