Stepsize Hedging: an Alternative Mechanism for Accelerating Gradient Descent
Jason M. AltschulerPablo A. Parrilo
所有作者
Jason M. AltschulerPablo A. Parrilo
文献摘要
Can gradient descent be accelerated by just choosing better stepsizes? Surprisingly, the answer is yes. This short expository article provides an accessible introduction to this phenomenon of stepsize hedging.