Gradient descent convergence for β-smooth functions
Let
be a β-smooth convex function and assume we have
.
If we run GD for
steps, we have:
Corollary
If
we have
Compare to: Gradient descent
convergence bound, Gradient
descent convergence for α-strongly convex functions