Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise

Conference paper

Improved Step-Size Schedules for Proximal Noisy Gradient Methods

Article

On the Convergence of Stochastic Gradient Descent with Bandwidth-based Step Size

Article

Generalized Polyak Step Size for First Order Optimization with Momentum

Conference paper

Stochastic Trust-Region Methods with Trust-Region Radius Depending on Probabilistic Models

Article

Zeroth-Order Randomized Subspace Newton Methods

Conference paper

Improved step-size schedules for noisy gradient methods

Conference paper

On the Convergence of Step Decay Step-Size for Stochastic Optimization

Conference paper

Stochastic proximal quasi-Newton methods for non-convex composite optimization

Article