We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
The Inexact Cyclic Block Proximal Gradient Method and Properties of Inexact Proximal Maps.
- Authors
Farias Maia, Leandro; Gutman, David Huckleberry; Hughes, Ryan Christopher
- Abstract
This paper expands the cyclic block proximal gradient method for block separable composite minimization by allowing for inexactly computed gradients and pre-conditioned proximal maps. The resultant algorithm, the inexact cyclic block proximal gradient (I-CBPG) method, shares the same convergence rate as its exactly computed analogue provided the allowable errors decrease sufficiently quickly or are pre-selected to be sufficiently small. We provide numerical experiments that showcase the practical computational advantage of I-CBPG for certain fixed tolerances of approximation error and for a dynamically decreasing error tolerance regime in particular. Our experimental results indicate that cyclic methods with dynamically decreasing error tolerance regimes can actually outpace their randomized siblings with fixed error tolerance regimes. We establish a tight relationship between inexact pre-conditioned proximal map evaluations and δ -subgradients in our (δ , B) -Second Prox theorem. This theorem forms the foundation of our convergence analysis and enables us to show that inexact gradient computations can be subsumed within a single unifying framework.
- Subjects
APPROXIMATION error; NONSMOOTH optimization; SET-valued maps
- Publication
Journal of Optimization Theory & Applications, 2024, Vol 201, Issue 2, p668
- ISSN
0022-3239
- Publication type
Article
- DOI
10.1007/s10957-024-02404-7