We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Online Optimization over Riemannian Manifolds.
- Authors
Xi Wang; Zhipeng Tu; Yiguang Hong; Yingyi Wu; Guodong Shi
- Abstract
Online optimization has witnessed a massive surge of research attention in recent years. In this paper, we propose online gradient descent and online bandit algorithms over Riemannian manifolds in full information and bandit feedback settings respectively, for both geodesically convex and strongly geodesically convex functions. We establish a series of upper bounds on the regrets for the proposed algorithms over Hadamard manifolds. We also find a universal lower bound for achievable regret on Hadamard manifolds. Our analysis shows how time horizon, dimension, and sectional curvature bounds have impact on the regret bounds. When the manifold permits positive sectional curvature, we prove similar regret bound can be established by handling non-constrictive project maps. In addition, numerical studies on problems defined on symmetric positive definite matrix manifold, hyperbolic spaces, and Grassmann manifolds are provided to validate our theoretical findings, using synthetic and real-world data.
- Subjects
GRASSMANN manifolds; HYPERBOLIC spaces; CONVEX functions; TIME perspective; REGRET; RIEMANNIAN manifolds
- Publication
Journal of Machine Learning Research, 2023, Vol 24, p1
- ISSN
1532-4435
- Publication type
Article