Optimization on manifold with additional linear constraints

constraintsmanifoldsoptimization

I am looking for references about manifold optimization when additional constraints on the variable are present.

Specifically, the problem I'm interested in is something along this line

\begin{align}
\min_{Q \in SO(n)} \quad & f(Q) \\
\text{s.t.} \quad & \Lambda Q \geq 0 \\
\text{s.t} \quad & M Q^T \geq 0
\end{align}

Best Answer

The field of unconstrained Riemannian optimization has a significant literature. But as far as I know, there had been no publications in constrained Riemannian optimization until the 2019 publication cited below.

Paywalled version: Simple Algorithms for Optimization on Riemannian Manifolds with Constraints, by Changshuo Liu & Nicolas Boumal

Freely accessible pre-publication version: Simple Algorithms for Optimization on Riemannian Manifolds with Constraints, by Changshuo Liu & Nicolas Boumal

Abstract: We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the Euclidean case to the Riemannian case. Thus, the variable lives on a known smooth manifold and is further constrained. In doing so, we exploit the growing literature on unconstrained Riemannian optimization. For the special case where the manifold is itself described by equality constraints, one could in principle treat the whole problem as a constrained problem in a Euclidean space. The main hypothesis we test here is whether it is sometimes better to exploit the geometry of the constraints, even if only for a subset of them. Specifically, this paper extends an augmented Lagrangian method and smoothed versions of an exact penalty method to the Riemannian case, together with some fundamental convergence results. Numerical experiments indicate some gains in computational efficiency and accuracy in some regimes for minimum balanced cut, non-negative PCA and k-means, especially in high dimensions.

Related Question