The talk is concerned with geometric optimization problems related to the Neumann eigenvalue problem for the Laplace-Beltrami operator on bounded subdomains of a Riemannian manifold. More precisely, we analyze locally extremal domains for the first nontrivial eigenvalue with respect to volume preserving domain perturbations, and we show that corresponding notions of criticality arise in the form of overdetermined boundary value problems. Our results rely on an extension of Zanger's shape derivative formula which covers the case where the first nonzero Neumann eigenvalue is not simple. In the second part of the talk, we focus on product manifolds with euclidean factors, and we classify the subdomains where the associated overdetermined boundary value problem has a solution. This is joint work with Moustapha Fall (AIMS Senegal).