Convexity of the Marginal (Optimal Value) Function

Under convexity of the objective and the set-valued map, the value function is convex
Convexity of the Marginal (Optimal Value) Function

Convexity of the Marginal Function: Let XX and YY be . Assume that φ:X×YR\varphi:X\times Y\to\overline{\mathbb{R}} is a and that F:XYF:X\rightrightarrows Y is a (i.e., its graph is convex). Define the μ\mu by

μ(x)=inf{φ(x,y)yF(x)}. \mu(x)=\inf\{\varphi(x,y)\mid y\in F(x)\}.

Then μ\mu is convex on XX.

Context: This result explains why optimal value functions in convex optimization are convex in parameters: convexity of φ\varphi and convexity of the feasible graph propagate through the infimum operation.

Proof sketch (idea): Fix x1,x2x_1,x_2 and choose near-minimizers y1F(x1)y_1\in F(x_1), y2F(x2)y_2\in F(x_2). By graph convexity, λy1+(1λ)y2F(λx1+(1λ)x2)\lambda y_1+(1-\lambda)y_2\in F(\lambda x_1+(1-\lambda)x_2). Use convexity of φ\varphi to bound μ(λx1+(1λ)x2)\mu(\lambda x_1+(1-\lambda)x_2) by λμ(x1)+(1λ)μ(x2)\lambda\mu(x_1)+(1-\lambda)\mu(x_2) (letting the approximation error go to 00).