[Math] Prove that the support function of an arbitrary set $A\subset\mathbb R^n$ is convex

convex optimizationconvex-analysissupport-function

Given an arbitrary set $A ⊂ \mathbb{R}^n$ , the support function associated with the set $A$

$ σ_A : \mathbb{R}^n \to \mathbb{R} ∪ \{+\infty\}$ is defined as

$\sigma_A(x):= \sup_{z \in A} \langle x,z \rangle$

Prove that $\sigma_A$ is convex.

Can I confirm that the inner product $\langle x, z \rangle$ is just a line orthogonal to $x$

I am confused by the meaning of "support function" and also what $\sigma_A(x)$ is.
If it's the supremum of the inner product of $x$ and $z$ (which tells us what exactly?) isn't it just going to be a single point/value?

How can I prove this, and where has my interpretation failed me?

Best Answer

First of all, \begin{align*} \sigma_A(x)=\sup_A\langle x, z\rangle=\sup\{\langle x,z\rangle\ |\ z\in A\}. \end{align*} To prove that $\sigma_A$ is convex, let $x,y\in\mathbb R^n$ and $t\in[0,1]$. Then \begin{align*} \sigma_A(tx+(1-t)y)&=\sup_{z\in A}\langle tx+(1-t)y,z\rangle \\ &= \sup_{z\in A}\left(t\langle x,z\rangle+(1-t)\langle y,z\rangle\right) \\ &\leq t\sup_{z\in A}\langle x,z\rangle+(1-t)\sup_{z\in A}\langle y,z\rangle \\ &=t\sigma_A(x)+(1-t)\sigma_A(y), \end{align*} which shows that $\sigma_A$ is convex.

Related Question