[Math] Can a smooth convex functions be non-differentiable

convex optimizationconvex-analysislocally-convex-spacesreal-analysis

Consider the definition of the $\beta$-smoothness (for some constant $\beta$):
$$
\|\left. \nabla f \right|_{ y } – \left. \nabla f \right|_{ x } \| \leq \beta \| x – y \|
$$
And convexity:
$$
f(x) \geq f(y)+ \left. \nabla f \right|_{ y } . (x – y), \forall x, y
$$
Can a smooth convex function be non-differentiable at some points on its domain? (and why?)

In the definitions, $\left. \nabla f \right|_{y}$ is subgradient of the function $f$ at point $y$, if it is not differentiable at this point; so the definitions of convexity and smoothness hold even for non-differentiable functions.

Best Answer

A convex function $f$ is non-differentiable at a point $x$ iff the subgradient $\nabla f|_x$ has more than one vector. I presume the inequality $\|\nabla f|_x - \nabla f|_y\| \le \beta \|x - y \|$ means $\|v - w\| \le \beta \|x - y\|$ for all $v \in \nabla f|_x$ and $w \in \nabla f|_y$. In particular, for $y = x$ you see that $\nabla f|_x$ must contain only one vector for this to be true.

Related Question