How to understand/remember Hölder's inequality
If $p$ and $q$ are nonnegative numbers such that $\frac{1}{p}+\frac{1}{q}=1$ and if $f \in L^p$ and $g \in L^q$, then $f\cdot g \in L^1$ and $$\int |fg| \leqslant ||f||_p \cdot ||g||_q$$
I think Hölder's inequality is derived in order to prove Minkowski's inequality, which is a generalization of triangle inequality to $L^p$ norm. But is there any intuitive understanding of Hölder's inequality? It's hard for me to remember it. It seems that it's a generalization of the Cauchy-Schwarz inequality, trying to compare $L^2$ inner product to norm, but the power of each term is different, which makes it harder to be understood compared with Minkowski inequality.
Solution 1:
Hölder's inequality is an attempt to generalize the Cauchy-Schwarz inequality to other Lebesgue exponents (other $L^p$ norm). In fact, for inequality of the form $$ \|fg\|_1 \leq \|f\|_p \|g\|_q$$ to be true, we must have $1/p+1/q=1$. To see this, we use scaling argument, which is also useful to verify the correct exponent for other type of inequalities (Sobolev inequalities, etc.).
If such inequality were true, then we could apply the inequality to functions $f(\lambda x)$ and $g(\lambda x)$ for $\lambda\in \mathbb{R}$ to get $$ \|fg\|_1 \leq \lambda^{n(1-1/p-1/q)} \|f\|_p \|g\|_q$$ which cannot be true for all $\lambda$ unless $1/p+1/q=1$. This is a way to see that indeed the correct exponents must be such that $1/p+1/q=1$.
Solution 2:
Slightly late to the game, but just in case this is helpful:
For sequences, Cauchy-Schwarz asserts that $$ (a_1 b_1 + a_2 b_2 + \cdots + a_n b_n)^2 \leq (a_1^2 + a_2^2 + \cdots + a_n^2)(b_1^2+b_2^2+ \cdots + b_n^2) $$ Or in words: $$ \textit{the square of the sum of products} \leq \textit{the product of the sum of squares} $$ Staring at this mnemonic, one can imagine many ways it might generalize. For example, maybe the cube of the sum of products is bounded by the product of the sum of cubes? Turns out this is true, with two small caveats:
- Cauchy-Schwarz involves squares and products of two sequences. To generalize to cubes, we need three sequences.
- We need to require all our sequences to be non-negative.
In symbols, the cubic generalization of Cauchy-Schwarz reads: $$ (a_1 b_1 c_1 + a_2 b_2 c_2 + \cdots + a_n b_n c_n)^3 \leq (a_1^3 + a_2^3 + \cdots + a_n^3)(b_1^3+b_2^3+ \cdots + b_n^3) (c_1^3 + c_2^3 + \cdots + c_n^3) $$ Hölder's inequality is the natural extension of this idea: for any positive integer $n$, the $n$-th power of the sum of products (of $n$ non-negative sequences) is bounded by the product of the sum of the $n$-th powers. It's a fun exercise to deduce the usual statement of Hölder's inequality for $p,q \in \mathbb{Q}$ from this one. This in turn forces Hölder's inequality to hold for all positive $p,q \in \mathbb R$.