How is the derivative of the CDF of a random variable $X$ its PDF?
Solution 1:
This is just the Fundamental Theorem of Calculus.
A PDF (of a univariate distribution) is a function defined such that it is 1.) everywhere non-negative and 2.) integrates to 1 over $\Bbb R$.
If we define $F(x) = \int_{-\infty}^x f(t)\ dt$, then the Fundamental Theorem of Calculus gives you the desired result.
This function, $F(x)$, is called the "cumulative distribution function," or CDF. It is defined in this manner, so the relationship between CDF and PDF is not coincidental -- it is by design.
Note that your last step is incorrect -- $x$ is the independent variable of the derivative there, and it is also the upper limit of the integral (so the resulting integral will be a function in terms of $x$). You can't move the $d/dx$ inside the integral.
Solution 2:
You can see this by differentiating under the integral sign, which follows from the fundamental theorem of calculus:
$$ \frac{d}{dx} F(x) =\lim_{c\to-\infty} \frac{d}{dx} \int^{x}_{c} f(t) dt = f(x).1 -\lim_{c\to-\infty} f(c).\frac{dc}{dx} + \lim_{c\to-\infty}\int^{x}_{c} \frac{d}{dx} f(t) dt $$
Since $c\to-\infty$ is a constant, the second term disappears, and since $f$ is a function of $t$, $\frac{d}{dx} f(t)$ also disappears.
Solution 3:
Since the accepted answer doesn't explicitly write out the proof, and considering that the other derivation uses Leibniz's rule, here's the answer in an explicit form: $$F(x) = \int_{-\infty}^{x}{f(t)dt}$$ From the fundamental theorem of calculus, if $P(x)$ is the indefinite integral of $f(x)$ : $f(x) = \frac{dP}{dx}(x)$, then $P(b) - P(a) = \int_{a}^{b}{f(t)dt}$. Then $F(x) = P(x) - \lim_{a \to -\infty}P(a)$. $$\frac{dF}{dx}(x) = \frac{d}{dx}[P(x) - \lim_{a \to -\infty}P(a)] = \frac{dP}{dx}(x) = f(x) $$