Differences between derivatives and strong derivatives
Definition: Let $f$ be a real valued function. We say $f$ is $\mathbf{strongly}$ $\mathbf{differentiable}$ at $x = a$ if the following limits exists and is finite:
$$ \lim_{x \to a, y \to a, x \neq y} \frac{ f(x)-f(y)}{x-y} = f^*(a) $$
and we can $f^*(a)$ the strong derivative of $f$ at $a$. Why is this definition of derivative different than the usual one? What is the main crucial point to understand here that makes it different?
Here is roughly what every student of analysis should know.
This "strong" derivative was introduced by Peano in 1892 as a "strict derivative". This asks rather more of a function than it merely have an (ordinary) derivative and Peano thought that this was actually better for students and engineers to learn and use. I prefer his terminology since the word "strong" gets rather overused in analysis and interferes with the more popular usages.
PEANO G.: Sur la définition de la dérivée, Mathesis, (2) 2 (1892), 12—14.
For a continuous function $f$ the strict (strong) derivative $f^*(x_0)$ exists at a point if and only if one (and hence all four) of the Dini derivatives $D^+f(x)$, $D_+f(x)$, $D^-f(x)$ or $D_-f(x)$ is continuous at $x_0$.
In particular, if $f'(x)$ is continuous at a point $x_0$ then the strict derivative $f^*(x_0)$ exists and, of course, is equal to the ordinary derivative $f'(x_0)$. If $f'(x)$ exists in some neighborhood of the point $x_0$ then the strict derivative at $x_0$ exists if and only if $f'$ is continuous at $x_0$.
For a bibliography of papers on the subject the ever-reliable Dave Renfro has supplied quite a few in his StackExchange answer.
Here are some considerations if you wish to decide whether you would prefer all your derivatives to be strong ones (as Peano did).
If $f'(x_0)$ exists you can be sure that $f$ is continuous at $x_0$, but it could be discontinuous and quite pathological everywhere else. But if $f^*(x_0)$ exists then you can be certain that $f$ is not only continuous at $x_0$, it is continuous in some neighborhood $(x_0-\delta,x_0+\delta)$. But way more than that: it is even Lipschitz in $(x_0-\delta,x_0+\delta)$.
If $f'(x_0)$ exists then, as already noted there doesn't have to be a derivative at any other point. But if $f^*(x_0)$ exists then there is some neighborhood $(x_0-\delta,x_0+\delta)$ in which $f$ has almost everywhere a derivative and that derivative is continuous at $x_0$ (i.e., continuous relative to the set of points at which it exists).
If you prefer espresso to green tea, a robust merlot to a sauvignon blanc, and a rare steak to a fillet of sole, you would probably like Peano's idea of using strong derivatives in place of their wimpy cousins (the ordinary derivative) when you have to teach the calculus. Especially to engineers.