Why has $\int \sin (\sin x) dx$ not been solved yet?
Solution 1:
Well you can do
$$\int_0^{\pi}{\sin(\sin x)} = \pi H_0(1)\,,$$ where $H$ is a non-elementary function known as the Struve function. (For info on Struve functions, see http://mathworld.wolfram.com/StruveFunction.html.)
You might be wondering...what good does it do to express the integral in terms of a function that almost nobody has ever heard of?
Well, think back to a long time ago when the sine, cosine, and tangent functions themselves were as arcane as Struve functions are now. A math student might have asked a question analogous to your own, saying "Why hasn't anybody been able to integrate $\int{{dx\over 1+x^2}}$? The specialists at the time would have said, "Actually, we ${\it can}$ evaluate that integral:
$$\int{{dx\over 1+x^2}} = \arctan x\,.$$
If the student were to say, "What good does that do?" The expert would have said, well, this is helpful because see we have these books with values of the tangent function written down in them. So effectively we have "done the integral" because we know which book to look in.
Likewise today, it helps to express the integral $\int_0^{\pi}{\sin(\sin x)}$ as $\pi H_0(1)$ because now we know which book to look at. (Probably Abramowitz and Stegun's ${\it Handbook\ of\ Mathematical\ Functions}$, which I used to use a lot when I was a mathematical physicist.) More commonly, programs like Mathematica have all those values pre-loaded, along with approximation schemes for computing accurate values by interpolation.
And you know, that's all your calculator is doing when it computes $\sin x$ anyway. Once you're beyond the polynomial functions, you're pretty much in this territory.
Solution 2:
The integration problems one gets in Calculus 2 have integrands specially tailored to admit sufficiently simple closed-form antiderivatives. In the platonic world of mathematics, integrands are more likely to have horrendous-looking antiderivatives than clean-looking, and much more likely still to not have any elementary closed-form. We have to be picky about defining special functions: the zoo is too large to name all non-elementary functions, so we need to pick the ones that (a) turn up the most, (b) are the most interesting, and (c) have the broadest utility.
In my experience, most special functions turn up in the contexts of differential equations, number theory, and combinatorics (with complex analysis as a given). The most general kind of special function that I am aware of is actually a family of them, multivariable hypergeometric functions, which are defined through infinite series expansions with ratios of rising factorials as coefficients.
The hypergeometrics are widely applicable because seemingly almost any elementary function and many non-elementary functions and their moms and dogs can all be expressed as one. For an easier example of how a single special function can "cover extra territory" than one might initially guess, consider the Lambert W function. It is the inverse of $xe^x$. So $W(xe^x)=x$, ignoring technical things like branch cuts in the complex plane. Initially the only kind of equation would seem to be useful for is $xe^x=a~\Rightarrow~ x=W(a)$. Somewhat surprisingly, some pretty simple manipulations allow things like $e^x+x=a$ to be solved (subtract $x$ from both sides, multiply both sides by $e^{a-x}$, ????, profit). We want our special functions to have the widest applicability, all else equal.
Many elementary functions (expressions obtained through the elementary operations applied to compositions of exponentials, logarithms, trigonemtric and inverse trigonometric functions - if we work with complex variables, the latter two are special cases of the former two) that we find do not have an elementary antiderivative. And we've seen we want there to be some strategy in which of these we pick to define as special functions. It is not just that we haven't yet found antiderivatives and suspect there aren't any, we can prove there aren't any.
Some examples are $e^{e^x}$ and $e^{-x^2}$. I think $\sin\sin x$ is another example, but I can't locate a source and I am not personally familiar with the machinery to determine if it is. A heuristic or rule of thumb is that composing exponential or trigonometric functions is walking a tightrope when it comes to having elementary antiderivatives. Perhaps the reason $\int \sin\sin xdx$ doesn't have a name is that it's not something that really comes up in practice. However, it turns out there are some instances of trig functions composed with trig functions occurring "in nature." The special functions needed for this situation are the Bessel functions (which appear in another answer here).
There are historically some other impossibility issues that have turned up. The ancients could bisect an angle but could not trisect one. At the turn of the $18$th century, we could solve cubics and quartics but could not solve a general quintic. The Abel-Ruffini theorem proved the impossibility of solving generic fifth degree or higher polynomials using radicals. Galois developed his theory of symmetry of equations which explained why this was true. It turns out that the impossibility of trisecting angles is a corollary to Galois theory. Very fittingly the current subject which deals with the impossibility of integrating some elementary functions is an outgrowth called differential Galois theory. There are various theorems and algorithms of significance here; see this thread.
(With sufficiently general hypergeometric functions one can exactly solve arbitrary polynomials.)
The real question here, then, is why is it so easy to differentiate and so hard to integrate? There are various rules to differentiate things like products and compositions. The closest product rule for integrals is by-parts and the closest chain rule for integrals is substitution. Why the asymmetry?
This very question was posed here. My favorite answer is that local operations are easier than global operations (differentiation is local and integration is global).
Solution 3:
The surprising thing (beyond Calc 2, unfortunately) are definite integrals with answers as Bessel functions... $$ \int_0^{\pi/2} \cos(\cos x)\;dx = \frac{\pi}{2}\;I_0(1) $$