Can asymptotes be curved?

The concept of asymptotes is quite common for curved graphs, although somehow the terminology is not much used outside of the context of lines. The way in which the concept is used is that if one is given a function $f(x)$, it is interesting to study other functions $g(x)$ that are "asymptotic to $f(x)$" in various ways. One meaning of this phrase would be that $$(1) \quad \lim_{x \to +\infty} |f(x)-g(x)|=0 $$ which is exactly what "asymptotic" means in the ordinary sense when the graph of $f(x)$ is a line. Another somewhat different notion is that $$(2) \quad \lim_{x \to +\infty} \frac{f(x)}{g(x)} = 1 $$ which only really makes sense when $f(x)$ and $g(x)$ are nonzero near $+\infty$. There are many other variations on this concept. This discussion falls under the name of "growth types of functions", which are important in computer science and other places; these notes look like a good basic discussion, for example.

And regarding your question of whether $g(x) = x^2 + \sin(x)$ is asymptotic to $y=x^2$, it is asymptotic in sense (2) but not in sense (1).

"Asymptote," in my view, essentially refers to some kind of limiting behavior of a function. So for instance, we talk about asymptotic series expansions. So from an analytic geometry perspective, we might think of an "asymptote" as a function or relation that describes how another function approaches it arbitrarily closely. For example, $$f(x) = \frac{x-x^2+x^4}{x^2-1}$$ might be thought of as having a parabolic asymptote and two vertical asymptotes, since for "large" $x$, $f(x) \sim x^2$. But I hesitate to say $f(x) = x^2 + \sin x$ has such an asymptote, because the magnitude of $\sin x$ does not diminish as $x$ gets large.

terminology is up to you. However, it is useful, when graphing rational functions, to realize that they are essentially polynomial (or the reciprocal of a polynomial) for large absolute values of the argument. Graph $$ y = \frac{x^5 - 7}{x^3 - 12 x}, $$ for large $|x|,$ $y$ is pretty much $x^2.$