Are there interesting rings without unity?
Two-sided ideals don't count as an example
Every nonunital ring $R$ is a two-sided ideal in its "unitization" $R \oplus \mathbb{Z}$ (with an appropriately defined multiplication). Unitization is the left adjoint to the forgetful functor from rings to nonunital rings. More generally, if $R$ is a $k$-algebra, there is a unitization $R \oplus k$ as a $k$-algebra. This is a common construction in, for example, the study of C*-algebras (where many naturally-occurring C*-algebras such as the algebra of compact operators or group C*-algebras of some locally compact groups are nonunital); it is an algebraic analogue of passing to the one-point compactification (the analogy is via Gelfand-Naimark).
The theory of C*-algebras in particular shows that it's profitable to prove theorems about nonunital rings because you can then apply those theorems to two-sided ideals.
I wrote down some examples and comments in this blog post, which in particular shows that the category of non-unital rings is equivalent to the category of augmented rings (rings together with a morphism $R \to \mathbb{Z}$), and this is a natural category to study; on the geometric side, augmented commutative rings are the rings of functions on "pointed affine schemes."
I once thought it was the case that in number theory basically all the relevant rings were commutative with identity. But this is not so! In the theory of automorphic forms and representations, the Hecke algebras which act on representations of various groups (the groups of points of reductive groups over local and global fields, valued in the field, or in the global case, in its completions or its adele ring) are generally non-commutative and do not have multiplicative identities (although there are interesting subalgebras, e.g. the spherical Hecke algebras, which are commutative and do have identities). In the local case, the rings are convolution algebras of locally profinite (meaning totally disconnected and locally compact) groups. Specifically, for $G$ locally profinite, the space $C_c^\infty(G)$ of smooth (meaning locally constant) and compactly supported complex-valued functions is a ring under convolution (for a choice of Haar measure on $G$) and acts on smooth representations of $G$. In fact, smooth representations of $G$ are literally the same as smooth representations of $C_c^\infty(G)$, so it plays the role of the group algebra $\mathbf{C}[G]$ for $G$ finite. But unlike the group algebra, this ring won't usually have a multiplicative identity.
The path algebra (over, say, $\mathbb{Z}$) of a quiver with infinitely many vertices is a ring without unit. A more "advanced" example is Lusztig's modified enveloping algebra of a Lie algebra. This algebra is important in representation theory and categorification.