Can speed be defined for a parametrized but irregular curve in a Riemannian manifold?

Here is a good reference that goes into some detail, of how to work with absolutely continuous curves on Riemannian manifolds: http://nyjm.albany.edu/j/2015/21-12v.pdf In other words, there is a reasonable extension of notions like the speed of a curve on a Riemannian manifold so that the answer to your question is negative.

Notably, a similar strategy sometimes allows you to work even with curves which are defined in an abstract metric space, with no manifold structure at all. For this, a good reference is the first half of the book by Ambrosio, Gigli, and Savaré.