Does primary, secondary, tertiary, [...] continue forever?

Solution 1:

The rules for forming these words are here http://mathforum.org/library/drmath/view/60405.html (as noted above) and they are indeed based on Latin.