Do we use the definite article when a noun is already uniquely identified?

It is "question 4" or "question number 4", based on 'every time I've ever heard it'. But it's also "the fourth question", which a teacher giving instructions wouldn't typically say unless the questions aren't numbered. (The students might complain, afterwords, about "that fourth question".)