Does the word "that" refer to "your car" or "the key"?

Grammatically, it could be either. But in the real world, it has to be the key, doesn't it?