When go is followed by a noun, it needs to. When it's followed by anything else, it doesn't. (In 'go home', home is an adverb.)