How do I make my horse stop following me?
Just go somewhere he can't. Like up a cliff or over some water or fast travel. The horse despawns when you get somewhere between 50 and 100m away from it.
Depending on your position and how hard it is to get back there i would advise to just teleport away using your map to a location mark and then get back where you were. This will take care of the horse.