Why do people say "you don't belong here" in Markarth?
Solution 1:
Sounds like a bug involving trespass checks- perhaps it's registering you as having broken in when you enter buildings. I'd try saving, then allowing yourself to get caught actually trespassing, and see if that clears it.