Meaning of “look off”
I found it under off:
- away from a place: to run off; to look off toward the west.
http://www.thefreedictionary.com/off
In the lyrics you quoted, "I look off and I stare" means:
I stare into the distance and I space out.
The way you might look out of a city bus window in a quasi-hypnotic state.