Is there a word or phrase for "taking the long way around a square"?
This may not be a direct answer to the question, but it will get there, eventually
Scenic route — Dictionary.com
noun, informal the long route or way to a destination; a road or path designed to take one past a pleasant view or nice scenery and usually less direct
"We took the scenic route home after having trouble reading the map."
The long route or way, often due to one's losing one's way
"missed the Garden State Parkway and ended up taking the scenic route."
"Go the long way around" (AmE) or "Go the long way round" (BrE).