How can I turn off the shrine indicator (or make it stop beeping)?

As said in the comments by Coded Monkey, you can turn it off by pressing the Y button while in the map screen.

But I don't know of a way for it to stay on while not doing any noise.