How do you access the "point of interest" that appear on the map?

Solution 1:

A point of interest is just a pointer (or saved spot) you (in your case accidentally) placed on the map.

You can remove them by pressing Y or Triangle when it is selected on your map.