How else can I express the concept of ' just to be on the safe side'

I always use this expression when I want to say that I just want to be prudent about something. Are there other ways to convey the same concept, other idioms or expressions I can use alternatively?

Solution 1:

Play (it) safe
to be careful and not take risks

hedge
(against something): to lessen the risk of something happening
hedge (your bets): to protect yourself against making the wrong choice

Abundant caution
Abundans cautela non nocet (Lt.) – "Abundant caution does no harm." Thus, one can never be too careful; even excessive precautions don't hurt anyone.

Solution 2:

"Err on the side of caution" comes to mind.