iPad still plays the music when muted - how can I truly turn off sounds?

If you are on iOS 12, swipe from the top-right of the screen to get to control centre.

Then make sure you slide the volume down: