What does iCloud Mail sync actually do?

This Mail button is used to have your Apple mailbox (@icloud.com/@me.com/@mac.com) on your device. If you turn it on your Apple mailbox will just show up in the Mail app.

Note that this option does not synchronize the other mailbox you might have, so in your case it will not be useful. You can find more informations about it here.