Is SSH and remote server config safe on public wifi?

SSH yes, FTP no. As a bonus, HTTP is only safe if you use it over HTTPS. You can use SCP or SFTP to transfer files securely to hosts which are already running SSH though.

Just don't use a 90's version of SSH and you will be fine.