How to allow login to a SMTP server better than with password?
Solution 1:
Look into client certificate validation for the SMTP server of your choice. For example, in Postfix you can use TLS client certificates as an authentication method.
Solution 2:
kerberos (gssapi) or certificates are the options, I guess.