Can I password protect an NFS share?
Without involving an authentication method like Kerberos, NFS on its own has very little in the way of access control - pretty much just restriction by IP address as you noted.
More info here if you want to look at the Kerberos option:
https://help.ubuntu.com/community/NFSv4Howto