ssh: can still use password after setting the key
Solution 1:
You've turned off PasswordAuthentication (i.e. sshd's built-in password authentication), but turned on ChallengeResponseAuthentication (i.e. authentication through PAM, which by default means password authentication). If you only want key-based authentication, turn off ChallengeResponseAuthentication.
Solution 2:
Did you restart the ssh daemon?