Solution 1:
You need to tell it to use the correct public key. I suspect ssh is still using user1's key, not user2. Use this command:
sudo -u user2 ssh -i ~user2/.ssh/id_rsa remoteserver
I tested this on my machine and it worked.
You need to tell it to use the correct public key. I suspect ssh is still using user1's key, not user2. Use this command:
sudo -u user2 ssh -i ~user2/.ssh/id_rsa remoteserver
I tested this on my machine and it worked.