How to connect from Ubuntu VM on Azure to another without uploading the private key

Solution 1:

What you are trying to do is "creating bastion host". And it can be done by using ssh-agent.