Will already existing troops upgrade when their respective laboratory research finishes?
Yes.
All units you currently have in your service will upgrade to the new level. As you have dragons you can easily see that because they will change it's color. You can also save some elixir by filling your queue with the "old" dragons and getting the new one out when you again have space.
Source: Personal experience