Apple Configurator 2 - How to edit a profile
You need to go to
File > Open, then select your profile.
(Posting Alex's comment as an answer, as he seems to be inactive since Dec 4, 2015, and I nearly missed the solution as I tend to skip reading the comments.)