Is there any way to dismiss Nightmare after summoning him?

Solution 1:

You can dismiss Nightmare by using the same button you used to summon him (on PS4 this is the L1 bumper). Note it does not work right away, you need to wait for him to completely materialize before you dismiss him.