What happens when you type Exit in the CMD window on Server Core in an RDP session
Solution 1:
ctrl+shift+esc brings up the task manager directly. You can launch it from there.
Alternatively, ctrl+alt+end will send a ctrl+alt+del to the RDP session if you want to take the long way.