Windows 8 + 10:

Alt+H for Home tab in the ribbon, then S and I for Invert Selection.

enter image description here

Windows 7:

Alt+E to open up the Edit menu, then I for Invert Selection.

enter image description here