How to close all windows of Mac OS X Finder?
Yes, you can use the shortcut ⌥ option + ⌘ command + W.
A sidenote on this: Often such commands are not visible in the main menu if you just click it. However, if you press ⌥ while the menu is open, then the menu will change to view the alternate feature.
Another example:
File > Get Info ⌘I
will turn into File > Show Inspector ⌥⌘I
once you press ⌥. As you can see in this image, Close Window ⌘W turns into Close All Windows ⌥⌘W as well.