Difference between "socket" and "outlet"
The other answers are being too specific. A socket is something into which something is plugged or fitted (also called a receptacle). An outlet is something that something comes out of.
A light socket is called a light socket because a light bulb is inserted into it. A power outlet is called an outlet because power comes out of it. It could conceivably be called a power socket but this is not usual and is possibly confusing.
Neither of these examples is intended to imply the power doesn't come out of a light socket or that a plug isn't plugged into a power outlet. Those are facts but not related to the terms in question themselves.
If you are in any doubt that context is not enough, just use light socket and power outlet.
I want to add one more comment, eight years later. It's also not usual to call the thing that's installed in your wall a receptacle. In this context, usually the speaker is referring the literal piece of equipment installed there that receives the plug. In other words, you're mostly talking about what the form of the thing is (a hole for a plug) and not what it does (outputs power).
In British English, 'socket' is the word that normally describes the place in the wall where you put a plug to connect to the electricity supply. 'Outlet' might conceivably be used in some technical contexts, but it has other meanings too and could be ambiguous.
In American English and when speaking about electrical circuits and devices, a "socket" is something into which a light bulb is screwed, while an "outlet" is something into which electrical cords are plugged.
Light socket: Electrical outlet: