Python urllib vs httplib?

Solution 1:

urllib (particularly urllib2) handles many things by default or has appropriate libs to do so. For example, urllib2 will follow redirects automatically and you can use cookiejar to handle login scripts. These are all things you'd have to code yourself if you were using httplib.

Solution 2:

I would like to say something about urllib, urllib2, httplib and httplib2.

The main different between urllib* and httplib* is that:

httplib and httplib2 handles HTTP/HTTPs request and response directly and give you more space to do your own job.

urllib and urllib2 are build upon httplib, they are more abstract and powerful, but sometimes won't fulfill your specified need about some HTTP related operations.

And for httplib and httplib2, I'd say that they are both HTTP client library. However httplib2 is much more powerful and have much more features than httplib.

As for urllib and urllib2, quote from this link:

urllib and urllib2 are both Python modules that do URL request related stuff but offer different functionalities. Their two most significant differences are listed below:

• urllib2 can accept a Request object to set the headers for a URL request, urllib accepts only a URL. That means, you cannot masquerade your User Agent string etc.
• urllib provides the urlencode method which is used for the generation of GET query strings, urllib2 doesn't have such a function. This is one of the reasons why urllib is often used along with urllib2.

I would recommend my personal blog Httplib Httplib2 Urllib Urllib2-what’s the Difference.

Hope it helps:-)