How to download a file behind authentication via Wget or cURL [duplicate]
Solution 1:
You can login with your browser (with preferable "Remember me" option), export browser cookie (for Firefox 3.x, here is a python code to do that) and use --load-cookies with wget.
Solution 2:
wget
and curl
are only capable of handling basic HTTP authentication and not custom form based authentication.
What you will need to do is first examine the HTML of the login form to find the form elements that the login system uses and the form's action
, then use curl
or wget
to send a request in the right format (POST or GET) to the form's action
URL containing the login variables and data.
That request should return a cookie containing a session key or something similar. Submitting that cookie along with any future requests should then allow you to access the pages on the site that require you to be logged in.