Using headers with the Python requests library's get method
Asked Answered
U

4

336

So I recently stumbled upon this great library for handling HTTP requests in Python; found here http://docs.python-requests.org/en/latest/index.html.

I love working with it, but I can't figure out how to add headers to my get requests. Help?

Ulcerous answered 7/6, 2011 at 4:3 Comment(0)
M
579

According to the API, the headers can all be passed in with requests.get():

import requests
r=requests.get("http://www.example.com/", headers={"Content-Type":"text"})
Murine answered 7/6, 2011 at 4:13 Comment(1)
You can check the http request header sent doing : print(r.request.headers)Cauterant
C
68

This answer taught me that you can set headers for an entire session:

s = requests.Session()
s.auth = ('user', 'pass')
s.headers.update({'x-test': 'true'})

# both 'x-test' and 'x-test2' are sent
s.get('http://httpbin.org/headers', headers={'x-test2': 'true'})

Bonus: Sessions also handle cookies.

Cusp answered 19/6, 2017 at 16:30 Comment(0)
F
58

Seems pretty straightforward, according to the docs on the page you linked (emphasis mine).

requests.get(url, params=None, headers=None, cookies=None, auth=None, timeout=None)

Sends a GET request. Returns Response object.

Parameters:

  • url – URL for the new Request object.
  • params – (optional) Dictionary of GET Parameters to send with the Request.
  • headers – (optional) Dictionary of HTTP Headers to send with the Request.
  • cookies – (optional) CookieJar object to send with the Request.
  • auth – (optional) AuthObject to enable Basic HTTP Auth.
  • timeout – (optional) Float describing the timeout of the request.
Falconry answered 7/6, 2011 at 4:12 Comment(0)
D
16
  1. Go to http://myhttpheader.com

  2. copy attributes - typically 'Accept-Language' and 'User-Agent'.

  3. Wrap them in the dictionary:

    headers = { 'Accept-Language' : content-copied-from-myhttpheader,
                'User-Agent':content-copied-from-myhttpheader}
    
  4. pass headers in your request

    requests.get(url=your_url,headers=headers)
    
Dissociate answered 19/12, 2021 at 12:14 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.