How to extract HTTP response body from a Python requests call?

Question

I'm using the Python requests library. I'm trying to figure out how to extract the actual HTML body from a response. The code looks a bit like this:

r = requests.get(...)
print r.content

This should indeed print lots of content, but instead prints nothing.

Any suggestions? Maybe I've misunderstood how requests.get() works?

Villiform

Answer 1

Your code is correct. I tested:

r = requests.get("http://www.google.com")
print(r.content)

And it returned plenty of content. Check the url, try "http://www.google.com".

Hesperides

Yeah, that's true. I must be misunderstanding what I should expect from the particular page I'm working with. Thanks, though. – Villiform

Answer 2

You can try this method:

import requests

response = requests.get("http://www.google.com")
response.raise_for_status()

data = response.json()
print(data)

Sagamore

The json() method only works if the response body is in JSON format – Gumm

Answer 3

import requests

site_request = requests.get("https://abhiunix.in")

site_response = str(site_request.content)

print(site_response)

You can do it either way.

Seif