I'm using the following code to get data from a REST API: import requests import json key = "my service key" api = "http://api.data.go.kr/openapi/pblprfr-event-info-std?serviceKey=", key, "&...

I am a new developer and learning to code in Python 3.4.2. I am running Debian linux on a Raspberry Pi3. After the fresh install I did both sudo apt-get update and sudo apt-get upgrade to ge...

I have met an Error of "Too many open files" when I run label detection via Cloud Vision API Client with Python. When I asked this probrem on GitHub before this post, the maintainer gave me an advi...

I got a problem on a Debian 8 system with python 2.7.9-2 amd64: marius@pydev:/usr/lib/python2.7/dist-packages/urllib3/contrib$ pip search doo Traceback (most recent call last): File "/usr/bin/pi...

I'm not sure why, but my script always stops crawling once it hits page 9. There are no errors, exceptions, or warnings, so I'm kind of at a loss. Can somebody help me out? P.S. Here is the full ...

I am trying to use urllib3 in simple thread to fetch several wiki pages. The script will Create 1 connection for every thread (I don't understand why) and Hang forever. Any tip, advice or simple ...

I am trying to open a website on chrome using Python Selenium chromedriver. Chrome browser is opening (with warnings) and the url is not opening. Version details : Chrome : 68.0.3440.106 seleni...

I've implemented a retry mechanism to requests session using urllib3.util.retry as suggested both here and here. Now, I am trying to figure out what is the best way to add a callback function that ...

I have seen something like this in a few code snippets and in the Requests documentation: import requests sess = requests.Session() adapter = requests.adapters.HTTPAdapter(max_retries=20) sess.mou...

Hi not every time but sometimes when trying to gain access to the LSE code I am thrown the every annoying HTTP Error 403: Forbidden message. Anyone know how I can overcome this issue only using st...

I’m getting: 'HTTP/1.1 400 Bad Request\r\n' and I don’t get why. It looks like it authenticates and then there is a redirection and then it now doesn’t work. Why is this happening? I had thought ...

I have a special URL where my code is halting for hours (more than 3 hours). I can't seem to understand why it would do that. The URL is http://www.etudes.ccip.fr/maintenance_site.php. Direct req...

I need to count words that are inside a webpage using python3. Which module should I use? urllib? Here is my Code: def web(): f =("urllib.request.urlopen("https://americancivilwar.com/north/linc...

I am using Python 2.7 64 bit on Windows 8. I have Requests version 2.3 installed. I am trying to run this import statement as part of bringing in number of retries within my code: from requests.pa...

I am working in the code modifications on my local setup of openstack Designate. Actually it was working fine before. But now I am trying to execute the same command which was working fine before...

I am having trouble finding solid examples of how to build a simple script in urllib3 which opens a url (via a proxy), then reads it and finally prints it. The proxy requires a user/pass to authent...

I'm trying to use the awesome Requests library on Google App Engine. I found a patch for urllib3, which requests relies on, that is compatible with App Engine. https://github.com/shazow/urllib3/iss...

I'm uploading hundreds of millions of items to my database via a REST API from a cloud server on Heroku to a database in AWS EC2. I'm using Python and I am constantly seeing the following INFO log ...

I'm using python 3.5 and I'm checking the performance of urllib module Vs requests module. I wrote two clients in python the first one is using the urllib module and the second one is using the req...

I have notice there are several ways to iniciate http connections for web scraping. I am not sure if some are more recent and up-to-date ways of coding, or if they are just different modules with d...

I am trying to diagnose an issue where some of my celery worker processes appear to hang for several minutes. I have many tasks that make several IO calls (usually to third party APIs). In any give...

I get this warning when building my Docker image: /usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/util/ssl_.py:79: InsecurePlatformWarning: A true SSLContext object is not avail...

Is there a way to tell the requests lib to add multiple certificates like all .pem files from a specified folder? import requests, glob CERTIFICATES = glob('/certs/') url = '127.0.0.1:8080' reques...

I want to use urllib3 library for making POST request over requests library since it has connection pooling and retries etc. But I couldn't find any substitute of following POST request. import r...

I'm using urllib3 and I want to see the headers that are send. I've found this in documentation but it doesn't print the headers: urllib3.add_stderr_logger(1) Is there any way of doing this?