urllib Questions

4

Solved

I'm attempting to download some data from an internal server using Python. Since it's internal, it uses a self-signed certificate. (We don't want to pay Verisign for servers that will never appear ...
Cudweed asked 8/3, 2016 at 18:36

4

Solved

I have import urllib2 try: urllib2.urlopen("some url") except urllib2.HTTPError: <whatever> but what I end up is catching any kind of HTTP error. I want to catch only if the spec...
Operator asked 7/7, 2010 at 8:25

4

Solved

If I have a URL (ex: "ssh://[email protected]:553/random_uri", "https://test.blah.blah:993/random_uri2"), I want to set/update the username in the url. I know there is urllib.parse.urlparse (h...
Indolent asked 17/9, 2018 at 0:29

5

Solved

I wrote a script to find spelling mistakes in SO questions' titles. I used it for about a month.This was working fine. But now, when I try to run it, I am getting this. Traceback (most recent ca...
Longanimity asked 24/2, 2017 at 14:32

2

Solved

I am trying to access a PDF file from a bank's website for PDF mining, but it keeps returning HTTP 403 error. So as a workaround, I am trying to change my User-Agent to a browser for accessing the ...
Bolshevist asked 18/1, 2019 at 21:7

3

How change a parameter's value of url? Without regexps. Now I try this, but it's long: from urllib.parse import parse_qs, urlencode, urlsplit url = 'http://example.com/?page=1&text=test#sect...
Flexuous asked 17/6, 2018 at 3:9

12

Solved

I'm downloading an entire directory from a web server. It works OK, but I can't figure how to get the file size before download to compare if it was updated on the server or not. Can this be done a...
Leralerch asked 8/8, 2008 at 13:35

3

Solved

I'm trying to encode non-ASCII characters so I can put them inside an url and use them in urlopen. The problem is that I want an encoding like JavaScript (that for example encodes ó as %C3%B3): en...
Trey asked 21/6, 2011 at 19:41

10

Solved

I got a problem when I am using python to save an image from url either by urllib2 request or urllib.urlretrieve. That is the url of the image is valid. I could download it manually using the explo...
Woollyheaded asked 14/5, 2015 at 4:28

15

Solved

I am trying to urlencode this string before I submit. queryString = 'eventName=' + evt.fields["eventName"] + '&' + 'eventDescription=' + evt.fields["eventDescription"];
Nakia asked 9/4, 2011 at 20:7

2

I am trying to install a library packages mentioned in requirements.txt Here's the error I got: PS C:\Users\lalit\Downloads\The-Movie-Cinema-master> pip install -r requirements.txt WARNING: Igno...
Trackman asked 21/8, 2021 at 17:18

3

Solved

I am using following code to save webpage using Python: import urllib import sys from bs4 import BeautifulSoup url = 'http://www.vodafone.de/privat/tarife/red-smartphone-tarife.html' f = urllib.ur...
Unessential asked 25/1, 2013 at 6:34

14

Solved

I am using urllib.urlencode to build web POST parameters, however there are a few values I only want to be added if a value other than None exists for them. apple = 'green' orange = 'orange' param...
Horehound asked 10/1, 2013 at 17:34

12

Solved

I have the following URL: url = http://photographs.500px.com/kyle/09-09-201315-47-571378756077.jpg I would like to extract the file name in this URL: 09-09-201315-47-571378756077.jpg Once I get th...
Stain asked 10/9, 2013 at 19:32

11

I apologize if this is a silly question, but I have been trying to teach myself how to use BeautifulSoup so that I can create a few projects. I was following this link as a tutorial: https:/...
Nog asked 23/2, 2016 at 4:47

2

I am using FastAPI to return a video response from googlevideo.com. This is the code I am using: @app.get(params.api_video_route) async def get_api_video(url=None): def iter(): req = urllib.requ...
Sachasachem asked 8/3, 2022 at 13:23

6

Solved

If I do url = "http://example.com?p=" + urllib.quote(query) It doesn't encode / to %2F (breaks OAuth normalization) It doesn't handle Unicode (it throws an exception) Is there a better...
Dallon asked 8/11, 2009 at 2:43

2

I'm trying to use Python to read .pdf files from the web directly rather than save them all to my computer. All I need is the text from the .pdf and I'm going to be reading a lot (~60k) of them, so...
Athletics asked 18/4, 2014 at 3:33

3

Solved

I wish to have my Python script download the Master data (Download, XLSX) Excel file from this Frankfurt stock exchange webpage. When to retrieve it with urrlib and wget, it turns out that the URL...
Mccomas asked 15/9, 2016 at 18:0

12

I'm trying to run a REST API on CentOS 7, I read urllib.parse is in Python 3 but I'm using Python 2.7.5 so I don't know how to install this module. I installed all the requirements but still can't...
Defensible asked 31/3, 2015 at 0:3

3

Solved

somehow I can't download files trough a proxyserver, and I don't know what i have done wrong. I just get a timeout. Any advice? import urllib.request urllib.request.ProxyHandler({"http" : "myprox...
Osgood asked 9/4, 2014 at 15:22

2

Solved

I want to create a REST API without using Flask. I have created once using Flask as shown below but now I want to try without Flask. I came to know that urllib is one of the packages for doing it b...
Stockyard asked 20/9, 2018 at 5:46

3

I'm trying to write code to login to a website. First I tested using ARC. It works fine. Image So I wrote python code like this: import requests url = 'https://www.bible.ac.kr/login.aspx/' head...
Dumah asked 27/8, 2019 at 9:51

5

Solved

Tried installing urllib.request module using below command sudo pip install urllib.request but it returned Downloading/unpacking urllib.request Could not find any downloads that satisfy the re...
Discuss asked 1/4, 2015 at 4:10

3

Solved

I need to get the content-type of an internet(intranet) resource not a local file. How can I get the MIME type from a resource behind an URL: I tried this: res = urllib.urlopen("http://www.iana.o...
Rifleman asked 18/9, 2012 at 9:45

© 2022 - 2024 — McMap. All rights reserved.