使用urllib.request时出现HTTP错误

Question

I am trying to do a profanity check test. The code I have written so far is

import urllib.request  

def read_text ():
    file = open (r"C:\Users\Kashif\Downloads\abc.txt")
    file_print = file.read ()
    print (file_print)
    file.close ()
    check_profanity (file_print)

def check_profanity (file_print):
    connection = urllib.request.urlopen ("http://www.purgomalum.com/service/containsprofanity?text="+file_print)
    output = connection.read ()
    print ("The Output is "+output)
    connection.close ()
    read_text ()

But I get the error below

urllib.error.HTTPError: HTTP Error 400: Bad Request

I don't know what I am going wrong.

I am using Python 3.6.1

Answer 1

The HTTP error you're getting is usually a sign of something bad in the way you are requesting data to the server. According to the HTTP Spec :

400 Bad Request

The request could not be understood by the server due to malformed syntax. The client SHOULD NOT repeat the request without modifications

In concrete in your example, the problem seems to be with the lack of URL encoding of the data you're sending in the URL. You should try using the method quote_plus from the urllib.parse module to make your request acceptable:

from urllib.parse import quote_plus

...

encoded_file_print = quote_plus(file_print)
url = "http://www.purgomalum.com/service/containsprofanity?text=" + encoded_file_print
connection = urllib.request.urlopen(url)

If that doesn't work then the problem might be with the contents of your file. You can try it first with a simple example, to verify your script works and then try using the file's content afterwards.

Apart from the above, there's also a couple of other issues with your code:

1. No spaces needed between methods and brackets: file.close () or def read_text (): and so on.
2. Decode the content after reading it to convert bytes to a string: output = connection.read().decode('utf-8')

3. The way you're calling the methods creates a circular dependency. read_text calls check_profanity that in the end calls read_text that calls check_profanity , etc. Remove the extra method calls and just use return to return the output of a method:

    content = read_text() has_profanity = check_profanity(content) print("has profanity? %s" % has_profanity)