从FTP文件夹读取csv

Question

I am trying to read csv file from FTP Folder

ftp = FTP('adr')  
ftp.login(user='xxxx', passwd = 'xxxxx')
r = StringIO()
ftp.retrbinary('RETR /DataLoadFolder/xxx/xxx/xxx/'+str(file_name),r.write)
r.seek(0)
csvfile1 = csv.reader(r,delimiter=';')
input_file = [list(line) for line in csv.reader(r)] ----- Error

getting an error at last line as

new-line character seen in unquoted field - do you need to open the file in universal-newline mode?

My csv file

Text Version

There are whites spaces at the end of each row (after 17.00)

Data starts from second row

what does the error mean? Any help would be much appreciated.

Answer 1

The error message simply asking how you'd want to handle the newline differently due to historical reasons, you can read the explanation here .

To solve the issue, specify the newline on StringIO like this:

r = StringIO(newline='')

According to StringIO documentation . If newline is set to None, newlines are written as \\n on all platforms, but universal newline decoding is still performed when reading.

Answer 2

I could partially reproduce and fix. The error is caused by a line containing a bad end of line. I could reproduce by adding a line \\r \\n at the end of an otherway valid csv file.

A simple way to fix it is to use a filter to eliminate blank lines and clean end of lines:

def filter_bytes(fd):
    for line in fd:
        line = line.strip()
        if len(line) != 0:
            yield(line + b'\r\n')

Once this is done, your code could become:

ftp = FTP('adr')  
ftp.login(user='xxxx', passwd = 'xxxxx')
r = BytesIO()
ftp.retrbinary('RETR /DataLoadFolder/xxx/xxx/xxx/'+str(file_name),r.write)
r.seek(0)
csvfile1 = csv.reader(filter_bytes(r),delimiter=';')
input_file = list(csvfile1)