如何删除 Csv 文件行之间的一些额外逗号

Question

How to remove some extra commas on CSV file sometimes there are 3 or more extra commas, I would like the marked part to become a single column

correct format is 11 columns, I just want to find the ones that are not and remove the commas

84,855,648857,8787548,R, mark,one 55, power ,0000081,3434,59190000,defen,six,

first 5 and last 5 columns are static, only the middle will become a single column and sometimes there are more than 3 extra columns

now i split the 300 GB file to work with python script in loop so there is a folder contain the files

the result should be like this

84,855,648857,8787548,R,mark one 55 power,0000081,3434,59190000,defen,six,

Answer 1

I suggest reading the csv data into a list, merge them, and write it back:

def merge(data):
    result = []
    result += data[:5]
    temporary = ""
    for item in data[5:-5]:
        temporary += item + " "
    result.append(temporary[:-1])
    result += data[-5:]
    return result

This function take a list, start(inclusive), end(exclusive), it merge the range specified and returns the result. For example, calling

merge(["84","855","648857","8787548","R","mark","one 55","power","0000081","3434","59190000","defen","six"])

will merge index 5,6,7, and return:

['84', '855', '648857', '8787548', 'R', 'mark one 55 power', '0000081', '3434', '59190000', 'defen', 'six']

You can then write the list back into a csv.