导入csv后移动的列

Question

I am new to Python/Pandas. I am wondering if there's a code that can help me fix how the columns move to the right inside the .csv we pull out of our systems - one column is filled with user input (containing messy characters ",) so usually after loading the user input column spreads out on several columns instead of one, wrongly moving out to the right the other columns as well.

I fix this manually in excel, manually filtering, deleting, moving the columns to their correct place - it takes 20 mins / day.

I would like to ask advice if there is code which I could try to clean and arrange correctly the columns or if it is easier the manual fix in excel as I do it now. Thank you!

Answer 1

pandas is altering the columns because it sees 'separators' in the import file.

In Excel, for each newline, count how many times a comma appears. Using your example above there should be 3 per line.

My quick and dirty solution would be replace the last three commas in your file with a character that is almost impossible for a user to type, I typically go for a pipe '|' character.

Try importing that into pandas, specifying a new delimier/separator example below:

import pandas as pd
df = pd.read_csv(filepath, sep="|")
df.head()

Answer 2

You cannot play with the layout with CSV that is a pure data transport format. Hopefully, there are 3rd party libs that can play with .xlsx files here and here .