如何从 python 中的 csv 文件中删除特殊字符？

Question

Hi I am trying to remove special character from csv file but not getting the satisfied result. Could you please help me how to do this?

example:

ÃœþÑÂúòð
Óþрþô áðýúт-ßõтõрñурó

These king of special characters I am getting.

I am saving the file using below python code-

df = pd.read_csv(r"D:\Users\SPate233\Documents\cleanData-JnJv2.csv", low_memory=False)
df.to_csv(r"D:\Users\SPate233\Documents\cleanData-JnJv2_new.csv", encoding='utf-8-sig', index=False)

Answer 1

I am not sure but you can try the Code Snippet given below:-

Basically, I have DataFrame from your Data . So, for Uploading CSV with Special Characters . It is important to specify the encoding type. So, I have used the ISO-8859-1 type of encoding technique. Because ISO-8859-1 is a family of single-byte encoding schemes used to represent alphabets that can be represented within the range of 127 to 255.

To Learn more about ISO-8859-1 Click here

# Import all the important Libraries
import pandas as pd

# Read 'Data'
df = pd.read_csv('temp_data.csv', encoding = "ISO-8859-1")

# Print a few records of data with special characters
df

# Output of Above Cell:-
    Data
0   ÃœþÑÂúòð
1   Óþрþô áðýúт-ßõтõрñурó

After reading DataFrame . we can move towards, the process of removal of Special Character . code for the same was stated below:-

# Removal of Special Characters
df['Data'] = df['Data'].map(str).apply(lambda x: x.encode('utf-8').decode('ascii', 'ignore'))

# Print Cleaned data
df

# Output of Above Cell:-
    Data
0   
1   -

As you can see we have removed all Special Characters . So, we can store this Result to CSV :-

# Store clean data into 'CSV' Format
df.to_csv(r'cleaned_temp_data.csv', encoding = 'utf-8-sig', index = False)

Hope this, Solution helps you.