使用Python从多个CSV文件中删除行

Question

I wanted to delete specific rows from every single csv. files in my directory (ie from row 0 to 33), but I have 224 separate csv. files which need to be done. I would be happy if you help me how can I use one code to carry out this.

Answer 1

I think you can use glob and pandas to do this quite easily, I'm not sure if you want to write over your original files something I never recommend, so be careful as this code will do that.

import os
import glob
import pandas as pd

os.chdir(r'yourdir')
allFiles = glob.glob("*.csv") # match your csvs
for file in allFiles:
   df = pd.read_csv(file)
   df = df.iloc[33:,] # read from row 34 onwards.
   df.to_csv(file)
   print(f"{file} has removed rows 0-33")

or something along those lines..

Answer 2

This is a simple combination of two separate tasks.

First, you need to loop through all the csv files in a folder. See this StackOverflow answer for how to do that.

Next, within that loop, for each file, you need to modify the csv by removing rows. See this answer for how to read a csv, write a csv, and omit certain rows based on a condition.

One final aspect is that you want to omit certain line numbers. A good way to do this is with the enumerate function.

So code such as this will give you the line numbers.

import csv
input = open('first.csv', 'r')
output = open('first_edit.csv', 'w')
writer = csv.writer(output)
for i, row in enumerate(input):
    if i > 33:
        writer.writerow(row)
input.close()
output.close()

Answer 3

Iterate over CSV files and use Pandas to remove the top 34 rows of each file then save it to an output directory.

Try this code after installing pandas :

from pathlib import Path
import pandas as pd

source_dir = Path('path/to/source/directory')
output_dir = Path('path/to/output/directory')

for file in source_dir.glob('*.csv'):
    df = pd.read_csv(file)
    df.drop(df.head(34).index, inplace=True)
    df.to_csv(output_dir.joinpath(file.name), index=False)