[英]Merge multiple csv files in python 3
我是 python 的新手,致力於分析涉及合並 csv 文件的大型數據集,它們都包含相同的標記行,但列數不同。 我沒有太多,但這是我當前的代碼,非常感謝任何幫助。
import csv
import pandas as pd
file1 = 'C:\\Users\\User\\Documents\\Ubiome csv Kit #\\107-078-414.csv'
file2 = 'C:\\Users\\User\\Documents\\Ubiome csv Kit #\\109-080-426.csv'
reader1 = csv.reader(open(file1))
reader2 = csv.reader(open(file2))
reader1 = csv.reader(open(file1))
reader2 = csv.reader(open(file2))
來自熊貓文檔: https : //pandas.pydata.org/pandas-docs/stable/merging.html
import pandas as pd
df1 = pd.read_csv(file1)
df2 = pd.read_csv(file2)
merged_df = pd.concat([df1, df2], axis = 1, join = 'outer')
import pymysql.cursors
import re
import csv
import collections
import glob
# Variables
total_record = []
headerCount = 0
for file in glob.glob("*.csv"):
print(file)
with open(file, 'r') as f:
reader = csv.reader(f)
list_record = list(reader)
if headerCount == 0:
headerCount = 1
total_record.extend(list_record)
else:
list_record.pop(0)
total_record.extend(list_record)
with open('combine.csv', 'w') as csvFile:
writer = csv.writer(csvFile)
writer.writerows(total_record)
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.