[英]'EmptyDataError: No columns to parse from file' in Pandas when concatenating all files in a directory into single CSV
So I'm working on a project that analyzes Covid-19 data from this entire year.因此,我正在开展一个项目,分析全年的 Covid-19 数据。 I have multiple csv files in a given directory.
我在给定目录中有多个 csv 文件。 I am trying to merge all the files' contents from each month into a single, comprehensive csv file.
我试图将每个月的所有文件内容合并到一个综合的 csv 文件中。 Here's what I got so far as shown below...Specifically, the error message that appears is 'EmptyDataError: No columns to parse from file.'
这是我到目前为止所得到的,如下所示...具体来说,出现的错误消息是“EmptyDataError:没有要从文件中解析的列。” If I were to delete
df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file)
and simply run print(file)
It lists all the correct files that I am trying to merge.如果我要删除
df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file)
并简单地运行print(file)
它会列出我要合并的所有正确文件。 However, when trying to merge all data into one I get that error message.但是,当尝试将所有数据合并为一个时,我收到了该错误消息。 What gives?
是什么赋予了?
import pandas as pd
import os
df = pd.read_csv('./csse_covid_19_daily_reports_us/09-04-2020.csv')
files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')]
all_data = pd.DataFrame()
for file in files:
df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file)
all_data = pd.concat([all_data, df])
all_data.head()
Folks, I have resolved this issue.伙计们,我已经解决了这个问题。 Instead of sifting through files with
files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')]
, I have instead used files=[f for f in os.listdir("./") if f.endswith('.csv')]
.我没有使用 files
files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')]
筛选文件,而是使用files=[f for f in os.listdir("./") if f.endswith('.csv')]
. This filtered out some garbage files that were not.csv, thus allowing me to compile all data into a single csv.这过滤掉了一些不是 .csv 的垃圾文件,这样我就可以将所有数据编译成一个 csv。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.