简体   繁体   English

将目录中的所有文件连接到单个 CSV 时,Pandas 中的“EmptyDataError:没有要从文件中解析的列”

[英]'EmptyDataError: No columns to parse from file' in Pandas when concatenating all files in a directory into single CSV

So I'm working on a project that analyzes Covid-19 data from this entire year.因此,我正在开展一个项目,分析全年的 Covid-19 数据。 I have multiple csv files in a given directory.我在给定目录中有多个 csv 文件。 I am trying to merge all the files' contents from each month into a single, comprehensive csv file.我试图将每个月的所有文件内容合并到一个综合的 csv 文件中。 Here's what I got so far as shown below...Specifically, the error message that appears is 'EmptyDataError: No columns to parse from file.'这是我到目前为止所得到的,如下所示...具体来说,出现的错误消息是“EmptyDataError:没有要从文件中解析的列。” If I were to delete df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file) and simply run print(file) It lists all the correct files that I am trying to merge.如果我要删除df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file)并简单地运行print(file)它会列出我要合并的所有正确文件。 However, when trying to merge all data into one I get that error message.但是,当尝试将所有数据合并为一个时,我收到了该错误消息。 What gives?是什么赋予了?

import pandas as pd
import os


df = pd.read_csv('./csse_covid_19_daily_reports_us/09-04-2020.csv')

files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')]

all_data = pd.DataFrame()

for file in files:
    df = pd.read_csv('./csse_covid_19_daily_reports_us/' + file)
    all_data = pd.concat([all_data, df])

all_data.head()

Folks, I have resolved this issue.伙计们,我已经解决了这个问题。 Instead of sifting through files with files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')] , I have instead used files=[f for f in os.listdir("./") if f.endswith('.csv')] .我没有使用 files files = [file for file in os.listdir('./csse_covid_19_daily_reports_us')]筛选文件,而是使用files=[f for f in os.listdir("./") if f.endswith('.csv')] . This filtered out some garbage files that were not.csv, thus allowing me to compile all data into a single csv.这过滤掉了一些不是 .csv 的垃圾文件,这样我就可以将所有数据编译成一个 csv。

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 EmptyDataError:从 S3 存储桶读取多个 csv 文件到 Pandas Dataframe 时,没有要从文件解析的列 - EmptyDataError: No columns to parse from file when reading multiple csv files from S3 bucket to pandas Dataframe Pandas - EmptyDataError:读取库存 .csv 文件时没有要从文件中解析的列 - Pandas - EmptyDataError: No columns to parse from file when reading stock .csv file EmptyDataError:在字典中加载多个文件时没有要从文件中解析的列 - EmptyDataError: No columns to parse from file when loading several files in a dictionary 已解决 - Python Pandas 不导入 .csv。 错误:pandas.errors.EmptyDataError:没有要从文件中解析的列 - SOLVED - Python Pandas not importing .csv. Error: pandas.errors.EmptyDataError: No columns to parse from file 无法读取.csv 文件。 EmptyDataError:没有要从文件中解析的列 - Cant read .csv file. EmptyDataError: No columns to parse from file 动态URL上的pandas read_csv给出EmptyDataError:没有要从文件解析的列 - pandas read_csv on dynamic URL gives EmptyDataError: No columns to parse from file 没有要从文件中解析的列 (EmptyDataError: ) - No columns to parse from file (EmptyDataError: ) EmptyDataError:没有要从文件中解析的列 - EmptyDataError: No columns to parse from file EmptyDataError:没有要从文件中解析的列 - EmptyDataError : No columns to parse from file pandas.errors.EmptyDataError:没有要从文件中解析的列 - pandas.errors.EmptyDataError: No columns to parse from file
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM