将文件夹中的多个excel文件读入pandas

Question

I would like to read several excel files contained into a folder in the Desktop of my MacBook into pandas.

The folder in the desktop is contains a folder (project dataset) with all the excel files and the Jupiter notebook page where I am writing the code (draft progetto)

I wrote the following code:

path = os.getcwd()
files = os.listdir(path)
files

Output:

['.DS_Store', 'draft progetto.ipynb', '.ipynb_checkpoints', 'project_dataset']

Then when I run:

files_xls = [f for f in files if f[3:] == 'xlsx']
files_xls

I GET AN EMPTY LIST AS OUTPUT!! WHY IS THIS?

Answer 1

IIUC,

this is something that can be done much easier with pathlib and unix matching using the glob module.

from pathlib import Path
import pandas as pd

#one liner
your_path = 'path_to_excel_files'
df = pd.concat([pd.read_excel(f) for f in Path(your_path).rglob('*.xlsx')])

Breaking it down.

# find the excel files 
# if you want to change the path do Path('your_path')...
files = [file for file in Path.cwd.rglob('*.xlsx')]

#create a list of dataframes.
dfs_list = [pd.read_excel(file) for file in files])


#concat
df = pd.concat(dfs_list)