如何通过python中的pandas导出单个csv文件的多个excel表

Question

I have imported a large txt file in python pandas. Now I want to export the csv file to multiple excel as data is too large to fit in a single excel sheet.

I use the following commands:

import pandas as pd
df = pd.read_csv('basel.txt',delimiter='|')
df.to_excel('basel.txt')

Unfortunately I got the following error:

****ValueError: This sheet is too large! Your sheet size is: 1158008, 18 Max sheet size is: 1048576, 16384****

Answer 1

You can split into chunks and write each chunk in one sheet. np.array_split splits into number of chunks np.split requires an equal division.

import numpy as np

nsheets = 10  # you may change it
for i, temp in enumerate(np.array_split(df, nsheets)):
    temp.to_excel('basel.xls', sheet_name=f'sheet_{i}')

Answer 2

You can write half of the dataset into a different excel sheet:

import pandas as pd
df = pd.read_csv('basel.txt',delimiter='|')
df.iloc[:df.shape[0]//2,:].to_excel('basel.xls', sheet_name='First Sheet')
df.iloc[df.shape[0]//2:,:].to_excel('basel.xls', sheet_name='Second Sheet')

Answer 3

import pandas as pd
chunksize = 10 ** 6
for chunk in pd.read_csv('basel.txt', chunksize=chunksize):
    chunk.to_excel('basel_'+str(chunk)+'.excel')

you may read the pandas file in chunks and save each chunk in excel file