使用 SSIS 将巨大的 excel (xlsx) 导入 SQL Server

Question

I have excel file about 300MB+ in size. When I tried loading it with conventional excel source and SQL destination it keep on spinning. Not loaded even a row.

Is there any way to load huge excel file to SQL Server using SSIS? possible to reduce into small chunks (batch processing) ?

Answer 1

Wow, that is a HUGE Excel file. I didn't know that you could actually save a file that big. Anyway, if I were you, I would convert it to .xlsb, which is binary, and may be as small as 1/4 the size of a .xlsx file. Or, save it as a cvs file, and load the csv into SQL Server. You can bulk insert a csv file into SLQ Seerver very easily using a concept like this.

BULK
INSERT CSVTest
FROM 'c:\csvtest.txt'
WITH
(
FIELDTERMINATOR = ',',
ROWTERMINATOR = '\n'
)
GO
--Check the content of the table.
SELECT *
FROM CSVTest
GO
--Drop the table to clean up database.
DROP TABLE CSVTest
GO

See the links below for a few ideas of how to do this.

https://archive.is/RATG#selection-443.0-561.3

https://blog.sqlauthority.com/2012/06/20/sql-server-importing-csv-file-into-database-sql-in-sixty-seconds-018-video/

https://blog.sqlauthority.com/2011/11/02/sql-server-import-csv-into-database-transferring-file-content-into-a-database-table-using-csvexpress/

https://blog.sqlauthority.com/2011/05/12/sql-server-import-csv-file-into-database-table-using-ssis/