SQL Server 2008 INSERT优化

Question

I've to INSERT a lot of rows (more than 1.000.000.000) to a SQL Server data base. The table has an AI Id, two varchar(80) cols and a smalldatetime with GETDATE as default value. The last one is just for auditory, but necesary.

I'd like to know the best (fastest) way to INSERT the rows. I've been reading about BULK INSERT. But if posible I'd like to avoid it because the app does not run on the same server where database is hosted and I'd like to keep them as isolated as posible.

Thanks!

Diego

Answer 1

Another option would be bcp .

Alternatively, if you're using .NET you can use the SqlBulkCopy class to bulk insert data. This is something I've blogged about on the performance of, which you may be interested in as I compared SqlBulkCopy vs another way of bulk loading data to SQL Server from .NET (using SqlDataAdapter). Basic example loading 100,000 rows took 0.8229s using SqlBulkCopy vs. 25.0729s using the SqlDataAdapter approach.

Answer 2

创建一个SSIS包，它将文件复制到SQL Server计算机，然后使用数据流任务将数据从文件导入SQL Server数据库。

Answer 3

没有比BULK INSERT更快/更有效的方法，当您处理如此大量的数据时，甚至不用考虑.NET中的任何内容，因为有了GC，管理内存中的数百万个对象会导致性能大幅下降。