在一笔交易中插入大量数据

Question

I have struggled with architectural problem.

I have table in DB2 v.9.7 database in which I need to insert ~250000 rows, with 13 columns each, in a single transaction. I especially need that this data would inserted as one unit of work.

Simple insert into and executeBatch give me:

The transaction log for the database is full. SQL Code: -964, SQL State: 57011

I don't have rights to change the size of transaction log. So I need to resolve this problem on the developer's side.

My second thought was to use savepoint before all inserts then I found out that works only with current transaction so it doesn't help me.

Any ideas?

Answer 1

You want to perform a large insert as a single transaction, but don't have enough log space for such transaction and no permissions to increase it.

This means you need to break up your insert into multiple database transactions and manage higher level commit or rollback on the application side. There is not anything in the driver, either JDBC or CLI, to help with that, so you will have to write custom code to record all committed rows and manually delete them if you need to roll back.

Another alternative might be to use the LOAD command by means of the ADMIN_CMD() system stored procedure. LOAD requires less log space. However, for this to work you will need to write rows that you want to insert into a file on the database server or to a shared filesystem or drive accessible from the server.

Answer 2

Hi you can use export/load commands to export/import large tables, this should be very fast.The LOAD command should not be using the transaction log.You may have problem if your user have no privilege to write file on server filesystem.

call SYSPROC.ADMIN_CMD('EXPORT TO /export/location/file.txt OF DEL MODIFIED BY   COLDEL0x09 DECPT, select  * from some_table ' )


call SYSPROC.ADMIN_CMD('LOAD FROM /export/location/file.txt OF DEL MODIFIED BY COLDEL0x09 DECPT, KEEPBLANKS INSERT INTO other_table COPY NO');