春季批处理在分区后挂起

Question

我的春季批处理应用程序正在处理200万条记录，网格大小为20。 对于100-200k记录，它可以正常工作，但是对于200万记录，它在分区后失败。

分区信息：

{
    partition - 20 = {
        startKey = 1980865.0,
        endKey = 2069192.0,
        partitionSize = 72,
        partitionId = 20,
        partitionRecordCount = 88328
    },
    partition - 10 = {
        st
        artKey = 938305.0,
        endKey = 1042560.0,
        partitionSize = 72,
        partitionId = 10,
        partitionRecordCount = 104256
    },
    partition - 11 = {
        startKey = 1042561.0,
        endKey = 1146816.0,
        partitionSize = 72,
        partitionId = 11,
        partitionRecordCount = 104256
    },
    partition - 12 = {
        startKey = 1146817.0,
        endKey = 1251072.0,
        partitionSize = 72,
        partitionId = 12,
        partitionRecordCount = 104256
    },
    partition - 13 = {
        startKey = 1251073.0,
        endKey = 1355328.0,
        partitionSize = 72,
        partitionId = 13,
        partitionRecordCount = 104256
    },
    par
    tition - 14 = {
        startKey = 1355329.0,
        endKey = 1459584.0,
        partitionSize = 72,
        partitionId = 14,
        partitionRecordCount = 104256
    },
    partition - 15 = {
        startKey = 1459585.0,
        end
        Key = 1563840.0,
        partitionSize = 72,
        partitionId = 15,
        partitionRecordCount = 104256
    },
    partition - 16 = {
        startKey = 1563841.0,
        endKey = 1668096.0,
        partitionSize = 72,
        p
        artitionId = 16,
        partitionRecordCount = 104256
    },
    partition - 17 = {
        startKey = 1668097.0,
        endKey = 1772352.0,
        partitionSize = 72,
        partitionId = 17,
        partitionRecordCoun
        t = 104256
    },
    partition - 18 = {
        startKey = 1772353.0,
        endKey = 1876608.0,
        partitionSize = 72,
        partitionId = 18,
        partitionRecordCount = 104256
    },
    partition - 19 = {
        startKey =
            1876609.0,
        endKey = 1980864.0,
        partitionSize = 72,
        partitionId = 19,
        partitionRecordCount = 104256
    },
    partition - 1 = {
        startKey = 1.0,
        endKey = 104256.0,
        partitionSize
             = 72,
        partitionId = 1,
        partitionRecordCount = 104256
    },
    partition - 2 = {
        startKey = 104257.0,
        endKey = 208512.0,
        partitionSize = 72,
        partitionId = 2,
        partitionRecordCou
        nt = 104256
    },
    partition - 3 = {
        startKey = 208513.0,
        endKey = 312768.0,
        partitionSize = 72,
        partitionId = 3,
        partitionRecordCount = 104256
    },
    partition - 4 = {
        startKey = 3127
            69.0,
        endKey = 417024.0,
        partitionSize = 72,
        partitionId = 4,
        partitionRecordCount = 104256
    },
    partition - 5 = {
        startKey = 417025.0,
        endKey = 521280.0,
        partitionSize = 7
            2,
        partitionId = 5,
        partitionRecordCount = 104256
    },
    partition - 6 = {
        startKey = 521281.0,
        endKey = 625536.0,
        partitionSize = 72,
        partitionId = 6,
        partitionRecordCount
             = 104256
    },
    partition - 7 = {
        startKey = 625537.0,
        endKey = 729792.0,
        partitionSize = 72,
        partitionId = 7,
        partitionRecordCount = 104256
    },
    partition - 8 = {
        startKey = 729793
            .0,
        endKey = 834048.0,
        partitionSize = 72,
        partitionId = 8,
        partitionRecordCount = 104256
    },
    partition - 9 = {
        startKey = 834049.0,
        endKey = 938304.0,
        partitionSize = 72,
        partitionId = 9,
        partitionRecordCount = 104256
    }
}
Total no. of Partitions: 20

它输出的最后一个日志是创建的分区，然后控件再也不会进入写入器。 对于200k记录，它一直在挣扎，因此我增加了连接池的大小，从而解决了该问题，但是200万行失败。

没有错误，只是挂在那里。

Answer 1

这可能与db有关。 您可以检查应用程序是否能够使用写入凭据访问数据库。 我确实注意到这种问题，其中分区已完成并且实际处理挂起了。 故障排除后，意识到它无法写入db。 一旦数据库被修复，它运行良好。