Spring Batch SkipPolicy 处理异常时陷入无限循环

Question

Spring batch job that is using a custom skip policy to handle an Exception that is getting thrown after all records are loaded to the database. My step looks like...

    @Bean
    public Step trialBalanceLoadStep(JdbcBatchItemWriter<TrialBalance> trialBalanceWriter) throws ParseException {
        return stepBuilderFactory.get("trialBalanceLoadStep")
                .<TrialBalance, TrialBalance> chunk(1000)
                .reader(trialBalanceReader())
                .writer(trialBalanceWriter)
                .faultTolerant()
                .skipPolicy(new CustomSkipPolicy())
                .build();
    }

My CustomSkipPolicy class is...

public class CustomSkipPolicy implements SkipPolicy {

    @Override
    public boolean shouldSkip(Throwable throwable, int i) {
        if (throwable instanceof Exception) {
            return true;
        }
        return false;
    }
}

I'm handling Exception just for testing purposes. But what I've been seeing is org.springframework.dao.DuplicateKeyException being thrown.

There are NO DUPLICATES in this file. Please do not ask. There isn't. I've deduped the entire file. They do not exist. In fact, the entire record count is being loaded to the db. Even after this job fails, if I run a count on the table i get the entire record count of the file. So this exception is being thrown AFTER all the records are loaded.

This ONLY HAPPENS when an particular index exists on this table. The index was created because we have a real time process querying this table and the query run time is significantly faster with the index. So we'd like to keep the index. But again, the index (which may or may not be causing the issue) is making the exception be thrown and now our batch load jobs won't run.

So I'm trying to handle this exception being thrown, by creating this CustomSkipPolicy class but it's staying in an infinite loop when I do this (if I put a println before my return statement it will just keep pumping that out)

EDIT Adding in the schema and trialBalanceWriter

When I run a describe...

Name                           Null?    Type         
------------------------------ -------- ------------ 
BAT_PROC_DT                    NOT NULL DATE         
ETL_TS                                  TIMESTAMP(6) 
PROC_APPL_CD                            VARCHAR2(3)  
FIRM_BNK_ID                    NOT NULL VARCHAR2(4)  
ACCT_NB                        NOT NULL VARCHAR2(15) 
ACCT_TYPE_CD                            VARCHAR2(2)  
CUST_ACCT_OWNR_SHRT_NM                  VARCHAR2(20) 
ACCT_CURR_BAL_AM                        NUMBER(15,2) 
ACCT_PROD_GP_CD                         VARCHAR2(3)  
SO_SCRTY_NB_ID                          NUMBER(9)    
ACCT_BR_ID                              NUMBER(7)    
ACCT_OPN_DT                             DATE         
CHK_OR_SV_LFCYC_STS_CD                  VARCHAR2(2)  
ACC_ROLL_12MO_OD_INSTN_CN               NUMBER(3)    
CHK_OR_SVACC_RCNCL_TXN_TYPE_CD          VARCHAR2(1)  
ACC_SRVC_FEE_BILL_SYS_CD                CHAR(1)      
CHK_OR_SVACC_LOB_CD                     VARCHAR2(3)  
CHK_OR_SVACC_LOB_OWNR_CD                VARCHAR2(2)  
CHK_ACCT_PSTV_PAY_IN                    CHAR(1)      
CHK_OR_SVACC_OD_TXN_PYMT_CD             CHAR(1)      
ACC_LAST_DAY_TOT_DEP_AM                 NUMBER(13)   
PRNT_ACCT_NB                            NUMBER(15)   
CARD_ACCT_NB                            NUMBER(17)   
CHK_OR_SVACC_OD_AM                      NUMBER(11)   
ACC_MO_TO_DT_OD_INSTN_DAY_CN            NUMBER(3)    
CHK_OR_SVACC_OD_PRTC_CD                 CHAR(1)      
CHK_OR_SVACC_OD_LAST_2PRTC_CD           CHAR(1)      
CHK_OR_SVACC_OD_LAST_3PRTC_CD           CHAR(1)      
CHK_OR_SVACC_LAST_MNTR_ACTV_DT          DATE         
CHK_OR_SVACC_LAST_DEP_DT                DATE         
CHK_OR_SVACC_MOST_RCNT_OD_DT            DATE         
STOP_PYMT_CD                            CHAR(1)      
CNTPR_TYPE_CD                           VARCHAR2(2)  
RISK_AVD_CD                             CHAR(1)      
RET_MAIL_STS_CD                         CHAR(1)      
AUTM_CLR_HS_IN                          CHAR(1)      
FED_TAX_WHLD_CD                         VARCHAR2(2)  
LAST_OD_DSPN_CD                         NUMBER(1)    
ACC_CAL_MO_TO_DT_ALB_AM                 NUMBER(15,2) 
ACC_MO_TO_DT_OD_INSTN_CN                NUMBER(3)    
ACCT_MO_TO_DT_RET_ITEM_CN               NUMBER(3)    
ACCT_MO_TO_DT_NSF_ITEM_CN               NUMBER(3)    
ACCT_CTL_DISB_CD                        CHAR(1)      
ACC_ROLL_12MO_AVG_COLL_BAL_AM           NUMBER(13)   
ACC_ROLL_12MO_OD_INSTN_DAY_CN           NUMBER(3)    
ACCT_ROLL_12MO_NSF_ITEM_CN              NUMBER(3)    
ACC_12MO_NSF_PTNL_RET_ITEM_CN           NUMBER(5)    
ACCT_ROLL_12MO_RET_ITEM_CN              NUMBER(3)    
CHK_OR_SVACC_OPN_DT                     DATE         
ACC_OD_PRTC_AVAL_FUND_AM                NUMBER(15,2) 
DBCD_LAST_CHRG_DT                       DATE         
CHK_OR_SVACC_PRC_RGN_NB                 NUMBER(5)    
DEP_ACCT_FUND_PRPS_CD                   CHAR(1)      
CHK_OR_SVACC_OD_PRTC_PROD_CD            NUMBER(1)    
UNVS_PROD_CAT_CD                        VARCHAR2(4)  
SGNTR_RVW_THLD_AM                       NUMBER(9)    
TXN_MIN_SGNTR_CN                        NUMBER(1)    
ACH_DEP_LTST_DT                         DATE         
TELR_BLK_TXN_TYPE_CD                    CHAR(1)      
PRVT_BNK_REL_CD                         CHAR(1)      
CHK_OR_SV_AVAL_BAL_AM                   NUMBER(15,2) 
CHK_OR_SVACC_COLL_BAL_AM                NUMBER(15,2) 
DDA_PNDG_HARD_HOLD_AM                   NUMBER(15,2) 
RCNT_CYC_CR_AM                          NUMBER(15,2) 
RCNT_CYC_DR_AM                          NUMBER(15,2) 
ACCT_PRPS_CD                            VARCHAR2(2)  
PYMT_FUND_SRC_CD                        VARCHAR2(2)  
CHK_ACCT_CHK_ENCST_CD                   CHAR(1)      
ACCT_ROLL_12MO_ALB_AM                   NUMBER(13)   
ACCT_ACTV_CD                            CHAR(1)      
OV_DRFT_PRTC_ACCT_NB                    NUMBER(15)   
OV_DRFT_PRTC_ACCT_LNK_DT                DATE         
ACCT_CLSE_DT                            DATE         
STOP_NOTE_IN                            CHAR(1)      
RCNT_CYC_CR_ITEM_CN                     NUMBER(7)    
RCNT_CYC_DR_ITEM_CN                     NUMBER(7)    
ADDL_WDRW_FEE_WVE_IN                    CHAR(1)      
ACCT_CLSE_SPRS_CD                       CHAR(1)      
ACCT_RCNT_ACTV_DT                       DATE         
GL_CC_NB                                NUMBER(7)    
ACCT_LAST_CNTC_DT                       DATE         
CHK_OR_SVACC_OD_DAY_CN                  NUMBER(3)    
UNVS_PROD_FAM_CD                        VARCHAR2(4)  

trialBalanceWriter is as follows...

    @Bean
    public JdbcBatchItemWriter<TrialBalance> trialBalanceWriter(final DataSource dataSource) {
        return new JdbcBatchItemWriterBuilder<TrialBalance>()
                .itemSqlParameterSourceProvider(new BeanPropertyItemSqlParameterSourceProvider<>())
                .sql(Constants.trialBalanceInsertStatement)
                .assertUpdates(false)
                .dataSource(dataSource)
                .build();
    }

Answer 1

there is something wrong with the primary key column, either NULLs are contained or its values (of the pk column, not the record itself) are not unique.

The reason why it is thrown after all records have been added is most likely because the transaction is committed at this point.