[英]Spring batch Step after JMS Reader/Processor/Writer step is not getting triggered
我们的 spring 批次需要有 2 个步骤
Step1:将来自JMS的消息Deque并处理该消息并将output数据写入文件。 步骤 2:包含 2 个从属步骤的分区步骤。每个从属步骤对 step1 output 数据应用不同的算法。
问题:从不调用第 2 步。 尝试将 Step 侦听器附加到第 1 步(以及编写器),但从未执行。 看起来 step1 总是在继续 state ,因此 step2 (分区步骤)永远不会被执行。
观察:当将步骤 1 中的 JMSReader 替换为 Normal (File/DB) Reader 时,控制转到步骤 2
注意:需要 firstQueueTemplate.setReceiveTimeout(Long.MAX_VALUE); 因为我们需要连续不断地将消息逐个出列。
public TransactionAwareConnectionFactoryProxy activeMQConnectionFactory() {
ActiveMQConnectionFactory amqConnectionFactory = new ActiveMQConnectionFactory(ActiveMQConnection.DEFAULT_BROKER_URL);
TransactionAwareConnectionFactoryProxy activeMQConnectionFactory = new TransactionAwareConnectionFactoryProxy(amqConnectionFactory);
return activeMQConnectionFactory;
}
@Bean
public ActiveMQQueue defaultQueue() {
return new ActiveMQQueue("batch-test");
}
@Bean
@DependsOn(value = { "activeMQConnectionFactory", "defaultQueue" })
public JmsTemplate firstQueueTemplate(ActiveMQQueue defaultQueue, TransactionAwareConnectionFactoryProxy activeMQConnectionFactory) {
JmsTemplate firstQueueTemplate = new JmsTemplate(activeMQConnectionFactory);
firstQueueTemplate.setDefaultDestination(defaultQueue);
firstQueueTemplate.setSessionTransacted(true);
firstQueueTemplate.setReceiveTimeout(Long.MAX_VALUE);
return firstQueueTemplate;
}
@Bean(name = "partitionerJob")
public Job partitionerJob() throws UnexpectedInputException, MalformedURLException, ParseException {
return jobs.get("partitionerJob")
.start(ingestionstep())
.next(partitionStep())
.build();
}
@Bean
public Step ingestionstep() throws UnexpectedInputException, MalformedURLException, ParseException {
System.out.println("ingestionstep forming");
return steps.get("ingsetionstep")
.<SPDRIngestScanBO, SPDRIngestScanBO>chunk(1)
.reader(jmsItemReader())
.processor(ingestionProcessor())
.writer(ingestionwriter() )
.listener(new StepExecutionListener() {
@Override
public void beforeStep(StepExecution stepExecution) {
// TODO Auto-generated method stub
}
@Override
public ExitStatus afterStep(StepExecution stepExecution) {
System.out.println("step exit status :"+stepExecution.getExitStatus());
return null;
}
})
// .listener(promotionListener())
.build();
}
@Bean
@StepScope
public Step partitionStep() throws UnexpectedInputException, MalformedURLException, ParseException {
System.out.println(" Inside partitionStep method ");
return steps.get("partitionStep")
.partitioner("partitionscans", partitioner(null))
.gridSize(2)
.step(scanStep())
.taskExecutor(taskExecutor())
.build();
}
@Bean
public JmsItemReader<SPDRIngestScanBO> jmsItemReader() {
JmsItemReader<SPDRIngestScanBO> jmsItemReader = new JmsItemReader<>();
jmsItemReader.setJmsTemplate(jmsTemplate);
jmsItemReader.setItemType(SPDRIngestScanBO.class);
return jmsItemReader;
}
@Bean
public SPDRIngestionStepProcessor ingestionProcessor() {
return new SPDRIngestionStepProcessor();
}
@Bean
public SPDRIngestionStepWriter ingestionwriter() {
return new SPDRIngestionStepWriter();
}
@Bean
@StepScope
public ModelsPartitioner partitioner(@Value("#{jobExecutionContext[models]}") List<SPDRScanModelBO> models) {
ModelsPartitioner partitioner = new ModelsPartitioner();
partitioner.setModels(models);
System.out.println("----partitioner----");
return partitioner;
}
@Bean
@StepScope
public Step scanStep() throws UnexpectedInputException, MalformedURLException, ParseException {
return steps.get("scanstep")
.<SPDRScanModelBO, SPDRScanResultBO>chunk(1)
.reader(scanStepReader(null))
.processor(scanStepProcessor())
.writer(scanStepWriter())
.build();
}
@Bean
@StepScope
public SPDRScanStepReader scanStepReader(@Value("#{stepExecutionContext[model]}") SPDRScanModelBO scanModelBO){
System.out.println("----scanStepReader----");
SPDRScanStepReader scanStepReader = new SPDRScanStepReader();
scanStepReader.setScanModelBO(scanModelBO);
return scanStepReader;
}
@Bean
@StepScope
public SPDRScanStepProcessor scanStepProcessor(){
SPDRScanStepProcessor scanStepProcessor = new SPDRScanStepProcessor();
return scanStepProcessor;
}
@Bean
@StepScope
public SPDRScanStepWriter scanStepWriter(){
SPDRScanStepWriter scanStepWriter = new SPDRScanStepWriter();
return scanStepWriter;
}
@Bean
@StepScope
public TaskExecutor taskExecutor() {
ThreadPoolTaskExecutor taskExecutor = new ThreadPoolTaskExecutor();
taskExecutor.setMaxPoolSize(2);
taskExecutor.setCorePoolSize(2);
taskExecutor.setQueueCapacity(2);
taskExecutor.afterPropertiesSet();
return taskExecutor;
}
```
在 Spring Batch 中,当您顺序运行两个步骤时,例如 step1 然后 step2,只有 step1 完成后才会执行 step2。
在您的情况下, step1 从带有receiveTimeout = Long.MAX_VALUE
的 jms 队列中读取,因此除非发生此超时,否则您的 step1 将不会完成,因此 step2 将不会启动。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.