使用Kafka向Dlq Spring雲流發送消息時出錯

Question

的pom.xml

<dependencies>
         <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream</artifactId>
         </dependency>
         <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-stream-kafka</artifactId>
        </dependency>
        </dependencies>
        <dependencyManagement>
        <dependencies>
        <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>Edgware.SR3</version>
                <type>pom</type>
                <scope>import</scope>
          </dependency>
          </dependencies>
          </dependencyManagement>

@Component
public class QueueConsumer {

    /** The Constant LOG. */
    public static final Logger LOG = LoggerFactory.getLogger(QueueConsumer.class);

    /** The processor. */
    @Autowired
    private IMessageProcessor processor;

    /**
     * Consume.
     *
     * @param message the message
     */
    @StreamListener(value = OrderEventSink.ORDER_EVENT)
    public void consume(Message<String> message) {
        try {
            processor.process(message);
        } catch (MessageProcessingFailedException e) {
            LOG.error("Error Code "+ e.getCode().getCode() + " " + e.getCode().getDescription(), e);
            throw e;
        }
    }
}

1. 我正在使用Spring Cloud Stream來讀取來自kafka主題的消息。 正在從隊列中讀取消息，進行處理，如果在處理過程中失敗，則消息應到達配置的錯誤隊列，但會出現以下錯誤。
2. 從消息中提取標頭時會出現例外，什么是解決此問題的最佳方法？
3. Kafka版本是1.0，kafka客戶端是2.11-1.0

application.properties

     spring.cloud.stream.bindings.orderEvent.destination=orderEvents
     spring.cloud.stream.bindings.orderEvent.content- 
     type=application/json
     spring.cloud.stream.bindings.orderEvent.group=orderEvents-consumer
     spring.cloud.stream.bindings.orderEvent.consumer.back-off- 
     multiplier=5
     spring.cloud.stream.bindings.orderEvent.consumer.back-off-initial- 
     interval=60000
     spring.cloud.stream.bindings.orderEvent.consumer.max-attempts=1
     spring.cloud.stream.bindings.orderEvent.consumer.headerMode=raw
     spring.cloud.stream.bindings.kafka.binder.brokers=localhost
     spring.cloud.stream.bindings.kafka.binder.defaultBrokerPort=9092
     spring.cloud.stream.bindings.kafka.binder.zkNodes=localhost
     spring.cloud.stream.bindings.kafka.binder.defaultZkPort=2181
     spring.cloud.stream.kafka.bindings.orderEvent.consumer.
     enableDlq=true
     spring.cloud.stream.kafka.bindings.orderEvent.consumer.
     dlqName=dead-queue
     spring.cloud.stream.kafka.bindings.orderEvent.consumer.
     dlqProducerProperties.configuration.key.
     serializer=org.apache.kafka.common.serialization.StringSerializer
     spring.cloud.stream.kafka.bindings.orderEvent.consumer.
     dlqProducerProperties.configuration.value.
     serializer=org.apache.kafka.common.serialization.StringSerializer

org.springframework.messaging.MessageDeliveryException：無法將消息發送到通道“ scm-orderEvents.scm-orderEvents-consumer.errors”； 嵌套的異常是java.lang.RuntimeException：java.lang.StringIndexOutOfBoundsException：字符串索引超出范圍：4297 at org.springframework.integration.channel.AbstractMessageChannel.send（AbstractMessageChannel.java:451）〜[spring-integration-core-4.3 .12.RELEASE.jar：4.3.12.RELEASE]，位於org.springframework.integration.channel.AbstractMessageChannel.send（AbstractMessageChannel.java:375）〜[spring-integration-core-4.3.12.RELEASE.jar：4.3。 12.RELEASE]位於org.springframework.messaging.core.GenericMessagingTemplate.doSend（GenericMessagingTemplate.java:115）〜[spring-messaging-4.3.13.RELEASE.jar：4.3.13.RELEASE]位於org.springframework.messaging。 core.GenericMessagingTemplate.doSend（GenericMessagingTemplate.java:45）〜[spring-messaging-4.3.13.RELEASE.jar：4.3.13.RELEASE] at org.springframework.messaging.core.AbstractMessageSendingTemplate.send（AbstractMessageSendingTemplate.java:105 ）〜[spring-messaging-4.3.13.RELEASE.jar：4.3.13.RELEASE]在org.springframework.integration.endpoint.MessageProducerSu pport.sendErrorMessageIfNecessary（MessageProducerSupport.java:207）〜[spring-integration-core-4.3.12.RELEASE.jar：4.3.12.RELEASE]位於org.springframework.integration.endpoint.MessageProducerSupport.sendMessage（MessageProducerSupport.java:191 ）〜[spring-integration-core-4.3.12.RELEASE.jar：4.3.12.RELEASE]在org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter.access $ 200（KafkaMessageDrivenChannelAdapter.java:63）〜[spring-integration -kafka-2.1.2.RELEASE.jar：na]，位於org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter $ IntegrationRecordMessageListener.onMessage（KafkaMessageDrivenChannelAdapter.java:372）〜[spring-integration-kafka-2.1.2.RELEASE。 jar：na]位於org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter $ IntegrationRecordMessageListener.onMessage（KafkaMessageDrivenChannelAdapter.java:352）〜[spring-integration-kafka-2.1.2.RELEASE.jar：na]位於org.springframework。 kafka.listener.KafkaMessageListenerContainer $ ListenerConsu mer.invokeRecordListener（KafkaMessageListenerContainer.java:794）[spring-kafka-1.1.6.RELEASE.jar：na]在org.springframework.kafka.listener.KafkaMessageListenerContainer $ ListenerConsumer.invokeListener（KafkaMessageListenerContainer.java:738）[spring-kafka org.springframework.kafka.listener.KafkaMessageListenerContainer $ ListenerConsumer.access $ 2200（KafkaMessageListenerContainer.java:245）-1.1.6.RELEASE.jar：na] [org-org.springframework-1.1.6.RELEASE.jar：na] .springframework.kafka.listener.KafkaMessageListenerContainer $ ListenerConsumer $ ListenerInvoker.run（KafkaMessageListenerContainer.java:1031）[spring-kafka-1.1.6.RELEASE.jar：na] at java.util.concurrent.Executors $ RunnableAdapter.call（Executors .java：511）[na：1.8.0_162]在java.util.concurrent.FutureTask.run（FutureTask.java:266）[na：1.8.0_162]在java.lang.Thread.run（Thread.java:748） ）[na：1.8.0_162]原因：java.lang.RuntimeException：java.lang.StringIndexOutOfBoundsException：字符串索引超出范圍：org.springframework.cloud.stre中的4297 am.binder.kafka.KafkaMessageChannelBinder $ 4.handleMessage（KafkaMessageChannelBinder.java:380）〜[spring-cloud-stream-binder-kafka-1.3.2.RELEASE.jar：1.3.2.RELEASE]在org.springframework.integration上。 dispatcher.BroadcastingDispatcher.invokeHandler（BroadcastingDispatcher.java:236）〜[spring-integration-core-4.3.12.RELEASE.jar：4.3.12.RELEASE]在org.springframework.integration.dispatcher.BroadcastingDispatcher.dispatch（BroadcastingDispatcher.java ：185）〜[spring-integration-core-4.3.12.RELEASE.jar：4.3.12.RELEASE]，位於org.springframework.integration.channel.AbstractSubscribableChannel.doSend（AbstractSubscribableChannel.java:89）〜[spring-integration- core-4.3.12.RELEASE.jar：4.3.12.RELEASE]，位於org.springframework.integration.channel.AbstractMessageChannel.send（AbstractMessageChannel.java:425）〜[spring-integration-core-4.3.12.RELEASE.jar ：4.3.12.RELEASE] ...省略了16個常見幀原因：java.lang.StringIndexOutOfBoundsException：字符串索引超出范圍：java.lang.String.checkBounds（S為4297 tring.java:385）〜[na：1.8.0_162]在java.lang.String。（String.java:425）〜[na：1.8.0_162]在org.springframework.cloud.stream.binder.EmbeddedHeaderUtils.oldExtractHeaders （EmbeddedHeaderUtils.java:154）〜[spring-cloud-stream-1.3.2.RELEASE.jar：1.3.2.RELEASE]在org.springframework.cloud.stream.binder.EmbeddedHeaderUtils.extractHeaders（EmbeddedHeaderUtils.java:115） 〜[spring-cloud-stream-1.3.2.RELEASE.jar：1.3.2.RELEASE]在org.springframework.cloud.stream.binder.EmbeddedHeaderUtils.extractHeaders（EmbeddedHeaderUtils.java:107）〜[spring-cloud-stream -1.3.2.RELEASE.jar：1.3.2.RELEASE]在org.springframework.cloud.stream.binder.kafka.KafkaMessageChannelBinder $ 4.handleMessage（KafkaMessageChannelBinder.java:368）〜[spring-cloud-stream-binder-kafka -1.3.2.RELEASE.jar：1.3.2.RELEASE] ...省略了20個共同的框架

Answer 1

這是kafka活頁夾的1.3.2.RELEASE中的一個錯誤。 它固定在主機 （1.3.3.BUILD-SNAPSHOT）上。

順便說一句，最好的解決方案是使用Spring Boot 2.0.1和SCSt Emlhurst.RELEASE（由FINCHLEY雲提供-目前處於M9里程碑）。

這些版本對Kafka 1.0具有本機支持。

轉向Wiki上討論的與SCSt 1.3.x兼容的kafka11活頁夾工件（1.3.0）可能也會取得一些成功。