[英]Kafka producer sending invalid characters
使用以下代碼,我發送Elasticsearch文檔以進行索引。 我嘗試將基本對象轉換為JSON並通過制作人發送。 但是,每條消息(從控制台檢查)都附加了像 - t {“productId”:2455這樣的亂碼字符
public boolean sendMessage()
{
PageRequest page = new PageRequest(0, 1);
Product p = product.findByName("Cream", page).getContent().get(0);
String json = "";
ObjectMapper mapper = new ObjectMapper();
try {
json = mapper.writeValueAsString(p);
} catch (JsonProcessingException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
logger.info("JSON = " + json);
boolean status = inputToKafka.send(org.springframework.integration.support.MessageBuilder.withPayload(json).build());
try {
Thread.sleep(10000);
} catch (InterruptedException e) {
e.printStackTrace();
}
return status;
}
出站配置
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:int="http://www.springframework.org/schema/integration"
xmlns:int-kafka="http://www.springframework.org/schema/integration/kafka"
xmlns:task="http://www.springframework.org/schema/task"
xsi:schemaLocation="http://www.springframework.org/schema/integration/kafka http://www.springframework.org/schema/integration/kafka/spring-integration-kafka.xsd
http://www.springframework.org/schema/integration http://www.springframework.org/schema/integration/spring-integration.xsd
http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/task http://www.springframework.org/schema/task/spring-task.xsd">
<int:channel id="inputToKafka">
<int:queue/>
</int:channel>
<int-kafka:outbound-channel-adapter
id="kafkaOutboundChannelAdapter"
kafka-producer-context-ref="kafkaProducerContext"
channel="inputToKafka">
<int:poller fixed-delay="1000" time-unit="MILLISECONDS" receive-timeout="0" task-executor="taskExecutor"/>
</int-kafka:outbound-channel-adapter>
<task:executor id="taskExecutor" pool-size="5" keep-alive="120" queue-capacity="500"/>
<int-kafka:producer-context id="kafkaProducerContext">
<int-kafka:producer-configurations>
<int-kafka:producer-configuration broker-list="localhost:9092"
topic="test_topic"
compression-codec="default"/>
</int-kafka:producer-configurations>
</int-kafka:producer-context>
</beans>
任何線索?
使用的插件: Spring Extension Kafka
我今天遇到了這個問題,並通過在生產者配置中設置正確的value-serializer類來解決它,如下所示:
<int-kafka:producer-configuration
broker-list="localhost:9092" topic="headers['kafka_topic']"
key-class-type="java.lang.String" value-class-type="java.lang.String"
key-serializer="kafkaSerializer" value-serializer="kafkaSerializer"/>
<bean id="kafkaSerializer" class="org.apache.kafka.common.serialization.StringSerializer" />
這些可能是您的控制台無法很好地解釋的制表符(因為縮進的JSON)。
如果禁用對象映射器生成的輸出的縮進,則這些字符可能會消失。
try {
mapper.disable(SerializationFeature.INDENT_OUTPUT); <---- add this line
json = mapper.writeValueAsString(p);
} catch (JsonProcessingException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
卡夫卡不做這樣的事情。 調試您發送給Kafka生產者的String消息。 如果您從URL或HTML表單收到此消息,您可能需要先將消息解碼,然后再發送給生產者。
例如URLDecoder.decode(消息,“UTF-8”)
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.