[英]Kafka consumer.poll call not returning kafka ConsumerRecords
[英]How can I initialize kafka ConsumerRecords<String,String> in kafka for testing
我正在為 kafka 消費者組件編寫測試用例並kafkaConsumer.poll()
,它返回ConsumerRecords<String,String>
實例。 我想初始化ConsumerRecords
並在模擬中使用它,但是ConsumerRecords
的構造函數期望我在測試中沒有的實際 kafka 主題。 我認為的一種方法是保留對象的序列化副本並反序列化以初始化ConsumerRecords
。 有沒有其他方法可以實現相同的目標。
這是一些示例代碼(Kafka 客戶端庫版本 0.10.1.1):
import java.util.ArrayList;
import java.util.Collection;
import java.util.HashMap;
import java.util.Map;
import org.apache.kafka.clients.consumer.ConsumerRecord;
import org.apache.kafka.clients.consumer.MockConsumer;
import org.apache.kafka.clients.consumer.OffsetResetStrategy;
import org.apache.kafka.common.TopicPartition;
...
String topic = "MyTopic";
Collection<TopicPartition> partitions = new ArrayList<TopicPartition>();
Collection<String> topicsCollection = new ArrayList<String>();
partitions.add(new TopicPartition(topic, 1));
Map<TopicPartition, Long> partitionsBeginningMap = new HashMap<TopicPartition, Long>();
Map<TopicPartition, Long> partitionsEndMap = new HashMap<TopicPartition, Long>();
long records = 10;
for (TopicPartition partition : partitions) {
partitionsBeginningMap.put(partition, 0l);
partitionsEndMap.put(partition, records);
topicsCollection.add(partition.topic());
}
MockConsumer<String, MyObject> second = new MockConsumer<String, MyObject>(
OffsetResetStrategy.EARLIEST);
second.subscribe(topicsCollection);
second.rebalance(partitions);
second.updateBeginningOffsets(partitionsBeginningMap);
second.updateEndOffsets(partitionsEndMap);
for (long i = 0; i < 10; i++) {
MyObject value = Generator.generate();
ConsumerRecord<String, MyObject> record = new ConsumerRecord<String, MyObject>(
topic, 1, i, null,value);
second.addRecord(record);
}
...
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.