如何在Kafka或KSQL中修改或添加topic的key

Question

I have a lot of topics created without a key, how i can modify them and add the proper one?

I need change this for some connectors that want them to read topic properly

I personally use ksql but i didn't find any way to do it

Answer 1

Keys are added to records, not topics. You can simply start writing your records with keys.

You can't add keys to already published records, since Kafka logs are immutable. In order to do this you can consume data from the topic containing the unkeyed records, and set a key in each record and re-publish them to another topic.

You can accomplish this with KSQL using the PARTITION BY statement :

CREATE STREAM KEYED_STREAM as \
  SELECT * FROM UNKEYED_STREAM PARTITION BY <key column>;