简体   繁体   English

看不到 Kafka 主题中的数据

[英]Unable to see Data in Kafka Topic

I have a json file in S3 bucket and I am pushing that file into kafka topic, Can some one guide me why I am not able to see this data in Kafka topic.我在 S3 存储桶中有一个 json 文件,我正在将该文件推送到 kafka 主题中,有人可以指导我为什么我无法在 Kafka 主题中看到这些数据。 My Program has no errors and running correctly.我的程序没有错误并且运行正常。

from kafka import KafkaProducer
import json
import time
import boto3


def json_serializer(data):
    return json.dumps(data).encode("utf-8")

producer = KafkaProducer(bootstrap_servers= ['localhost:9092'],
                         value_serializer=json_serializer)
def read_s3():
    s3 = boto3.resource('s3')
    bucket = s3.Bucket('s3sparkbucket')
    for obj in bucket.objects.all():
        key = obj.key
        body = obj.get()['Body'].read().decode('utf-8')
        return body
if __name__ == "__main__":
          body=read_s3()
          producer.send("Uber_Eats",body)
          print("Done")

KafkaProducer must need 3 params: KafkaProducer 必须需要 3 个参数:

bootstrap.servers  key.serializer and value.serializer

May be caused by that可能是由此造成的

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM