简体   繁体   English

使用翻滚窗口时如何选择时间语义的类型?

[英]How to select the type of time semantics when working with tumbling windows?

I am working on kafka streams windowing , particularly tumbling windows for my use case. 我正在研究kafka流窗口化,特别是在我的用例中滚动窗口。

TimeWindowedKStream<String, Blob> windowedStreams = groupedStreams
                .windowedBy(TimeWindows.of(TimeUnit.MINUTES.toMillis(5)));

this is a tumbling window for 5 minutes per record key and advances by 5 minutes. 这是每个记录键5分钟的翻滚窗口,前进5分钟。 For my use case, I want no old message to be dropped and hence I want it to consider processing time as time semantic. 对于我的用例,我不希望删除任何旧消息,因此希望将处理时间视为时间语义。

what is the default behaviour of tumbling window for time semantics, how does I specify in tumbling windows which time semantic to pick ?event time/processing time/ingestion time. 时间语义的滚动窗口的默认行为是什么,如何在滚动窗口中指定选择哪种时间语义?事件时间/处理时间/摄取时间。

The time semantics are not specified on the window definition, but depend on the configured TimestampeExtractor . 时间语义未在窗口定义中指定,但取决于已配置的TimestampeExtractor If you want to switch to processing time semantics, you can set default.timestamp.extractor to WallclockTimestampExtractor.class in the KafkaStreams config. 如果要切换到处理时间语义,可以在KafkaStreams配置中将default.timestamp.extractor设置为WallclockTimestampExtractor.class

Compare 相比

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 对于翻滚窗口,emitEarlywhenFull()的抑制如何工作? - How does the suppress with emitEarlywhenFull() for tumbling windows works? 是否可以使用输入流中的时间戳在 Flink 中创建 Tumbling Windows。 如果是,那么如何? - Is it possible to create Tumbling Windows in Flink using a timestamp coming in Input Stream. If yes then How? 如何对 Tumbling Window 应用偏移量,以延迟 Windows 的启动<timewindow>在卡夫卡流中</timewindow> - How to apply an offset to Tumbling Window, in order to delay the starting of Windows<TimeWindow> in Kafka Streams KSQL - 在 WINDOW TUMBLING 子句中更改时区 - KSQL - Change the time zone in WINDOW TUMBLING clause 使用窗口翻转时如何从 KSQL 流中获取最后一个值 - How to get last value from a KSQL stream when using window tumbling 窗口翻转在ksql中如何工作? 作为查询返回相同的结果,无论是否在ksql中使用窗口滚动 - How does window tumbling works in ksql? As query returning same result with or without using window tumbling in ksql 使用Kafka翻滚窗口查询时返回空数据 - Empty data is returned when querying using Kafka tumbling window Flink 中非 keyed 流数据如何使用 Tumbling 窗口功能? - How to use the Tumbling window function for the non keyed streaming data in Flink? 我如何在我的 kafka 流应用程序中测试 Exactly Once Semantics - how do i test Exactly Once Semantics working in my kafka streams application 将kafka消息归档到AWS S3时如何实现“精确一次”语义? - How to achieve Exactly Once semantics when archive kafka message into AWS S3?
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM