[英]How KCL application is integrated to Kinesis Connector to emit data on S3
[英]How to build and use flink-connector-kinesis?
我正在嘗試使用Apache Flink和AWS kinesis。 該文件說我必須自己構建連接器。
因此,我構建了連接器並為我的項目添加了jar文件,並且我將依賴項放在我的pom.xml文件中。
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kinesis_2.11</artifactId>
<version>1.6.1</version>
</dependency>
但是,當我嘗試使用mvn clean package
構建時,我得到了這樣的錯誤消息
[INFO] -----------------------< kkaldk:flink-kinesis >-----------------------
[INFO] Building Flink Quickstart Job 0.1
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The POM for org.apache.flink:flink-connector-kinesis_2.11:jar:1.6-SNAPSHOT is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 0.458 s
[INFO] Finished at: 2018-12-19T17:45:43+09:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flink-kinesis: Could not resolve dependencies for project kkaldk:flink-kinesis:jar:0.1: Failure to find org.apache.flink:flink-connector-kinesis_2.11:jar:1.6-SNAPSHOT in https://repository.apache.org/content/repositories/snapshots/ was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots has elapsed or updates are forced ->
[Help 1]
[ERROR]
你能幫我解決這個問題嗎?
- - - - -添加 - - - - -
這就是我所做的(這是錯誤的程序)
這就是我為解決方案所做的。
我從這里下載了1.6.1版本。
解壓縮文件(存檔將解壓縮到.../flink-release-1.6.1/
通過mvn clean install -Pinclude-kinesis -DskipTests
構建它
然后我在我的本地maven存儲庫中有flink-connector-kinesis_2.11版本1.6.1
(對我來說,路徑是這樣的): ~/.m2/repository/org/apache/flink/flink-connector-kinesis_2.11
之后,我可以通過在此代碼中添加依賴項來在任何項目中使用此連接器。 (我不必再添加jar文件了。)
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kinesis_2.11</artifactId>
<version>1.6.1</version>
</dependency>
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.