简体   繁体   English

适用于大数据的Spring-XD spring应用程序

[英]Spring-XD spring application for bigdata

I'm new to Spring-XD and only have basic idea that it helps in storing huge data in hadoop as files. 我是Spring-XD的新手,只有一个基本的想法,那就是它有助于将大量数据作为文件存储在hadoop中。 I would like to develop my application to save data coming into socket using Spring-XD to hadoop. 我想开发我的应用程序,以使用Spring-XD来存储进入套接字的数据。

Is this possible ? 这可能吗 ? If yes can anyone point me to some examples where it has been done ? 如果是的话,有人可以指出一些例子吗? Please do not redirect me to https://github.com/spring-projects/spring-xd . 请不要将我重定向到https://github.com/spring-projects/spring-xd It does not contain any example of how to write a file to hadoop and connection configuration of hadoop. 它不包含任何有关如何向hadoop写入文件以及hadoop的连接配置的示例。

Thanks in advance. 提前致谢。

You might want to consider using Spring Cloud Data Flow as it is the successor of Spring XD. 您可能要考虑使用Spring Cloud Data Flow,因为它是Spring XD的后继产品。 You can make use of hdfs source/sink application based on whether you need to read/write from/to HDFS. 您可以根据是否需要从HDFS读取/写入数据来使用hdfs源/接收器应用程序。

You can still try out Spring XD samples here to get an idea. 您仍然可以在此处尝试Spring XD示例以获取想法。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM