是否可以从Hadoop中的同一reducer写入HBase和多个文件
[英]is it possible to write to HBase and multiple files from the same reducer in Hadoop
问题描述
we need to be able to write output of the map/reduce to multiple files (already working) as well as HBase table. 
我们需要能够将map / reduce的输出写入到多个文件（已经工作）以及HBase表中。 Is this possible? 这可能吗？ I had been looking at the MultipleOutputs option, but I can't figure out how to do it or if it's even doable. 我一直在看MultipleOutputs选项，但是我不知道该怎么做或者它是否可行。 I am very very new to haddop. 我对haddop非常陌生。 If somebody knows of any examples on the web, could you point me to the right direction please? 如果有人知道网络上的任何示例，请您指出正确的方向吗？ thank you. 谢谢。
1 个解决方案
解决方案1
0 2013-11-27 05:50:53
I personally haven't tried this, but the API for MultipleOutputs does support it. 我个人还没有尝试过，但是MultipleOutputs的API确实支持它。 Because you configure the Output Key/Value classes independently for each named output, you can have one (or multiple) *FileOutputFormat and one for TableOutputFormat . 因为您为每个命名的输出分别配置了输出键/值类，所以可以具有一个（或多个） *FileOutputFormat而可以具有TableOutputFormat 。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.