简体繁体 English

从Avro读取并写入Mapper中的多个HBase

[英]Read from Avro and Write to multiple HBase in Mapper

原文 2015-02-04 13:40:03 7 1 hadoop/ hbase/ avro

I have used MultiTableOutputFormat and successfully written to Multiple HBase tables in TableReducer . 我已使用MultiTableOutputFormat并将其成功写入TableReducer多个HBase表中。 But how to achieve that in Mapper only job? 但是如何在仅Mapper工作中实现这一目标？

I tried using TableMapper but it has only <KEYOUT,VALUEOUT> and not <KEYIN,VALUEIN,KEYOUT,VALUEOUT> . 我尝试使用TableMapper但它只有<KEYOUT,VALUEOUT>而没有<KEYIN,VALUEIN,KEYOUT,VALUEOUT> 。 So I couldn't read in text files. 因此，我无法读取文本文件。

My Mapper is reading from Text/Avro file and processing it before pushing to HBase. 我的Mapper正在读取文本/ Avro文件并进行处理，然后再推送到HBase。 Is that possible? 那可能吗？

1 个解决方案

您可以打开HBase连接，并在实现的Mapper中自己编写PUT操作

从HDFS读取并写入HBASE - Read from HDFS and write to HBASE

读取保存在HBase列中的AVRO结构 - Read AVRO structures saved in HBase columns

Hadoop - 直接从Mapper写入HBase - Hadoop - Writing to HBase directly from the Mapper

如何从一个HBase实例读取但如何写入另一个实例？ - How can I read from one HBase instance but write to another?

映射器可以写入多个文件吗 - Can a mapper write to multiple files

Hadoop：Mapper无法从多个输入路径读取文件 - Hadoop: the Mapper didn't read files from multiple input paths

是否可以从Hadoop中的同一reducer写入HBase和多个文件 - is it possible to write to HBase and multiple files from the same reducer in Hadoop

如何从HBase读取记录然后存储到Spark RDD（弹性分布式数据集）中；并读取一条RDD记录，然后写入HBase？ - How to read a record from HBase then store into Spark RDD (Resilient Distributed Datasets); and read one RDD record then write into HBase?

如何在Flink流作业中读写HBase - How to read and write to HBase in flink streaming job

不带减速器的HBase读/写，异常 - Read/Write Hbase without reducer, exceptions

暂无

暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 从HDFS读取并写入HBASE - Read from HDFS and write to HBASE 读取保存在HBase列中的AVRO结构 - Read AVRO structures saved in HBase columns Hadoop - 直接从Mapper写入HBase - Hadoop - Writing to HBase directly from the Mapper 如何从一个HBase实例读取但如何写入另一个实例？ - How can I read from one HBase instance but write to another? 映射器可以写入多个文件吗 - Can a mapper write to multiple files Hadoop：Mapper无法从多个输入路径读取文件 - Hadoop: the Mapper didn't read files from multiple input paths 是否可以从Hadoop中的同一reducer写入HBase和多个文件 - is it possible to write to HBase and multiple files from the same reducer in Hadoop 如何从HBase读取记录然后存储到Spark RDD（弹性分布式数据集）中；并读取一条RDD记录，然后写入HBase？ - How to read a record from HBase then store into Spark RDD (Resilient Distributed Datasets); and read one RDD record then write into HBase? 如何在Flink流作业中读写HBase - How to read and write to HBase in flink streaming job 不带减速器的HBase读/写，异常 - Read/Write Hbase without reducer, exceptions

相关标签

粤ICP备18138465号 © 2020-2024 STACKOOM.COM