简体   繁体   English

记录读取器的概念

[英]Concept of RecordReaders

We know that prior to Mapper phase the files are split and the RecordReader starts working to emit a input to the Mapper. 我们知道,在Mapper阶段之前,文件已被拆分,并且RecordReader开始工作以向Mapper发出输入。 My question is whether the reducer uses a RecordReader class to read the data emitted by the mapper? 我的问题是reducer是否使用RecordReader类读取映射器发出的数据?


because reducer takes input too!! 因为减速机也需要输入! Please Explain!!! 请解释!!!

Overview of the mapreduce steps is as follows mapreduce步骤概述如下

1) InputFormat :

 - Validates the Input.

 - Splits the input files.        

 - Gives Record Reader Implementation to give input to Mapper.

2)Mapper Phase

3)Shuffle and Sort Phase

4)Reducer Phase

5) OutputFormat     

 - Validates the Output Specification.  

 - Provides Record Writer Implementation used to write the output files.

Reducer does not use record reader... 减速器不使用记录读取器...

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM