简体   繁体   English

在hadoop集群中,是否应该在所有节点上安装配置单元?

[英]In a hadoop cluster, should hive be installed on all nodes?

I am a newbie to Hadoop / Hive and I have just started reading the docs. 我是Hadoop / Hive的新手,我刚刚开始阅读文档。 There are lots of blogs on installing Hadoop in cluster mode. 有很多关于在群集模式下安装Hadoop的博客。 Also, I know that Hive runs on top of Hadoop. 另外,我知道Hive运行在Hadoop之上。 My question is: Hadoop is installed on all the cluster nodes. 我的问题是:Hadoop安装在所有集群节点上。 Should I also install Hive on all the cluster nodes or only on the master node? 我是否还应该在所有群集节点上或仅在主节点上安装Hive?

No, it is not something you install on worker nodes. 不,它不是您在工作节点上安装的东西。 Hive is a Hadoop client. Hive是一个Hadoop客户端。 Just run Hive according to the instructions you see at the Hive site . 只需根据您在Hive站点上看到的说明运行Hive。

From Cloudera's Hive installation Guide : Cloudera的Hive安装指南

Install Hive on your client machine(s) from which you submit jobs; 在您提交作业的客户端计算机上安装Hive; you do not need to install it on the nodes in your Hadoop cluster. 您不需要在Hadoop集群中的节点上安装它。

Hive is basically used for processing structured and semi-structured data in Hadoop. Hive主要用于处理Hadoop中的结构化和半结构化数据。 We can also perform Analysis of large datasets which is present in HDFS and also in Amazon S3 filesystem using Hive. 我们还可以使用Hive执行分析大型数据集,这些数据集存在于HDFS和Amazon S3文件系统中。 In order to query data hive also provides query language known as HiveQL which is similar to SQL. 为了查询数据,hive还提供了称为HiveQL的查询语言,类似于SQL。 Using Hive one can easily run Ad-hoc queries for the data analysis. 使用Hive可以轻松地为数据分析运行Ad-hoc查询。 Using Hive we don't need to write complex Map-Reduce jobs, we just need to submit SQL queries. 使用Hive我们不需要编写复杂的Map-Reduce作业,我们只需要提交SQL查询。 Hive converts these SQL queries into MapReduce jobs. Hive将这些SQL查询转换为MapReduce作业。

Finally Hive SQL will get converted to MapReduce jobs and we don't have to submit MapReduce job from all node in a Hadoop cluster, in the same way we don't need Hive to be installed in all node of Hadoop cluster 最后,Hive SQL将转换为MapReduce作业,我们不必从Hadoop集群中的所有节点提交MapReduce作业,就像我们不需要在Hadoop集群的所有节点中安装Hive一样

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM