简体   繁体   English

在没有Spark SQL的情况下从Spark转换为HCatalog

[英]Spark to HCatalog without Spark SQL

How to connect to HCatalog from a Spark Job without using Spark SQL. 如何在不使用Spark SQL的情况下从Spark Job连接到HCatalog。

WE are using Cloudera distribution of Spark, in that currently they don't have support for Spark SQL. 我们正在使用Spark的Cloudera发行版,因为它们目前不支持Spark SQL。

Is there any other way we can connect o HCatalog from a Spark Job? 还有其他方法可以从Spark Job连接HCatalog吗?

Why not connect to the HCatalog REST server via WebHCat? 为什么不通过WebHCat连接到HCatalog REST服务器? https://cwiki.apache.org/confluence/display/Hive/WebHCat https://cwiki.apache.org/confluence/display/Hive/WebHCat

That can be done without relying upon the Cloudera spark / SparkSQL integration. 无需依赖Cloudera spark / SparkSQL集成即可完成此操作。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM