[英]Hive ACID Transaction properties using hive jdbc connection
我試圖在Hive 0.14中執行Hive ACID事務屬性,例如通過Java進行插入,刪除和更新。我能夠設置所需的ACID事務屬性。 還能夠使用事務屬性創建表。 但這是失敗的。 下面是示例代碼:
public class HiveJdbcClient {
private static String driverName = "org.apache.hive.jdbc.HiveDriver";
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con = DriverManager.getConnection("jdbc:hive2://ipaddress:port/default", "user", "password");
Statement stmt = con.createStatement();
stmt.execute("set set hive.support.concurrency=true");
stmt.execute("set hive.enforce.bucketing=true");
stmt.execute("set hive.exec.dynamic.partition.mode=nonstrict");
stmt.execute("set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager");
stmt.execute("set hive.compactor.initiator.on=true");
stmt.execute("set hive.compactor.worker.threads=2");
String tableName = "hive_acid_test";
stmt.execute("drop table if exists " + tableName);
stmt.execute("create table " + tableName + " (id int, name string,department string) clustered by (department) into 3 buckets stored as orc TBLPROPERTIES ('transactional'='true')");
stmt.execute("insert into table hive_acid_test values(1,'jon','sales')");
}
}
嘗試插入時收到以下異常:
線程“主”中的異常java.sql.SQLException:處理語句時出錯:FAILED:執行錯誤,從org.apache.hive.jdbc上的org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代碼1。 HiveStatement.execute(HiveStatement.java:296)位於promo.hive.sample.HiveJdbcClient.main(HiveJdbcClient.java:49)
從命令行運行相同的插入命令。 請幫助我找到問題。
我能夠重現問題並檢查了Hive服務器日志-hiveserver2.log。 現在,這是一個已知的問題- https://issues.apache.org/jira/browse/HIVE-8326它是固定在蜂巢1.1版本
問題與您的ACID配置中使用的DbTxManager有關。
錯誤日志:
java.lang.NullPointerException
at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.heartbeat(DbTxnManager.java:254)
at org.apache.hadoop.hive.ql.exec.Heartbeater.heartbeat(Heartbeater.java:81)
at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:242)
at org.apache.hadoop.hive.ql.exec.mr.HadoopJobExecHelper.progress(HadoopJobExecHelper.java:547)
at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:435)
at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1604)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1364)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1177)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1004)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:999)
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.