如何使用Sqoop將數據從Oracle DB成功傳輸到Microsoft Azure HDInsights中的Hadoop群集

Question

我建立了一個項目，在其中使用Talend Open Studio for Big Data進行數據准備。 在這種情況下，我需要將數據從Oracle DBMS獲取到運行在Azure Microsoft HDInsights上的Hadoop群集。 為此，我創建了一個Talend作業，在其中使用Talend apache sqoop節點將Oracle表從數據庫發送到Hadoop。 我已經成功連接到Oracle DB和Hadoop集群。 雖然我在運行作業時遇到以下異常：

Job Sqoop_Experiment ended at 14:39 07/06/2017. [exit code=0]
Starting job Sqoop_Experiment at 14:39 07/06/2017.

[statistics] connecting to socket on port 3694
[statistics] connected
Exception in thread "main" java.lang.Error: Unresolved compilation problems: 
    com.cloudera.sqoop cannot be resolved to a type
    com.cloudera.sqoop.tool.SqoopTool cannot be resolved to a type
    com.cloudera.sqoop cannot be resolved to a type
    com.cloudera.sqoop cannot be resolved to a type
    com.cloudera.sqoop.SqoopOptions cannot be resolved to a type
    org.apache.sqoop cannot be resolved to a type
    org.apache.sqoop cannot be resolved to a type
    org.apache.sqoop.Sqoop cannot be resolved to a type

    at teste.sqoop_experiment_0_1.Sqoop_Experiment.tSqoopImport_1Process(Sqoop_Experiment.java:372)
    at teste.sqoop_experiment_0_1.Sqoop_Experiment.runJobInTOS(Sqoop_Experiment.java:690)
    at teste.sqoop_experiment_0_1.Sqoop_Experiment.main(Sqoop_Experiment.java:539)
Job Sqoop_Experiment ended at 14:39 07/06/2017. [exit code=0]

Answer 1

您是否嘗試使用Azure Data Management Gateway來查看Azure Data Factory，該Azure Data Management Gateway已在本地安裝以連接到Oracle DB。