覆蓋httpclient版本

Question

我正在使用aws sdk構建一個spark應用程序以訪問S3源。 我收到以下錯誤：

java.lang.NoSuchMethodError：org.apache.http.conn.ssl.SSLConnectionSocketFactory。（Ljavax / net / ssl / SSLContext; Ljavax / net / ssl / HostnameVerifier;）V

在線查找解決方案，似乎我的spark應用程序使用了錯誤的httpclient。 以下線程似乎提供了一個解決方案，但不確定如何覆蓋默認的默認httpclient。

哪個版本的httpclient與Amazon SDK v 1.11.5兼容？

這是我在系統中擁有的不同的httpclient。

./Applications/IBM Notes.app/Contents/MacOS/shared/eclipse/plugins/org.apache.wink_1.1.2.20150826-0855/lib/httpclient-4.0.1.jar
./Users/XXXXX/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.1.2.jar
./Users/XXXXX/.ivy2/cache/org.apache.httpcomponents/httpclient/jars/httpclient-4.5.1.jar
./Users/XXXXX/.m2/repository/org/apache/httpcomponents/httpclient/4.0.2/httpclient-4.0.2.jar
./Users/XXXXX/.m2/repository/org/apache/httpcomponents/httpclient/4.3.6/httpclient-4.3.6.jar
./Users/XXXXX/Downloads/aws-java-sdk-1.11.110/third-party/lib/httpclient-4.5.2.jar
./usr/local/aws-java/aws-java-sdk-1.11.109/third-party/lib/httpclient-4.5.2.jar
./usr/local/spark/spark-2.1.0-bin-hadoop2.7/jars/httpclient-4.5.2.jar
./usr/local/zeppelin/interpreter/alluxio/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/bqsql/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/elasticsearch/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/hbase/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/kylin/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/lens/httpclient-4.3.6.jar
./usr/local/zeppelin/interpreter/livy/httpclient-4.3.4.jar
./usr/local/zeppelin/interpreter/pig/httpclient-4.3.6.jar
./usr/local/zeppelin/lib/httpclient-4.3.6.jar
./usr/local/zeppelin/lib/interpreter/httpclient-4.3.6.jar

我沒有指定類路徑，所以我不確定它在選擇哪個httpclient。 我如何重寫以使其始終拾取./usr/local/aws-java/aws-java-sdk-1.11.109/third-party/lib/httpclient-4.5.2.jar ？

Answer 1

將httpclient-4.5.2.jar和httpcore-4.4.4.jar復制到zeppelin / interpreter / spark文件夾中可消除此錯誤。