![](/img/trans.png)
[英]Spark : java.lang.NoSuchMethodError: com.google.common.collect.Ordering.leastOf(Ljava/util/Iterator;I)Ljava/util/List
[英]java.lang.NoSuchMethodError: com.google.api.services.bigquery.model.JobConfigurationQuery.getConnectionProperties()Ljava/util/List;
我对 com.google.api.services 有一些问题。 我正在使用这个版本“BigQuery API v2(修订版 459)”:
确实不存在“getConnectionProperties()”方法......这是完整的错误:
Exception in thread "main" java.lang.NoSuchMethodError: com.google.api.services.bigquery.model.JobConfigurationQuery.getConnectionProperties()Ljava/util/List; at com.google.cloud.bigquery.QueryJobConfiguration$Builder.(QueryJobConfiguration.java:250) at com.google.cloud.bigquery.QueryJobConfiguration$Builder.(QueryJobConfiguration.java:95) at com.google.cloud.bigquery.QueryJobConfiguration .fromPb(QueryJobConfiguration.java:1060) at com.google.cloud.bigquery.JobConfiguration.fromPb(JobConfiguration.java:128) at com.google.cloud.bigquery.JobInfo$BuilderImpl.(JobInfo.java:158) at com .google.cloud.bigquery.Job.fromPb(Job.java:497) at com.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:363) at Z4D236D9A2D102C5FE6AD1 C50DA4BEC50Z.google.cloud.bigquery.BigQueryImpl.create(BigQueryImpl.java:340) at bce_datahub.bigquery_template_0_1.bigquery_template.tJava_1Process(bigquery_template.java:383) at bce_datahub.bigquery_template_0_1.bigquery_template.runJobInTOS(bigquery_template.java:757) at bce_datahub .bigquery_template_0_1.bigquery_template.main(bigquery_template.java:583)
我看到了这个版本:
包含这个方法,但如果我用这个版本替换它,我会得到另一个错误:
NoClassDefFoundError:com/google/api/services/bigquery/Bigquery$Builder
所以这个版本似乎没有这个 class。
我正在开发一个 Java 程序来:
对于第 2 步,我没有问题。 这些是我正在使用的jara:
我正在使用 Talend Studio,所以我必须安装 jars: 一个一个。 这是产生问题的脚本的一部分:
import java.io.File;
import java.io.FileInputStream;
import com.google.cloud.RetryOption;
import com.google.cloud.bigquery.BigQuery;
import com.google.cloud.bigquery.BigQueryException;
import com.google.cloud.bigquery.BigQueryOptions;
import com.google.cloud.bigquery.QueryJobConfiguration;
import com.google.cloud.bigquery.Job;
import com.google.cloud.bigquery.JobInfo;
import com.google.cloud.bigquery.Table;
import com.google.cloud.bigquery.TableId;
import com.google.auth.oauth2.GoogleCredentials;
import com.google.auth.oauth2.ServiceAccountCredentials;
import com.google.auth.oauth2.AccessToken;
import org.threeten.bp.Duration;
//INPUT
String credentialsPath = "...";
String projectId = "...";
String datasetName = "...";
String tableName = "...";
String bucketName = "...";
String objectName = "...";
String destinationUri = "...";
String dataFormat = "...";
String destFilePath = "...";
String ddl =
"DROP TABLE IF EXISTS `" + datasetName + "." + tableName + "`;"
+ "CREATE TABLE `" + datasetName + "." + tableName + "` AS "
+ "SELECT * FROM ...";
//Authentification
File credentialsFilePath = new File(credentialsPath);
FileInputStream serviceAccountStream = new FileInputStream(credentialsFilePath);
GoogleCredentials credentials;
credentials = ServiceAccountCredentials.fromStream(serviceAccountStream);
// Initialize client that will be used to send requests. This client only needs to be created
// once, and can be reused for multiple requests
BigQuery bigquery = BigQueryOptions.newBuilder()
.setProjectId(projectId)
.setCredentials(credentials).build()
.getService();
// Execute query on BigQuery
QueryJobConfiguration config = QueryJobConfiguration.newBuilder(ddl).build();
Job job = bigquery.create(JobInfo.of(config));
Job completedJob =
job.waitFor(
RetryOption.initialRetryDelay(Duration.ofSeconds(1)), //Checking period time [Optional]
RetryOption.totalTimeout(Duration.ofMinutes(3)) //Timeout [Optional]
);
if (completedJob == null)
{
System.out.println("Job not executed since it no longer exists.");
return;
} else if (completedJob.getStatus().getError() != null)
{
System.out.println("BigQuery was unable to execute the query due to an error: \n" + job.getStatus().getError());
return;
}
System.out.println("Table create successful. Check in " + datasetName + " for the " + tableName + " table.");
...
解决。
不起作用。
似乎他们是不同的。 但是我解决了我的问题。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.