[英]Synapse Spark Pool Error HTTP Request failed to Authenticate
I am getting the below error, It use to run fine but suddenly started getting the below error我收到以下错误,它过去运行良好但突然开始出现以下错误
Error code 1错误代码 1
LIVY_JOB_STATE_DEAD LIVY_JOB_STATE_DEAD
Message信息
[plugins.synapse-ent-tekura.sparkpoolsmall.180 WorkspaceType: CCID:] [Monitoring] Livy Endpoint=[https://hubservice.australiasoutheast.azuresynapse.net:8001/api/v1.0/publish/1567bc8e-206c-475f-bf1f-7c550c17a6d6]. [plugins.synapse-ent-tekura.sparkpoolsmall.180 WorkspaceType: CCID:] [Monitoring] Livy Endpoint=[https://hubservice.australiasoutheast.azuresynapse.net:8001/api/v1.0/publish/1567bc8e-206c- 475f-bf1f-7c550c17a6d6]。 Livy Id=[23] Job failed during run time with state=[dead]. Livy Id=[23] 作业在运行时失败,状态为 [dead]。
Source来源
Unknown未知
Sparl logs is here: Sparl 原木在这里:
Copy复制
Caused by: org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator$HttpException: HTTP Error -1CustomTokenProvider getAccessToken threw java.io.IOException: POST failed with 'Unauthorized' (401) and message: {"result":"UserError","errorId":"Unauthorized","errorMessage":"Invalid JobSessionToken: IDX10249: X509SecurityKey validation failed. The associated certificate has expired. ValidTo (UTC): '1/28/2023 7:18:14 AM', Current time (UTC): '1/30/2023 7:06:05 PM'.. TraceId: f51d91bd-f786-4225-a223-e9401cf58527. Error Component: TokenService"} at org.apache.hadoop.fs.azurebfs.oauth2.CustomTokenProviderAdapter.refreshToken(CustomTokenProviderAdapter.java:91) at org.apache.hadoop.fs.azurebfs.oauth2.AccessTokenProvider.getToken(AccessTokenProvider.java:50) at org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAccessToken(AbfsClient.java:1055) at org.apache.883 Caused by: org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator$HttpException: HTTP Error -1CustomTokenProvider getAccessToken threw java.io.IOException: POST failed with 'Unauthorized' (401) and message: {"result":"UserError","errorId ":"Unauthorized","errorMessage":"无效的 JobSessionToken: IDX10249: X509SecurityKey 验证失败。关联的证书已过期。ValidTo (UTC): '1/28/2023 7:18:14 AM',当前时间 (UTC) :'1/30/2023 7:06:05 PM'..TraceId:f51d91bd-f786-4225-a223-e9401cf58527。错误组件:TokenService"} at org.apache.hadoop.fs.azurebfs.oauthiderapCustomTokenerapcustomTokenterapcustomTokenderapCustomTokenDer .java:91) at org.apache.hadoop.fs.azurebfs.oauth2.AccessTokenProvider.getToken(AccessTokenProvider.java:50) at org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAccessToken(AbfsClient.java:1055) at org. apache.883 02989938088.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(AbfsRestOperation.java:256)... 26 more 23/01/30 19:06:05 INFO ShutdownHookManager: Shutdown hook called 23/01/30 19:06:05 INFO ShutdownHookManager: Deleting directory /mnt/tmp/spark-16f17c6d-3914-46f6-979c-9da7c8149d86 23/01/30 19:06:05 INFO MetricsSystemImpl: Stopping azure-file-system metrics system... 23/01/30 19:06:05 INFO MetricsSystemImpl: azure-file-system metrics system stopped. 02989938088.fs.azurebfs.services.AbfsRestOperation.executeHttpOperation(AbfsRestOperation.java:256)... 26 更多 23/01/30 19:06:05 INFO ShutdownHookManager:关闭挂钩调用 23/01/30 19:06:05 INFO ShutdownHookManager:删除目录/mnt/tmp/spark-16f17c6d-3914-46f6-979c-9da7c8149d86 23/01/30 19:06:05 INFO MetricsSystemImpl:停止 azure 文件系统指标系统... 23/01/30 19 :06:05 信息 MetricsSystemImpl:azure 文件系统指标系统已停止。 23/01/30 19:06:05 INFO MetricsSystemImpl: azure-file-system metrics system shutdown complete. 23/01/30 19:06:05 信息 MetricsSystemImpl:azure 文件系统指标系统关闭完成。
Failed to find which authentication is failed未能找到是哪个认证失败
Most likely it is because of expired SSL certificate.很可能是因为 SSL 证书已过期。
ValidTo (UTC): '1/28/2023 7:18:14 AM',
Current time (UTC): '1/30/2023 7:06:05 PM'
If this is something managed by you then ask your infra team to renew the SSL certificates or wait for new certificate to be added if you do not know who manages these certificates.如果这是由您管理的,那么请您的基础设施团队更新 SSL 证书,或者如果您不知道谁管理这些证书,请等待添加新证书。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.