[英]Error while trying to preview data in DataFlow in Azure Synaspe
I have a data pipeline in Azure Synaspe.我在 Azure Synaspe 中有一个数据管道。 The Pipeline has a data flow activity that is reading data from a Spark database in Azure Data Lake Storage Gen 2 data lake.
Pipeline 有一个数据流活动,它从 Azure Data Lake Storage Gen 2 数据湖中的 Spark 数据库读取数据。 The data then sinks into another spark database.
然后数据会下沉到另一个 spark 数据库中。
The other day when I tried to preview from the source spark database, I got the following error(data source name is masked).前几天我尝试从源 spark 数据库进行预览时,出现以下错误(数据源名称被屏蔽)。
at Source '<>': org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:null);在源“<>”:org.apache.hadoop.hive.ql.metadata.HiveException:MetaException(消息:null);
This was working perfectly fine previously.这以前工作得很好。
Please note: There were no code changes to this pipeline.请注意:此管道没有代码更改。
Any thoughts有什么想法吗
Make sure Autoscale
of Spark pool configuration is Enable.确保 Spark 池配置的
Autoscale
为 Enable。
You should try by increasing Number of nodes.您应该尝试增加节点数。
Also try with more Node Size.也尝试更多的节点大小。
Reference - https://docs.microsoft.com/en-us/answers/questions/706694/unable-to-run-sql-queries-in-azure-synapse-error-o.html参考 - https://docs.microsoft.com/en-us/answers/questions/706694/unable-to-run-sql-queries-in-azure-synapse-error-o.html
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.