[英]Databricks notebook hang forever
Actually I am doing some dataframe work for ETL, the dataframe is read from Azure datawarehouse . 实际上,我正在为ETL做一些数据框架工作,该数据框架是从Azure数据仓库读取的。 and seems somehow to notebook hang forever , but I don't know where it is and why it hang so long !!!
并且似乎以某种方式使笔记本计算机永久挂起,但我不知道它在哪里以及为什么挂那么久!
Any one has idea and the experience ? 任何人都有想法和经验吗?
There are various rare scenarios and corner cases that can cause a streaming or batch job to hang. 在各种罕见的情况和极端情况下,可能会导致流式处理或批处理作业挂起。 It is also possible for a job to hang because the Databricks internal metastore has become corrupted.
由于Databricks内部元存储已损坏,作业也可能挂起。
Often restarting the cluster or creating a new one resolves the problem. 通常,重新启动集群或创建新集群可以解决该问题。 In other cases, run the following script to unhang the job and collect notebook information, which can be provided to Databricks Support.
在其他情况下,请运行以下脚本来取消作业并收集笔记本信息,这些信息可以提供给Databricks支持。
For more details, refer " How to Resolve Job Hands and Collect Diagnostic Information ". 有关更多详细信息,请参阅“ 如何解决作业手和收集诊断信息 ”。
Hope this helps. 希望这可以帮助。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.