Azure Databricks 和 pyspark - 子串错误

Question

Getting two errors with my Databricks Spark script with the following line:

df = spark.createDataFrame(pdDf).withColumn('month', substring(col('dt'), 0, 7))

The first one:

AttributeError: 'Series' object has no attribute 'substr'

and

NameError: name 'substr' is not defined

I wonder what I am doing wrong...

Answer 1

原来我没有导入pyspark.sql.functions

from pyspark.sql.functions import *