NameError：未定义名称“ redis”-PySpark-Redis

Question

I am using the addPyFile method in pyspark to load the redis.zip file. I am able to load the file using

sc.addPyFile("/home/path/to/redis.zip")

But while running the code using ./pyspark , it is showing the error:

NameError: name 'redis' is not defined

The zip( redis.zip ) contains .py files( client.py , connection.py , exceptions.py , lock.py , utils.py and others).

Python version is - 3.5 and spark is 2.7

Answer 1

如果将py文件打包为zip并使用sc.addPyFile添加，则应使用import client ， import connector等导入模块。