找不到 Pandas 模块

Question

I have a AWS EMR cluster and a Jupyert Note book on another instance connected through livy , I have installed packages on EMR master and node, Jupyter seems to recognize all packages except pandas.

I have checked sys.executable(/usr/bin/python3)which is same on Jypter and terminal .

An error was encountered:

Pandas >= 0.19.2 must be installed; however, it was not found.
Traceback (most recent call last):
  File "/usr/lib/spark/python/lib/pyspark.zip/pyspark/sql/dataframe.py", line 2085, in toPandas
    require_minimum_pandas_version()
  File "/usr/lib/spark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 129, in require_minimum_pandas_version
    "it was not found." % minimum_pandas_version)
ImportError: Pandas >= 0.19.2 must be installed; however, it was not found.

Can some one please help me?

Answer 1

It is complaining that it cannot find a pandas of at least the minimum required version, which is equal to 0.19.2 or greater. Have you checked in your dependencies whether maybe you have installed an earlier version?