導入 modin.pandas 導致錯誤：AttributeError：類型 object 'pyarrow.lib.Message' 沒有屬性 '__reduce_cython__'

Question

問題

• 我已經安裝了conda install -c conda-forge modin
• 當我導入import modin.pandas as pd
• 我收到一條錯誤消息

嘗試過的解決方案

• 類似於但不同的框架，不同的用例和略有不同的錯誤消息 - 使用 Pyinstaller exe 時出現“沒有屬性 'reduce_cython” 錯誤
• 未解決 GitHub 問題 - https://github.com/cython/cython/issues/1953#issuecomment-398128940
• 不同的錯誤代碼 - AttributeError: type object 'cupy.core.core.broadcast' has no attribute '__reduce_cython__'
• 不同的錯誤代碼 - AttributeError: type object 'sklearn.manifold._barnes_hut_tsne.array' 沒有屬性 '__reduce_cython__'

錯誤信息

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-1-f6aea802f5ba> in <module>
      2 import openpyxl
      3 
----> 4 import modin.pandas as pd
      5 ##import pandas as pd
      6 

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/pandas/__init__.py in <module>
    170 
    171 from .. import __version__
--> 172 from .dataframe import DataFrame
    173 from .io import (
    174     read_csv,

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/pandas/dataframe.py in <module>
     46 from .series import Series
     47 from .base import BasePandasDataset, _ATTRS_NO_LOOKUP
---> 48 from .groupby import DataFrameGroupBy
     49 from .accessor import CachedAccessor, SparseFrameAccessor
     50 

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/pandas/groupby.py in <module>
     32     wrap_into_list,
     33 )
---> 34 from modin.backends.base.query_compiler import BaseQueryCompiler
     35 from modin.data_management.functions.default_methods.groupby_default import GroupBy
     36 from modin.config import IsExperimental

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/backends/__init__.py in <module>
     17 __all__ = ["BaseQueryCompiler", "PandasQueryCompiler"]
     18 try:
---> 19     from .pyarrow import PyarrowQueryCompiler  # noqa: F401
     20 except ImportError:
     21     pass

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/backends/pyarrow/__init__.py in <module>
     14 """The module represents the query compiler level for the PyArrow backend."""
     15 
---> 16 from .query_compiler import PyarrowQueryCompiler
     17 
     18 __all__ = ["PyarrowQueryCompiler"]

~/anaconda3/envs/tfall/lib/python3.7/site-packages/modin/backends/pyarrow/query_compiler.py in <module>
     26 from pandas.core.computation.ops import UnaryOp, BinOp, Term, MathCall, Constant
     27 
---> 28 import pyarrow as pa
     29 import pyarrow.gandiva as gandiva
     30 

~/anaconda3/envs/tfall/lib/python3.7/site-packages/pyarrow/__init__.py in <module>
     52 
     53 
---> 54 from pyarrow.lib import cpu_count, set_cpu_count
     55 from pyarrow.lib import (null, bool_,
     56                          int8, int16, int32, int64,

~/anaconda3/envs/tfall/lib/python3.7/site-packages/pyarrow/ipc.pxi in init pyarrow.lib()

AttributeError: type object 'pyarrow.lib.Message' has no attribute '__reduce_cython__'

Answer 1

解決方案

• 要求：Python >=3.8（當前版本鏈接）
• “我得到 AttributeError: type object 'pandas._libs.tslib._TSObject' 也沒有屬性 'reduce_cython'。我通過使用 pandas-0.20.3、cython-0.27.3 和 python-3.5 解決了這個問題。” 關聯

conda install -c conda-forge modin-all

工作代碼

import modin.pandas as pd
from distributed import Client
client = Client()


df = pd.read_csv('my_data.csv')  
df