如何从运行 PySpark 内核的 EMR jupyter notebook 中的另一个 ipynb 文件导入？

Question

I'm using jupyter notebook on AWS EMR to run PySpark, and is having trouble importing modules from another file. I tried a couple methods that I searched on stackoverflow, none worked. More specifically, I tried the following (here I have a notebook named "include.ipynb" in the same directory as the notebook that runs the import statements):

Both of these methods worked in jupyter notebook on my local computer. Why aren't they working on AWS?

Answer 1

You have to install these packages in your EMR explicitly using Pip or conda. Your local has those packages installed already.