“从扩展导入实用程序”在 AWS Glue Jupyter Notebook 中给出错误

Question

In AWS Glue Jupyter Notebook, When I run the command from extension import utils i get error ModuleNotFoundError: No module named 'extension'

Below is the complete list of things that I have to import, Only the last one I am getting error.

import time
import boto3
import logging 

from datetime import timedelta, datetime
from awsglue.transforms import *
from awsglue.utils import getResolvedOptions
from awsglue.context import GlueContext
from awsglue.job import Job
from pyspark.context import SparkContext
from pyspark.sql.types import *

import pyarrow as pa
import numpy as np
import pandas as pd

from extension import utils

Screenshot:

I tried pip install extension but don't know whats going on.

Answer 1

It seems that you have not installed extension module.

You can add install the module by adding the following in the previous cell.

!pip3 install extension

Answer 2

First of all, in order to add additional libraries you can use %additional_python_modules option in notebook. You can give pypi packages or s3 location of packages.

Second, I dont see utils class in any of extension/extensions/pyextension packages. Can you double check the package.? If its internal package, i suggest using s3 option.