如何在 sagemaker 上自动缩放 SKLearn 作业

Question

I want to launch a SKLearn job using sagemaker . The way I do this is as follows:

from sagemaker.sklearn.estimator import SKLearn

FRAMEWORK_VERSION = '0.23-1' 
script_path = 'main.py'

sklearn = SKLearn(
    entry_point=os.path.join(script_path),
    framework_version=FRAMEWORK_VERSION,
    instance_type='ml.m5.2xlarge',
    source_dir='src',
    output_path='my/output/path',
)

I am not sure if the instance_type that I have chosen is enough (in terms of memory etc) for my application though.

Is there a way to "let sagemaker" decide on the instance type?

Or, is there a way to choose an instance_type and if along the way it is about to run out of memory, the sagemaker to automatically scale up?

Answer 1

Automatic scale-up feature for Training doesn't exist in SageMaker at this time.

On a separate note, for selecting the right instance type for inference, we have an instance recommender service ( https://docs.aws.amazon.com/sagemaker/latest/dg/inference-recommender.html ).