我如何使用 API 网关调用 sagemaker 推理端点

Question

I am trying to call sagemaker inference endpoint from api gateway with AWS Integration.I don't want to use lamdba in between of API gateway and sagemaker runtime. I followed this doc to setup api gateway method but it fails.

How can i call sagemaker inference endpoint from API gateway?

Web Browser ----> API Gateway ----> Sagemaker endpoint

Answer 1

API Gateway supports integration with AWS services directly (without the Lambda). You can follow the instructions at https://docs.aws.amazon.com/apigateway/latest/developerguide/getting-started-aws-proxy.html .

When you go to Step 4 in the instructions above, for the AWS Service option, you can choose 'SageMaker Runtime' to target the invoke endpoints.

Answer 2

Invocation of the SageMaker Runtime API will require proper IAM permissions which is why Lambda is recommended within the architecture. Without Lambda, you would need to handle the SageMaker InvokeEndpoint call (and AWS signature) passing through API gateway which isn't a best practice for a few different reasons.

Here is an example of a simple Lambda python function to handle the InvokeEndpoint call. This will pass input/output through API gateway to SageMaker, and then a prediction back to client side.

import os
import io
import boto3
import json
import csv

ENDPOINT_NAME = os.environ['ENDPOINT_NAME']

runtime = boto3.client('runtime.sagemaker')

def handler(event, context):

    print("data: " + json.dumps(event))

    response = runtime.invoke_endpoint(EndpointName=ENDPOINT_NAME,
                                       ContentType='text/csv',
                                       Body=event)

    result = json.loads(response['Body'].read().decode())

    print(result)

    return result

Here is API reference for more information: https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_runtime_InvokeEndpoint.html

Hope this helps!

Answer 3

it's a long shot since it's an old question but somebody might end up here.

Reading the first section of the documentation about calling the inference endpoint in sagemaker, you'll find that you can only call it with a POST and pass your input data in the body.

https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_runtime_InvokeEndpoint.html

So it might be that you created a GET method in API Gateway and that you need to map your request parameters to a body payload or simply set up a POST method instead.