lambda客户端调用函数并从MQ读取json消息并将其发送到AWS Kinesis

Question

我有两个用python编写的lambda函数。

1-subscription.py（将连接到AWS MQ，收集并显示消息）

import time
import boto3
import stomp
import json
global message

lambda_client = boto3.client('lambda')

class Listener(stomp.ConnectionListener):
    def on_error(self, headers, message):
        print('received an error "%s"' % message)

    def on_message(self, headers, message):
        print('received a message in subscriber : "%s"' % message)
        invoke_response = lambda_client.invoke(FunctionName="op_worker",
                                           InvocationType='Event',
                                           Payload=json.dumps(message)
                                           )
        #print('invoke_response a message in subscriber : "%s"' % invoke_response)
        print("terstesfsff")
        print (invoke_response['Payload'].read())
def lambda_handler(event, context):
    conn = stomp.Connection(host_and_ports=[('b-4714-4441-8166-1.mq.eu-central-1.amazonaws.com', 61614)])
    lst = Listener()
    conn.set_listener('Listener', lst)
    conn.set_ssl(for_hosts=[('b-4714-4441-8166-1.mq.eu-central-1.amazonaws.com', 61614)])
    conn.start()
    print('CONNECTION Started')
    conn.connect(login='test_mq', passcode='test_secure_mq',wait=True)
    print('CONNECTION established')
    conn.subscribe(destination='/queue/', id=1, ack='auto')
    print('CONNECTION Subscribed')
    time.sleep(10)
    conn.disconnect()
    return

2- worker.py（需要从Subscriber.py函数收集消息并将此消息传递给Kinesis）

import time
import boto3
import stomp
import json

lambda_client = boto3.client('lambda')
kinesis_client = boto3.client('kinesis')

def lambda_handler(event, context):

    #print (invoke_response['Payload'].read())
    print('received a message in worker : "%s"' % message)
    kinesis_client.put_record(
            StreamName='',
            Data=b'bytes',
            PartitionKey='1'
        )
    return { 
        'message' : message
    }

我执行Subscriber.py Lambda函数时出现错误消息：-

    Response:
null

Request ID:
"009406bc-f334-11e8-950f-fde41035f262"

Function Logs:
START RequestId: 009406bc-f334-11e8-950f-fde41035f262 Version: $LATEST
CONNECTION Started
CONNECTION established
CONNECTION Subscribed
received a message in subscriber : "{

  "rateChange":{

    "contractCode":"DOPC/DOPC0004/W19",
    "sourceMarketGroup":"TNO"
}
}"
terstesfsff
b''
END RequestId: 009406bc-f334-11e8-950f-fde41035f262
REPORT RequestId: 009406bc-f334-11e8-950f-fde41035f262  Duration: 10255.69 ms   Billed Duration: 10300 ms   Memory Size: 128 MB Max Memory Used: 33 MB

关于worker.py的错误消息：-

    {
  "errorMessage": "name 'message' is not defined",
  "errorType": "NameError",
  "stackTrace": [
    [
      "/var/task/op_worker.py",
      12,
      "lambda_handler",
      "print('received a message in worker : \"%s\"' % message)"
    ]

订户Cloudwatch事件

工人Cloudwatch事件

Answer 1

这是问题所在：

1. 您的subscriber.py没有返回错误，而是应该返回的错误。 它返回b''作为来自worker.py调用的响应，因为worker.py不产生结果
2. worker.py返回错误，因为没有名为message的变量。 调用worker.py时作为函数参数发送的json在event对象内部，您应该访问通过event发送的信息。

Answer 2

工作人员的更新代码：-

import time
import boto3
import stomp
import json

lambda_client = boto3.client('lambda')
kinesis_client = boto3.client('kinesis')

def lambda_handler(event, context):
    print('received a message in worker : "%s"' % event)
    kinesis_client.put_record(
            StreamName='OnePurchasing',
            Data=b'bytes',
            PartitionKey='1'
        )