[英]Is it possible to use bigquery in aws lambda?
I want to write a python function that send data to Bigquery every time a put event occurs in my S3 bucket but I'm new in AWS is it possible to integrate bigquery with a lambda function? I want to write a python function that send data to Bigquery every time a put event occurs in my S3 bucket but I'm new in AWS is it possible to integrate bigquery with a lambda function? or can someone give me another way to stream my dynamodb data to bigquery?
或者有人可以给我另一种方式来 stream 我的 dynamodb 数据到 bigquery? Thank you my language is python
谢谢我的语言是 python
There are already plenty of resources online about "how to trigger a lambda after a put object on a S3".网上已经有很多关于“在 S3 上放置 object 后如何触发 lambda”的资源。
But here are a few links to get you set up:但是这里有一些链接可以帮助您进行设置:
You will need to set up an EventBridge (CloudWatch Events are legacy) to trigger your Lambda when some action happens on your S3 bucket: https://aws.amazon.com/fr/blogs/compute/using-dynamic-amazon-s3-event-handling-with-amazon-eventbridge/当您的 S3 存储桶上发生某些操作时,您将需要设置 EventBridge(CloudWatch Events 是旧版)来触发您的 Lambda: https://aws.amazon.com/fr/blogs/compute/using-dynamic-amazon-s3 -事件处理与亚马逊事件桥/
You can use the boto3 Python framework to write AWS Lambdas: https://boto3.amazonaws.com/v1/documentation/api/latest/index.html您可以使用 boto3 Python 框架来编写 AWS Lambdas: https://boto3.amazonaws.com/v1/documentation/api/latest/index.ZFC35FDC70D5FC69D2693EZ883A8
You can check the BigQuery Python SDK by GCP to communicate with your BQ database: https://googleapis.dev/python/bigquery/latest/index.html You can check the BigQuery Python SDK by GCP to communicate with your BQ database: https://googleapis.dev/python/bigquery/latest/index.html
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.