[英]Deploy Flask app with celery worker on Google Cloud
我有一个非常简单的 Flask 应用程序示例,它使用 celery 工作程序异步处理任务:
应用程序.py
app.config['CELERY_BROKER_URL'] = os.environ.get('REDISCLOUD_URL', 'redis://localhost:6379')
app.config['CELERY_RESULT_BACKEND']= os.environ.get('REDISCLOUD_URL', 'redis://localhost:6379')
app.config['SQLALCHEMY_DATABASE_URI'] = conn_str
celery = make_celery(app)
db.init_app(app)
@app.route('/')
def index():
return "Working"
@app.route('/test')
def test():
task = reverse.delay("hello")
return task.id
@celery.task(name='app.reverse')
def reverse(string):
return string[::-1]
if __name__ == "__main__":
app.run()
要在本地运行它,我在一个终端中运行 celery -A app.celery worker --loglevel=INFO,在另一个终端中运行 python app.py。
我想知道如何在 Google Cloud 上部署此应用程序? 我不想使用任务队列,因为它只与 Python 2 兼容。是否有很好的文档可用于执行此类操作? 谢谢
App Engine 任务队列是Google Cloud Tasks的早期版本,它完全支持 App Engine Flex/STD 和 Python 3.x 运行时。
您需要创建一个 Cloud Task Queue 和一个 App 引擎服务来处理任务
Gcloud 命令创建队列
gcloud tasks queues create [QUEUE_ID]
任务处理程序代码
from flask import Flask, request
app = Flask(__name__)
@app.route('/example_task_handler', methods=['POST'])
def example_task_handler():
"""Log the request payload."""
payload = request.get_data(as_text=True) or '(empty payload)'
print('Received task with payload: {}'.format(payload))
return 'Printed task payload: {}'.format(payload)
推送任务的代码
"""Create a task for a given queue with an arbitrary payload."""
from google.cloud import tasks_v2
client = tasks_v2.CloudTasksClient()
# replace with your values.
# project = 'my-project-id'
# queue = 'my-appengine-queue'
# location = 'us-central1'
# payload = 'hello'
parent = client.queue_path(project, location, queue)
# Construct the request body.
task = {
'app_engine_http_request': { # Specify the type of request.
'http_method': tasks_v2.HttpMethod.POST,
'relative_uri': '/example_task_handler'
}
}
if payload is not None:
# The API expects a payload of type bytes.
converted_payload = payload.encode()
# Add the payload to the request.
task['app_engine_http_request']['body'] = converted_payload
if in_seconds is not None:
timestamp = datetime.datetime.utcnow() + datetime.timedelta(seconds=in_seconds)
# Add the timestamp to the tasks.
task['schedule_time'] = timestamp
# Use the client to build and send the task.
response = client.create_task(parent=parent, task=task)
print('Created task {}'.format(response.name))
return response
要求.txt
Flask==1.1.2
gunicorn==20.0.4
google-cloud-tasks==2.0.0
您可以在 GCP Python 示例 Github 页面中查看此完整示例
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.