AppEngine中长时间运行的受I / O约束的进程：任务还是线程？

Question

My Python AppEngine app interacts with slow external systems (think receiving data from narrow-band connections). Half-hour-long interactions are a norm. I need to run 10-15 of such interactions in parallel.

My options are background tasks and "background threads" ( not plain Python threads). Theoretically they look about the same. I'd stick with tasks since background threads don't run on the local development server.

Are there any significant advantages of one approach over the other?

Answer 1

It depends on how long the "interaction" takes. Appengine has a limit of 60 seconds per HTTP Requests. If your external systems send data periodically then I would advice to grab the data in small chunks to respect the 60 seconds limit. Aggregate those into blobs and then process the data periodically using tasks.