长时间运行python脚本

Question

I have application of following parts:

client->nginx->uwsgi(python)

and some python scripts can be running long time (2-6 minutes). After execution of script I should give to client content, but connection break with error "gateway timeout 504". What can I use for my case to avoid this error?

Answer 1

So is your goal to reduce the run time of the scripts, or to not have them time out? Browsers are going to give up on a 6 minute request no matter what you try.

Perhaps try doing the work on the server, and then polling for progress with AJAX requests?

Or, if possible, try optimizing the scripts. For example, if you have some horribly slow SQL stuff going on, try cleaning that up.

Otherwise, without more information, a more specific answer is hard to give.

Answer 2

I once set up a system where the "main page" contained an Iframe which showed the output of the long running program as text/plain. I think the the handler for the the Iframe content was a Python CGI script which emitted all headers and then the program output line by line under an Apache server.

I don't know whether this would work under your configuration.

Answer 3

这在很大程度上取决于您的服务器设置（即将数据推送回客户端是多么容易），但是在运行冗长的应用程序时可以定期发送一些“空”内容（例如，假设输出为html的简单换行符）浏览器认为这只是一个缓慢的连接，而不是一个停滞的连接？