大型php脚本会减慢其余应用程序的速度...为什么？

Question

I have a large php web scraping script that logs the results onto a mysql database as it goes.The script generally runs for 5 to 10 minutes at a time.

The problem is that when this script is running other pages on the application will not load.

The script is on a dedicated server with plenty of RAM so I have tried increasing the allowed memory usage for MYSQL and PHP. Also increased the max allowed connections. None of this has helped.

Does anyone have any ideas about what else I can try?

Answer 1

Probably, problem in your session. Try to use session_write_close() before you start "big script".

Answer 2

well, there's a big difference between "slowing down" and "not load"!

try the following:

1. build a static html site and check if it is loaded well during the execution of the big script
2. build a php site that doesn't connect to the DB (just echo something) during the execution of the big script
3. build a small php site that connects to the DB (just select something from a table)

if 1 or 2 doesn't work well, your problem has something todo with the web server or server resources. if 3 doesn't work well, there could be resource issues with the mysql server.

if everything works well, check the scraping script. does it lock any table that is needed by the main application?