Perl中的并行处理。 CPU使用率100％

Question

i have developed a script for data extraction in perl.

using a parallel::ForkManager module and its functionalities

it works well when i run the script from 4core cpu. but when i try to run it from different cpu which is of 2core only has a cpu usage 100%.

my problem is to reduce that cpu usage n run script smoothly. i already reduces the max_Child_process to 10 previously it was 40. restriction: my script must parse all pages and store data in database within a 25 seconds. currently it is doing it in 22-24 seconds but uses full cpu. can anybody gives me some idea about how and what to do for reducing my cpu usage.

Answer 1

Use a usleep when waiting for child processes.

until (waitpid(-1, WNOHANG)) { usleep(100); }

Dramatically reduces cpu in parallel programs