bash：无限期地使用并行命令继续运行脚本

Question

I have logging system that creates new log file every second in Ubuntu Server. I have developed script called "processor.sh" that runs every second to extract important information from the newly created log files. Previously, I used to use watch command to run the processors.sh indefinitely:

watch -n1 ./processor.sh 

Now I started to use parallel command like the following:

ls *.log | parallel xargs ./processors.sh

I believe using watch to run it continuously is a wrong thing. How can I keep running processor.sh forever every second with parallel command?

Answer 1

Here is one way:

while true; do
  parallel ./processors.sh ::: *.log
  sleep 1
done

But I think this will be way better:

inotifywait -qmre MOVED_TO -e CLOSE_WRITE --format %w%f `pwd` |
  parallel ./processors.sh

This will start the processing when another process stops writing to a .log-file and closes it.