两个线程在Scala中访问同一文件

Question

I have a shell script that copies files into a location and another one that picks these up for further processing. I want to use multithreading to pick up files parallelly in Scala using a threadpool.

However, if there are two threads and two files, both of them are picking up the same file. I have tried the program a lot of times, and it always ends up like this. I need the threads to pick up different files in parallel .

Can someone help me out? What approaches can I use? If you could point me in the right direction that would be enough.

Answer 1

I think you can use a parallel sequence to do the processing in parallel. You don't have to handle this logic yourself. for ex. the code could be like this:

newFiles:Seq[String] = listCurrentFilesNames()
newFiles.par.foreach { fileName =>
   processFile(fileName)
}

This code will be executed in parallel. and you could set the number of threads to a specific number as mentioned here: https://stackoverflow.com/a/37725987/2201566

Answer 2

您还可以尝试使用演员-例如-供您参考-https: //github.com/tsheppard01/akka-parallel-read-csv-file