简体   繁体   中英

Can multiple qsub submissions read the same group of files?

I would like to use a bash script and qsub to run 30-40 python programs at once. Each python program reads and searches through the same set of files (~400 total) for a set of sequences. Is there a problem where multiple python programs could be trying to read from the same file? If so, what are the consequences?

There are no problems with multiple jobs reading from the same files that are imposed by Torque. (I think that statement is likely to be true for any resource manager / scheduler.)

The main issue I can imagine would be your file system's performance and whether or not it can keep up with potentially concurrent accesses to those files.

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM