在没有线程的情况下并发执行python脚本

Question

How can I execute single python script multiple time concurrently using different PID without using Threads and Multiprocessing from another python script?

And I need to get results from each execution

I tried Multiprocessing module simple program I got AttributeError: 'module' object has no attribute 'f' and it need to work on both Linux and windows. previous post's solution not working for me

After verifying with previous posts I posted this again.

Answer 1

A different PID means you need a different process. Not using multiprocessing you may start another process with the subprocess module and get the result via stdout :

#!/usr/bin/env python
# coding: utf8
from __future__ import absolute_import, division, print_function
import pickle
import sys
from subprocess import PIPE, Popen


def main():
    processes = [
        Popen([sys.executable, 'test.py'], stdout=PIPE)
        for _ in xrange(5)
    ]
    results = [pickle.loads(p.stdout.read()) for p in processes]
    for process in processes:
        process.wait()
    print(results)


if __name__ == '__main__':
    main()

test.py needs to write the result serialized with pickle to its stdout .

Answer 2

May this help?

test.py:(just for demo)

import time, os, datetime, fcntl

with open("output.txt", "a") as g:
    fcntl.flock(g, fcntl.LOCK_EX)
    g.write( "PID [" + str(os.getpid()) + "]," + str(datetime.datetime.now()) + "\n" )
    fcntl.flock(g, fcntl.LOCK_UN)


time.sleep(30)

with open("output.txt", "a") as g:
    fcntl.flock(g, fcntl.LOCK_EX)
    g.write( "PID [" + str(os.getpid()) + "]," + str(datetime.datetime.now()) + "\n" )
fcntl.flock(g, fcntl.LOCK_UN)

Run it several times:

c@chen:~/src$ python test2.py &
[1] 29265
c@chen:~/src$ python test2.py &
[2] 29266
c@chen:~/src$ python test2.py &
[3] 29268
c@chen:~/src$ python test2.py &
[4] 29269
c@chen:~/src$ vim test2.py 
[1]   Done                    python test2.py
[2]   Done                    python test2.py
[3]-  Done                    python test2.py
[4]+  Done                    python test2.py

Output:

c@chen:~/src$ tail -f -n 100 output.txt 
PID [29265],2016-01-20 16:28:20.373244
PID [29266],2016-01-20 16:28:21.068946
PID [29268],2016-01-20 16:28:21.911043
PID [29269],2016-01-20 16:28:22.547805
PID [29265],2016-01-20 16:28:50.403474
PID [29266],2016-01-20 16:28:51.075268
PID [29268],2016-01-20 16:28:51.914001
PID [29269],2016-01-20 16:28:52.564706