C++ - threads and multiple queues

Question

I need to build a system of workers (represented as threads) and (multiple) queues. Individual jobs are waiting in one of the queues and waits for a worker thread to process them. Each worker can process jobs only from some of the queues. No spin-waiting. C/C++, pthreads, standard POSIX.

The problem for me is the "multiple queues" thing. I know how to implement this with a single queue. The workers need to wait on all the queues that they can process (wait for ANY of them).

On Windows I would use WaitForMultipleObjects, but this needs to be multi-platform.

I don't want any particular code for this, only a hint or a description of the model which I should use. Thanks in advance.

Answer 1

How about:

• all worker threads wait on a semaphore
• when anything is added to the queue, the semaphore is incremented, which wakes a single thread
• the thread checks the queues it is interested in, processes one of them and goes back to waiting on the semaphore

You will need additional mutex(es) to control actual read & writes to the queues.

Answer 2

What you can do is use a condition variable . Have your worker threads wait on a condition variable. When a job gets added to any of the job queues, signal the condition variable. Then, when the worker thread wakes up, it checks the queues it's waiting on. If any of them have a job, it takes that job off the queue. Otherwise, it goes back to waiting on the condition variable. Waiting on a condition variable puts the thread to sleep, so it does not consume CPU time.

Of course, it goes without saying that you should protect all accesses to the job queues with a mutex (eg pthread_mutex_t ).

Answer 3

如果每个队列的工作人员不多，则可以为每个工作人员创建一个条件变量。

Answer 4

I've been thinking about this recently and the only idea I could come up with is (assuming that you have thread-safe queues) to only ever have multiple threads servicing a single queue.

You can then have one or more work producing threads adding jobs to a single queue and one or more worker threads blocking on the queue until they find something to process.

If you ever have multiple queues that multiple worker threads have to poll, then a solution might be to add one extra thread for each queue and an extra queue. The extra threads each block on their own single queue, but simply forward jobs to the extra queue. Now the existing worker thread are back to blocking on a single queue.

Answer 5

听起来你应该使用boost :: thread ， boost :: condition和std :: queue 。

Answer 6

What I would do is use boost::asio to queue up data so that your multiple threads can have a go at it. You can pass a ref to the queue via the post command and have the thread process accordingly.

Answer 7

Instead of having a separate lock for each queue, why not have one lock for all queue?

1. Wait on the lock
2. Get the lock
3. Dequeue from whichever queue
4. Release the lock
5. Process the dequeued item
6. Goto step 1

Assuming that the dequeue takes negligible time (so the lock is only ever held for negligible time) there may be no need for more than one lock.

Answer 8

You could do something like this: each job has a "queue" associated with it. Eg:

Say you have 2 queues. Your jobs could say:

job[0].queue = 1; /* That job is in queue 1 */
job[1].queue = 1;
job[2].queue = 2; /* this job is in queue 2 */
... 
etc

So then you have your "bag of threads". A thread simply picks a job - say, job[2]. If that thread is only allowed to process jobs from queue 1, then it puts that job back into the ready queue and chooses a different job.

So each thread knows which queues it is allowed to process, and when it chooses a job, it makes sure that job's "queue" field matches. If it doesn't, it chooses a different job.

(this is in many ways how process scheduling works in linux on multiple cores. Each process has a bitmask saying which processors it is allowed to run on, and then the processor makes sure it is "allowed" to run that process before doing so.)