使用JavaCV并发视频帧处理

Question

我有一个使用JavaCV逐帧过滤视频的代码。 代码如下

try (FFmpegFrameGrabber grabber = createGrabber()) {
    grabber.start();
    try (FFmpegFrameRecorder recorder = createRecorder(grabber)) {
        recorder.start();
        Frame frame;
        while ((frame = grabber.grab()) != null) {
            Frame editedFrame = filterFrame(frame); //This takes a long time.
            recorder.setTimestamp(grabber.getTimestamp());
            recorder.record(editedFrame);
        }
    }
}

由于行Frame editedFrame = filterFrame(frame); 需要很长时间，是否有可能利用多线程处理，从而使整个过程更快？ 我正在考虑使用ExecutorService或LinkedBlockingQueue类的东西一次处理多个帧，然后根据时间戳记录回帧。

Answer 1

它是模式生产者 ：

生产者类用于执行长任务（filterFrame）：

import java.util.concurrent.Callable;

public class Producer implements Callable<Frame> {

    private final Frame frame;

    public Producer(Frame frame) {
        this.frame = frame;
    }

    @Override
    public Frame call() throws Exception {
        return filterFrame(frame);
    }
}

消费者类别适用于商店框架：

import java.util.Map;
import java.util.concurrent.BlockingQueue;
import java.util.concurrent.Future;
import java.util.concurrent.LinkedBlockingQueue;
import java.util.concurrent.TimeUnit;

public class Consumer implements Runnable {

    private final BlockingQueue<Map.Entry<Long, Future<Frame>>> queue;
    public Boolean continueProducing = Boolean.TRUE;
    private final FFmpegFrameRecorder recorder;

    public Consumer(FFmpegFrameRecorder recorder,
                    BlockingQueue<Map.Entry<Long, Future<Frame>>> queue) {
        this.recorder = recorder;
        this.queue = queue;
    }

    @Override
    public void run() {
        try {
            Map.Entry<Long, Future<Frame>> entry = this.queue.poll(2, TimeUnit.SECONDS);
            Frame editedFrame = entry.getValue().get();
            recorder.setTimestamp(entry.getKey());
            recorder.record(editedFrame);
        } catch (InterruptedException e) {
            e.printStackTrace();
        }
    }
}

以及管理任务和关闭线程的主要部分

try (FFmpegFrameGrabber grabber = createGrabber()) {
            grabber.start();
            try (FFmpegFrameRecorder recorder = createRecorder(grabber)) {
                recorder.start();
                Frame frame;
                ExecutorService threadPool = Executors.newWorkStealingPool();
                BlockingQueue<Map.Entry<Long, Future<Frame>>> queue = new LinkedBlockingQueue<>();
                threadPool.execute(new Consumer(recorder, queue));
                while ((frame = grabber.grab()) != null) {
                    queue.put(new Map.Entry<Long, Future<Frame>>() {
                        @Override
                        public Long getKey() {
                            return grabber.getTimestamp();
                        }

                        @Override
                        public Future<Frame> getValue() {
                            return threadPool.submit(new Producer(frame)); // Frame editedFrame = filterFrame(frame); //This takes a long time.
                        }

                        @Override
                        public Future<Frame> setValue(Future<Frame> value) {
                            return null;
                        }
                    });
                }
                threadPool.shutdownNow();
            }
        }

注意：这不是复制粘贴解决方案，需要对您的代码进行一些自定义。 如果您分享更多信息，我将对其进行更改