如何从android中的视频捕获帧？

Question

Hi i have made a custom video played in android.with some simple "play","pause","play again" and "capture" button.NOw i have done all this functionalities except "capture".I have seacrched lot many links and googled a lot,But i can't find how to capture a frame from running video in android? my code is as below: please help me for is:

Main.java

package org.apache.android.media;
import java.io.File;
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.net.URL;
import java.net.URLConnection;
import android.app.Activity;
import android.os.Bundle;
import android.util.Log;
import android.view.View;
import android.view.View.OnClickListener;
import android.webkit.URLUtil;
import android.widget.EditText;
import android.widget.ImageButton;
import android.widget.Toast;

    import android.widget.VideoView;
    public class VideoViewDemo extends Activity {
        private static final String TAG = "VideoViewDemo";
        private VideoView mVideoView;
        private EditText mPath;
        private ImageButton mPlay;
        private ImageButton mPause;
        private ImageButton mReset;
        private ImageButton mStop;
        private ImageButton mcaptur;
        private String current;
        @Override
        public void onCreate(Bundle icicle) {
            super.onCreate(icicle);
            setContentView(R.layout.main);
            mVideoView = (VideoView) findViewById(R.id.surface_view);
            mPath = (EditText) findViewById(R.id.path);
            mPath.setText("http://daily3gp.com/vids/747.3gp");
            mPlay = (ImageButton) findViewById(R.id.play);
            mPause = (ImageButton) findViewById(R.id.pause);
            mReset = (ImageButton) findViewById(R.id.reset);
            mStop = (ImageButton) findViewById(R.id.stop);
            mcaptur = (ImageButton) findViewById(R.id.Captur);
            mPlay.setOnClickListener(new OnClickListener() {
                public void onClick(View view) {
                    playVideo();
                }
            });
            mPause.setOnClickListener(new OnClickListener() {
                public void onClick(View view) {
                    if (mVideoView != null) {
                        mVideoView.pause();
                    }
                }
            });
            mReset.setOnClickListener(new OnClickListener() {
                public void onClick(View view) {
                    if (mVideoView != null) {
                        mVideoView.seekTo(0);
                    }
                }
            });
            mStop.setOnClickListener(new OnClickListener() {
                public void onClick(View view) {
                    if (mVideoView != null) {
                        current = null;
                        mVideoView.stopPlayback();
                    }
                }
            });
            runOnUiThread(new Runnable() {
                public void run() {
                    playVideo();
                }
            });
            mcaptur.setOnClickListener(new OnClickListener() {
                @Override
                public void onClick(View v) {
                }
            });
        }
        private void playVideo() {
            try {
                final String path = mPath.getText().toString();
                Log.v(TAG, "path: " + path);
                if (path == null || path.length() == 0) {
                    Toast.makeText(VideoViewDemo.this, "File URL/path is empty",
                            Toast.LENGTH_LONG).show();
                } else {
                    // If the path has not changed, just start the media player
                    if (path.equals(current) && mVideoView != null) {
                        mVideoView.start();
                        mVideoView.requestFocus();
                        return;
                    }
                    current = path;
                    mVideoView.setVideoPath(getDataSource(path));
                    mVideoView.start();
                    mVideoView.requestFocus();
                }
            } catch (Exception e) {
                Log.e(TAG, "error: " + e.getMessage(), e);
                if (mVideoView != null) {
                    mVideoView.stopPlayback();
                }
            }
        }
        private String getDataSource(String path) throws IOException {
            if (!URLUtil.isNetworkUrl(path)) {
                return path;
            } else {
                URL url = new URL(path);
                URLConnection cn = url.openConnection();
                cn.connect();
                InputStream stream = cn.getInputStream();
                if (stream == null)
                    throw new RuntimeException("stream is null");
                File temp = File.createTempFile("mediaplayertmp", "dat");
                temp.deleteOnExit();
                String tempPath = temp.getAbsolutePath();
                FileOutputStream out = new FileOutputStream(temp);
                byte buf[] = new byte[128];
                do {
                    int numread = stream.read(buf);
                    if (numread <= 0)
                        break;
                    out.write(buf, 0, numread);
                } while (true);
                try {
                    stream.close();
                } catch (IOException ex) {
                    Log.e(TAG, "error: " + ex.getMessage(), ex);
                }
                return tempPath;
            }
        }
    }

Answer 1

You can get a video frame with MediaMetadataRetriever . The basic usage is as follows.

MediaMetadataRetriever retriever = new MediaMetadataRetriever();

// Set data source to retriever.
// From your code, you might want to use your 'String path' here.
retriever.setDataSource(yourPath);

// Get a frame in Bitmap by specifying time.
// Be aware that the parameter must be in "microseconds", not milliseconds.
Bitmap bitmap = retriever.getFrameAtTime(timeInMicroSeconds);

// Do something with your bitmap.

You might want to use FFmpegMediaMetadataRetriever for better performance.

Answer 2

I too have searched the same for some days and finally i came across opencv library through that we can able to read the frames from a live video and do the operations accordingly.

I have did successfully and keeping the project in github for your reference.

https://github.com/Karthi96/Video-Recorder-with-Frames-Analysis

Let me know if you still need a help.

Answer 3

you can use ffmpeg

Refer this link for more details

How to extract images from a Video using FFmpeg

you need to run this ffmpeg command in your activity to achieve this

you can also pad video,crop video using ffmpeg