Android video stream capture for AR

Question

I would like to be able to capture the video from an android phone camera, and then process this video. Processing involves adding a layer of AR to the live stream. Is this possible on android? Pretty sure it should be.

I have looked at the android site [ http://developer.android.com/guide/topics/media/index.html] but this seems to be concerned with video capture and storage. I would like to be able to play with the video pre-storage.

Thanks,

Answer 1

Depending on how real-time you want the data to be, you can potentially use Camera.setPreviewCallback with Camera.PreviewCallback#onPreviewFrame to listen for preview frames coming from the camera.

An example on usage can be found in the ZXing source code (aka Barcode Scanner) source code.

Answer 2

I am studying the problem. Personally I think it is better to use video streams from Android MediaRecorder, rather than from previewPicture, because the latter is just some samples, with lower frame rate.