Unknown format error on running examples on coral board along with coral camera

Question

I was running examples from google coral. They worked fine on my coral board. Then i modified the examples after following this post to increase fps output of camera.

The details of platform:

mendel@coral2:~$ uname -a
Linux coral2 4.14.98-imx #1 SMP PREEMPT Fri Nov 8 23:28:21 UTC 2019 aarch64 GNU/Linux

The example runs fine with usb camera (standard one) however with coral camera results in following error. ( VISIBLE IN SYSLOGS )

Jun  1 10:32:28 coral2 kernel: [378824.885837] unknown pixelformat:'BGR3'
Jun  1 10:32:28 coral2 kernel: [378824.889798] mx6s-csi 30a90000.csi1_bridge: Fourcc format (0x33524742) invalid.
Jun  1 10:32:28 coral2 kernel: [378824.897302] unknown pixelformat:'YV12'
Jun  1 10:32:28 coral2 kernel: [378824.901344] mx6s-csi 30a90000.csi1_bridge: Fourcc format (0x32315659) invalid.
Jun  1 10:32:28 coral2 kernel: [378824.908784] unknown pixelformat:'411P'
Jun  1 10:32:28 coral2 kernel: [378824.912753] mx6s-csi 30a90000.csi1_bridge: Fourcc format (0x50313134) invalid.
Jun  1 10:32:28 coral2 kernel: [378824.920308] unknown pixelformat:'MJPG'
Jun  1 10:32:28 coral2 kernel: [378824.924268] mx6s-csi 30a90000.csi1_bridge: Fourcc format (0x47504a4d) invalid.
Jun  1 10:32:28 coral2 kernel: [378824.931818] unknown pixelformat:'JPEG'
Jun  1 10:32:28 coral2 kernel: [378824.935778] mx6s-csi 30a90000.csi1_bridge: Fourcc format (0x4745504a) invalid.

Steps to produce error

1. git clone https://github.com/deepanshu-yadav/coral_bug.git
2. ./download_models.sh
3. cd opencv
4. ./install_requirements.sh
5. python3 detect.py

To sum it up it only reads the first frame and never shows the subsequent frames.

Answer 1

I believe you have also reached out to us via our private support channel, but I'm pasting it here for other to reference also.

Unfortunately, I cannot reproduce this issue on my side using your code. A quick look at the code base, it appears that you haven't commit your changes. On another note, I don't believe this is going to work in the first place. This is because the Camera module that we ship doesn't have supports for BGR3 format and only YUYV. You can confirm this with this command:

$ v4l2-ctl --list-formats-ext --device /dev/video0
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'YUYV' (YUYV 4:2:2)
                Size: Discrete 640x480
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 720x480
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 1280x720
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 1920x1080
                        Interval: Discrete 0.067s (15.000 fps)
                        Interval: Discrete 0.033s (30.000 fps)
                Size: Discrete 2592x1944
                        Interval: Discrete 0.067s (15.000 fps)
                Size: Discrete 0x0