Streaming low latency avc/h264 video to a browser with MSE

Question

I am currently encoding live video and streaming to the browser. I encode rgb->vuy->h264->Wrap in (MP4 ISO BMFF Byte Stream Format spec, section 3)-> websocket to client. first package is initialization data from ftyp to moov tag.

And from there on I am sending moof and mdat tags to the client. And I stream the video.

No matter how many frames are in mdat chunk. The MSE always buffers the data to have seamless play. How can one overwrite this using MSE.

I read somewhere that there is a way mdat understands that it is a live steaming webm chunk. But I do not know if such think exist for mp4 or exists altogether.

Answer 1

我每帧发送一次Moof，它起作用。