How to extract the h264 samples in the media-receiver example

[AlexSZYDLO]

Hello all,

The media-receiver example is working fine and acquires data from the webcam via the browser, that I can visualize with the provided GStreamer pipeline

However, I need to extract the h264 samples in the code. In the example, it looks like the data is RTP packets, which I have no idea how to convert into h264...

I'm not sure if I'm missing something or if this is just not implemented in this lib. I believe the missing part is what gstreamer's "rtph264depay" filter is doing but the code looks pretty complex...

Any thoughts or help would be much appreciated... At least to confirm that I'm looking in the right direction :)

Thanks!

[feiwei9696]

I am wondering for the same question, it seems only implemented packetizations for send direction, but not implemented depacketizations yet for recv direction.
Is any plan for the depacketizations? @paullouisageneau

[AlexSZYDLO]

I don't know about that...

[feiwei9696]

how do you deal with the missing packets when receive rtp packets?

[AlexSZYDLO]

I don't, I just send everything to ffmpeg for decoding, I believe it handles it...

[paullouisageneau]

There is currently no support for depacketization (see #676) but I'd like to add support in the future. To do it properly, it requires a jitter buffer to reorder and reassemble frames, plus support for detecting loss and sending NACK and PLI.

[feiwei9696]

looking forward to :)