mirrors/gst-plugins-rs
mirrors/gst-plugins-rs
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs.git synced 2024-05-18 08:12:38 +00:00
Code Issues Projects Releases Wiki Activity
3208 commits 13 branches 84 tags 24 MiB
Commit graph

109 commits

Author SHA1 Message Date
Sebastian Dröge 4d9b6c5472 fmp4mux: Pass one more buffer in test_buffer_multi_stream_short_gops test 
This works around non-determinism in aggregator where depending on
timing it can happen that it consumes all buffers from both pads or
waits for another buffer on one pad while the other one already has one.

The effect in this test was that it sometimes timed out. By providing
one more buffer it is guaranteed now that at this point the muxer is
beyond the end of the first fragment.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1081>
 2023-02-09 20:36:44 +02:00
Sebastian Dröge 5965ff4364 fmp4mux: Accept more data on already filled streams if the remaining streams need more data for finishing a GOP 
In other words, continue queueing buffers in sync from all streams until
all of them are ready for draining instead of stopping to queue buffers
on every stream that is already filled individually.

Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/310

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1081>
 2023-02-09 20:36:42 +02:00
Sebastian Dröge 3a408c0146 fmp4mux: Handle GOPs ending after the desired fragment end correctly 
Either create further chunks if enough data is queued or simply start
the new fragment at a later time if the keyframe is later.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1077>
 2023-02-06 19:20:34 +02:00
Sebastian Dröge 5627bd8d7d mp4: Add support for AV1 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1075>
 2023-02-04 13:48:37 +00:00
Sebastian Dröge 4c3ae6f8ce fmp4: Add support for AV1 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1075>
 2023-02-04 13:48:37 +00:00
Sebastian Dröge cef6fef079 fmp4: Add support for VP8 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1075>
 2023-02-04 13:48:37 +00:00
Sebastian Dröge 02ac4b3b04 mp4: Add support for VP8 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1075>
 2023-02-04 13:48:37 +00:00
Sebastian Dröge ecb26a0b16 fmp4mux: Fix a couple of assertions by handling these cases cleaner 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1071>
 2023-02-01 14:57:00 +02:00
Sebastian Dröge 1998ecab45 fmp4mux: Refactor and clean up code 
Split many longer functions into multiple functions and simplify various
parts. Overall this is functionally still the same as before.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1068>
 2023-01-30 14:41:33 +00:00
Sebastian Dröge 2a3d962dc5 fmp4mux: Add support for sub-fragments / chunking 
Allow outputting sub-fragments (chunks in CMAF terms) that are shorter
than the fragment duration and don't usually start on a keyframe. By
this the buffering requirements of the element is reduced to one chunk
duration, as is the latency.

This is used for formats like low-latency / LL-HLS and DASH.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1059>
 2023-01-27 19:28:27 +00:00
Guillaume Desmottes abe4efc4a2 fmp4mux: add 'offset-to-zero' property 
Add it only to 'isofmp4mux', the onvif variant already does this and
CMAF and DASH are always single-stream so you rely on inter-container
synchronization via the running-time.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1063>
 2023-01-25 12:29:30 +00:00
Sebastian Dröge 3b4c48d9f5 Fix various new clippy warnings 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1062>
 2023-01-25 10:31:19 +02:00
Sebastian Dröge ee8249eec7 fmp4mux: Don't write the first sample flags into any trun but the first 
The flags are based on the first sample of this fragment so writing it
into any trun but the first is not very useful.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1060>
 2023-01-24 19:54:12 +02:00
Sebastian Dröge 1ceaea844a fmp4mux: Fix decision whether per-sample flags are needed in the trun 
Previously it would never use per-sample flags if any later sample
needed different flags than the first two.

Also comment the code a bit better.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1060>
 2023-01-24 19:54:11 +02:00
Sebastian Dröge 458b2386ed Update for glib API changes 2023-01-21 18:13:48 +02:00
Sebastian Dröge 6132788b02 Update for caps/structure-related string API changes 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1048>
 2023-01-15 22:58:44 +02:00
Sebastian Dröge e9bbf804ba fmp4mux: Remove obsolete comment 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1037>
 2023-01-06 14:52:56 +02:00
Sebastian Dröge af9d9c0a5c fmp4: Fix compilation after glib::List API changes 2023-01-02 19:22:51 +02:00
Johan Bjäreholt 71c268da14 fmp4mux: Only push fragment_offset if write_mfra is true 
This is done so that the fragment_offset vector does not infinitely
build up when write_mfra is disabled.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1023>
 2022-12-22 10:31:27 +01:00
Sebastian Dröge 13b6f8fad4 fmp4mux: Skip gap buffers earlier to consider them for the sample durations and fragment start durations 
Otherwise dropping the gap buffers would offset the timestamps of
following samples.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1016>
 2022-12-16 17:43:44 +02:00
Sebastian Dröge e344585d99 mp4mux: Adjust durations and possibly stream start time on encountering a gap buffer 
If there was a previous sample in this stream then its duration needs to
be extended by the gap position, and if there was none then the start
time of the whole stream has to be shifted by the duration.

Not doing so causes timestamps to be offset wrongly by the duration of
the gap.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1015>
 2022-12-16 13:24:21 +02:00
Sebastian Dröge 9307acf7fa mp4mux: Fix edit list shift for streams with initial DTS smaller earliest PTS but initial DTS positive 
This would be a stream where the initial DTS is negative if the initial
PTS was zero, but it is offset so the initial DTS became positive now.
The edit list shift has to happen exactly the same way though.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1014>
 2022-12-15 18:52:47 +02:00
Sebastian Dröge ed429d570e mp4mux: Don't write gap edit lists if their duration would be zero 
The track might start later than the earliest track by less than one
timescale units, in which case writing an empty gap edit list would be
useless and confusing.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1014>
 2022-12-15 18:45:19 +02:00
Sebastian Dröge f8024f072f mp4mux: Don't write empty chunks at the end if the last buffer of a stream started a new chunk and happened to be a from a gap event 
Empty chunks are not valid in MP4.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1014>
 2022-12-15 17:44:03 +02:00
Sebastian Dröge 3f904553ea Fix various new clippy warnings 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1011>
 2022-12-13 11:43:16 +02:00
Sebastian Dröge 3172bcd095 fmp4mux: Crank clock for the first fragment in more tests 
Due to how aggregator works, it depends on how buffers are pulled
whether aggregate() is called again or it is waiting for a timeout or EOS:

works:
  - pad 1: 4 buffers, pad 2: 4 buffers
  - aggregate ready: take all 4/4 buffers
  - pad 1: 1 buffers, pad 2: 1 buffer
  - aggregate ready: take all 1/1 buffers

waits:
  - pad 1: 5 buffers, pad 2: 4 buffers
  - aggregate ready: take all 5/4 buffers
  - pad 1: 0 buffers, pad 2: 1 buffer
  - aggregate not ready: waiting for timeout or EOS

Also don't manually set the clock time as that's unnecessary.

Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/274

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/998>
 2022-12-03 18:21:19 +00:00
Jordan Petridis a84eeeb240 mux/{mp4, fmp4}: Hard depend on feature v1_18 
Else --no-default-features was failing to compile.

v1_18 is needed to for the aggregator code.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/588>
 2022-11-29 21:06:12 +02:00
Sebastian Dröge 1fcbc346bc fmp4mux: examples: Avoid unnecessary caps copies 2022-11-22 10:39:47 +02:00
Sebastian Dröge 6b3bb2c747 fmp4mux: Handle EOS correctly if it happens before a fragment start time was determined 
Whatever earliest time we have at that point is going to be the start
time.

Also handle the case correctly where all inputs are EOS before any
buffers were received at all.

Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/270

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/982>
 2022-11-19 19:24:43 +02:00
Sebastian Dröge e3f645af19 fmp4mux: Don't overflow negative composition offset calculation 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/982>
 2022-11-19 19:24:04 +02:00
Sebastian Dröge ae4b49c668 mp4mux: For video with N/1001 framerates use N as timescale 
See https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3049

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/981>
 2022-11-18 16:10:10 +02:00
Sebastian Dröge fd910cb828 fmp4mux: For video with N/1001 framerates use N as timescale 
See https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3049

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/981>
 2022-11-18 16:07:11 +02:00
Sebastian Dröge c553ac7402 fmp4mux: Re-work buffer dequeueing and calculations of timestamps 
Especially simplify calculation of ONVIF UTC times. As a side-effect
this reduces the number of times the running times of a buffer are
calculated, and also causes streams to be interleaved correctly in ONVIF
mode if there is a non-constant UTC-to-running-time difference.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/979>
 2022-11-18 15:00:00 +02:00
Sebastian Dröge 3003987c3a mp4mux: Make use of i64::TryFrom<gst::Signed<u64>> impl 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/979>
 2022-11-18 12:26:18 +02:00
Sebastian Dröge 9903d536b5 mp4mux: Factor out running time to UTC time calculation into a function 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/979>
 2022-11-18 12:21:25 +02:00
Sebastian Dröge aa7fd34097 mp4mux: Remove unnecessary error case of negative PTS when doing the ONVIF UTC time calculations 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/979>
 2022-11-18 12:21:25 +02:00
Sebastian Dröge 4d310434ab mp4mux: Skip gap buffers instead of writing empty samples 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/974>
 2022-11-10 12:59:53 +02:00
Sebastian Dröge 2b4fd40d62 mp4: Add ONVIF non-fragmented MP4 muxer 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/974>
 2022-11-10 12:59:53 +02:00
Sebastian Dröge 97bb327b2a mp4: Remove unneeded cast in tests 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/974>
 2022-11-10 12:44:46 +02:00
Sebastian Dröge 10d8cc21e6 mp4: Update to url 2 2022-11-09 09:15:50 +02:00
Sebastian Dröge c2f403f998 gst-plugin-mp4: Add new MP4 plugin with a non-fragmented MP4 muxer 2022-11-08 19:08:47 +02:00
Sebastian Dröge f062b7cf0d fmp4mux: Make media/trak timescales configurable 
And refactor a bit of code for easier extensibility.
 2022-11-07 18:06:29 +00:00
Sebastian Dröge 7ac29827d2 fmp4mux: Don't allow VP9 for CMAF 
This would require setting the correct compatible band for VP9 in CMAF,
which is not implemented yet.
 2022-11-03 16:53:01 +02:00
Sebastian Dröge 6706f3a4b4 fmp4mux: Add initial Opus support 
Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/239
 2022-11-03 16:53:01 +02:00
Sebastian Dröge a8250abbf1 Fix various new clippy warnings 2022-11-01 10:27:48 +02:00
Sebastian Dröge 31d4ba2eae fmp4mux: For VP9, write resolution into the tkhd and include a stss box to signal that not all frames are sync samples 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/957>
 2022-10-31 15:20:19 +02:00
Sebastian Dröge 7106b0484d fmp4mux: Remove unused uuid dependency 2022-10-28 12:45:42 +03:00
Sebastian Dröge 938f4e4f1c fmp4mux: Clip negative PTS to zero/last PTS instead of erroring out 
This can happen at the beginning of a stream if upstream is
rtpjitterbuffer and it has problems figuring out timestamps in the
beginning due to resetting / skew.
 2022-10-27 14:47:16 +03:00
Sebastian Dröge 627bf756b1 fmp4mux: Send force-keyunit events for now if the ideal position has already passed 2022-10-27 12:53:09 +03:00
Sebastian Dröge a56435801d fmp4mux: Add debug log when writing the mfra box 2022-10-26 17:22:20 +00:00
Sebastian Dröge 27fac33c44 fmp4mux: Reset timing infos to None if a stream only contained gap events for a whole fragment 2022-10-26 17:22:20 +00:00
Sebastian Dröge cab4cd3b8c fmp4mux: If a stream is longer than the main stream at EOS, simply include all of its buffers in the last fragment nonetheless 2022-10-26 17:22:20 +00:00
Matthew Waters d067fb2ec8 fmp4mux: don't require dts for predictive-only formats like vp9 2022-10-26 11:42:13 +00:00
Matthew Waters 8c8384c711 fmp4: add support for muxing VP9 streams in cmaf, dash and iso fmp4 
As specified in https://www.webmproject.org/vp9/mp4/
 2022-10-25 18:33:42 +11:00
Sebastian Dröge f2223cf2cb Update versions to 0.10.0-alpha.1 2022-10-24 19:31:19 +03:00
Sebastian Dröge 9a68f6e221 Move from imp.instance() to imp.obj() 
It's doing the same thing and is shorter.
 2022-10-23 23:08:46 +03:00
François Laignel 86776be58c Remove & for obj in log macros 
This is no longer necessary.

See https://gitlab.freedesktop.org/gstreamer/gstreamer-rs/-/merge_requests/1137
 2022-10-23 21:22:31 +02:00
Sebastian Dröge f045099fc1 Fix GObject type names, GStreamer debug category names and element factory names 
Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/198
 2022-10-23 20:46:08 +03:00
Sebastian Dröge 211cd095d6 Add new mux subdirectory for container formats 
Contains the (incomplete) flavors FLV demuxer and the fragmented MP4
muxer for now.

Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/issues/173
 2022-10-23 20:25:08 +03:00