mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-06 17:39:47 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/subprojects/gst-plugins-good/gst/multifile/gstsplitmuxsink.h

242 lines
6.8 KiB
C
Raw Normal View History

splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
/* GStreamer split muxer bin
splitmuxsink: add the ability to mux auxilliary video streams The primary video stream is used to select fragment cut points at keyframe boundaries. Auxilliary video streams may be broken up at any packet - so fragments may not start with a keyframe for those streams.
2019-05-25 12:08:05 +00:00
* Copyright (C) 2014-2019 Jan Schmidt <jan@centricular.com>
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Library General Public
* License as published by the Free Software Foundation; either
* version 2 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Library General Public License for more details.
*
* You should have received a copy of the GNU Library General Public
* License along with this library; if not, write to the
* Free Software Foundation, Inc., 51 Franklin St, Fifth Floor,
* Boston, MA 02110-1301, USA.
*/
#ifndef __GST_SPLITMUXSINK_H__
#define __GST_SPLITMUXSINK_H__
#include <gst/gst.h>
#include <gst/pbutils/pbutils.h>
splitmuxsink: Added a split-at-running-time action signal The video file can now be split at an arbitrary time, given by the user as an argument to the action signal. https://bugzilla.gnome.org/show_bug.cgi?id=787922
2018-09-26 14:43:05 +00:00
#include <gst/base/base.h>
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
G_BEGIN_DECLS
#define GST_TYPE_SPLITMUX_SINK (gst_splitmux_sink_get_type())
#define GST_SPLITMUX_SINK(obj) (G_TYPE_CHECK_INSTANCE_CAST((obj),GST_TYPE_SPLITMUX_SINK,GstSplitMuxSink))
#define GST_SPLITMUX_SINK_CLASS(klass) (G_TYPE_CHECK_CLASS_CAST((klass),GST_TYPE_SPLITMUX_SINK,GstSplitMuxSinkClass))
#define GST_IS_SPLITMUX_SINK(obj) (G_TYPE_CHECK_INSTANCE_TYPE((obj),GST_TYPE_SPLITMUX_SINK))
#define GST_IS_SPLITMUX_SINK_CLASS(klass) (G_TYPE_CHECK_CLASS_TYPE((klass),GST_TYPE_SPLITMUX_SINK))
typedef struct _GstSplitMuxSink GstSplitMuxSink;
typedef struct _GstSplitMuxSinkClass GstSplitMuxSinkClass;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
GType gst_splitmux_sink_get_type (void);
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
typedef enum _SplitMuxInputState
{
SPLITMUX_INPUT_STATE_STOPPED,
SPLITMUX_INPUT_STATE_COLLECTING_GOP_START, /* Waiting for the next ref ctx keyframe */
SPLITMUX_INPUT_STATE_WAITING_GOP_COLLECT, /* Waiting for all streams to collect GOP */
SPLITMUX_INPUT_STATE_FINISHING_UP /* Got EOS from reference ctx, send everything */
} SplitMuxInputState;
typedef enum _SplitMuxOutputState
{
SPLITMUX_OUTPUT_STATE_STOPPED,
SPLITMUX_OUTPUT_STATE_AWAITING_COMMAND, /* Waiting first command packet from input */
SPLITMUX_OUTPUT_STATE_OUTPUT_GOP, /* Outputting a collected GOP */
SPLITMUX_OUTPUT_STATE_ENDING_FILE, /* Finishing the current fragment */
splitmuxsink: Change EOS catching logic. Add a new state for ending the overall stream, and use it to decide whether to pass the final EOS message up the bus instead of dropping it. Fixes a small race that makes the testsuite sometimes not generate the last fragment(s) sometimes because the wrong EOS gets allowed through too early. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/798>
2020-10-31 01:49:08 +00:00
SPLITMUX_OUTPUT_STATE_ENDING_STREAM, /* Finishing up the entire stream due to input EOS */
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
SPLITMUX_OUTPUT_STATE_START_NEXT_FILE /* Restarting after ENDING_FILE */
} SplitMuxOutputState;
typedef struct _SplitMuxOutputCommand
{
gboolean start_new_fragment; /* Whether to start a new fragment before advancing output ts */
GstClockTimeDiff max_output_ts; /* Set the limit to stop GOP output */
} SplitMuxOutputCommand;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
typedef struct _MqStreamBuf
{
gboolean keyframe;
splitmuxsink: Handle negative running time Use signed clock times for running time everywhere so that we handle negative running times without going haywire, similar to what queue and multiqueue do these days.
2016-07-17 12:41:02 +00:00
GstClockTimeDiff run_ts;
Fixed splitmuxsink 32-bit overflow bug Extend the byte tracking counters to 64-bit on all platforms, instead of using gsize, which overflows after 4GB. https://bugzilla.gnome.org/show_bug.cgi?id=770019
2016-08-20 08:59:30 +00:00
guint64 buf_size;
splitmuxsink: Add option to split at exactly max-size-time Will try to request a keyframe from the encoder to be sent at the target running time. https://bugzilla.gnome.org/show_bug.cgi?id=769664
2016-08-09 09:55:59 +00:00
GstClockTime duration;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
} MqStreamBuf;
splitmuxsink: Keep track of the pending input GOPs in a queue This cleans up input GOP handling and makes it possible to handle more than 2 pending GOPs, which could happen before if keyframes are arriving with too short of a distance between them. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-21 10:37:35 +00:00
typedef struct {
/* For the very first GOP if it was created from a GAP event */
gboolean from_gap;
/* Minimum start time (PTS or DTS) of the GOP */
GstClockTimeDiff start_time;
/* Start time (PTS) of the GOP */
GstClockTimeDiff start_time_pts;
/* Minimum start timecode of the GOP */
GstVideoTimeCode *start_tc;
/* Number of bytes we've collected into the GOP */
guint64 total_bytes;
/* Number of bytes from the reference context
* that we've collected into the GOP */
guint64 reference_bytes;
gboolean sent_fku;
} InputGop;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
typedef struct _MqStreamCtx
{
GstSplitMuxSink *splitmux;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
guint q_overrun_id;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
guint sink_pad_block_id;
guint src_pad_block_id;
splitmuxsink: Added new async-finalize mode This mode is useful for muxers that can take a long time to finalize a file. Instead of blocking the whole upstream pipeline while the muxer is doing its stuff, we can unlink it and spawn a new muxer+sink combination to continue running normally. This requires us to receive the muxer and sink (if needed) as factories, optionally accompanied by their respective properties structures. Also added the muxer-added and sink-added signals, in case custom code has to be called for them. https://bugzilla.gnome.org/show_bug.cgi?id=783754
2017-06-13 14:42:55 +00:00
gulong fragment_block_id;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
splitmuxsink: allow non-video streams to serve as reference In the absence of a video stream, the first stream will be used as reference. https://bugzilla.gnome.org/show_bug.cgi?id=753617
2015-04-29 17:23:28 +00:00
gboolean is_reference;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
gboolean flushing;
gboolean in_eos;
gboolean out_eos;
splitmuxsink: Added new async-finalize mode This mode is useful for muxers that can take a long time to finalize a file. Instead of blocking the whole upstream pipeline while the muxer is doing its stuff, we can unlink it and spawn a new muxer+sink combination to continue running normally. This requires us to receive the muxer and sink (if needed) as factories, optionally accompanied by their respective properties structures. Also added the muxer-added and sink-added signals, in case custom code has to be called for them. https://bugzilla.gnome.org/show_bug.cgi?id=783754
2017-06-13 14:42:55 +00:00
gboolean out_eos_async_done;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
gboolean need_unblock;
splitmuxsink: Change files on incompatible caps https://bugzilla.gnome.org/show_bug.cgi?id=761761
2017-02-15 19:48:58 +00:00
gboolean caps_change;
splitmuxsink: Avoid deadlock when releasing a pad from a running muxer Might not drain correctly Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/838>
2020-12-10 12:27:49 +00:00
gboolean is_releasing;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GstSegment in_segment;
GstSegment out_segment;
splitmuxsink: Handle negative running time Use signed clock times for running time everywhere so that we handle negative running times without going haywire, similar to what queue and multiqueue do these days.
2016-07-17 12:41:02 +00:00
GstClockTimeDiff in_running_time;
GstClockTimeDiff out_running_time;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
GstElement *q;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GQueue queued_bufs;
GstPad *sinkpad;
GstPad *srcpad;
splitmuxsink: Add option for timecode-based split If this option is given, it will calculate the next split point based on timecode difference. https://bugzilla.gnome.org/show_bug.cgi?id=774209
2016-12-22 15:40:40 +00:00
GstBuffer *cur_out_buffer;
splitmuxsink: Add format-location-full signal Add a new signal for formatting the filename, which receives a GstSample containing the first buffer from the reference stream that will be muxed into that file. Useful for creating filenames that are based on the running time or other attributes of the buffer. To make it work, opening of files and setting filenames is now deferred until there is some data to write to it, which also requires some changes to how async state changes and gap events are handled.
2016-11-17 12:40:27 +00:00
GstEvent *pending_gap;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
} MqStreamCtx;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
struct _GstSplitMuxSink
{
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GstBin parent;
splitmuxsink: Don't use the element state lock Using the element state lock to avoid splitmuxsink shutting down while doing element manipulations can lead to a deadlock on shutdown if a fragment switch happens at exactly the wrong moment. Use a private mutex and a shutdown boolean instead. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/798>
2020-10-30 15:19:07 +00:00
GMutex state_lock;
gboolean shutdown;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GMutex lock;
splitmuxsink: Don't use the element state lock Using the element state lock to avoid splitmuxsink shutting down while doing element manipulations can lead to a deadlock on shutdown if a fragment switch happens at exactly the wrong moment. Use a private mutex and a shutdown boolean instead. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/798>
2020-10-30 15:19:07 +00:00
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
GCond input_cond;
GCond output_cond;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
gdouble mux_overhead;
GstClockTime threshold_time;
guint64 threshold_bytes;
splitmuxsink: Add max_files_number property https://bugzilla.gnome.org/show_bug.cgi?id=744612
2016-04-13 17:45:07 +00:00
guint max_files;
splitmuxsink: Add option to split at exactly max-size-time Will try to request a keyframe from the encoder to be sent at the target running time. https://bugzilla.gnome.org/show_bug.cgi?id=769664
2016-08-09 09:55:59 +00:00
gboolean send_keyframe_requests;
splitmuxsink: Add option for timecode-based split If this option is given, it will calculate the next split point based on timecode difference. https://bugzilla.gnome.org/show_bug.cgi?id=774209
2016-12-22 15:40:40 +00:00
gchar *threshold_timecode_str;
splitmuxsink: Take account queued time and max-size-timecode for split decision Not only the requested keyframe time, the queued size should be a criterion for the split decision of timecode based mode (same as max-size-time based split case).
2020-03-24 04:45:00 +00:00
/* created from threshold_timecode_str */
GstVideoTimeCodeInterval *tc_interval;
splitmuxsink: Add alignment-threshold argument If a non-reference stream is behind the reference stream by an amount of time smaller than the alignment threshold (in nsec), it counts as being after it. https://bugzilla.gnome.org/show_bug.cgi?id=782563
2017-05-12 14:53:57 +00:00
GstClockTime alignment_threshold;
splitmuxsink: Don't send too many force key unit event splitmuxsink should requst keyframe depending on configured threshold and previously requested time in order to avoid too many keyframe request.
2020-04-03 04:45:56 +00:00
/* expected running time of next force keyframe unit event */
GstClockTime next_fku_time;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
splitmuxsink: Add new reset-muxer property With this the muxer is not set to NULL after each segment but instead only flush events are sent to it to reset the EOS state. As a result, the muxer will keep stream state and e.g. mpegtsmux will keep the packet continuity counter continuous between segments as needed by hlssink2. https://bugzilla.gnome.org/show_bug.cgi?id=794816
2018-03-29 16:19:21 +00:00
gboolean reset_muxer;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GstElement *muxer;
GstElement *sink;
GstElement *provided_muxer;
GstElement *provided_sink;
GstElement *active_sink;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
gboolean ready_for_output;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
gchar *location;
guint fragment_id;
splitmuxsink: provides a start-index property Allow to change the fragment-id start index.
2019-12-05 14:58:40 +00:00
guint start_index;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GList *contexts;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
SplitMuxInputState input_state;
splitmuxsink: Handle negative running time Use signed clock times for running time everywhere so that we handle negative running times without going haywire, similar to what queue and multiqueue do these days.
2016-07-17 12:41:02 +00:00
GstClockTimeDiff max_in_running_time;
splitmuxsink: Keep track of the pending input GOPs in a queue This cleans up input GOP handling and makes it possible to handle more than 2 pending GOPs, which could happen before if keyframes are arriving with too short of a distance between them. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-21 10:37:35 +00:00
GstClockTimeDiff max_in_running_time_dts;
splitmuxsink: Handle frame reordering due to B frames better Instead of assuming that the PTS of a keyframe is the lowest PTS of a GOP, wait until the DTS has passed this PTS and take the minimum PTS up to that point. That way the minimum PTS of a GOP can be determined, at least for closed GOP streams. Open GOP streams still can't be handled properly. By knowing the minimum PTS of each GOP, keyframes can be requested at the correct time relative to the GOP (and thus fragment) start and fragment overflow calculations can calculate the correct durations of the GOPs. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-16 16:36:27 +00:00
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
/* Number of bytes sent to the
* current fragment */
guint64 fragment_total_bytes;
splitmuxsink: Never start a new fragment with no reference buffers If there has been no bytes from the reference stream muxed into the current fragment, then time can't have advanced, there's no GOP... this fragment would be broken or empty, so wait for some data on the reference buffer. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/798>
2020-09-17 12:56:01 +00:00
/* Number of bytes for the reference
* stream in this fragment */
guint64 fragment_reference_bytes;
splitmuxsink: Handle frame reordering due to B frames better Instead of assuming that the PTS of a keyframe is the lowest PTS of a GOP, wait until the DTS has passed this PTS and take the minimum PTS up to that point. That way the minimum PTS of a GOP can be determined, at least for closed GOP streams. Open GOP streams still can't be handled properly. By knowing the minimum PTS of each GOP, keyframes can be requested at the correct time relative to the GOP (and thus fragment) start and fragment overflow calculations can calculate the correct durations of the GOPs. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-16 16:36:27 +00:00
/* Minimum start time (PTS or DTS) of the current fragment */
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
GstClockTimeDiff fragment_start_time;
splitmuxsink: Handle frame reordering due to B frames better Instead of assuming that the PTS of a keyframe is the lowest PTS of a GOP, wait until the DTS has passed this PTS and take the minimum PTS up to that point. That way the minimum PTS of a GOP can be determined, at least for closed GOP streams. Open GOP streams still can't be handled properly. By knowing the minimum PTS of each GOP, keyframes can be requested at the correct time relative to the GOP (and thus fragment) start and fragment overflow calculations can calculate the correct durations of the GOPs. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-16 16:36:27 +00:00
/* Start time (PTS) of the current fragment */
GstClockTimeDiff fragment_start_time_pts;
/* Minimum start timecode of the current fragment */
splitmuxsink: Enhancement for timecode based split The calculated threshold for timecode might be varying depending on "max-size-timecode" and framerate. For instance, with framerate 29.97 (30000/1001) and "max-size-timecode=00:02:00;02", every fragment will have identical number of frames 3598. However, when "max-size-timecode=00:02:00;00", calculated next keyframe via gst_video_time_code_add_interval() can be different per fragment, but this is the nature of timecode. To compensate such timecode drift, we should keep track of expected timecode of next fragment based on observed timecode.
2020-04-10 14:52:45 +00:00
GstVideoTimeCode *fragment_start_tc;
splitmuxsink: Handle frame reordering due to B frames better Instead of assuming that the PTS of a keyframe is the lowest PTS of a GOP, wait until the DTS has passed this PTS and take the minimum PTS up to that point. That way the minimum PTS of a GOP can be determined, at least for closed GOP streams. Open GOP streams still can't be handled properly. By knowing the minimum PTS of each GOP, keyframes can be requested at the correct time relative to the GOP (and thus fragment) start and fragment overflow calculations can calculate the correct durations of the GOPs. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-16 16:36:27 +00:00
splitmuxsink: Keep track of the pending input GOPs in a queue This cleans up input GOP handling and makes it possible to handle more than 2 pending GOPs, which could happen before if keyframes are arriving with too short of a distance between them. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-21 10:37:35 +00:00
/* Oldest GOP at head, newest GOP at tail */
GQueue pending_input_gops;
splitmuxsink: Handle frame reordering due to B frames better Instead of assuming that the PTS of a keyframe is the lowest PTS of a GOP, wait until the DTS has passed this PTS and take the minimum PTS up to that point. That way the minimum PTS of a GOP can be determined, at least for closed GOP streams. Open GOP streams still can't be handled properly. By knowing the minimum PTS of each GOP, keyframes can be requested at the correct time relative to the GOP (and thus fragment) start and fragment overflow calculations can calculate the correct durations of the GOPs. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1005>
2021-09-16 16:36:27 +00:00
splitmuxsink: Enhancement for timecode based split The calculated threshold for timecode might be varying depending on "max-size-timecode" and framerate. For instance, with framerate 29.97 (30000/1001) and "max-size-timecode=00:02:00;02", every fragment will have identical number of frames 3598. However, when "max-size-timecode=00:02:00;00", calculated next keyframe via gst_video_time_code_add_interval() can be different per fragment, but this is the nature of timecode. To compensate such timecode drift, we should keep track of expected timecode of next fragment based on observed timecode.
2020-04-10 14:52:45 +00:00
/* expected running time of next fragment in timecode mode */
GstClockTime next_fragment_start_tc_time;
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
GQueue out_cmd_q; /* Queue of commands for output thread */
SplitMuxOutputState output_state;
splitmuxsink: Handle negative running time Use signed clock times for running time everywhere so that we handle negative running times without going haywire, similar to what queue and multiqueue do these days.
2016-07-17 12:41:02 +00:00
GstClockTimeDiff max_out_running_time;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
Fixed splitmuxsink 32-bit overflow bug Extend the byte tracking counters to 64-bit on all platforms, instead of using gsize, which overflows after 4GB. https://bugzilla.gnome.org/show_bug.cgi?id=770019
2016-08-20 08:59:30 +00:00
guint64 muxed_out_bytes;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
MqStreamCtx *reference_ctx;
/* Count of queued keyframes in the reference ctx */
guint queued_keyframes;
splitmuxsink: post messages when fragments are being opened and closed This can be useful for applications that need to track the created fragments (to log them in a recording database, for example) https://bugzilla.gnome.org/show_bug.cgi?id=750108
2015-04-17 12:25:43 +00:00
Revert "splitmuxsink: Use GstBin async-handling instead of our own." This reverts commit fa008f271a52f82dededc28bd81b020ca7939b47. async-handling in GstBin causes the pipeline to spin at 100% CPU as the top-level pipeline tries to change that state to PLAYING constantly. This is a workaround for a core problem, essentially, but an improvement in this case for now.
2016-08-07 16:53:48 +00:00
gboolean switching_fragment;
splitmuxsink: Only allow one video request pad The pacing of the overall muxing is controlled by the video GOPs arriving, so we can only handle 1 video stream, and the request pad is named accordingly. Ignore a request for a 2nd video pad if there's already an active one.
2016-10-26 03:32:48 +00:00
gboolean have_video;
splitmuxsink: Add format-location-full signal Add a new signal for formatting the filename, which receives a GstSample containing the first buffer from the reference stream that will be muxed into that file. Useful for creating filenames that are based on the running time or other attributes of the buffer. To make it work, opening of files and setting filenames is now deferred until there is some data to write to it, which also requires some changes to how async state changes and gap events are handled.
2016-11-17 12:40:27 +00:00
gboolean need_async_start;
gboolean async_pending;
splitmuxsink: Use muxer reserved space properties if present. If the use-robust-muxing property is set, check if the assigned muxer has reserved-max-duration and reserved-duration-remaining properties, and if so set the configured maximum duration to the reserved-max-duration property, and monitor the remaining space to start a new file if the reserved header space is about to run out - even though it never ought to.
2015-04-07 13:53:19 +00:00
gboolean use_robust_muxing;
gboolean muxer_has_reserved_props;
splitmuxsink: added a "split now" action signal Now, the video file can be split at an arbitrary time chosen by the user. https://bugzilla.gnome.org/show_bug.cgi?id=787922
2017-09-21 15:23:54 +00:00
splitmuxsink: Implement split-after The behaviour of split-now is to output the current GOP after starting a new file. The newly-added split-after signal will output the current GOP to the old file if possible once a new GOP is opened. https://bugzilla.gnome.org/show_bug.cgi?id=796982
2018-08-16 19:42:37 +00:00
gboolean split_requested;
gboolean do_split_next_gop;
splitmuxsink: Added a split-at-running-time action signal The video file can now be split at an arbitrary time, given by the user as an argument to the action signal. https://bugzilla.gnome.org/show_bug.cgi?id=787922
2018-09-26 14:43:05 +00:00
GstQueueArray *times_to_split;
splitmuxsink: Added new async-finalize mode This mode is useful for muxers that can take a long time to finalize a file. Instead of blocking the whole upstream pipeline while the muxer is doing its stuff, we can unlink it and spawn a new muxer+sink combination to continue running normally. This requires us to receive the muxer and sink (if needed) as factories, optionally accompanied by their respective properties structures. Also added the muxer-added and sink-added signals, in case custom code has to be called for them. https://bugzilla.gnome.org/show_bug.cgi?id=783754
2017-06-13 14:42:55 +00:00
/* Async finalize options */
gboolean async_finalize;
gchar *muxer_factory;
splitmuxsink: Add new properties for setting muxer/sink presets Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/644>
2020-06-25 09:58:48 +00:00
gchar *muxer_preset;
splitmuxsink: Added new async-finalize mode This mode is useful for muxers that can take a long time to finalize a file. Instead of blocking the whole upstream pipeline while the muxer is doing its stuff, we can unlink it and spawn a new muxer+sink combination to continue running normally. This requires us to receive the muxer and sink (if needed) as factories, optionally accompanied by their respective properties structures. Also added the muxer-added and sink-added signals, in case custom code has to be called for them. https://bugzilla.gnome.org/show_bug.cgi?id=783754
2017-06-13 14:42:55 +00:00
GstStructure *muxer_properties;
gchar *sink_factory;
splitmuxsink: Add new properties for setting muxer/sink presets Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/644>
2020-06-25 09:58:48 +00:00
gchar *sink_preset;
splitmuxsink: Added new async-finalize mode This mode is useful for muxers that can take a long time to finalize a file. Instead of blocking the whole upstream pipeline while the muxer is doing its stuff, we can unlink it and spawn a new muxer+sink combination to continue running normally. This requires us to receive the muxer and sink (if needed) as factories, optionally accompanied by their respective properties structures. Also added the muxer-added and sink-added signals, in case custom code has to be called for them. https://bugzilla.gnome.org/show_bug.cgi?id=783754
2017-06-13 14:42:55 +00:00
GstStructure *sink_properties;
splitmux: Add muxer-pad-map property Add a property which explicitly maps splitmuxsink pads to the muxer pads they should connect to, overriding the implicit logic that tries to match pads but yields arbitrary names.
2019-07-31 06:17:36 +00:00
GstStructure *muxerpad_map;
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
};
splitmux: Rewrite buffer collection and scheduling Majorly change the way that splitmuxsink collects incoming data and sends it to the output, so that it makes all decisions about when / where to split files on the input side. Use separate queues for each stream, so they can be grown individually and kept as small as possible. This removes raciness I observed where sometimes some data would end up put in a different output file over multiple runs with the same input. Also fixes hangs with input queues getting full and causing muxing to stall out.
2016-11-18 11:42:18 +00:00
struct _GstSplitMuxSinkClass
{
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
GstBinClass parent_class;
splitmuxsink: added a "split now" action signal Now, the video file can be split at an arbitrary time chosen by the user. https://bugzilla.gnome.org/show_bug.cgi?id=787922
2017-09-21 15:23:54 +00:00
/* actions */
void (*split_now) (GstSplitMuxSink * splitmux);
splitmuxsink: Implement split-after The behaviour of split-now is to output the current GOP after starting a new file. The newly-added split-after signal will output the current GOP to the old file if possible once a new GOP is opened. https://bugzilla.gnome.org/show_bug.cgi?id=796982
2018-08-16 19:42:37 +00:00
void (*split_after) (GstSplitMuxSink * splitmux);
splitmuxsink: Added a split-at-running-time action signal The video file can now be split at an arbitrary time, given by the user as an argument to the action signal. https://bugzilla.gnome.org/show_bug.cgi?id=787922
2018-09-26 14:43:05 +00:00
void (*split_at_running_time) (GstSplitMuxSink * splitmux, GstClockTime split_time);
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
};
multifile: allow per feature registration Split plugin into features including dynamic types which can be indiviually registered during a static build. More details here: https://gitlab.freedesktop.org/gstreamer/gst-build/-/merge_requests/199 https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/661 Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/-/merge_requests/876>
2021-02-16 11:04:26 +00:00
GST_ELEMENT_REGISTER_DECLARE (splitmuxsink);
splitmux: Implement new elements for splitting files at mux level. Implement 2 new elements - splitmuxsink and splitmuxsrc. splitmuxsink is a bin which wraps a muxer and takes 1 video stream, plus audio/subtitle streams, and starts a new file whenever necessary to avoid overrunning a threshold of either bytes or time. New files are started at a keyframe, and corresponding audio and subtitle streams are split at packet boundaries to match video GOP timestamps. splitmuxsrc is a corresponding source element which handles the splitmux:// URL and plays back all component files, reconstructing the original elementary streams as it goes.
2014-07-31 14:07:53 +00:00
G_END_DECLS
#endif /* __GST_SPLITMUXSINK_H__ */
Reference in a new issue Copy permalink