mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-27 04:01:08 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/subprojects/gst-plugins-bad/sys/msdk/gstmsdkdec.h

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

148 lines
4.7 KiB
C
Raw Normal View History

msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
/* GStreamer Intel MSDK plugin
* Copyright (c) 2016, Intel Corporation
* All rights reserved.
*
* Redistribution and use in source and binary forms, with or without
* modification, are permitted provided that the following conditions are met:
*
* 1. Redistributions of source code must retain the above copyright notice,
* this list of conditions and the following disclaimer.
*
* 2. Redistributions in binary form must reproduce the above copyright notice,
* this list of conditions and the following disclaimer in the documentation
* and/or other materials provided with the distribution.
*
* 3. Neither the name of the copyright holder nor the names of its contributors
* may be used to endorse or promote products derived from this software
* without specific prior written permission.
*
* THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO,
* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR
* CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
* EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
* PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS;
* OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,
* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE
* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE,
* EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
*/
#ifndef __GST_MSDKDEC_H__
#define __GST_MSDKDEC_H__
#include <gst/gst.h>
#include <gst/video/video.h>
#include "msdk.h"
msdk: implements GstMsdkContext. Makes GstMsdkContext to be a descendant of GstObject so that we could track the life-cycle of the session of the driver. Also replaces MsdkContext with this one. Keeps msdk_d3d.c alive for the future. https://bugzilla.gnome.org/show_bug.cgi?id=790752
2018-02-13 21:41:28 +00:00
#include "gstmsdkcontext.h"
msdkdec: move output-order out of decode bass class. Since output-order is a deprecated attribute, move it out of decode bass class and configure it in each sub decoder class who need it. https://bugzilla.gnome.org/show_bug.cgi?id=796853
2018-11-20 06:36:30 +00:00
#include "msdk-enums.h"
#include "gstmsdkdecproputil.h"
msdk: Move all _gst_caps_has_feature to gstmsdkcaps.c _gst_caps_has_feature is used by all msdk elements, so move it to gstmsdkcaps.c Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/4177>
2023-02-22 02:26:38 +00:00
#include "gstmsdkcaps.h"
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
G_BEGIN_DECLS
#define GST_TYPE_MSDKDEC \
(gst_msdkdec_get_type())
#define GST_MSDKDEC(obj) \
(G_TYPE_CHECK_INSTANCE_CAST((obj),GST_TYPE_MSDKDEC,GstMsdkDec))
#define GST_MSDKDEC_CLASS(klass) \
(G_TYPE_CHECK_CLASS_CAST((klass),GST_TYPE_MSDKDEC,GstMsdkDecClass))
#define GST_MSDKDEC_GET_CLASS(obj) \
(G_TYPE_INSTANCE_GET_CLASS((obj),GST_TYPE_MSDKDEC,GstMsdkDecClass))
#define GST_IS_MSDKDEC(obj) \
(G_TYPE_CHECK_INSTANCE_TYPE((obj),GST_TYPE_MSDKDEC))
#define GST_IS_MSDKDEC_CLASS(klass) \
(G_TYPE_CHECK_CLASS_TYPE((klass),GST_TYPE_MSDKDEC))
msdkdec: allow sub class to add extra parameters for additional configuration MSDK allows user add extended buffers to a bitstream for additional configuration. This commit is to support this feature in this plugin Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:02:50 +00:00
#define MAX_BS_EXTRA_PARAMS 8
msdkdec: Add SFC codes SFC refers to Scaler Format Converter, more details here: https://01.org/sites/default/files/documentation/intel-gfx-prm-osrc-kbl-vol15-sfc.pdf By attaching mfxExtDecVideoProcessing buffer to mfxVideoParam, decoder can do SFC for csc and scaling. MSDK will check if surface bitdepth equals to input when no SFC is triggered, which means in the case of SFC, there is no need to update surface bitdepth via gst_msdk_update_mfx_frame_info_from_mfx_video_param. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1444>
2021-11-17 09:05:09 +00:00
#define MAX_VIDEO_EXTRA_PARAMS 8
msdkdec: allow sub class to add extra parameters for additional configuration MSDK allows user add extended buffers to a bitstream for additional configuration. This commit is to support this feature in this plugin Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:02:50 +00:00
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
typedef struct _GstMsdkDec GstMsdkDec;
typedef struct _GstMsdkDecClass GstMsdkDecClass;
typedef struct _MsdkDecTask MsdkDecTask;
struct _GstMsdkDec
{
GstVideoDecoder element;
/* input description */
GstVideoCodecState *input_state;
msdk: dec: Add dynamic-configuration change support The patch adds a serios of changes to support dynamic resolution change and efficient utilization of resources. Major changes: -- Use MSDK's apis to retrieve the headers instead of only relying on upsteram notification. For eg: avc decoder requires SEI header information for dpb count calculation which we don't get from caps. -- For all codecs other than VP9, we force the reset of decoder if resoultion changes to fit with gstreamer flow. VP9 enfource the hard reset only if the new resolution is bigger. -- delay the src caps setting till msdk api's invokation in handle_frame to avoid caching multiple configuration values -- ensure pool negotiation is based on decoder's allocation_caps. --dynamic resoluttion change use an explicit allocation_query to reclaim the buffers before closing the decoder (thanks to v4l2dec) --In case if we don't get upstream notification of res change (for eg, this can can happen for vp9 frames with ivfheader where ivfparse is not able to notify the dynamic changes), we handle the the case based on MFX_ERR_INCOMPATIBLE_VIDEO_PARAM which is the return value of MFXVideoDECODE_DecodeFrameAsync -- calculate the minimum surfaces to be preallocated based on msdk suggestion, downstream requirement, async depth and scratch surface count for smooth display. https://bugzilla.gnome.org/show_bug.cgi?id=796566
2018-07-03 00:17:49 +00:00
/* aligned msdk pool info */
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
GstBufferPool *pool;
msdkdec: Add a function to directly allocate output GstMsdkSurface Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3439>
2022-08-22 10:33:35 +00:00
GstBufferPool *alloc_pool;
msdkdec: Add a function to create va pool Add a pool creation function name as 2 for later use which will create va pool for video memory in linux and keep system pool for windows. This gst_msdkdec_create_buffer_pool2 will replace gst_msdkdec_create_buffer_pool when all the memory allocation modifications are ready in the commits after. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3439>
2022-08-23 03:25:15 +00:00
GstBufferPool *other_pool;
msdk: dec: Add dynamic-configuration change support The patch adds a serios of changes to support dynamic resolution change and efficient utilization of resources. Major changes: -- Use MSDK's apis to retrieve the headers instead of only relying on upsteram notification. For eg: avc decoder requires SEI header information for dpb count calculation which we don't get from caps. -- For all codecs other than VP9, we force the reset of decoder if resoultion changes to fit with gstreamer flow. VP9 enfource the hard reset only if the new resolution is bigger. -- delay the src caps setting till msdk api's invokation in handle_frame to avoid caching multiple configuration values -- ensure pool negotiation is based on decoder's allocation_caps. --dynamic resoluttion change use an explicit allocation_query to reclaim the buffers before closing the decoder (thanks to v4l2dec) --In case if we don't get upstream notification of res change (for eg, this can can happen for vp9 frames with ivfheader where ivfparse is not able to notify the dynamic changes), we handle the the case based on MFX_ERR_INCOMPATIBLE_VIDEO_PARAM which is the return value of MFXVideoDECODE_DecodeFrameAsync -- calculate the minimum surfaces to be preallocated based on msdk suggestion, downstream requirement, async depth and scratch surface count for smooth display. https://bugzilla.gnome.org/show_bug.cgi?id=796566
2018-07-03 00:17:49 +00:00
/* downstream pool info based on allocation query */
GstVideoInfo non_msdk_pool_info;
msdkdec: use bufferpool 1\ In decide_allocation, it makes its own msdk bufferpool. - If downstream supports video meta, it just replace it with the msdk bufferpool. - If not, it uses the msdk bufferpool as a side pool, which will be decoded into. and will copy it to downstream's bufferpool. 2\ Decide if using video memory or system memory. - This is not completed in this patch. - It might be decided in update_src_caps. - But tested for both system memory and video memory cases. https://bugzilla.gnome.org/show_bug.cgi?id=790752
2018-02-13 22:49:28 +00:00
mfxFrameAllocResponse alloc_resp;
msdkdec: use dmabuf if possible https://bugzilla.gnome.org/show_bug.cgi?id=793707
2018-03-30 19:06:40 +00:00
gboolean use_dmabuf;
msdkdec: Add a function to create va pool Add a pool creation function name as 2 for later use which will create va pool for video memory in linux and keep system pool for windows. This gst_msdkdec_create_buffer_pool2 will replace gst_msdkdec_create_buffer_pool when all the memory allocation modifications are ready in the commits after. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3439>
2022-08-23 03:25:15 +00:00
gboolean do_copy;
msdkdec/enc: query GstContext to share GstMsdkContext How to share/create GstMsdkcontext is the following: - Search GstMsdkContext if there's in the pipeline. - If found, check if it's decoder, encoder or vpp by job type. - If it's same job type, it creates another instance of GstMsdkContext with joined-session. - Otherwise just use the shared GstMsdkContext. - If not found, just creates new instance of GstMsdkContext. https://bugzilla.gnome.org/show_bug.cgi?id=790752
2018-02-13 22:51:18 +00:00
gboolean initialized;
msdkdec: Add SFC codes SFC refers to Scaler Format Converter, more details here: https://01.org/sites/default/files/documentation/intel-gfx-prm-osrc-kbl-vol15-sfc.pdf By attaching mfxExtDecVideoProcessing buffer to mfxVideoParam, decoder can do SFC for csc and scaling. MSDK will check if surface bitdepth equals to input when no SFC is triggered, which means in the case of SFC, there is no need to update surface bitdepth via gst_msdk_update_mfx_frame_info_from_mfx_video_param. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1444>
2021-11-17 09:05:09 +00:00
gboolean sfc;
msdkdec: Apply the modified memory allocation logic We did several things to enable the new memory logic in msdkdec: (1) We always use video memory for decoder in linux path; (2) We give negotiated pool to alloc_pool stored in GstMsdkContext which will be used in callback mfxFrameAllocator:Alloc to alloc surfaces as MediaSDK needs, and this pool is also available for decoder itself; (3) We modify decide_allocation process, that is we make pool negotiaion before gst_msdk_init_decoder to ensure the pool is decided and ready for use in mfxFrameAllocator:Alloc callback; then we will consider the case when we need to do the gpu to cpu copy. (4) In gst_msdkdec_finish_task, we modify the way for copy following the logic in (3). Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3439>
2022-08-23 03:47:02 +00:00
gboolean ds_has_known_allocator;
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
msdk: dec: Add non-packetized stream handling support The gst-msdk decoders prefer packetized streams as input and in this case we can avoid unnecessary input bitstream copy to mfxBitstream. This works fine for codecs like h264 where we only support byte-stream with au alignment. Other format conversions should be done thorugh parsers. But this won't work for codecs like vc1 where we don't have an autoplugged parser. Even the parser is not capable to do format conversions. Packetizing through base decoders parse() routine will bring a lot of uncecessary of complexities and codecparser libraray dependency. So we just use an interal gst_adaper to keep track of bitstream which is not consumed by msdk durig AsynchronusDecoding. This adapter will get used only if subclass implementations set the "is_packetized" to FALSE for msdk base encoder. https://bugzilla.gnome.org/show_bug.cgi?id=792589
2018-02-13 23:41:20 +00:00
/* for packetization */
GstAdapter *adapter;
msdk: dec: Add dynamic-configuration change support The patch adds a serios of changes to support dynamic resolution change and efficient utilization of resources. Major changes: -- Use MSDK's apis to retrieve the headers instead of only relying on upsteram notification. For eg: avc decoder requires SEI header information for dpb count calculation which we don't get from caps. -- For all codecs other than VP9, we force the reset of decoder if resoultion changes to fit with gstreamer flow. VP9 enfource the hard reset only if the new resolution is bigger. -- delay the src caps setting till msdk api's invokation in handle_frame to avoid caching multiple configuration values -- ensure pool negotiation is based on decoder's allocation_caps. --dynamic resoluttion change use an explicit allocation_query to reclaim the buffers before closing the decoder (thanks to v4l2dec) --In case if we don't get upstream notification of res change (for eg, this can can happen for vp9 frames with ivfheader where ivfparse is not able to notify the dynamic changes), we handle the the case based on MFX_ERR_INCOMPATIBLE_VIDEO_PARAM which is the return value of MFXVideoDECODE_DecodeFrameAsync -- calculate the minimum surfaces to be preallocated based on msdk suggestion, downstream requirement, async depth and scratch surface count for smooth display. https://bugzilla.gnome.org/show_bug.cgi?id=796566
2018-07-03 00:17:49 +00:00
/* cap negotiation needed, allocation may or may not be required*/
gboolean do_renego;
/* re-allocation is mandatory if enabled */
gboolean do_realloc;
/* force reset on resolution change */
gboolean force_reset_on_res_change;
/* minimum number of buffers to be allocated, this should
* include downstream requirement, msdk suggestion and extra
* surface allocation for smooth display in render pipeline */
guint min_prealloc_buffers;
msdk: dec: Add non-packetized stream handling support The gst-msdk decoders prefer packetized streams as input and in this case we can avoid unnecessary input bitstream copy to mfxBitstream. This works fine for codecs like h264 where we only support byte-stream with au alignment. Other format conversions should be done thorugh parsers. But this won't work for codecs like vc1 where we don't have an autoplugged parser. Even the parser is not capable to do format conversions. Packetizing through base decoders parse() routine will bring a lot of uncecessary of complexities and codecparser libraray dependency. So we just use an interal gst_adaper to keep track of bitstream which is not consumed by msdk durig AsynchronusDecoding. This adapter will get used only if subclass implementations set the "is_packetized" to FALSE for msdk base encoder. https://bugzilla.gnome.org/show_bug.cgi?id=792589
2018-02-13 23:41:20 +00:00
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
/* MFX context */
msdk: implements GstMsdkContext. Makes GstMsdkContext to be a descendant of GstObject so that we could track the life-cycle of the session of the driver. Also replaces MsdkContext with this one. Keeps msdk_d3d.c alive for the future. https://bugzilla.gnome.org/show_bug.cgi?id=790752
2018-02-13 21:41:28 +00:00
GstMsdkContext *context;
msdk: Fix increasing memory usage in dynamic pipelines Our context is non-persistent, and we propagate it throughout the pipeline. This means that if we try to reuse any gstmsdk element by removing it from the pipeline and then re-adding it, we'll clone the mfxSession and create a new gstmsdk context as a child of the old one inside `gst_msdk_context_new_with_parent()`. Normally this only allocates a few KB inside the driver, but on Windows it seems to allocate tens of MBs which leads to linearly increasing memory usage for each PLAYING->NULL->PLAYING state cycle for the process. The contexts will only be freed when the pipeline itself goes to `NULL`, which would defeat the purpose of dynamic pipelines. Essentially, we need to optimize the case in which the element is removed from the pipeline and re-added and the same context is re-set on it. To detect that case, we set the context on `old_context`, and compare it to the new one when preparing the context. If they're the same, we don't need to do anything. Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/946
2020-01-17 05:37:47 +00:00
GstMsdkContext *old_context;
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
mfxVideoParam param;
GArray *tasks;
guint next_task;
msdkdec: hold a reference for the surfaces locked by msdk previous code releases GstBuffer too earlier. so we will see ERROR default gstmsdkvideomemory.c:77:gst_msdk_video_allocator_get_surface: failed to get surface available ERROR msdkbufferpool gstmsdkbufferpool.c:270:gst_msdk_buffer_pool_alloc_buffer:<msdkbufferpool0> failed to create new MSDK memory We need to hold GstBuffer reference for msdk if the surfaced locked by msdk. step to reproduce. 1. ffmpeg -f lavfi -i testsrc=duration=10:size=320x240:rate=30 -pix_fmt yuv420p -c:v libx265 test.265 2. GST_GL_PLATFORM=egl gst-launch-1.0 -v filesrc location=test.265 ! h265parse ! msdkh265dec ! queue ! glimagesink Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1277>
2020-05-14 03:03:49 +00:00
GList *locked_msdk_surfaces;
msdkdec: use bufferpool 1\ In decide_allocation, it makes its own msdk bufferpool. - If downstream supports video meta, it just replace it with the msdk bufferpool. - If not, it uses the msdk bufferpool as a side pool, which will be decoded into. and will copy it to downstream's bufferpool. 2\ Decide if using video memory or system memory. - This is not completed in this patch. - It might be decided in update_src_caps. - But tested for both system memory and video memory cases. https://bugzilla.gnome.org/show_bug.cgi?id=790752
2018-02-13 22:49:28 +00:00
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
/* element properties */
gboolean hardware;
msdkh264dec: report error to user Sometimes user want to know what the error is when decoding a stream, This commit adds a property of report-error to msdkh264dec. When report-error is TRUE, msdkh264dec may catch bitstream error and frame corruption, then report the error to application by using GST_ELEMENT_ERROR Refer to the code in https://github.com/Intel-Media-SDK/MediaSDK/tree/master/samples Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:48:37 +00:00
gboolean report_error;
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
guint async_depth;
msdkdec: allow sub class to add extra parameters for additional configuration MSDK allows user add extended buffers to a bitstream for additional configuration. This commit is to support this feature in this plugin Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:02:50 +00:00
mfxExtBuffer *bs_extra_params[MAX_BS_EXTRA_PARAMS];
guint num_bs_extra_params;
msdkh264dec: report error to user Sometimes user want to know what the error is when decoding a stream, This commit adds a property of report-error to msdkh264dec. When report-error is TRUE, msdkh264dec may catch bitstream error and frame corruption, then report the error to application by using GST_ELEMENT_ERROR Refer to the code in https://github.com/Intel-Media-SDK/MediaSDK/tree/master/samples Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:48:37 +00:00
msdkdec: Add SFC codes SFC refers to Scaler Format Converter, more details here: https://01.org/sites/default/files/documentation/intel-gfx-prm-osrc-kbl-vol15-sfc.pdf By attaching mfxExtDecVideoProcessing buffer to mfxVideoParam, decoder can do SFC for csc and scaling. MSDK will check if surface bitdepth equals to input when no SFC is triggered, which means in the case of SFC, there is no need to update surface bitdepth via gst_msdk_update_mfx_frame_info_from_mfx_video_param. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1444>
2021-11-17 09:05:09 +00:00
mfxExtBuffer *video_extra_params[MAX_VIDEO_EXTRA_PARAMS];
guint num_video_extra_params;
msdkh264dec: report error to user Sometimes user want to know what the error is when decoding a stream, This commit adds a property of report-error to msdkh264dec. When report-error is TRUE, msdkh264dec may catch bitstream error and frame corruption, then report the error to application by using GST_ELEMENT_ERROR Refer to the code in https://github.com/Intel-Media-SDK/MediaSDK/tree/master/samples Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:48:37 +00:00
#if (MFX_VERSION >= 1025)
mfxExtDecodeErrorReport error_report;
#endif
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
};
struct _GstMsdkDecClass
{
GstVideoDecoderClass parent_class;
gboolean (*configure) (GstMsdkDec * decoder);
msdkdec: force the alignment of width/height to 16 for vp8/vp9 MSDK library requires 16 alignment for vp8/vp9, otherwise a pipeline for vp8/vp9 decoding might fail. example pipeline: gst-launch-1.0 filesrc location=vp8_1280x720.webm ! matroskademux ! \ msdkvp8dec ! fakesink 0:00:00.150565444 10657 0x55c8484036d0 ERROR msdkdec gstmsdkdec.c:1056:gst_msdkdec_handle_frame:<msdkvp8dec0> DecodeFrameAsync failed (invalid video parameters)
2019-02-22 08:20:16 +00:00
msdkdec: add post_configure virtual method A post_configure virtual method is added to allow codec subclasses to adjust the initialized parameters after MFXVideoDECODE_DecodeHeader is called from the gstmsdkdec::gst_msdkdec_handle_frame function. This is useful if codecs want to adjust the output parameters based on the codec-specific decoding options that are present in the mfxInfoMFX structure after MFXVideoDECODE_DecodeHeader initializes them.
2019-06-22 01:12:48 +00:00
/* adjust mfx parameters per codec after decode header */
gboolean (*post_configure) (GstMsdkDec * decoder);
msdkdec: don't set unknown picture struct to progressive for vc1 MFXVideoDECODE_DecodeHeader only parses the sequence layer for VC1, so the structure is unknown for a stream with interlace flag set in the sequence layer. If forcing the struct to progressive in this plugin, MediaSDK will fail to decode such streams.
2019-03-29 04:53:38 +00:00
/* reset mfx parameters per codec */
msdkdec: force the alignment of width/height to 16 for vp8/vp9 MSDK library requires 16 alignment for vp8/vp9, otherwise a pipeline for vp8/vp9 decoding might fail. example pipeline: gst-launch-1.0 filesrc location=vp8_1280x720.webm ! matroskademux ! \ msdkvp8dec ! fakesink 0:00:00.150565444 10657 0x55c8484036d0 ERROR msdkdec gstmsdkdec.c:1056:gst_msdkdec_handle_frame:<msdkvp8dec0> DecodeFrameAsync failed (invalid video parameters)
2019-02-22 08:20:16 +00:00
gboolean (*preinit_decoder) (GstMsdkDec * decoder);
msdkdec: add postinit_decoder The workaround for https://github.com/Intel-Media-SDK/MediaSDK/issues/1139 is required for vp8 only, so move this workaround to the corresponding postinit_decoder function The pipeline below works with this change gst-launch-1.0 filesrc location=SA10104.vc1 ! \ 'video/x-wmv,profile=(string)advanced',width=720,height=480,framerate=14/1 ! \ msdkvc1dec ! fakesink
2019-03-29 05:22:55 +00:00
/* adjust mfx parameters per codec */
gboolean (*postinit_decoder) (GstMsdkDec * decoder);
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
};
GType gst_msdkdec_get_type (void);
msdkdec: allow sub class to add extra parameters for additional configuration MSDK allows user add extended buffers to a bitstream for additional configuration. This commit is to support this feature in this plugin Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/909>
2019-12-06 04:02:50 +00:00
void
gst_msdkdec_add_bs_extra_param (GstMsdkDec * thiz, mfxExtBuffer * param);
msdkdec: Enable SFC scaling for AVC and HEVC Decoder SFC only supports down-scaling at most to 1/8. For example, given a 4K bistream, SFC can scale it to 1080p via: "msdkh265dec ! video/x-raw,width=1920,height=1080 ! glimagesink" Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1444>
2022-01-21 07:32:09 +00:00
void
gst_msdkdec_add_video_extra_param (GstMsdkDec * thiz, mfxExtBuffer * param);
msdk: Add H.264 decoder The decoder only supports system memory output presently. https://bugzilla.gnome.org/show_bug.cgi?id=774587
2016-11-07 20:32:38 +00:00
G_END_DECLS
#endif /* __GST_MSDKDEC_H__ */
Reference in a new issue Copy permalink