mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-30 20:20:38 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/subprojects/gst-plugins-bad/sys/d3d11/gstd3d11decoder.h

169 lines
7.3 KiB
C
Raw Normal View History

d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
/* GStreamer
* Copyright (C) 2019 Seungha Yang <seungha.yang@navercorp.com>
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Library General Public
* License as published by the Free Software Foundation; either
* version 2 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Library General Public License for more details.
*
* You should have received a copy of the GNU Library General Public
* License along with this library; if not, write to the
* Free Software Foundation, Inc., 51 Franklin St, Fifth Floor,
* Boston, MA 02110-1301, USA.
*/
#ifndef __GST_D3D11_DECODER_H__
#define __GST_D3D11_DECODER_H__
#include <gst/gst.h>
#include <gst/video/video.h>
d3d11: Move core methods to gst-libs Move d3d11 device, memory, buffer pool and minimal method to gst-libs so that other plugins can access d3d11 resource. Since Direct3D is primary graphics API on Windows, we need this infrastructure for various plugins can share GPU resource without downloading GPU memory. Note that this implementation is public only for -bad scope for now. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/464>
2020-12-20 17:47:45 +00:00
#include <gst/d3d11/gstd3d11.h>
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
G_BEGIN_DECLS
d3d11: Move to G_DECLARE_FINAL_TYPE ... and remove unnecessary forward declaration. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1627>
2020-09-25 18:27:39 +00:00
#define GST_TYPE_D3D11_DECODER (gst_d3d11_decoder_get_type())
G_DECLARE_FINAL_TYPE (GstD3D11Decoder,
gst_d3d11_decoder, GST, D3D11_DECODER, GstObject);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Remove duplicated class_init and property related code Move them into the decoder helper code to remove duplication Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 14:41:39 +00:00
typedef struct _GstD3D11DecoderClassData GstD3D11DecoderClassData;
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
typedef enum
{
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
GST_DXVA_CODEC_NONE,
GST_DXVA_CODEC_MPEG2,
GST_DXVA_CODEC_H264,
GST_DXVA_CODEC_H265,
GST_DXVA_CODEC_VP8,
GST_DXVA_CODEC_VP9,
GST_DXVA_CODEC_AV1,
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
/* the last of supported codec */
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
GST_DXVA_CODEC_LAST
} GstDXVACodec;
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
typedef struct
{
d3d11: d3d11decoder: Use DXGI adapter LUID ... instead of index of DXGI adapter. The order of IDXGIAdapter1 enumerated via IDXGIFactory1::EnumAdapters1 can be varying even there's no rebooting in case that GPU preference order is updated by user (for example, it can be done by using NVIDIA Control Panel in case of multi-GPU laptop system) and eGPU is another possible case. So, for an element which requires fixed target GPU requirement, index based device enumeration is unreliable. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1098>
2021-10-08 13:37:20 +00:00
GstDXVACodec codec;
gint64 adapter_luid;
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
guint device_id;
guint vendor_id;
d3d11decoder: Remove duplicated class_init and property related code Move them into the decoder helper code to remove duplication Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 14:41:39 +00:00
} GstD3D11DecoderSubClassData;
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
typedef struct _GstD3D11DecodeInputStreamArgs
{
gpointer picture_params;
gsize picture_params_size;
gpointer slice_control;
gsize slice_control_size;
gpointer bitstream;
gsize bitstream_size;
gpointer inverse_quantization_matrix;
gsize inverse_quantization_matrix_size;
} GstD3D11DecodeInputStreamArgs;
GstD3D11Decoder * gst_d3d11_decoder_new (GstD3D11Device * device,
GstDXVACodec codec);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Get rid of private struct Completely hide member variables Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 05:26:17 +00:00
gboolean gst_d3d11_decoder_is_configured (GstD3D11Decoder * decoder);
gboolean gst_d3d11_decoder_configure (GstD3D11Decoder * decoder,
d3d11decoder: Move zero-copy decision logic into decoder object Get rid of all duplicated code for zero-copy decision and output buffer allocation Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2117>
2021-03-28 07:06:55 +00:00
GstVideoCodecState * input_state,
d3d11decoder: Get rid of private struct Completely hide member variables Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 05:26:17 +00:00
GstVideoInfo * info,
d3d11decoder: Move profile GUID handling into decoder object Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 06:08:01 +00:00
gint coded_width,
gint coded_height,
guint dpb_size);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
gboolean gst_d3d11_decoder_decode_frame (GstD3D11Decoder * decoder,
ID3D11VideoDecoderOutputView * output_view,
GstD3D11DecodeInputStreamArgs * input_args);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Take account of min buffers of downstream buffer pool Since our decoder DPB texture pool cannot be grown once it's configured, we should pre-allocate sufficient number of textures for zero-copy playback (but not too many). The "min buffers" allocation query parameter can be a hint for the number of required textures in addition to DPB size. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2017>
2021-02-14 12:01:32 +00:00
GstBuffer * gst_d3d11_decoder_get_output_view_buffer (GstD3D11Decoder * decoder,
GstVideoDecoder * videodec);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Directly access ID3D11VideoDecoderOutputView for decoding Decoder output view is stored in GstD3D11Memory object instead of wrapper struct now. So qdata is no more required. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1712>
2020-10-20 08:31:17 +00:00
ID3D11VideoDecoderOutputView * gst_d3d11_decoder_get_output_view_from_buffer (GstD3D11Decoder * decoder,
d3d11decoder: Implement array-of-texture DPB again Re-implementation of array-of-texture based on d3d11 memory pool. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2097>
2021-03-20 10:52:16 +00:00
GstBuffer * buffer,
guint8 * view_id);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11vp9dec: Add support for internal frame resizing VP9 codec allows resizing reference frame by spec. Handling this case is a bit tricky especially when the resizing happens on non-keyframe, because pre-allocated decoder textures (i.e., dpb) have negotiated resolution and to change resolution meanwhile decoding on non-keyframe, each texture might need to be re-created, copied to new dpb somehow, and re-negotiated with downstream. Due to the complicated requirement of negotiation driven resizing handling, this commit adds shader into d3d11decoder object to resize only corresponding frames. Note that if the resolution change is detected on keyframe, decoder will re-negotiate with downstream.
2020-03-07 10:41:53 +00:00
gboolean gst_d3d11_decoder_process_output (GstD3D11Decoder * decoder,
d3d11decoder: Move zero-copy decision logic into decoder object Get rid of all duplicated code for zero-copy decision and output buffer allocation Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2117>
2021-03-28 07:06:55 +00:00
GstVideoDecoder * videodec,
d3d11vp9dec: Add support for internal frame resizing VP9 codec allows resizing reference frame by spec. Handling this case is a bit tricky especially when the resizing happens on non-keyframe, because pre-allocated decoder textures (i.e., dpb) have negotiated resolution and to change resolution meanwhile decoding on non-keyframe, each texture might need to be re-created, copied to new dpb somehow, and re-negotiated with downstream. Due to the complicated requirement of negotiation driven resizing handling, this commit adds shader into d3d11decoder object to resize only corresponding frames. Note that if the resolution change is detected on keyframe, decoder will re-negotiate with downstream.
2020-03-07 10:41:53 +00:00
gint display_width,
gint display_height,
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
GstBuffer * decoder_buffer,
d3d11decoder: Move zero-copy decision logic into decoder object Get rid of all duplicated code for zero-copy decision and output buffer allocation Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2117>
2021-03-28 07:06:55 +00:00
GstBuffer ** output);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
d3d11decoder: Refactor device open step and negotiation * Remove redundant method arguments * Don't allocate staging texture if downstream supports d3d11 memory Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 07:11:12 +00:00
gboolean gst_d3d11_decoder_negotiate (GstD3D11Decoder * decoder,
d3d11decoder: Move zero-copy decision logic into decoder object Get rid of all duplicated code for zero-copy decision and output buffer allocation Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2117>
2021-03-28 07:06:55 +00:00
GstVideoDecoder * videodec);
d3d11decoder: Refactor device open step and negotiation * Remove redundant method arguments * Don't allocate staging texture if downstream supports d3d11 memory Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 07:11:12 +00:00
gboolean gst_d3d11_decoder_decide_allocation (GstD3D11Decoder * decoder,
GstVideoDecoder * videodec,
GstQuery * query);
d3d11decoder: Add helper methods for negotiation and decide_allocation The implementation for all codecs is almost the same. No need to duplicate code. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1079>
2020-03-29 14:31:13 +00:00
d3d11decoder: Set flushing to internal pool on flush event d3d11 decoders use internal pool for DPB texture and Gst*Decoder::new_picture() will be blocked if internal pool is full. We should be able to unblock in on flush-start event as expected. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2192>
2021-04-23 14:20:54 +00:00
gboolean gst_d3d11_decoder_set_flushing (GstD3D11Decoder * decoder,
GstVideoDecoder * videodec,
gboolean flushing);
d3d11decoder: Do negotiation again per forward/reverse playback mode change For reverse playback, we are always copying decoded frame to downstream buffer. So the pool size can be and need to be large enough. In case that forward playback, however, we need to restrict the max pool size for performance reason. Otherwise decoder will keep copying decoded texture to downstream buffer pool if decoding is faster than downstream throughput performance and also there are queue element between them. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2083>
2021-03-15 09:26:03 +00:00
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
/* Utils for class registration */
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
typedef struct _GstDXVAResolution
{
guint width;
guint height;
} GstDXVAResolution;
static const GstDXVAResolution gst_dxva_resolutions[] = {
{1920, 1088}, {2560, 1440}, {3840, 2160}, {4096, 2160},
d3d11decoder: Check 16K resolution support 16K decoding is supported by some GPUs Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/2633>
2022-06-17 19:05:53 +00:00
{7680, 4320}, {8192, 4320}, {15360, 8640}, {16384, 8640}
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
};
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
gboolean gst_d3d11_decoder_util_is_legacy_device (GstD3D11Device * device);
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
gboolean gst_d3d11_decoder_get_supported_decoder_profile (GstD3D11Device * device,
GstDXVACodec codec,
d3d11decoder: Move profile GUID handling into decoder object Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2079>
2021-03-14 06:08:01 +00:00
GstVideoFormat format,
const GUID ** selected_profile);
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
gboolean gst_d3d11_decoder_supports_format (GstD3D11Device * device,
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
const GUID * decoder_profile,
DXGI_FORMAT format);
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
gboolean gst_d3d11_decoder_supports_resolution (GstD3D11Device * device,
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
const GUID * decoder_profile,
DXGI_FORMAT format,
guint width,
guint height);
d3d11decoder: Remove duplicated class_init and property related code Move them into the decoder helper code to remove duplication Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 14:41:39 +00:00
GstD3D11DecoderClassData * gst_d3d11_decoder_class_data_new (GstD3D11Device * device,
d3d11decoder: Refactor for more unified decoding flow ... and various code cleanup. * Move spreaded decoding API calls into one method Previously, decoding flow of most codecs are - Call DecoderBeginFrame() on start_picture() - Call {Get,Release}DecoderBuffer() on decode_slice() - Call SubmitDecoderBuffers() and DecoderEndFrame() on end_picture() Such spreaded API calls make it hard to keep track of status of decoding. Now it will be done at once in a new method. * Drop a code for non-zero wBadSliceChopping When bitstream buffer provided by driver is not sufficient to write compressed bitstream data, host decoder needs to make use of wBadSliceChopping so that driver can understand there are multiple bitstream buffer. But it's a bit unrealistic and not tested. Since FFMpeg's DXVA implemetaion doesn't support it, we might be able to ignore the case for now. * Make code more portable Consider common logic of GstCodecs -> DXVA translation for all D3D APIs (i,e., D3D9, D3D11, and D3D12). Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 15:59:37 +00:00
GstDXVACodec codec,
d3d11decoder: Remove duplicated class_init and property related code Move them into the decoder helper code to remove duplication Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 14:41:39 +00:00
GstCaps * sink_caps,
GstCaps * src_caps);
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
d3d11decoder: Remove duplicated class_init and property related code Move them into the decoder helper code to remove duplication Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2525>
2021-09-15 14:41:39 +00:00
void gst_d3d11_decoder_class_data_fill_subclass_data (GstD3D11DecoderClassData * data,
GstD3D11DecoderSubClassData * subclass_data);
void gst_d3d11_decoder_proxy_class_init (GstElementClass * klass,
GstD3D11DecoderClassData * data,
const gchar * author);
void gst_d3d11_decoder_proxy_get_property (GObject * object,
guint prop_id,
GValue * value,
GParamSpec * pspec,
GstD3D11DecoderSubClassData * subclass_data);
d3d11decoder: Register elements per GPU device with capability check This implementation is similar to what we've done for nvcodec plugin. Since supported resolution, profiles, and formats are device dependent ones, single template caps cannot represent them, so this modification will help autoplugging and fallback. Note that the legacy gpu list and list of resolution to query were taken from chromium's code.
2020-02-14 16:23:32 +00:00
d3d11: d3d11decoder: Use DXGI adapter LUID ... instead of index of DXGI adapter. The order of IDXGIAdapter1 enumerated via IDXGIFactory1::EnumAdapters1 can be varying even there's no rebooting in case that GPU preference order is updated by user (for example, it can be done by using NVIDIA Control Panel in case of multi-GPU laptop system) and eGPU is another possible case. So, for an element which requires fixed target GPU requirement, index based device enumeration is unreliable. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1098>
2021-10-08 13:37:20 +00:00
gboolean gst_d3d11_decoder_proxy_open (GstVideoDecoder * videodec,
GstD3D11DecoderSubClassData * subclass_data,
GstD3D11Device ** device,
GstD3D11Decoder ** decoder);
d3d11: Add h264 decoder element New decoder implementation based on dxva2 on d3d11 APIs. The DPB management implementation is taken from Chromium.
2019-12-26 05:24:46 +00:00
G_END_DECLS
#endif /* __GST_D3D11_DECODER_H__ */
Reference in a new issue Copy permalink