mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-03 16:09:39 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/sys/d3d11/gstd3d11format.c

613 lines
22 KiB
C
Raw Normal View History

d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
/* GStreamer
* Copyright (C) 2019 Seungha Yang <seungha.yang@navercorp.com>
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Library General Public
* License as published by the Free Software Foundation; either
* version 2 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Library General Public License for more details.
*
* You should have received a copy of the GNU Library General Public
* License along with this library; if not, write to the
* Free Software Foundation, Inc., 51 Franklin St, Fifth Floor,
* Boston, MA 02110-1301, USA.
*/
#ifdef HAVE_CONFIG_H
#include "config.h"
#endif
#include "gstd3d11format.h"
#include "gstd3d11utils.h"
#include "gstd3d11device.h"
d3d11videosink: Specify d3d11 memory caps feature on sinkpad template
2019-08-24 08:43:43 +00:00
#include "gstd3d11memory.h"
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
#include <string.h>
d3d11: Initialize debug categories of non-GstElement implementation in plugin init That's the way to expose debug category to --gst-debug-help
2019-12-04 15:53:40 +00:00
GST_DEBUG_CATEGORY_EXTERN (gst_d3d11_format_debug);
#define GST_CAT_DEFAULT gst_d3d11_format_debug
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
guint
gst_d3d11_dxgi_format_n_planes (DXGI_FORMAT format)
{
switch (format) {
case DXGI_FORMAT_B8G8R8A8_UNORM:
case DXGI_FORMAT_R8G8B8A8_UNORM:
case DXGI_FORMAT_R10G10B10A2_UNORM:
case DXGI_FORMAT_AYUV:
d3d11: Add support for packed 8bits 4:2:2 YUV formats Note that newly added formats (YUY2, UYVY, and VYUY) are not supported render target view formats. So such formats can be only input of d3d11convert or d3d11videosink. Another note is that YUY2 format is a very common format for hardware en/decoders on Windows. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1581>
2020-09-17 16:41:35 +00:00
case DXGI_FORMAT_YUY2:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
case DXGI_FORMAT_R8_UNORM:
case DXGI_FORMAT_R8G8_UNORM:
case DXGI_FORMAT_R16_UNORM:
case DXGI_FORMAT_R16G16_UNORM:
d3d11: Add support for packed 8bits 4:2:2 YUV formats Note that newly added formats (YUY2, UYVY, and VYUY) are not supported render target view formats. So such formats can be only input of d3d11convert or d3d11videosink. Another note is that YUY2 format is a very common format for hardware en/decoders on Windows. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1581>
2020-09-17 16:41:35 +00:00
case DXGI_FORMAT_G8R8_G8B8_UNORM:
case DXGI_FORMAT_R8G8_B8G8_UNORM:
d3d11: Add support for packed 4:2:2 and 4:4:4 10bits formats Add support for Y210 and Y410 formats which are commonly used format for en/decoders on Windows. Note that those formats cannot be used for render target (output) of shader. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1821>
2020-11-19 12:15:25 +00:00
case DXGI_FORMAT_Y210:
case DXGI_FORMAT_Y410:
case DXGI_FORMAT_R16G16B16A16_UNORM:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
return 1;
case DXGI_FORMAT_NV12:
case DXGI_FORMAT_P010:
d3d11colorconverter: Handle P016_LE format P016 format is no different than P010. Not much things to add code.
2020-01-09 10:39:59 +00:00
case DXGI_FORMAT_P016:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
return 2;
default:
break;
}
return 0;
}
gboolean
gst_d3d11_dxgi_format_get_size (DXGI_FORMAT format, guint width, guint height,
guint pitch, gsize offset[GST_VIDEO_MAX_PLANES],
gint stride[GST_VIDEO_MAX_PLANES], gsize * size)
{
g_return_val_if_fail (format != DXGI_FORMAT_UNKNOWN, FALSE);
switch (format) {
case DXGI_FORMAT_B8G8R8A8_UNORM:
case DXGI_FORMAT_R8G8B8A8_UNORM:
case DXGI_FORMAT_R10G10B10A2_UNORM:
case DXGI_FORMAT_AYUV:
d3d11: Add support for packed 8bits 4:2:2 YUV formats Note that newly added formats (YUY2, UYVY, and VYUY) are not supported render target view formats. So such formats can be only input of d3d11convert or d3d11videosink. Another note is that YUY2 format is a very common format for hardware en/decoders on Windows. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1581>
2020-09-17 16:41:35 +00:00
case DXGI_FORMAT_YUY2:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
case DXGI_FORMAT_R8_UNORM:
case DXGI_FORMAT_R8G8_UNORM:
case DXGI_FORMAT_R16_UNORM:
case DXGI_FORMAT_R16G16_UNORM:
d3d11: Add support for packed 8bits 4:2:2 YUV formats Note that newly added formats (YUY2, UYVY, and VYUY) are not supported render target view formats. So such formats can be only input of d3d11convert or d3d11videosink. Another note is that YUY2 format is a very common format for hardware en/decoders on Windows. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1581>
2020-09-17 16:41:35 +00:00
case DXGI_FORMAT_G8R8_G8B8_UNORM:
case DXGI_FORMAT_R8G8_B8G8_UNORM:
d3d11: Add support for packed 4:2:2 and 4:4:4 10bits formats Add support for Y210 and Y410 formats which are commonly used format for en/decoders on Windows. Note that those formats cannot be used for render target (output) of shader. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1821>
2020-11-19 12:15:25 +00:00
case DXGI_FORMAT_Y210:
case DXGI_FORMAT_Y410:
case DXGI_FORMAT_R16G16B16A16_UNORM:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
offset[0] = 0;
stride[0] = pitch;
*size = pitch * height;
break;
case DXGI_FORMAT_NV12:
case DXGI_FORMAT_P010:
d3d11colorconverter: Handle P016_LE format P016 format is no different than P010. Not much things to add code.
2020-01-09 10:39:59 +00:00
case DXGI_FORMAT_P016:
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
offset[0] = 0;
stride[0] = pitch;
offset[1] = offset[0] + stride[0] * height;
stride[1] = pitch;
*size = offset[1] + stride[1] * GST_ROUND_UP_2 (height / 2);
break;
default:
return FALSE;
}
GST_LOG ("Calculated buffer size: %" G_GSIZE_FORMAT
" (dxgi format:%d, %dx%d, Pitch %d)",
*size, format, width, height, pitch);
return TRUE;
}
d3d11: Use GRecMutex to protect immediate context and dxgi API call In some cases, rendering and dxgi (e.g., swapchain) APIs should be called from window message pump thread, but current design (dedicated d3d11 thread) make it impossible. To solve it, change concurrency model to locking based one from single-thread model.
2019-12-19 15:17:33 +00:00
/**
* gst_d3d11_device_get_supported_caps:
* @device: a #GstD3DDevice
* @flags: D3D11_FORMAT_SUPPORT flags
*
* Check supported format with given flags
*
* Returns: a #GstCaps representing supported format
*/
GstCaps *
gst_d3d11_device_get_supported_caps (GstD3D11Device * device,
D3D11_FORMAT_SUPPORT flags)
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
{
ID3D11Device *d3d11_device;
HRESULT hr;
gint i;
GValue v_list = G_VALUE_INIT;
GstCaps *supported_caps;
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
static const GstVideoFormat format_list[] = {
GST_VIDEO_FORMAT_BGRA,
GST_VIDEO_FORMAT_RGBA,
GST_VIDEO_FORMAT_RGB10A2_LE,
GST_VIDEO_FORMAT_VUYA,
GST_VIDEO_FORMAT_NV12,
GST_VIDEO_FORMAT_P010_10LE,
GST_VIDEO_FORMAT_P016_LE,
GST_VIDEO_FORMAT_I420,
GST_VIDEO_FORMAT_I420_10LE,
};
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
d3d11: Use GRecMutex to protect immediate context and dxgi API call In some cases, rendering and dxgi (e.g., swapchain) APIs should be called from window message pump thread, but current design (dedicated d3d11 thread) make it impossible. To solve it, change concurrency model to locking based one from single-thread model.
2019-12-19 15:17:33 +00:00
g_return_val_if_fail (GST_IS_D3D11_DEVICE (device), NULL);
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
d3d11_device = gst_d3d11_device_get_device_handle (device);
g_value_init (&v_list, GST_TYPE_LIST);
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
for (i = 0; i < G_N_ELEMENTS (format_list); i++) {
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
UINT format_support = 0;
GstVideoFormat format;
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
const GstD3D11Format *d3d11_format;
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
d3d11_format = gst_d3d11_device_format_from_gst (device, format_list[i]);
if (!d3d11_format || d3d11_format->dxgi_format == DXGI_FORMAT_UNKNOWN)
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
continue;
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
format = d3d11_format->format;
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
hr = ID3D11Device_CheckFormatSupport (d3d11_device,
d3d11memory: Always use native DXGI format if device support it Use consistent memory layout between dxva and other shader use case. For example, use DXGI_FORMAT_NV12 texture format instead of two textures with DXGI_FORMAT_R8_UNORM and DXGI_FORMAT_R8G8_UNORM.
2020-01-11 09:24:02 +00:00
d3d11_format->dxgi_format, &format_support);
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
d3d11: Use GRecMutex to protect immediate context and dxgi API call In some cases, rendering and dxgi (e.g., swapchain) APIs should be called from window message pump thread, but current design (dedicated d3d11 thread) make it impossible. To solve it, change concurrency model to locking based one from single-thread model.
2019-12-19 15:17:33 +00:00
if (SUCCEEDED (hr) && ((format_support & flags) == flags)) {
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
GValue v_str = G_VALUE_INIT;
g_value_init (&v_str, G_TYPE_STRING);
GST_LOG_OBJECT (device, "d3d11 device can support %s with flags 0x%x",
d3d11: Use GRecMutex to protect immediate context and dxgi API call In some cases, rendering and dxgi (e.g., swapchain) APIs should be called from window message pump thread, but current design (dedicated d3d11 thread) make it impossible. To solve it, change concurrency model to locking based one from single-thread model.
2019-12-19 15:17:33 +00:00
gst_video_format_to_string (format), flags);
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
g_value_set_string (&v_str, gst_video_format_to_string (format));
gst_value_list_append_and_take_value (&v_list, &v_str);
}
}
supported_caps = gst_caps_new_simple ("video/x-raw",
"width", GST_TYPE_INT_RANGE, 1, G_MAXINT,
"height", GST_TYPE_INT_RANGE, 1, G_MAXINT,
"framerate", GST_TYPE_FRACTION_RANGE, 0, 1, G_MAXINT, 1, NULL);
gst_caps_set_value (supported_caps, "format", &v_list);
g_value_unset (&v_list);
d3d11videosink: Specify d3d11 memory caps feature on sinkpad template
2019-08-24 08:43:43 +00:00
gst_caps_set_features_simple (supported_caps,
gst_caps_features_from_string (GST_CAPS_FEATURE_MEMORY_D3D11_MEMORY));
d3d11: Use GRecMutex to protect immediate context and dxgi API call In some cases, rendering and dxgi (e.g., swapchain) APIs should be called from window message pump thread, but current design (dedicated d3d11 thread) make it impossible. To solve it, change concurrency model to locking based one from single-thread model.
2019-12-19 15:17:33 +00:00
return supported_caps;
d3d11: Refactor d3d11 memory and dxgi format usage * Create staging texture only when the CPU access is requested. Note that we should avoid the CPU access to d3d11 memory as mush as possible. Incoming d3d11upload and d3d11download will take this GPU memory upload/download. * Upload/Download texture memory from/to staging only if it needed, similar to GstGL PBO implementation. * Define more dxgi formats for future usage (e.g., color conversion, dxva2 decoder). Because I420_* formats are not supported formats by dxgi, each plane should be handled likewise GstGL separately, but NV12/P10 formats might be supported ones. So we decide the number of d3d11memory per GstBuffer for video memory depending on OS version and dxgi format. For instance, if NV12 is supported by OS, only one d3d11memory with DXGI_FORMAT_NV12 texture can be allocated by this commit. One use case of such texture is DXVA. In case DXVA decoder, it might need to produce decoded data to one DXGI_FORMAT_NV12 instead of seperate Y and UV planes. Such behavior will be controlled via configuration of GstD3D11BufferPool and default configuration is separate resources per plane.
2019-11-06 10:37:33 +00:00
}
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
#if (DXGI_HEADER_VERSION >= 5)
gboolean
gst_d3d11_hdr_meta_data_to_dxgi (GstVideoMasteringDisplayInfo * minfo,
GstVideoContentLightLevel * cll, DXGI_HDR_METADATA_HDR10 * dxgi_hdr10)
{
g_return_val_if_fail (dxgi_hdr10 != NULL, FALSE);
memset (dxgi_hdr10, 0, sizeof (DXGI_HDR_METADATA_HDR10));
if (minfo) {
d3d11: Update for video-hdr struct change See the change of -base https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/-/merge_requests/594
2020-03-13 07:50:16 +00:00
dxgi_hdr10->RedPrimary[0] = minfo->display_primaries[0].x;
dxgi_hdr10->RedPrimary[1] = minfo->display_primaries[0].y;
dxgi_hdr10->GreenPrimary[0] = minfo->display_primaries[1].x;
dxgi_hdr10->GreenPrimary[1] = minfo->display_primaries[1].y;
dxgi_hdr10->BluePrimary[0] = minfo->display_primaries[2].x;
dxgi_hdr10->BluePrimary[1] = minfo->display_primaries[2].y;
dxgi_hdr10->WhitePoint[0] = minfo->white_point.x;
dxgi_hdr10->WhitePoint[1] = minfo->white_point.y;
dxgi_hdr10->MaxMasteringLuminance = minfo->max_display_mastering_luminance;
dxgi_hdr10->MinMasteringLuminance = minfo->min_display_mastering_luminance;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
if (cll) {
d3d11: Update for video-hdr struct change See the change of -base https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/-/merge_requests/594
2020-03-13 07:50:16 +00:00
dxgi_hdr10->MaxContentLightLevel = cll->max_content_light_level;
dxgi_hdr10->MaxFrameAverageLightLevel = cll->max_frame_average_light_level;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
return TRUE;
}
#endif
#if (DXGI_HEADER_VERSION >= 4)
typedef enum
{
GST_DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709 = 0,
GST_DXGI_COLOR_SPACE_RGB_FULL_G10_NONE_P709 = 1,
GST_DXGI_COLOR_SPACE_RGB_STUDIO_G22_NONE_P709 = 2,
GST_DXGI_COLOR_SPACE_RGB_STUDIO_G22_NONE_P2020 = 3,
GST_DXGI_COLOR_SPACE_RESERVED = 4,
GST_DXGI_COLOR_SPACE_YCBCR_FULL_G22_NONE_P709_X601 = 5,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G22_LEFT_P601 = 6,
GST_DXGI_COLOR_SPACE_YCBCR_FULL_G22_LEFT_P601 = 7,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G22_LEFT_P709 = 8,
GST_DXGI_COLOR_SPACE_YCBCR_FULL_G22_LEFT_P709 = 9,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G22_LEFT_P2020 = 10,
GST_DXGI_COLOR_SPACE_YCBCR_FULL_G22_LEFT_P2020 = 11,
GST_DXGI_COLOR_SPACE_RGB_FULL_G2084_NONE_P2020 = 12,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G2084_LEFT_P2020 = 13,
GST_DXGI_COLOR_SPACE_RGB_STUDIO_G2084_NONE_P2020 = 14,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G22_TOPLEFT_P2020 = 15,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G2084_TOPLEFT_P2020 = 16,
GST_DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P2020 = 17,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_GHLG_TOPLEFT_P2020 = 18,
GST_DXGI_COLOR_SPACE_YCBCR_FULL_GHLG_TOPLEFT_P2020 = 19,
GST_DXGI_COLOR_SPACE_RGB_STUDIO_G24_NONE_P709 = 20,
GST_DXGI_COLOR_SPACE_RGB_STUDIO_G24_NONE_P2020 = 21,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G24_LEFT_P709 = 22,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G24_LEFT_P2020 = 23,
GST_DXGI_COLOR_SPACE_YCBCR_STUDIO_G24_TOPLEFT_P2020 = 24,
GST_DXGI_COLOR_SPACE_CUSTOM = 0xFFFFFFFF
} GST_DXGI_COLOR_SPACE_TYPE;
/* https://docs.microsoft.com/en-us/windows/win32/api/dxgicommon/ne-dxgicommon-dxgi_color_space_type */
#define MAKE_COLOR_MAP(d,r,m,t,p) \
{ GST_DXGI_COLOR_SPACE_ ##d, GST_VIDEO_COLOR_RANGE ##r, \
GST_VIDEO_COLOR_MATRIX_ ##m, GST_VIDEO_TRANSFER_ ##t, \
GST_VIDEO_COLOR_PRIMARIES_ ##p }
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
static const GstDxgiColorSpace rgb_colorspace_map[] = {
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 1) DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P709
* 2) DXGI_COLOR_SPACE_RGB_FULL_G10_NONE_P709
* 3) DXGI_COLOR_SPACE_RGB_STUDIO_G22_NONE_P709
* 4) DXGI_COLOR_SPACE_RGB_STUDIO_G22_NONE_P2020
* 5) DXGI_COLOR_SPACE_RGB_FULL_G2084_NONE_P2020
* 6) DXGI_COLOR_SPACE_RGB_STUDIO_G2084_NONE_P2020
* 7) DXGI_COLOR_SPACE_RGB_FULL_G22_NONE_P2020
* 8) DXGI_COLOR_SPACE_RGB_STUDIO_G24_NONE_P709
* 9) DXGI_COLOR_SPACE_RGB_STUDIO_G24_NONE_P2020
*
* NOTE: if G24 (Gamma 2.4, SRGB) transfer is not defined,
* it will be approximated as G22.
* NOTE: BT470BG ~= BT709
*/
/* 1) RGB_FULL_G22_NONE_P709 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT709, BT709),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT601, BT709),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT2020_10, BT709),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT2020_12, BT709),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT709, BT470BG),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT601, BT470BG),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT2020_10, BT470BG),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, BT2020_12, BT470BG),
/* 1-1) Approximation for RGB_FULL_G22_NONE_P709 */
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, SRGB, BT709),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P709, _0_255, UNKNOWN, SRGB, BT470BG),
/* 2) RGB_FULL_G10_NONE_P709 */
MAKE_COLOR_MAP (RGB_FULL_G10_NONE_P709, _0_255, UNKNOWN, GAMMA10, BT709),
MAKE_COLOR_MAP (RGB_FULL_G10_NONE_P709, _0_255, UNKNOWN, GAMMA10, BT470BG),
/* 3) RGB_STUDIO_G22_NONE_P709 */
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT709, BT709),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT601, BT709),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT2020_10, BT709),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT2020_12, BT709),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT709, BT470BG),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT601, BT470BG),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT2020_10,
BT470BG),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, BT2020_12,
BT470BG),
/* 3-1) Approximation for RGB_STUDIO_G22_NONE_P709 */
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, SRGB, BT709),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P709, _16_235, UNKNOWN, SRGB, BT470BG),
/* 4) RGB_STUDIO_G22_NONE_P2020 */
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P2020, _16_235, UNKNOWN, BT709, BT2020),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P2020, _16_235, UNKNOWN, BT601, BT2020),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P2020, _16_235, UNKNOWN, BT2020_10,
BT2020),
MAKE_COLOR_MAP (RGB_STUDIO_G22_NONE_P2020, _16_235, UNKNOWN, BT2020_12,
BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 5) RGB_FULL_G2084_NONE_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (RGB_FULL_G2084_NONE_P2020, _0_255, UNKNOWN, SMPTE2084,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 6) RGB_STUDIO_G2084_NONE_P2020 */
MAKE_COLOR_MAP (RGB_STUDIO_G2084_NONE_P2020, _16_235, UNKNOWN, SMPTE2084,
BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 7) RGB_FULL_G22_NONE_P2020 */
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P2020, _0_255, UNKNOWN, BT709, BT2020),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P2020, _0_255, UNKNOWN, BT601, BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P2020, _0_255, UNKNOWN, BT2020_10, BT2020),
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P2020, _0_255, UNKNOWN, BT2020_12, BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 7-1) Approximation for RGB_FULL_G22_NONE_P2020 */
MAKE_COLOR_MAP (RGB_FULL_G22_NONE_P2020, _0_255, UNKNOWN, SRGB, BT2020),
/* 8) RGB_STUDIO_G24_NONE_P709 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (RGB_STUDIO_G24_NONE_P709, _16_235, UNKNOWN, SRGB, BT709),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (RGB_STUDIO_G24_NONE_P709, _16_235, UNKNOWN, SRGB, BT470BG),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 9) RGB_STUDIO_G24_NONE_P2020 */
MAKE_COLOR_MAP (RGB_STUDIO_G24_NONE_P2020, _16_235, UNKNOWN, SRGB, BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
};
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
static const GstDxgiColorSpace yuv_colorspace_map[] = {
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 1) YCBCR_FULL_G22_NONE_P709_X601
* 2) YCBCR_STUDIO_G22_LEFT_P601
* 3) YCBCR_FULL_G22_LEFT_P601
* 4) YCBCR_STUDIO_G22_LEFT_P709
* 5) YCBCR_FULL_G22_LEFT_P709
* 6) YCBCR_STUDIO_G22_LEFT_P2020
* 7) YCBCR_FULL_G22_LEFT_P2020
* 8) YCBCR_STUDIO_G2084_LEFT_P2020
* 9) YCBCR_STUDIO_G22_TOPLEFT_P2020
* 10) YCBCR_STUDIO_G2084_TOPLEFT_P2020
* 11) YCBCR_STUDIO_GHLG_TOPLEFT_P2020
* 12) YCBCR_FULL_GHLG_TOPLEFT_P2020
* 13) YCBCR_STUDIO_G24_LEFT_P709
* 14) YCBCR_STUDIO_G24_LEFT_P2020
* 15) YCBCR_STUDIO_G24_TOPLEFT_P2020
*
* NOTE: BT470BG ~= BT709
*/
/* 1) YCBCR_FULL_G22_NONE_P709_X601 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT709, BT709),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT601, BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT2020_10,
BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT2020_12,
BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT709, BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT601, BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT2020_10,
BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_NONE_P709_X601, _0_255, BT601, BT2020_12,
BT470BG),
/* 2) YCBCR_STUDIO_G22_LEFT_P601 */
d3d11: Handle newly added GST_VIDEO_TRANSFER_BT601 Use the value for mapping between DXGI_COLOR_SPACE_TYPE and GstVideoColorimetry. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1410>
2020-07-06 19:31:50 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT601, SMPTE170M),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT709, SMPTE170M),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT2020_10,
SMPTE170M),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT2020_12,
SMPTE170M),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT601, SMPTE240M),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT709, SMPTE240M),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT2020_10,
SMPTE240M),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P601, _16_235, BT601, BT2020_12,
SMPTE240M),
/* 3) YCBCR_FULL_G22_LEFT_P601 */
d3d11: Handle newly added GST_VIDEO_TRANSFER_BT601 Use the value for mapping between DXGI_COLOR_SPACE_TYPE and GstVideoColorimetry. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1410>
2020-07-06 19:31:50 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT601, SMPTE170M),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT709, SMPTE170M),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT2020_10,
SMPTE170M),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT2020_12,
SMPTE170M),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT601, SMPTE240M),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT709, SMPTE240M),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT2020_10,
SMPTE240M),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P601, _0_255, BT601, BT2020_12,
SMPTE240M),
/* 4) YCBCR_STUDIO_G22_LEFT_P709 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT709, BT709),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT601, BT709),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT2020_10,
BT709),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT2020_12,
BT709),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT709, BT470BG),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT601, BT470BG),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT2020_10,
BT470BG),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P709, _16_235, BT709, BT2020_12,
BT470BG),
/* 5) YCBCR_FULL_G22_LEFT_P709 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT709, BT709),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT601, BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT2020_10, BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT2020_12, BT709),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT709, BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT601, BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT2020_10, BT470BG),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P709, _0_255, BT709, BT2020_12, BT470BG),
/* 6) YCBCR_STUDIO_G22_LEFT_P2020 */
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P2020, _16_235, BT2020, BT709, BT2020),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P2020, _16_235, BT2020, BT601, BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P2020, _16_235, BT2020, BT2020_10,
BT2020),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_LEFT_P2020, _16_235, BT2020, BT2020_12,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 7) YCBCR_FULL_G22_LEFT_P2020 */
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P2020, _0_255, BT2020, BT709, BT2020),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P2020, _0_255, BT2020, BT601, BT2020),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P2020, _0_255, BT2020, BT2020_10,
BT2020),
MAKE_COLOR_MAP (YCBCR_FULL_G22_LEFT_P2020, _0_255, BT2020, BT2020_12,
BT2020),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 8) YCBCR_STUDIO_G2084_LEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G2084_LEFT_P2020, _16_235, BT2020, SMPTE2084,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 9) YCBCR_STUDIO_G22_TOPLEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_TOPLEFT_P2020, _16_235, BT2020, BT2020_10,
BT2020),
MAKE_COLOR_MAP (YCBCR_STUDIO_G22_TOPLEFT_P2020, _16_235, BT2020, BT2020_12,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 10) YCBCR_STUDIO_G2084_TOPLEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
/* FIXME: check chroma-site to differentiate this from
* YCBCR_STUDIO_G2084_LEFT_P2020 */
MAKE_COLOR_MAP (YCBCR_STUDIO_G2084_TOPLEFT_P2020, _16_235, BT2020, SMPTE2084,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 11) YCBCR_STUDIO_GHLG_TOPLEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_GHLG_TOPLEFT_P2020, _16_235, BT2020,
ARIB_STD_B67, BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 12) YCBCR_FULL_GHLG_TOPLEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_FULL_GHLG_TOPLEFT_P2020, _0_255, BT2020, ARIB_STD_B67,
BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 13) YCBCR_STUDIO_G24_LEFT_P709 */
MAKE_COLOR_MAP (YCBCR_STUDIO_G24_LEFT_P709, _16_235, BT709, SRGB, BT709),
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 14) YCBCR_STUDIO_G24_LEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
MAKE_COLOR_MAP (YCBCR_STUDIO_G24_LEFT_P2020, _16_235, BT2020, SRGB, BT2020),
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
/* 15) YCBCR_STUDIO_G24_TOPLEFT_P2020 */
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
/* FIXME: check chroma-site to differentiate this from
* YCBCR_STUDIO_G24_LEFT_P2020 */
MAKE_COLOR_MAP (YCBCR_STUDIO_G24_TOPLEFT_P2020, _16_235, BT2020, SRGB,
BT2020),
};
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
#define SCORE_RANGE_MISMATCH 5
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
#define SCORE_MATRIX_MISMATCH 5
#define SCORE_TRANSFER_MISMATCH 5
#define SCORE_PRIMARY_MISMATCH 10
static gint
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
get_score (GstVideoInfo * info, const GstDxgiColorSpace * color_map,
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
gboolean is_yuv)
{
gint loss = 0;
GstVideoColorimetry *color = &info->colorimetry;
if (color->range != color_map->range)
loss += SCORE_RANGE_MISMATCH;
if (is_yuv && color->matrix != color_map->matrix)
loss += SCORE_MATRIX_MISMATCH;
if (color->transfer != color_map->transfer)
loss += SCORE_TRANSFER_MISMATCH;
if (color->primaries != color_map->primaries)
loss += SCORE_PRIMARY_MISMATCH;
return loss;
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
static const GstDxgiColorSpace *
gst_d3d11_video_info_to_dxgi_color_space_rgb (GstVideoInfo * info)
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
{
gint best_score = G_MAXINT;
gint score, i;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
const GstDxgiColorSpace *colorspace = NULL;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
for (i = 0; i < G_N_ELEMENTS (rgb_colorspace_map); i++) {
d3d11format: Map more colorimetry with dxgi colorspace Map more logically identical set of GstVideoColorimetry formats with dxgi color space. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1723>
2020-10-25 20:04:55 +00:00
score = get_score (info, &rgb_colorspace_map[i], FALSE);
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
if (score < best_score) {
best_score = score;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
colorspace = &rgb_colorspace_map[i];
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
if (score == 0)
break;
}
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return colorspace;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
static const GstDxgiColorSpace *
gst_d3d11_video_info_to_dxgi_color_space_yuv (GstVideoInfo * info)
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
{
gint best_score = G_MAXINT;
gint score, i;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
const GstDxgiColorSpace *colorspace = NULL;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
for (i = 0; i < G_N_ELEMENTS (yuv_colorspace_map); i++) {
score = get_score (info, &yuv_colorspace_map[i], TRUE);
if (score < best_score) {
best_score = score;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
colorspace = &yuv_colorspace_map[i];
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
if (score == 0)
break;
}
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return colorspace;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
const GstDxgiColorSpace *
gst_d3d11_video_info_to_dxgi_color_space (GstVideoInfo * info)
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
{
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
g_return_val_if_fail (info != NULL, NULL);
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
if (GST_VIDEO_INFO_IS_RGB (info)) {
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return gst_d3d11_video_info_to_dxgi_color_space_rgb (info);
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
} else if (GST_VIDEO_INFO_IS_YUV (info)) {
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return gst_d3d11_video_info_to_dxgi_color_space_yuv (info);
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return NULL;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
const GstDxgiColorSpace *
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
gst_d3d11_find_swap_chain_color_space (GstVideoInfo * info,
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
IDXGISwapChain3 * swapchain, gboolean use_hdr10)
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
{
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
const GstDxgiColorSpace *colorspace = NULL;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
gint best_score = G_MAXINT;
gint i;
g_return_val_if_fail (info != NULL, FALSE);
g_return_val_if_fail (swapchain != NULL, FALSE);
if (!GST_VIDEO_INFO_IS_RGB (info)) {
GST_WARNING ("Swapchain colorspace should be RGB format");
return FALSE;
}
for (i = 0; i < G_N_ELEMENTS (rgb_colorspace_map); i++) {
UINT can_support = 0;
HRESULT hr;
gint score;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
GST_DXGI_COLOR_SPACE_TYPE cur_type =
rgb_colorspace_map[i].dxgi_color_space_type;
/* FIXME: Non-HDR colorspace with BT2020 primaries will break rendering.
* https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/1175
* To workaround it, BT709 colorspace will be chosen for non-HDR case.
*/
if (!use_hdr10 &&
rgb_colorspace_map[i].primaries == GST_VIDEO_COLOR_PRIMARIES_BT2020)
continue;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
hr = IDXGISwapChain3_CheckColorSpaceSupport (swapchain,
cur_type, &can_support);
if (FAILED (hr))
continue;
if ((can_support & DXGI_SWAP_CHAIN_COLOR_SPACE_SUPPORT_FLAG_PRESENT) ==
DXGI_SWAP_CHAIN_COLOR_SPACE_SUPPORT_FLAG_PRESENT) {
score = get_score (info, &rgb_colorspace_map[i], FALSE);
GST_DEBUG ("colorspace %d supported, score %d", cur_type, score);
if (score < best_score) {
best_score = score;
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
colorspace = &rgb_colorspace_map[i];
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
}
}
d3d11window: Reorganize display colorspace selection The set of supported color space by DXGI is not full combination of our colorimetry. That means we should convert color space to one of supported color space by DXGI. This commit modifies the color space selection step so that d3d11window can find the best matching DXGI color space first and then the selected input/output color space will be referenced by shader and/or d3d11videoprocessor.
2020-03-09 11:29:17 +00:00
return colorspace;
d3d11format: Add util methods for mapping DXGI color space with ours Move color space mapping and hdr10 metadata conversion methods to d3d11format in order to reuse the code.
2020-01-29 08:29:04 +00:00
}
#endif
Reference in a new issue Copy permalink