Seungha Yang
7bfdeaf161
d3d11: Add support for Array typed texture memory
...
A ID3D11Texture2D memory can consist of multiple planes with array.
For array typed memory, GstD3D11Allocator will allocate new GstD3D11Memory
with increased reference count to the ID3D11Texture2D but different array index.
2019-12-31 02:13:48 +00:00
Seungha Yang
81dde0f5b8
d3d11: Aggregate d3d11 memory usage query for dynamic-usage type decision
...
Even if one of downstream d3d11 elements can support dynamic-usage memory,
another one might not support it. Also, to support dynamic-usage,
both upstream and downstream d3d11device must be the same object.
2019-12-28 05:43:44 +00:00
Seungha Yang
d731bcb18a
d3d11colorconvert: Remove device type dependent behavior
...
If d3d11colorconvert element is configured, do color space conversion
regardless of the device type whether it's S/W emulation or real H/W.
Since d3d11colorconvert is no more a child of d3d11videosinkbin,
we don't need this behavior. Note that previous code was added to
avoid color space conversion from d3d11videosink if no hardware
device is available (S/W emulation of d3d11 is too slow).
2019-12-28 05:43:44 +00:00
Seungha Yang
46186356ca
d3d11colorconverter: Fix unmatched lock/unlock pair
2019-12-28 05:43:44 +00:00
Seungha Yang
ab80c771df
d3d11upload: Don't hard overwrite caps features to support d3d11 memory passthrough
...
d3d11upload should be able to support upstream d3d11 memory, not only system memory.
Fix for following pipeline
d3d11upload ! "video/x-raw(memory:D3D11Memory)" ! d3d11videosink
2019-12-28 05:43:44 +00:00
Seungha Yang
5298d95195
d3d11window: Make use of partial presentation with IDXGISwapChain1::Present1
...
Since we might draw on partial area of backbuffer in case of force-aspect-ratio,
presenting only updated area is more efficient way.
See also https://docs.microsoft.com/ko-kr/windows/win32/direct3ddxgi/dxgi-1-2-presentation-improvements
2019-12-24 20:10:54 +09:00
Seungha Yang
487a41d312
d3d11videosink: Add support for overlay composition
...
Add d3d11overlaycompositor object to draw overlay image
on render target using Blend method.
2019-12-24 19:00:45 +09:00
Seungha Yang
a5295509af
d3d11: Enable dxgi debug layer and always try to pop d3d11/dxgi debug message if possible
...
Note that dxgi and d3d11 sdk debug will be enabled on debug build
2019-12-24 19:00:40 +09:00
Seungha Yang
0e013fe539
d3d11videosink: Use dynamic texture for fallback buffer
...
Upload CPU memory to texture directly by using dynamic usage texture.
This will reduce at least one step of staging copy per frame.
2019-12-20 19:21:02 +09:00
Seungha Yang
65cace22e2
d3d11colorconvert: Set TRANSFER_NEED_DOWNLOAD flag to output memory for later cpu access
...
Otherwise CPU cannot access texture via gst_memory_map()
2019-12-20 19:21:02 +09:00
Seungha Yang
18e13404a2
d3d11colorconvert: Use shader resource and render target bind flags together
...
The output of d3d11colorconvert would be used for rendering (i.e., shader resource)
2019-12-20 19:21:02 +09:00
Seungha Yang
62c8d19e01
d3d11window: Change aspect-ratio mode from window thread
...
Call DXGI API from window thread as much as possible
2019-12-20 19:21:02 +09:00
Seungha Yang
1b687d556a
d3d11videosink: Add support for full screen mode
...
borderless top-most style full screen mode support.
Basically fullscreen toggle mode is disabled by default. To enable it
use "fullscreen-toggle-mode" property to allow fullscreen mode change
by user input and/or property.
2019-12-20 19:21:02 +09:00
Seungha Yang
0788492461
d3d11: Use GRecMutex to protect immediate context and dxgi API call
...
In some cases, rendering and dxgi (e.g., swapchain) APIs should be
called from window message pump thread, but current design (dedicated d3d11 thread)
make it impossible. To solve it, change concurrency model to locking based one
from single-thread model.
2019-12-20 19:21:03 +09:00
Seungha Yang
a0a85cd80c
d3d11window: Prefer to use flip-sequential over discard
...
flip-sequential is more efficient than discard
2019-12-20 11:15:12 +09:00
Seungha Yang
1424de0a4a
d3d11window: Don't hold backbuffer interface
...
We don't need to hold it
2019-12-20 11:15:12 +09:00
Seungha Yang
32d618c677
d3d11window: Use CreateSwapChainForHwnd if available
...
That's recommended way from MS and CreateSwapChainForHwnd supports
more options than CreateSwapChain
2019-12-20 11:15:12 +09:00
Seungha Yang
9fd0b62f2d
d3d11: Use configuration file for dxgi header version check
2019-12-20 11:15:12 +09:00
Seungha Yang
23b47a7ec1
d3d11window: Use allow-tearing mode if device supports it
...
As the recommendation from MS.
2019-12-20 11:15:12 +09:00
Seungha Yang
72b6b3557d
d3d11window: Disable fullscreen mode change by alt + enter
...
Disable full screen mode change until proper handling is implemented
2019-12-20 11:15:12 +09:00
Seungha Yang
9dada90108
d3d11videosink: Remove resizing window hack and unify resizing flow
...
In earlier implementation of d3d11videosink where no shader was implemented,
the aspect ratio and render size were adjusted by manipulating the backbuffer size
with unintuitive formula. Since now we do color conversion and resize using
shader, we can remove the hack.
2019-12-20 11:15:12 +09:00
Seungha Yang
61cb6b2bbe
d3d11: Pass GstD3D11Memory object to ensure_{shader_resource,render_target}_view methods
...
The method name indicates it should be d3d11memory, so passing
GstD3D11Memory seems to make more sense than GstMemory.
2019-12-20 11:15:12 +09:00
Seungha Yang
7c041f1934
d3d11videosink: Don't specify crop meta to allocation query
...
d3d11videosink could not handle it for now
2019-12-20 11:15:12 +09:00
Seungha Yang
64eb1d46b5
d3d11window: Always draw to internal window
...
... and use SetParent() WIN32 API when external window is used.
Depending on DXGI swap effect, the external window might not be
reusable by another backend. To preserve the external window's property
and setting, drawing to internal window seems to be safer way.
2019-12-16 22:24:29 +09:00
Seungha Yang
638c6d6931
d3d11window: Always set error reason to GError object
2019-12-16 18:21:02 +09:00
Seungha Yang
a400126889
d3d11window: Initialize surface rect with given external window handle
...
Unlike internal window, resize event might not happen with external window.
2019-12-11 23:04:55 +09:00
Seungha Yang
a8ec409b84
d3d11device: Report alive d3d11 objects at the end
...
It would be useful for debugging d3d11 object leak.
2019-12-11 23:04:49 +09:00
Seungha Yang
59295b4271
d3d11: Fix ID3D11SamplerState leak
2019-12-11 12:57:46 +00:00
Seungha Yang
d963d442c5
d3d11videosink: Fix broken fallback rendering
...
Make fallback rendering work
2019-12-10 04:06:28 +00:00
Seungha Yang
abc1443cf0
d3d11videosink: Add debug message for fallback reason
2019-12-10 04:06:28 +00:00
Seungha Yang
9835289239
d3d11window: Do not check shader resource view if not doing conversion
...
If d3d11window does not convert format internally, shader resource view
is not required. Note that shader resource view is used for
color conversion using shader but when conversion is not required,
we just copy input input texture to backbuffer.
2019-12-10 04:06:28 +00:00
Seungha Yang
8154b22a88
d3d11window: Clear old swapchain per prepare
...
_prepare() might be called multiple times for given window, so clear
old swapchain if any.
Fixes: https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/1138
2019-12-10 10:58:28 +09:00
Seungha Yang
5bf10d8781
d3d11window: Always set dxgi colorspace if possible
...
Not only for the 10 bits RGB case with HDR metadata, set proper color space
to swapchain in order to make color representaion correct
2019-12-09 12:22:15 +00:00
Aaron Boxer
e9891dfe14
d3d11: translate windows error codes to human readable strings
...
This will help with debugging.
2019-12-07 16:09:03 -06:00
Seungha Yang
199caccc41
d3d11: Initialize debug categories of non-GstElement implementation in plugin init
...
That's the way to expose debug category to --gst-debug-help
2019-12-05 02:29:18 +00:00
Seungha Yang
71befc477f
d3d11window: Invoke resize task with high priority
...
On resize event, swapchain should be configured with higher priority
than the other tasks since it's directly related to visual artifacts.
2019-12-05 02:29:18 +00:00
Seungha Yang
d2b85683de
d3d11device: Add gst_d3d11_device_thread_add_full method
...
I would be used to invoke GPU task with specified priority.
2019-12-05 02:29:18 +00:00
Seungha Yang
7cab47ddda
d3d11videosinkbin: Drop d3d11 color convert element
...
d3d11videosink can convert color space now, so the conversion element
seems to be redundant.
2019-12-05 02:29:18 +00:00
Seungha Yang
ca3ddf7848
d3d11videosink: Add color conversion support
...
Draw to back buffer texture directly. It would reduce the number of
copy at least once when color conversion is required.
2019-12-05 02:29:18 +00:00
Seungha Yang
622733ed0d
d3d11converter: Skip setup converter if input and output formats are equal
2019-12-05 02:29:18 +00:00
Seungha Yang
c9cb08fcd4
d3d11colorconvert: Split color space converter to reuse code
2019-12-05 02:29:18 +00:00
Seungha Yang
42ca123f0f
d3d11: Split shader to reuse code
2019-12-05 02:29:18 +00:00
Seungha Yang
59d9589722
d3d11videosink: Draw window with cached texture on resize
...
This would render nicer than presenting scene with broken aspect ratio,
especially in case of low framerate.
2019-12-05 02:29:18 +00:00
Seungha Yang
ddd13fc7c0
d3d11: Add support for D3D11_USAGE_DYNAMIC
...
D3D11 dynamic texture is a special memory type, which is mainly used for
frequent CPU write access to the texture. For now, this texture type
does not support gst_memory_{map,unmap}
2019-12-05 02:29:18 +00:00
Seungha Yang
5ce4748cc0
d3d11device: Add debug message for CreateTexture2D failure
2019-12-05 02:29:18 +00:00
Seungha Yang
914d2df79e
d3d11device: Fix misreading debug message
2019-12-05 02:29:18 +00:00
Seungha Yang
71ae632b25
d3d11colorconvert: Disable color conversion with software rasterizer
...
It's much slower than our CPU based color-converter in most case.
2019-12-05 02:29:18 +00:00
Seungha Yang
79e88b76da
d3d11videosink: Handle context query
...
Propagate d3d11device via context query.
2019-12-05 02:29:18 +00:00
Seungha Yang
5edf64d655
d3d11colorconvert: Avoid copy in/out texture if possible
...
When input and/or output d3d11memory has its own view, use them for
rendering to avoid texture copy
2019-12-05 02:29:18 +00:00
Seungha Yang
da3545e8c8
d3d11memory: Allocate texture with required views
...
Store required resource views with d3d11 texture when it requested.
2019-12-05 02:29:18 +00:00