mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-29 11:40:38 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/gst/vaapi/gstvaapipluginutil.h

143 lines
4.1 KiB
C
Raw Normal View History

Add gst_vaapi_display_lookup_downstream() helper.
2010-05-12 07:57:55 +00:00
/*
Port to GstVideoContext interface. This new interface allows for upstream and downstream display sharing that works in both static and dynamic pipelines. Signed-off-by: Gwenole Beauchesne <gwenole.beauchesne@intel.com>
2011-11-04 20:50:15 +00:00
* gstvaapipluginutil.h - VA-API plugins private helper
Add gst_vaapi_display_lookup_downstream() helper.
2010-05-12 07:57:55 +00:00
*
legal: update copyright notice dates.
2014-01-22 17:54:14 +00:00
* Copyright (C) 2011-2014 Intel Corporation
legal: add per-file authorship information. Credit original authors on a per-file basis as we cannot expect people to know all country-specific rules, or bother browsing through the git history.
2013-11-22 04:57:18 +00:00
* Author: Gwenole Beauchesne <gwenole.beauchesne@intel.com>
Port to GstVideoContext interface. This new interface allows for upstream and downstream display sharing that works in both static and dynamic pipelines. Signed-off-by: Gwenole Beauchesne <gwenole.beauchesne@intel.com>
2011-11-04 20:50:15 +00:00
* Copyright (C) 2011 Collabora
* Author: Nicolas Dufresne <nicolas.dufresne@collabora.co.uk>
Add gst_vaapi_display_lookup_downstream() helper.
2010-05-12 07:57:55 +00:00
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Lesser General Public License
* as published by the Free Software Foundation; either version 2.1
* of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Lesser General Public License for more details.
*
* You should have received a copy of the GNU Lesser General Public
* License along with this library; if not, write to the Free
* Software Foundation, Inc., 51 Franklin Street, Fifth Floor,
* Boston, MA 02110-1301 USA
*/
configure: drop check for --enable-vaapisink-glx. vaapisink is now built with support for multiple display types, whenever they are enabled. The new "display" attribute is used to select a particular renderer.
2012-07-23 15:49:08 +00:00
#ifndef GST_VAAPI_PLUGIN_UTIL_H
#define GST_VAAPI_PLUGIN_UTIL_H
Add gst_vaapi_display_lookup_downstream() helper.
2010-05-12 07:57:55 +00:00
#include <gst/vaapi/gstvaapidisplay.h>
plugins: use common helper function to apply compositions. Use common gst_vaapi_apply_composition() helper function to apply compositions attached to a buffer in vaapisink or GstVaapiVideoConverterGLX.
2013-03-21 15:32:43 +00:00
#include <gst/vaapi/gstvaapisurface.h>
plugins: add helpers to create video caps with features. Add gst_vaapi_video_format_new_template_caps_with_features() helper function to add the supplied caps feature string on GStreamer >= 1.2. Add gst_vaapi_find_preferred_caps_feature() helper function to discover the "best" caps feature to use for the supplied pad. In practice, we will always favor memory:VASurface first, then meta:GLTextureUploadMeta, and finally the system memory caps. https://bugzilla.gnome.org/show_bug.cgi?id=719372
2014-01-14 18:08:36 +00:00
#include "gstvaapivideomemory.h"
Add gst_vaapi_display_lookup_downstream() helper.
2010-05-12 07:57:55 +00:00
plugins: declare helper functions as internal.
2012-07-24 14:14:51 +00:00
G_GNUC_INTERNAL
pluginutils: cosmetics (indentation fixes).
2012-07-23 16:01:26 +00:00
gboolean
plugins: remove gstreamer-0.10 crumbs GstVideoContext was used in gstreamer-0.10, which is not supported anymore. Still, its definition was still in the code. This patch removes it. https://bugzilla.gnome.org/show_bug.cgi?id=749113
2015-05-08 13:54:09 +00:00
gst_vaapi_ensure_display (GstElement * element, GstVaapiDisplayType type);
pluginutils: cosmetics (indentation fixes).
2012-07-23 16:01:26 +00:00
plugins: declare helper functions as internal.
2012-07-24 14:14:51 +00:00
G_GNUC_INTERNAL
pluginutils: cosmetics (indentation fixes).
2012-07-23 16:01:26 +00:00
gboolean
plugins: fix context query handling The current context query handling design is flawed: the function gst_vaapi_reply_to_query() returns FALSE either if the query is not a GST_CONTEXT_QUERY of if the query could not be handled correctly. But the pad query function should handle differently each case. This patch changes the gst_vaapi_reply_to_query() for gst_vaapi_handle_context_query() and changes it usage in all the vaapi plugins to match the correct context query handling. Signed-off-by: Víctor Manuel Jáquez Leal <victorx.jaquez@intel.com> https://bugzilla.gnome.org/show_bug.cgi?id=757598
2015-11-04 20:38:42 +00:00
gst_vaapi_handle_context_query (GstQuery * query, GstVaapiDisplay * display);
vaapipluingutils: add helper to append surface caps to YUV caps.
2012-01-05 10:00:39 +00:00
plugins: declare helper functions as internal.
2012-07-24 14:14:51 +00:00
G_GNUC_INTERNAL
vaapipluingutils: add helper to append surface caps to YUV caps.
2012-01-05 10:00:39 +00:00
gboolean
plugins: re-indent common and video context creation utils.
2013-12-21 05:22:30 +00:00
gst_vaapi_append_surface_caps (GstCaps * out_caps, GstCaps * in_caps);
configure: drop check for --enable-vaapisink-glx. vaapisink is now built with support for multiple display types, whenever they are enabled. The new "display" attribute is used to select a particular renderer.
2012-07-23 15:49:08 +00:00
plugins: use common helper function to apply compositions. Use common gst_vaapi_apply_composition() helper function to apply compositions attached to a buffer in vaapisink or GstVaapiVideoConverterGLX.
2013-03-21 15:32:43 +00:00
G_GNUC_INTERNAL
gboolean
plugins: re-indent common and video context creation utils.
2013-12-21 05:22:30 +00:00
gst_vaapi_apply_composition (GstVaapiSurface * surface, GstBuffer * buffer);
plugins: use common helper function to apply compositions. Use common gst_vaapi_apply_composition() helper function to apply compositions attached to a buffer in vaapisink or GstVaapiVideoConverterGLX.
2013-03-21 15:32:43 +00:00
pluginutils: add G_PRIMITIVE_SWAP() helper macro. This macro helps swapping variables while maintaining the correct underlying and primitive type.
2012-09-06 09:47:40 +00:00
#ifndef G_PRIMITIVE_SWAP
#define G_PRIMITIVE_SWAP(type, a, b) do { \
const type t = a; a = b; b = t; \
} while (0)
#endif
plugins: factor out construction of GValue from GstVideoFormat. Add new helper functions to build GValues from GstVideoFormat: - gst_vaapi_value_set_format(): build a GValue from the supplied video format - gst_vaapi_value_set_format_list(): build a GValue list from the supplied array of video formats
2013-12-21 05:41:34 +00:00
/* Helpers for GValue construction for video formats */
G_GNUC_INTERNAL
gboolean
gst_vaapi_value_set_format (GValue * value, GstVideoFormat format);
G_GNUC_INTERNAL
gboolean
gst_vaapi_value_set_format_list (GValue * value, GArray * formats);
plugins: factor out construction of template caps. Add new helper functions to build video template caps. - gst_vaapi_video_format_new_template_caps(): create GstCaps with size, frame rate and PAR to full range - gst_vaapi_video_format_new_template_caps_from_list(): try to create a "simplified" list from the supplied formats
2013-12-21 09:41:22 +00:00
/* Helpers to build video caps */
plugins: add helpers to create video caps with features. Add gst_vaapi_video_format_new_template_caps_with_features() helper function to add the supplied caps feature string on GStreamer >= 1.2. Add gst_vaapi_find_preferred_caps_feature() helper function to discover the "best" caps feature to use for the supplied pad. In practice, we will always favor memory:VASurface first, then meta:GLTextureUploadMeta, and finally the system memory caps. https://bugzilla.gnome.org/show_bug.cgi?id=719372
2014-01-14 18:08:36 +00:00
typedef enum
{
vaapidecode: delayed src caps negotiation Currently the src caps are set immediately after the sink caps are set, but in that moment the pipeline might not fully constructed and the video sink has not negotiated its supported caps and features. As a consequence, in many cases of playback, the least optimized caps feature is forced. This is partially the responsible of bug #744039. Also, vaapidecode doesn't attend the reconfigure events from downstream, which is a problem too, since the video sink can be changed with different caps features. This patch delays the src caps, setting them until the first frame arrives to the decoder, assuming until that very moment the whole pipeline is already negotiated. Particularly, it checks if the src pad needs to be reconfigured, as a consequence of a reconfiguration event from downstream. A key part of this patch is the new GstVaapiCapsFeature GST_VAAPI_CAPS_FEATURE_NOT_NEGOTIATED, which is returned when the src pad doesn't have a peer yet. Also, for a better report of the caps allowed through the src pad and its peer, this patch uses gst_pad_get_allowed_caps() instead of gst_pad_peer_query_caps() when looking for the preferred feature. v3: move the input_state unref to close(), since videodecoder resets at some events such as navigation. v4: a) the state_changed() callback replaces the input_state if the media changed, so this case is also handled. b) since the parameter ref_state in gst_vaapidecode_update_src_caps() is always the input_state, the parameter were removed. c) there were a lot of repeated code handling the input_state, so I refactored it with the function gst_vaapi_decode_input_state_replace(). https://bugzilla.gnome.org/show_bug.cgi?id=744618 Signed-off-by: Víctor Manuel Jáquez Leal <victorx.jaquez@intel.com> Signed-off-by: Sreerenj Balachandran <sreerenj.balachandran@intel.com>
2015-02-26 10:24:55 +00:00
GST_VAAPI_CAPS_FEATURE_NOT_NEGOTIATED,
GST_VAAPI_CAPS_FEATURE_SYSTEM_MEMORY,
plugins: add helpers to create video caps with features. Add gst_vaapi_video_format_new_template_caps_with_features() helper function to add the supplied caps feature string on GStreamer >= 1.2. Add gst_vaapi_find_preferred_caps_feature() helper function to discover the "best" caps feature to use for the supplied pad. In practice, we will always favor memory:VASurface first, then meta:GLTextureUploadMeta, and finally the system memory caps. https://bugzilla.gnome.org/show_bug.cgi?id=719372
2014-01-14 18:08:36 +00:00
GST_VAAPI_CAPS_FEATURE_GL_TEXTURE_UPLOAD_META,
GST_VAAPI_CAPS_FEATURE_VAAPI_SURFACE,
} GstVaapiCapsFeature;
plugins: factor out construction of template caps. Add new helper functions to build video template caps. - gst_vaapi_video_format_new_template_caps(): create GstCaps with size, frame rate and PAR to full range - gst_vaapi_video_format_new_template_caps_from_list(): try to create a "simplified" list from the supplied formats
2013-12-21 09:41:22 +00:00
G_GNUC_INTERNAL
GstCaps *
gst_vaapi_video_format_new_template_caps (GstVideoFormat format);
G_GNUC_INTERNAL
GstCaps *
gst_vaapi_video_format_new_template_caps_from_list (GArray * formats);
plugins: add helpers to create video caps with features. Add gst_vaapi_video_format_new_template_caps_with_features() helper function to add the supplied caps feature string on GStreamer >= 1.2. Add gst_vaapi_find_preferred_caps_feature() helper function to discover the "best" caps feature to use for the supplied pad. In practice, we will always favor memory:VASurface first, then meta:GLTextureUploadMeta, and finally the system memory caps. https://bugzilla.gnome.org/show_bug.cgi?id=719372
2014-01-14 18:08:36 +00:00
G_GNUC_INTERNAL
GstCaps *
gst_vaapi_video_format_new_template_caps_with_features (GstVideoFormat format,
const gchar * features_string);
G_GNUC_INTERNAL
GstVaapiCapsFeature
plugin: use allowed caps filter from element Instead of using the srcpad template caps for filtering the peer caps, the function gst_vaapi_find_preferred_caps_feature(), now receives a new parameter for the element's allowed caps. With this modification, the vaapipostproc element simplifies a bit its code. https://bugzilla.gnome.org/show_bug.cgi?id=765223
2016-03-29 12:17:54 +00:00
gst_vaapi_find_preferred_caps_feature (GstPad * pad, GstCaps * allowed_caps,
plugins: add support for BGRA textures. Some frameworks (EFL) expect BGRA textures for storage. However, adding support for that broadly into GStreamer framework implies two kinds of hacks: (i) libgstgl helpers currently do not support BGRA textures correctly, (ii) we need to better parse downstream suggested caps and intersect them with what the VA plugin elements can offer to them for GL texturing.
2015-02-09 20:09:07 +00:00
GstVideoFormat * out_format_ptr);
plugins: add helpers to create video caps with features. Add gst_vaapi_video_format_new_template_caps_with_features() helper function to add the supplied caps feature string on GStreamer >= 1.2. Add gst_vaapi_find_preferred_caps_feature() helper function to discover the "best" caps feature to use for the supplied pad. In practice, we will always favor memory:VASurface first, then meta:GLTextureUploadMeta, and finally the system memory caps. https://bugzilla.gnome.org/show_bug.cgi?id=719372
2014-01-14 18:08:36 +00:00
vaapipostproc: add support for "download" capability. Allow implicit conversions to raw video formats, while still keeping VA surfaces underneath. This allows for chaining the vaapipostproc element to a software-only element that takes care of maps/unmaps. e.g. xvimagesink. https://bugzilla.gnome.org/show_bug.cgi?id=720174
2014-08-22 13:22:32 +00:00
G_GNUC_INTERNAL
const gchar *
gst_vaapi_caps_feature_to_string (GstVaapiCapsFeature feature);
vaapidecode: use caps to check the features Instead of calling gst_vaapi_find_preferred_caps_feature(), which is expensive, we check the caps from the allocation query, to check the negotiated feature. In order to do this verification a new utility function has been implemented: gst_vaapi_caps_feature_contains(). As this new function shared its logic with gst_caps_has_vaapi_surface(), both have been refactorized. Signed-off-by: Víctor Manuel Jáquez Leal <victorx.jaquez@intel.com> https://bugzilla.gnome.org/show_bug.cgi?id=756686
2015-10-14 18:30:30 +00:00
G_GNUC_INTERNAL
gboolean
gst_vaapi_caps_feature_contains (const GstCaps * caps,
GstVaapiCapsFeature feature);
vaapipostproc: port to GStreamer 1.0. Add support for interlaced streams with GStreamer 1.0 too. Basically, this enables vaapipostproc, though it is not auto-plugged yet. We also make sure to reply to CAPS queries, and happily handle CAPS events.
2013-04-17 08:18:45 +00:00
/* Helpers to handle interlaced contents */
# define GST_CAPS_INTERLACED_MODES \
vaapipostproc: add support for "mixed" interlace mode. Add support for "mixed" interlace-mode, whereby the video frame buffer shall be deinterlaced only if its flags mention that's actually an interlaced frame buffer.
2013-10-04 14:00:56 +00:00
"interlace-mode = (string){ progressive, interleaved, mixed }"
vaapipostproc: port to GStreamer 1.0. Add support for interlaced streams with GStreamer 1.0 too. Basically, this enables vaapipostproc, though it is not auto-plugged yet. We also make sure to reply to CAPS queries, and happily handle CAPS events.
2013-04-17 08:18:45 +00:00
# define GST_CAPS_INTERLACED_FALSE \
"interlace-mode = (string)progressive"
refactor vaapi caps strings for pad templates Refactor the main vaapi caps strings into three macros: GST_VAAPI_MAKE_SURFACE_CAPS, GST_VAAPI_MAKE_ENC_SURFACE_CAPS and GST_VAAPI_MAKE_GLTEXUPLOAD_CAPS. Those are in gstvaapipluginutil.h so all the elements could use them, instead of re-declaring them every time. No functional changes. Signed-off-by: Víctor Manuel Jáquez Leal <victorx.jaquez@intel.com>
2015-08-05 12:11:12 +00:00
#define GST_VAAPI_MAKE_SURFACE_CAPS \
GST_VIDEO_CAPS_MAKE_WITH_FEATURES( \
gst/vaapi: keep precedence for NV12 over I420 Use NV12 as default "assumption" format all over. NV12 is the default high priority format used my most of the vaapi-drivers.
2016-03-29 12:02:46 +00:00
GST_CAPS_FEATURE_MEMORY_VAAPI_SURFACE, "{ ENCODED, NV12, I420, YV12, P010_10LE }")
refactor vaapi caps strings for pad templates Refactor the main vaapi caps strings into three macros: GST_VAAPI_MAKE_SURFACE_CAPS, GST_VAAPI_MAKE_ENC_SURFACE_CAPS and GST_VAAPI_MAKE_GLTEXUPLOAD_CAPS. Those are in gstvaapipluginutil.h so all the elements could use them, instead of re-declaring them every time. No functional changes. Signed-off-by: Víctor Manuel Jáquez Leal <victorx.jaquez@intel.com>
2015-08-05 12:11:12 +00:00
#define GST_VAAPI_MAKE_GLTEXUPLOAD_CAPS \
GST_VIDEO_CAPS_MAKE_WITH_FEATURES( \
GST_CAPS_FEATURE_META_GST_VIDEO_GL_TEXTURE_UPLOAD_META, "{ RGBA, BGRA }")
plugins: add helper function to disable deinterlacing in caps. Add gst_caps_set_interlaced() helper function that would reset the interlace-mode field to "progressive" for GStreamer >= 1.0, or the interlaced field to "false" for GStreamer 0.10.
2013-10-04 17:30:36 +00:00
G_GNUC_INTERNAL
gboolean
plugins: re-indent common and video context creation utils.
2013-12-21 05:22:30 +00:00
gst_caps_set_interlaced (GstCaps * caps, GstVideoInfo * vip);
plugins: add helper function to disable deinterlacing in caps. Add gst_caps_set_interlaced() helper function that would reset the interlace-mode field to "progressive" for GStreamer >= 1.0, or the interlaced field to "false" for GStreamer 0.10.
2013-10-04 17:30:36 +00:00
plugins: add helper for detecting VA surfaces in caps. Introduce new gst_caps_has_vaapi_surface() helper function to detect whether the supplied caps has VA surfaces. With GStreamer >= 1.2, this implies a check for memory:VASurface caps features, and format=ENCODED for earlier versions of GStreamer.
2014-08-20 09:30:41 +00:00
G_GNUC_INTERNAL
gboolean
gst_caps_has_vaapi_surface (GstCaps * caps);
plugins: preserve framerate when updating src caps video format. In the current implementation, gst_video_info_set_format() would reset the whole GstVideoInfo structure first, prior to setting video format and size. So, coleteral information like framerate or pixel-aspect- ratio are lost. Provide and use a unique gst_video_info_change_format() for overcome this issue, i.e. only have it change the format and video size, and copy over the rest of the fields. https://bugzilla.gnome.org/show_bug.cgi?id=734665
2014-11-18 13:57:02 +00:00
G_GNUC_INTERNAL
void
gst_video_info_change_format (GstVideoInfo * vip, GstVideoFormat format,
guint width, guint height);
pluginutil: add gst_video_info_changed() helper This function is shared among different elements, so let factorized it. https://bugzilla.gnome.org/show_bug.cgi?id=765435
2016-05-20 12:15:53 +00:00
G_GNUC_INTERNAL
gboolean
gst_video_info_changed (GstVideoInfo * old, GstVideoInfo * new);
pluginutil: add gst_video_info_force_nv12_if_encoded() This lines repeat a couple times in the code, so it would be better to put it a helper function. https://bugzilla.gnome.org/show_bug.cgi?id=765435
2016-05-23 13:38:07 +00:00
G_GNUC_INTERNAL
void
gst_video_info_force_nv12_if_encoded (GstVideoInfo * vinfo);
vaapidecodebin: ensure VPP before going to READY There are sometimes that the VA-API display context is not shared among the pipeline, but it is important to know it before going to READY state (when the pipeline is already linked). One instance of this case is this: gst-launch-1.0 filesrc location=media ! decodebin ! vaapipostproc ! vaapisink This patch adds a new function in gstvaapipluginutil called gst_vaapi_create_test_display(). Its purpose is to create a disposable VA-API display, which only will be used for verify if the VAEntrypointVideoProc is available by the hardware. Afterwards, it should be unrefed. If the vaapidecodebin is going to READY state, and the element still doesn't know if VPP is available, the last resort is to create a new instance of the VA-API display and test for it. https://bugzilla.gnome.org/show_bug.cgi?id=749554
2015-08-06 16:48:13 +00:00
G_GNUC_INTERNAL
GstVaapiDisplay *
gst_vaapi_create_test_display (void);
plugins: add gst_vaapi_driver_is_whitelisted() Move some of the logic in gst_vaapi_plugin_base_driver_is_whitelisted() to a new function gst_vaapi_driver_is_whitelisted(), in this way, it can be used when registering the plugin's feature set with the test VA display. https://bugzilla.gnome.org/show_bug.cgi?id=724352
2016-06-28 15:14:06 +00:00
G_GNUC_INTERNAL
gboolean
gst_vaapi_driver_is_whitelisted (GstVaapiDisplay * display);
configure: drop check for --enable-vaapisink-glx. vaapisink is now built with support for multiple display types, whenever they are enabled. The new "display" attribute is used to select a particular renderer.
2012-07-23 15:49:08 +00:00
#endif /* GST_VAAPI_PLUGIN_UTIL_H */
Reference in a new issue Copy permalink