mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-02 14:36:41 +00:00
Code Issues 1 Projects Releases Wiki Activity
gstreamer/subprojects/gst-plugins-base/gst/compositor/blend.h

134 lines
6.4 KiB
C
Raw Normal View History

compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
/*
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
* Copyright (C) 2009 Sebastian Dröge <sebastian.droege@collabora.co.uk>
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Library General Public
* License as published by the Free Software Foundation; either
* version 2 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Library General Public License for more details.
*
* You should have received a copy of the GNU Library General Public
* License along with this library; if not, write to the
* Free Software Foundation, Inc., 51 Franklin St, Fifth Floor,
* Boston, MA 02110-1301, USA.
*/
#ifndef __BLEND_H__
#define __BLEND_H__
#include <gst/gst.h>
#include <gst/video/video.h>
compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
/**
* GstCompositorBlendMode:
compositor: Implement different operators via per-pad property This removes the crossfade-ratio property and replaces it with an operator property. Currently this implements the following operators: - SOURCE: Copy over the source and don't look at the destination - OVER: Default blending of the source over the destination - ADD: Like OVER but simply adding the alpha instead See the example for how to implement crossfading with this. https://bugzilla.gnome.org/show_bug.cgi?id=797169
2018-10-27 15:44:27 +00:00
* @COMPOSITOR_BLEND_MODE_SOURCE: Copy source
* @COMPOSITOR_BLEND_MODE_OVER: Normal blending
* @COMPOSITOR_BLEND_MODE_ADD: Alphas are simply added,
compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
*
* The different modes compositor can use for blending.
*/
typedef enum
{
compositor: Implement different operators via per-pad property This removes the crossfade-ratio property and replaces it with an operator property. Currently this implements the following operators: - SOURCE: Copy over the source and don't look at the destination - OVER: Default blending of the source over the destination - ADD: Like OVER but simply adding the alpha instead See the example for how to implement crossfading with this. https://bugzilla.gnome.org/show_bug.cgi?id=797169
2018-10-27 15:44:27 +00:00
COMPOSITOR_BLEND_MODE_SOURCE,
COMPOSITOR_BLEND_MODE_OVER,
COMPOSITOR_BLEND_MODE_ADD,
compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
} GstCompositorBlendMode;
compositor: blend with multiple threads Increases the throughput of compositing by using more CPU cycles across multiple threads. Simple cases (the output contains one pixel from at most one input) can have up to a 70% increase in throughput. Not so simple cases are limited by the region with the most number of composite operations. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/-/merge_requests/755>
2020-07-15 05:46:56 +00:00
/*
* @srcframe: source #GstVideoFrame
* @xpos: horizontal start position of @srcframe, leftmost pixel line.
* @ypos: vertical start position of @srcframe, topmost pixel line.
* @gdouble: src_alpha, alpha factor applied to @srcframe
* @destframe: destination #GstVideoFrame
* @dst_y_start: start position of where to write into @destframe. Used for splitting work across multiple sequences.
* @dst_y_end: end position of where to write into @destframe. Used for splitting work across multiple sequences.
*/
compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
typedef void (*BlendFunction) (GstVideoFrame *srcframe, gint xpos, gint ypos, gdouble src_alpha, GstVideoFrame * destframe,
compositor: blend with multiple threads Increases the throughput of compositing by using more CPU cycles across multiple threads. Simple cases (the output contains one pixel from at most one input) can have up to a 70% increase in throughput. Not so simple cases are limited by the region with the most number of composite operations. Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/-/merge_requests/755>
2020-07-15 05:46:56 +00:00
gint dst_y_start, gint dst_y_end, GstCompositorBlendMode mode);
typedef void (*FillCheckerFunction) (GstVideoFrame * frame, guint y_start, guint y_end);
typedef void (*FillColorFunction) (GstVideoFrame * frame, guint y_start, guint y_end, gint c1, gint c2, gint c3);
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
extern BlendFunction gst_compositor_blend_argb;
extern BlendFunction gst_compositor_blend_bgra;
#define gst_compositor_blend_ayuv gst_compositor_blend_argb
compositor: Add support for VUYA format Reversed order of AYUV format. Most of core methods are prepared already.
2019-08-20 14:12:22 +00:00
#define gst_compositor_blend_vuya gst_compositor_blend_bgra
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
#define gst_compositor_blend_abgr gst_compositor_blend_argb
#define gst_compositor_blend_rgba gst_compositor_blend_bgra
compositor: Add support for crossfade blending Crossfading is a bit more complex than just having two pads with the right keyframes as the blending is not exactly the same. The difference is in the way we compute the alpha channel, in the case of crossfading, we have to compute an additive operation between the destination and the source (factored by the alpha property of both the input pad alpha property and the crossfading ratio) basically so that the crossfade result of 2 opaque frames is also fully opaque at any time in the crossfading process, avoid bleeding through the layer blending. Some rationnal can be found in https://phabricator.freedesktop.org/T7773. https://bugzilla.gnome.org/show_bug.cgi?id=784827
2017-07-06 18:26:21 +00:00
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
extern BlendFunction gst_compositor_overlay_argb;
extern BlendFunction gst_compositor_overlay_bgra;
#define gst_compositor_overlay_ayuv gst_compositor_overlay_argb
compositor: Add support for VUYA format Reversed order of AYUV format. Most of core methods are prepared already.
2019-08-20 14:12:22 +00:00
#define gst_compositor_overlay_vuya gst_compositor_overlay_bgra
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
#define gst_compositor_overlay_abgr gst_compositor_overlay_argb
#define gst_compositor_overlay_rgba gst_compositor_overlay_bgra
extern BlendFunction gst_compositor_blend_i420;
#define gst_compositor_blend_yv12 gst_compositor_blend_i420
extern BlendFunction gst_compositor_blend_nv12;
extern BlendFunction gst_compositor_blend_nv21;
extern BlendFunction gst_compositor_blend_y41b;
extern BlendFunction gst_compositor_blend_y42b;
extern BlendFunction gst_compositor_blend_y444;
extern BlendFunction gst_compositor_blend_rgb;
#define gst_compositor_blend_bgr gst_compositor_blend_rgb
extern BlendFunction gst_compositor_blend_rgbx;
#define gst_compositor_blend_bgrx gst_compositor_blend_rgbx
#define gst_compositor_blend_xrgb gst_compositor_blend_rgbx
#define gst_compositor_blend_xbgr gst_compositor_blend_rgbx
extern BlendFunction gst_compositor_blend_yuy2;
#define gst_compositor_blend_uyvy gst_compositor_blend_yuy2;
#define gst_compositor_blend_yvyu gst_compositor_blend_yuy2;
extern FillCheckerFunction gst_compositor_fill_checker_argb;
#define gst_compositor_fill_checker_abgr gst_compositor_fill_checker_argb
extern FillCheckerFunction gst_compositor_fill_checker_bgra;
#define gst_compositor_fill_checker_rgba gst_compositor_fill_checker_bgra
extern FillCheckerFunction gst_compositor_fill_checker_ayuv;
compositor: Add support for VUYA format Reversed order of AYUV format. Most of core methods are prepared already.
2019-08-20 14:12:22 +00:00
extern FillCheckerFunction gst_compositor_fill_checker_vuya;
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
extern FillCheckerFunction gst_compositor_fill_checker_i420;
#define gst_compositor_fill_checker_yv12 gst_compositor_fill_checker_i420
extern FillCheckerFunction gst_compositor_fill_checker_nv12;
extern FillCheckerFunction gst_compositor_fill_checker_nv21;
extern FillCheckerFunction gst_compositor_fill_checker_y41b;
extern FillCheckerFunction gst_compositor_fill_checker_y42b;
extern FillCheckerFunction gst_compositor_fill_checker_y444;
extern FillCheckerFunction gst_compositor_fill_checker_rgb;
#define gst_compositor_fill_checker_bgr gst_compositor_fill_checker_rgb
extern FillCheckerFunction gst_compositor_fill_checker_rgbx;
#define gst_compositor_fill_checker_bgrx gst_compositor_fill_checker_rgbx
compositor: Define a separate checker fill function for BGRx/RGBx than for xBGR/xRGB Otherwise we'll create a cyan or yellow checkerboard. Fixes https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/736
2020-03-09 18:12:12 +00:00
extern FillCheckerFunction gst_compositor_fill_checker_xrgb;
#define gst_compositor_fill_checker_xbgr gst_compositor_fill_checker_xrgb
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
extern FillCheckerFunction gst_compositor_fill_checker_yuy2;
#define gst_compositor_fill_checker_yvyu gst_compositor_fill_checker_yuy2;
extern FillCheckerFunction gst_compositor_fill_checker_uyvy;
extern FillColorFunction gst_compositor_fill_color_argb;
extern FillColorFunction gst_compositor_fill_color_abgr;
extern FillColorFunction gst_compositor_fill_color_bgra;
extern FillColorFunction gst_compositor_fill_color_rgba;
extern FillColorFunction gst_compositor_fill_color_ayuv;
compositor: Add support for VUYA format Reversed order of AYUV format. Most of core methods are prepared already.
2019-08-20 14:12:22 +00:00
extern FillColorFunction gst_compositor_fill_color_vuya;
compositor: Add a new compositor based on the new GstVideoAggregator base class It is a replacement for videomixer with a similare API Co-Authored by: Thibault Saunier <tsaunier@gnome.org> https://bugzilla.gnome.org/show_bug.cgi?id=731919
2014-05-22 17:46:02 +00:00
extern FillColorFunction gst_compositor_fill_color_i420;
extern FillColorFunction gst_compositor_fill_color_yv12;
extern FillColorFunction gst_compositor_fill_color_nv12;
#define gst_compositor_fill_color_nv21 gst_compositor_fill_color_nv12;
extern FillColorFunction gst_compositor_fill_color_y41b;
extern FillColorFunction gst_compositor_fill_color_y42b;
extern FillColorFunction gst_compositor_fill_color_y444;
extern FillColorFunction gst_compositor_fill_color_rgb;
extern FillColorFunction gst_compositor_fill_color_bgr;
extern FillColorFunction gst_compositor_fill_color_xrgb;
extern FillColorFunction gst_compositor_fill_color_xbgr;
extern FillColorFunction gst_compositor_fill_color_rgbx;
extern FillColorFunction gst_compositor_fill_color_bgrx;
extern FillColorFunction gst_compositor_fill_color_yuy2;
extern FillColorFunction gst_compositor_fill_color_yvyu;
extern FillColorFunction gst_compositor_fill_color_uyvy;
void gst_compositor_init_blend (void);
#endif /* __BLEND_H__ */
Reference in a new issue Copy permalink