mirror of
https://gitlab.freedesktop.org/gstreamer/gstreamer.git
synced 2024-11-03 16:09:39 +00:00
786 lines
39 KiB
Text
786 lines
39 KiB
Text
# GStreamer 1.8 Release Notes
|
|
|
|
**GStreamer 1.8.0 was released on 24 March 2016.**
|
|
|
|
The GStreamer team is proud to announce a new major feature release in the
|
|
stable 1.x API series of your favourite cross-platform multimedia framework!
|
|
|
|
As always, this release is again packed with new features, bug fixes and other
|
|
improvements.
|
|
|
|
See [https://gstreamer.freedesktop.org/releases/1.8/][latest] for the latest
|
|
version of this document.
|
|
|
|
*Last updated: Thursday 24 March 2016, 10:00 UTC [(log)][gitlog]*
|
|
|
|
[latest]: https://gstreamer.freedesktop.org/releases/1.8/
|
|
[gitlog]: https://cgit.freedesktop.org/gstreamer/www/log/src/htdocs/releases/1.8/release-notes-1.8.md
|
|
|
|
## Highlights
|
|
|
|
- **Hardware-accelerated zero-copy video decoding on Android**
|
|
|
|
- **New video capture source for Android using the android.hardware.Camera API**
|
|
|
|
- **Windows Media reverse playback** support (ASF/WMV/WMA)
|
|
|
|
- **New tracing system** provides support for more sophisticated debugging tools
|
|
|
|
- **New high-level GstPlayer playback convenience API**
|
|
|
|
- **Initial support for the new [Vulkan][vulkan] API**, see
|
|
[Matthew Waters' blog post][vulkan-in-gstreamer] for more details
|
|
|
|
- **Improved Opus audio codec support**: Support for more than two channels; MPEG-TS demuxer/muxer can now handle Opus;
|
|
[sample-accurate][opus-sample-accurate] encoding/decoding/transmuxing with
|
|
Ogg, Matroska, ISOBMFF (Quicktime/MP4), and MPEG-TS as container;
|
|
[new codec utility functions for Opus header and caps handling][opus-codec-utils]
|
|
in pbutils library. The Opus encoder/decoder elements were also moved to
|
|
gst-plugins-base (from -bad), and the opus RTP depayloader/payloader to -good.
|
|
|
|
[opus-sample-accurate]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
|
|
[opus-codec-utils]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstpbutilscodecutils.html
|
|
|
|
- **GStreamer VAAPI module now released and maintained as part of the GStreamer project**
|
|
|
|
[vulkan]: https://www.khronos.org/vulkan
|
|
[vulkan-in-gstreamer]: http://ystreet00.blogspot.co.uk/2016/02/vulkan-in-gstreamer.html
|
|
|
|
## Major new features and changes
|
|
|
|
### Noteworthy new API, features and other changes
|
|
|
|
- New GstVideoAffineTransformationMeta meta for adding a simple 4x4 affine
|
|
transformation matrix to video buffers
|
|
|
|
- [g\_autoptr()](https://developer.gnome.org/glib/stable/glib-Miscellaneous-Macros.html#g-autoptr)
|
|
support for all types is exposed in GStreamer headers now, in combination
|
|
with a sufficiently-new GLib version (i.e. 2.44 or later). This is primarily
|
|
for the benefit of application developers who would like to make use of
|
|
this, the GStreamer codebase itself will not be using g_autoptr() for
|
|
the time being due to portability issues.
|
|
|
|
- GstContexts are now automatically propagated to elements added to a bin
|
|
or pipeline, and elements now maintain a list of contexts set on them.
|
|
The list of contexts set on an element can now be queried using the new functions
|
|
[gst\_element\_get\_context()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-context)
|
|
and [gst\_element\_get\_contexts()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-contexts). GstContexts are used to share context-specific configuration objects
|
|
between elements and can also be used by applications to set context-specific
|
|
configuration objects on elements, e.g. for OpenGL or Hardware-accelerated
|
|
video decoding.
|
|
|
|
- New [GST\_BUFFER\_DTS\_OR\_PTS()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
|
|
convenience macro that returns the decode timestamp if one is set and
|
|
otherwise returns the presentation timestamp
|
|
|
|
- New GstPadEventFullFunc that returns a GstFlowReturn instead of a gboolean.
|
|
This new API is mostly for internal use and was added to fix a race condition
|
|
where occasionally internal flow error messages were posted on the bus when
|
|
sticky events were propagated at just the wrong moment whilst the pipeline
|
|
was shutting down. This happened primarily when the pipeline was shut down
|
|
immediately after starting it up. GStreamer would not know that the reason
|
|
the events could not be propagated was because the pipeline was shutting down
|
|
and not some other problem, and now the flow error allows GStreamer to know
|
|
the reason for the failure (and that there's no reason to post an error
|
|
message). This is particularly useful for queue-like elements which may need
|
|
to asynchronously propagate a previous flow return from downstream.
|
|
|
|
- Pipeline dumps in form of "dot files" now also show pad properties that
|
|
differ from their default value, the same as it does for elements. This is
|
|
useful for elements with pad subclasses that provide additional properties,
|
|
e.g. videomixer or compositor.
|
|
|
|
- Pad probes are now guaranteed to be called in the order they were added
|
|
(before they were called in reverse order, but no particular order was
|
|
documented or guaranteed)
|
|
|
|
- Plugins can now have dependencies on device nodes (not just regular files)
|
|
and also have a prefix filter. This is useful for plugins that expose
|
|
features (elements) based on available devices, such as the video4linux
|
|
plugin does with video decoders on certain embedded systems.
|
|
|
|
- gst\_segment\_to\_position() has been deprecated and been replaced by the
|
|
better-named gst\_segment\_position\_from\_running\_time(). At the same time
|
|
gst\_segment\_position\_from\_stream\_time() was added, as well as \_full()
|
|
variants of both to deal with negative stream time.
|
|
|
|
- GstController: the interpolation control source gained a new monotonic cubic
|
|
interpolation mode that, unlike the existing cubic mode, will never overshoot
|
|
the min/max y values set.
|
|
|
|
- GstNetAddressMeta: can now be read from buffers in language bindings as well,
|
|
via the new gst\_buffer\_get\_net\_address\_meta() function
|
|
|
|
- ID3 tag PRIV frames are now extraced into a new GST\_TAG\_PRIVATE\_DATA tag
|
|
|
|
- gst-launch-1.0 and gst\_parse\_launch() now warn in the most common case if
|
|
a dynamic pad link could not be resolved, instead of just silently
|
|
waiting to see if a suitable pad appears later, which is often perceived
|
|
by users as hanging -- they are now notified when this happens and can check
|
|
their pipeline.
|
|
|
|
- GstRTSPConnection now also parses custom RTSP message headers and retains
|
|
them for the application instead of just ignoring them
|
|
|
|
- rtspsrc handling of authentication over tunneled connections (e.g. RTSP over HTTP)
|
|
was fixed
|
|
|
|
- gst\_video\_convert\_sample() now crops if there is a crop meta on the input buffer
|
|
|
|
- The debugging system printf functions are now exposed for general use, which
|
|
supports special printf format specifiers such as GST\_PTR\_FORMAT and
|
|
GST\_SEGMENT\_FORMAT to print GStreamer-related objects. This is handy for
|
|
systems that want to prepare some debug log information to be output at a
|
|
later point in time. The GStreamer-OpenGL subsystem is making use of these
|
|
new functions, which are [gst\_info\_vasprintf()][gst_info_vasprintf],
|
|
[gst\_info\_strdup\_vprintf()][gst_info_strdup_vprintf] and
|
|
[gst\_info\_strdup\_printf()][gst_info_strdup_printf].
|
|
|
|
- videoparse: "strides", "offsets" and "framesize" properties have been added to
|
|
allow parsing raw data with strides and padding that do not match GStreamer
|
|
defaults.
|
|
|
|
- GstPreset reads presets from the directories given in GST\_PRESET\_PATH now.
|
|
Presets are read from there after presets in the system path, but before
|
|
application and user paths.
|
|
|
|
[gst_info_vasprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-vasprintf
|
|
[gst_info_strdup_vprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-vprintf
|
|
[gst_info_strdup_printf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-printf
|
|
|
|
### New Elements
|
|
|
|
- [netsim](): a new (resurrected) element to simulate network jitter and
|
|
packet dropping / duplication.
|
|
|
|
- New VP9 RTP payloader/depayloader elements: rtpvp9pay/rtpvp9depay
|
|
|
|
- New [videoframe_audiolevel]() element, a video frame synchronized audio level element
|
|
|
|
- New spandsp-based tone generator source
|
|
|
|
- New NVIDIA NVENC-based H.264 encoder for GPU-accelerated video encoding on
|
|
suitable NVIDIA hardware
|
|
|
|
- [rtspclientsink](), a new RTSP RECORD sink element, was added to gst-rtsp-server
|
|
|
|
- [alsamidisrc](), a new ALSA MIDI sequencer source element
|
|
|
|
### Noteworthy element features and additions
|
|
|
|
- *identity*: new ["drop-buffer-flags"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-identity.html#GstIdentity--drop-buffer-flags)
|
|
property to drop buffers based on buffer flags. This can be used to drop all
|
|
non-keyframe buffers, for example.
|
|
|
|
- *multiqueue*: various fixes and improvements, in particular special handling
|
|
for sparse streams such as substitle streams, to make sure we don't overread
|
|
them any more. For sparse streams it can be normal that there's no buffer for
|
|
a long period of time, so having no buffer queued is perfectly normal. Before
|
|
we would often unnecessarily try to fill the subtitle stream queue, which
|
|
could lead to much more data being queued in multiqueue than necessary.
|
|
|
|
- *multiqueue*/*queue*: When dealing with time limits, these elements now use the
|
|
new ["GST_BUFFER_DTS_OR_PTS"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
|
|
and ["gst_segment_to_running_time_full()"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstSegment.html#gst-segment-to-running-time-full)
|
|
API, resulting in more accurate levels, especially when dealing with non-raw
|
|
streams (where reordering happens, and we want to use the increasing DTS as
|
|
opposed to the non-continuously increasing PTS) and out-of-segment input/output.
|
|
Previously all encoded buffers before the segment start, which can happen when
|
|
doing ACCURATE seeks, were not taken into account in the queue level calculation.
|
|
|
|
- *multiqueue*: New ["use-interleave"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-multiqueue.html#GstMultiQueue--use-interleave)
|
|
property which allows the size of the queues to be optimized based on the input
|
|
streams interleave. This should only be used with input streams which are properly
|
|
timestamped. It will be used in the future decodebin3 element.
|
|
|
|
- *queue2*: new ["avg-in-rate"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-queue2.html#GstQueue2--avg-in-rate)
|
|
property that returns the average input rate in bytes per second
|
|
|
|
- audiotestsrc now supports all audio formats and is no longer artificially
|
|
limited with regard to the number of channels or sample rate
|
|
|
|
- gst-libav (ffmpeg codec wrapper): map and enable JPEG2000 decoder
|
|
|
|
- multisocketsink can, on request, send a custom GstNetworkMessage event
|
|
upstream whenever data is received from a client on a socket. Similarly,
|
|
socketsrc will, on request, pick up GstNetworkMessage events from downstream
|
|
and send any data contained within them via the socket. This allows for
|
|
simple bidirectional communication.
|
|
|
|
- matroska muxer and demuxer now support the ProRes video format
|
|
|
|
- Improved VP8/VP9 decoding performance on multi-core systems by enabling
|
|
multi-threaded decoding in the libvpx-based decoders on such systems
|
|
|
|
- appsink has a new ["wait-on-eos"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-plugins/html/gst-plugins-base-plugins-appsink.html#GstAppSink--wait-on-eos)
|
|
property, so in cases where it is uncertain if an appsink will have a consumer for
|
|
its buffers when it receives an EOS this can be set to FALSE to ensure that the
|
|
appsink will not hang.
|
|
|
|
- rtph264pay and rtph265pay have a new "config-interval" mode -1 that will
|
|
re-send the setup data (SPS/PPS/VPS) before every keyframe to ensure
|
|
optimal coverage and the shortest possibly start-up time for a new client
|
|
|
|
- mpegtsmux can now mux H.265/HEVC video as well
|
|
|
|
- The MXF muxer was ported to 1.x and produces more standard conformant files now
|
|
that can be handled by more other software; The MXF demuxer got improved
|
|
support for seek tables (IndexTableSegments).
|
|
|
|
### Plugin moves
|
|
|
|
- The rtph265pay/depay RTP payloader/depayloader elements for H.265/HEVC video
|
|
from the rtph265 plugin in -bad have been moved into the existing rtp plugin
|
|
in gst-plugins-good.
|
|
|
|
- The mpg123 plugin containing a libmpg123 based audio decoder element has
|
|
been moved from -bad to -ugly.
|
|
|
|
- The Opus encoder/decoder elements have been moved to gst-plugins-base and
|
|
the RTP payloader to gst-plugins-good, both coming from gst-plugins-bad.
|
|
|
|
### New tracing tools for developers
|
|
|
|
A new tracing subsystem API has been added to GStreamer, which provides
|
|
external tracers with the possibility to strategically hook into GStreamer
|
|
internals and collect data that can be evaluated later. These tracers are a
|
|
new type of plugin features, and GStreamer core ships with a few example
|
|
tracers (latency, stats, rusage, log) to start with. Tracers can be loaded
|
|
and configured at start-up via an environment variable (GST\_TRACER\_PLUGINS).
|
|
|
|
Background: While GStreamer provides plenty of data on what's going on in a
|
|
pipeline via its debug log, that data is not necessarily structured enough to
|
|
be generally useful, and the overhead to enable logging output for all data
|
|
required might be too high in many cases. The new tracing system allows tracers
|
|
to just obtain the data needed at the right spot with as little overhead as
|
|
possible, which will be particularly useful on embedded systems.
|
|
|
|
Of course it has always been possible to do performance benchmarks and debug
|
|
memory leaks, memory consumption and invalid memory access using standard
|
|
operating system tools, but there are some things that are difficult to track
|
|
with the standard tools, and the new tracing system helps with that. Examples
|
|
are things such as latency handling, buffer flow, ownership transfer of
|
|
events and buffers from element to element, caps negotiation, etc.
|
|
|
|
For some background on the new tracing system, watch Stefan Sauer's
|
|
GStreamer Conference talk ["A new tracing subsystem for GStreamer"][tracer-0]
|
|
and for a more specific example how it can be useful have a look at
|
|
Thiago Santos's lightning talk ["Analyzing caps negotiation using GstTracer"][tracer-1]
|
|
and his ["GstTracer experiments"][tracer-2] blog post. There was also a Google
|
|
Summer of Code project in 2015 that used tracing system for a graphical
|
|
GStreamer debugging tool ["gst-debugger"][tracer-3].
|
|
|
|
This is all still very much work in progress, but we hope this will provide the
|
|
foundation for a whole suite of new debugging tools for GStreamer pipelines.
|
|
|
|
[tracer-0]: https://gstconf.ubicast.tv/videos/a-new-tracing-subsystem-for-gstreamer/
|
|
[tracer-1]: https://gstconf.ubicast.tv/videos/analyzing-caps-negotiation-using-gsttracer/
|
|
[tracer-2]: http://blog.thiagoss.com/2015/07/23/gsttracer-experiments/
|
|
[tracer-3]: https://git.gnome.org/browse/gst-debugger
|
|
|
|
### GstPlayer: a new high-level API for cross-platform multimedia playback
|
|
|
|
GStreamer has had reasonably high-level API for multimedia playback
|
|
in the form of the playbin element for a long time. This allowed application
|
|
developers to just configure a URI to play, and playbin would take care of
|
|
everything else. This works well, but there is still way too much to do on
|
|
the application-side to implement a fully-featured playback application, and
|
|
too much general GStreamer pipeline API exposed, making it less accessible
|
|
to application developers.
|
|
|
|
Enter GstPlayer. GstPlayer's aim is to provide an even higher-level abstraction
|
|
of a fully-featured playback API but specialised for its specific use case. It
|
|
also provides easy integration with and examples for Gtk+, Qt, Android, OS/X,
|
|
iOS and Windows. Watch Sebastian's [GstPlayer talk at the GStreamer Conference][gstplayer-talk]
|
|
for more information, or check out the [GstPlayer API reference][gstplayer-api]
|
|
and [GstPlayer examples][gstplayer-examples].
|
|
|
|
[gstplayer-api]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/player.html
|
|
[gstplayer-talk]: https://gstconf.ubicast.tv/videos/gstplayer-a-simple-cross-platform-api-for-all-your-media-playback-needs-part-1/
|
|
[gstplayer-examples]: https://github.com/sdroege/gst-player/
|
|
|
|
### Adaptive streaming: DASH, HLS and MSS improvements
|
|
|
|
- dashdemux now supports loading external xml nodes pointed from its MPD.
|
|
|
|
- Content protection nodes parsing support for PlayReady WRM in mssdemux.
|
|
|
|
- Reverse playback was improved to respect seek start and stop positions.
|
|
|
|
- Adaptive demuxers (hlsdemux, dashdemux, mssdemux) now support the SNAP_AFTER
|
|
and SNAP_BEFORE seek flags which will jump to the nearest fragment boundary
|
|
when executing a seek, which means playback resumes more quickly after a seek.
|
|
|
|
### Audio library improvements
|
|
|
|
- audio conversion, quantization and channel up/downmixing functionality
|
|
has been moved from the audioconvert element into the audio library and
|
|
is now available as public API in form of [GstAudioConverter][audio-0],
|
|
[GstAudioQuantize][audio-1] and [GstAudioChannelMixer][audio-2].
|
|
Audio resampling will follow in future releases.
|
|
|
|
- [gst\_audio\_channel\_get\_fallback\_mask()][audio-3] can be used
|
|
to retrieve a default channel mask for a given number of channels as last
|
|
resort if the layout is unknown
|
|
|
|
- A new [GstAudioClippingMeta][audio-4] meta was added for specifying clipping
|
|
on encoded audio buffers
|
|
|
|
- A new GstAudioVisualizer base class for audio visualisation elements;
|
|
most of the existing visualisers have been ported over to the new base class.
|
|
This new base class lives in the pbutils library rather than the audio library,
|
|
since we'd have had to make libgstaudio depend on libgstvideo otherwise,
|
|
which was deemed undesirable.
|
|
|
|
[audio-0]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioConverter.html
|
|
[audio-1]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioQuantize.html
|
|
[audio-2]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-mix-new
|
|
[audio-3]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-get-fallback-mask
|
|
[audio-4]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
|
|
|
|
### GStreamer OpenGL support improvements
|
|
|
|
#### Better OpenGL Shader support
|
|
|
|
[GstGLShader][shader] has been revamped to allow more OpenGL shader types
|
|
by utilizing a new GstGLSLStage object. Each stage holds an OpenGL pipeline
|
|
stage such as a vertex, fragment or a geometry shader that are all compiled
|
|
separately into a program that is executed.
|
|
|
|
The glshader element has also received a revamp as a result of the changes in
|
|
the library. It does not take file locations for the vertex and fragment
|
|
shaders anymore. Instead it takes the strings directly leaving the file
|
|
management to the application.
|
|
|
|
A new [example][liveshader-example] was added utilizing the new shader
|
|
infrastructure showcasing live shader edits.
|
|
|
|
[shader]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglshader.html
|
|
[liveshader-example]: https://cgit.freedesktop.org/gstreamer/gst-plugins-bad/tree/tests/examples/gtk/glliveshader.c
|
|
|
|
#### OpenGL GLMemory rework
|
|
|
|
[GstGLMemory] was extensively reworked to support the addition of multiple
|
|
texture targets required for zero-copy integration with the Android
|
|
MediaCodec elements. This work was also used to provide IOSurface based
|
|
GLMemory on OS X for zero-copy with OS X's VideoToolbox decoder (vtdec) and
|
|
AV Foundation video source (avfvideosrc). There are also patches in bugzilla
|
|
for GstGLMemoryEGL specifically aimed at improving the decoding performance on
|
|
the Raspberry Pi.
|
|
|
|
[GstGLMemory]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglmemory.html
|
|
|
|
A texture-target field was added to video/x-raw(memory:GLMemory) caps to signal
|
|
the texture target contained in the GLMemory. Its values can be 2D, rectangle
|
|
or external-oes. glcolorconvert can convert between the different formats as
|
|
required and different elements will accept or produce different targets. e.g.
|
|
glimagesink can take and render external-oes textures directly as required for
|
|
effecient zero-copy on android.
|
|
|
|
A generic GL allocation framework was also implemented to support the generic
|
|
allocation of OpenGL buffers and textures which is used extensively by
|
|
GstGLBufferPool.
|
|
|
|
#### OpenGL DMABuf import uploader
|
|
|
|
There is now a DMABuf uploader available for automatic selection that will
|
|
attempt to import the upstream provided DMABuf. The uploader will import into
|
|
2D textures with the necesarry format. YUV to RGB conversion is still provided
|
|
by glcolorconvert to avoid the laxer restrictions with external-oes textures.
|
|
|
|
#### OpenGL queries
|
|
|
|
Queries of various aspects of the OpenGL runtime such as timers, number of
|
|
samples or the current timestamp are not possible. The GstGLQuery object uses a
|
|
delayed debug system to delay the debug output to later to avoid expensive calls
|
|
to the glGet\* family of functions directly after finishing a query. It is
|
|
currently used to output the time taken to perform various operations of texture
|
|
uploads and downloads in GstGLMemory.
|
|
|
|
#### New OpenGL elements
|
|
|
|
glcolorbalance has been created mirroring the videobalance elements.
|
|
glcolorbalance provides the exact same interface as videobalance so can be used
|
|
as a GPU accelerated replacement. glcolorbalance has been added to glsinkbin so
|
|
usage with playsink/playbin will use it automatically instead of videobalance
|
|
where possible.
|
|
|
|
glvideoflip, which is the OpenGL equiavalant of videoflip, implements the exact
|
|
same interface and functionality as videoflip.
|
|
|
|
#### EGL implementation now selects OpenGL 3.x
|
|
|
|
The EGL implementation can now select OpenGL 3.x contexts.
|
|
|
|
#### OpenGL API removal
|
|
|
|
The GstGLDownload library object was removed as it was not used by anything.
|
|
Everything is performed by GstGLMemory or in the gldownloadelement.
|
|
|
|
The GstGLUploadMeta library object was removed as it was not being used and we
|
|
don't want to promote the use of GstVideoGLTextureUploadMeta.
|
|
|
|
#### OpenGL: Other miscellaneous changes
|
|
|
|
- The EGL implementation can now select OpenGL 3.x contexts. This brings
|
|
OpenGL 3.x to e.g. wayland and other EGL systems.
|
|
|
|
- glstereomix/glstereosplit are now built and are usable on OpenGL ES systems
|
|
|
|
- The UYVY/YUY2 to RGBA and RGBA to UYVY/YUY2 shaders were fixed removing the
|
|
sawtooth pattern and luma bleeding.
|
|
|
|
- We now utilize the GL\_APPLE\_sync extension on iOS devices which improves
|
|
performance of OpenGL applications, especially with multiple OpenGL
|
|
contexts.
|
|
|
|
- glcolorconvert now uses a bufferpool to avoid costly
|
|
glGenTextures/glDeleteTextures for every frame.
|
|
|
|
- glvideomixer now has full glBlendFunc and glBlendEquation support per input.
|
|
|
|
- gltransformation now support navigation events so your weird transformations
|
|
also work with DVD menus.
|
|
|
|
- qmlglsink can now run on iOS, OS X and Android in addition to the already
|
|
supported Linux platform.
|
|
|
|
- glimagesink now posts unhandled keyboard and mouse events (on backends that
|
|
support user input, current only X11) on the bus for the application.
|
|
|
|
### Initial GStreamer Vulkan support
|
|
|
|
Some new elements, vulkansink and vulkanupload have been implemented utilizing
|
|
the new Vulkan API. The implementation is currently limited to X11 platforms
|
|
(via xcb) and does not perform any scaling of the stream's contents to the size
|
|
of the available output.
|
|
|
|
A lot of infrasctructure work has been undertaken to support using Vulkan in
|
|
GStreamer in the future. A number of GstMemory subclasses have been created for
|
|
integrating Vulkan's GPU memory handling along with VkBuffer's and VkImage's
|
|
that can be passed between elements. Some GStreamer refcounted wrappers for
|
|
global objects such as VkInstance, VkDevice, VkQueue, etc have also been
|
|
implemented along with GstContext integration for sharing these objects with the
|
|
application.
|
|
|
|
### GStreamer VAAPI support for hardware-accelerated video decoding and encoding on Intel (and other) platforms
|
|
|
|
#### GStreamer VAAPI is now part of upstream GStreamer
|
|
|
|
The GStreamer-VAAPI module which provides support for hardware-accelerated
|
|
video decoding, encoding and post-processing on Intel graphics hardware
|
|
on Linux has moved from its previous home at the [Intel Open Source Technology Center][iostc]
|
|
to the upstream GStreamer repositories, where it will in future be maintained
|
|
as part of the upstream GStreamer project and released in lockstep with the
|
|
other GStreamer modules. The current maintainers will continue to spearhead
|
|
the development at the new location:
|
|
|
|
[http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/][gst-vaapi-git]
|
|
|
|
[gst-vaapi-git]: http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/
|
|
|
|
GStreamer-VAAPI relies heavily on certain GStreamer infrastructure API that
|
|
is still in flux such as the OpenGL integration API or the codec parser
|
|
libraries, and one of the goals of the move was to be able to leverage
|
|
new developments early and provide tighter integration with the latest
|
|
developments of those APIs and other graphics-related APIs provided by
|
|
GStreamer, which should hopefully improve performance even further and in
|
|
some cases might also provide better stability.
|
|
|
|
Thanks to everyone involved in making this move happen!
|
|
|
|
#### GStreamer VAAPI: Bug tracking
|
|
|
|
Bugs had already been tracked on [GNOME bugzilla](bgo) but will be moved
|
|
from the gstreamer-vaapi product into a new gstreamer-vaapi component of
|
|
the GStreamer product in bugzilla. Please file new bugs against the new
|
|
component in the GStreamer product from now on.
|
|
|
|
#### GStreamer VAAPI: Pending patches
|
|
|
|
The code base has been re-indented to the GStreamer code style, which
|
|
affected some files more than others. This means that some of the patches
|
|
in bugzilla might not apply any longer, so if you have any unmerged patches
|
|
sitting in bugzilla please consider checking if they still apply cleany and
|
|
refresh them if not. Sorry for any inconvenience this may cause.
|
|
|
|
#### GStreamer VAAPI: New versioning scheme and supported GStreamer versions
|
|
|
|
The version numbering has been changed to match the GStreamer version
|
|
numbering to avoid confusion: there is a new gstreamer-vaapi 1.6.0 release
|
|
and a 1.6 branch that is roughly equivalent to the previous 0.7.0 version.
|
|
Future releases 1.7.x and 1.8.x will be made alongside GStreamer releases.
|
|
|
|
While it was possible and supported by previous releases to build against
|
|
a whole range of different GStreamer versions (such as 1.2, 1.4, 1.6 or 1.7/1.8),
|
|
in the future there will only be one target branch, so that git master will
|
|
track GStreamer git master, 1.8.x will target GStreamer 1.8, and
|
|
1.6.x will target the 1.6 series.
|
|
|
|
[iostc]: http://01.org
|
|
[bgo]: http://bugzilla.gnome.og
|
|
|
|
#### GStreamer VAAPI: Miscellaneous changes
|
|
|
|
All GStreamer-VAAPI functionality is now provided solely by its GStreamer
|
|
elements. There is no more public library exposing GstVaapi API, this API
|
|
was only ever meant for private use by the elements. Parts of it may be
|
|
resurrected again in future if needed, but for now it has all been made
|
|
private.
|
|
|
|
GStreamer-VAAPI now unconditionally uses the codecparser library in
|
|
gst-plugins-bad instead of shipping its own internal copy. Similarly,
|
|
it no longer ships its own codec parsers but relies on the upstream
|
|
codec parser elements.
|
|
|
|
The GStreamer-VAAPI encoder elements have been renamed from vaapiencode_foo
|
|
to vaapifooenc, so encoders are now called vaapih264enc, vaapih265enc,
|
|
vaapimpeg2enc, vaapijpegenc, and vaapivp8enc. With this change we now follow
|
|
the standard names in GStreamer, and the plugin documentation is generated
|
|
correctly.
|
|
|
|
In the case of the decoders, only the jpeg decoder has been split from the
|
|
general decoding element vaapidecode: vaapijpegdec. This is the first step to
|
|
split per codec each decoding element. The vaapijpegdec has also been given
|
|
marginal rank for the time being.
|
|
|
|
#### GStreamer VAAPI: New features in 1.8: 10-bit H.265/HEVC decoding support
|
|
|
|
Support for decoding 10-bit H.265/HEVC has been added. For the time being
|
|
this only works in combination with vaapisink though, until support for the
|
|
P010 video format used internally is added to GStreamer and to the
|
|
vaGetImage()/vaPutimage() API in the vaapi-intel-driver.
|
|
|
|
Several fixes for memory leaks, build errors, and in the internal
|
|
video parsing.
|
|
|
|
Finally, vaapisink now posts the unhandled keyboard and mouse events to the
|
|
application.
|
|
|
|
### GStreamer Video 4 Linux Support
|
|
|
|
Colorimetry support has been enhanced even more. It will now properly select
|
|
default values when not specified by the driver. The range of color formats
|
|
supported by GStreamer has been greatly improved. Notably, support for
|
|
multi-planar I420 has been added along with all the new and non-ambiguous RGB
|
|
formats that got added in recent kernels.
|
|
|
|
The device provider now exposes a variety of properties as found in the udev
|
|
database.
|
|
|
|
The video decoder is now able to negotiate the downstream format.
|
|
|
|
Elements that are dynamically created from /dev/video\* now track changes on
|
|
these devices to ensure the registry stay up to date.
|
|
|
|
All this and various bug fixes that improve both stability and correctness.
|
|
|
|
### GStreamer Editing Services
|
|
|
|
Added APIs to handle asset proxying support. Proxy creation is not the
|
|
responsibility of GES itself, but GES provides all the needed features
|
|
for it to be cleanly handled at a higher level.
|
|
|
|
Added support for changing playback rate. This means that now, whenever a
|
|
user adds a 'pitch' element (as it is the only known element to change playback
|
|
rate through properties), GES will handle everything internally. This change
|
|
introduced a new media-duration-factor property in NleObject which will
|
|
lead to tweaking of seek events so they have the proper playback range to be
|
|
requested upstream.
|
|
|
|
Construction of NLE objects has been reworked making copy/pasting fully
|
|
functional and allowing users to set properties on effects right after
|
|
creating them.
|
|
|
|
Rework of the title source to add more flexibility in text positioning,
|
|
and letting the user get feedback about rendered text positioning.
|
|
|
|
Report nlecomposition structural issues (coming from user programing mistakes)
|
|
into ERROR messages on the bus.
|
|
|
|
Add GI/pythyon testsuite in GES itself, making sure the API is working as expected
|
|
in python, and allowing writing tests faster.
|
|
|
|
### GstValidate
|
|
|
|
Added support to run tests inside gdb.
|
|
|
|
Added a 'smart' reporting mode where we give as much information as possible about
|
|
critical errors.
|
|
|
|
Uses GstTracer now instead of a LD\_PRELOAD library.
|
|
|
|
## Miscellaneous
|
|
|
|
- encodebin now works with "encoder-muxers" such as wavenc
|
|
|
|
- gst-play-1.0 acquired a new keyboard shortcut: '0' seeks back to the start
|
|
|
|
- gst-play-1.0 supports two new command line switches: -v for verbose output
|
|
and --flags to configure the playbin flags to use.
|
|
|
|
## Build and Dependencies
|
|
|
|
- The GLib dependency requirement was bumped to 2.40
|
|
|
|
- The -Bsymbolic configure check now works with clang as well
|
|
|
|
- ffmpeg is now required as libav provider, incompatible changes were
|
|
introduced that make it no longer viable to support both FFmpeg and Libav
|
|
as libav providers. Most major distros have switched to FFmpeg or are in
|
|
the process of switching to it anyway, so we don't expect this to be a
|
|
problem, and there is still an internal copy of ffmpeg that can be used
|
|
as fallback if needed.
|
|
|
|
- The internal ffmpeg snapshot is now FFMpeg 3.0, but it should be possible
|
|
to build against 2.8 as well for the time being.
|
|
|
|
## Platform-specific improvements
|
|
|
|
### Android
|
|
|
|
- Zero-copy video decoding on Android using the hardware-accelerated decoders
|
|
has been implemented, and is fully integrated with the GStreamer OpenGL stack
|
|
|
|
- ahcsrc, a new camera source element, has been merged and can be used to
|
|
capture video on android devices. It uses the android.hardware.Camera Java
|
|
API to capture from the system's cameras.
|
|
|
|
- The OpenGL-based QML video sink can now also be used on Android
|
|
|
|
- New tinyalsasink element, which is mainly useful for Android but can also
|
|
be used on other platforms.
|
|
|
|
### OS/X and iOS
|
|
|
|
- The system clock now uses mach\_absolute\_time() on OSX/iOS, which is
|
|
the preferred high-resolution monotonic clock to be used on Apple platforms
|
|
|
|
- The OpenGL-based QML video sink can now also be used on OS X and iOS (with
|
|
some Qt build system massaging)
|
|
|
|
- New IOSurface based memory implementation in avfvideosrc and vtdec on OS X
|
|
for zerocopy with OpenGL. The previously used OpenGL extension
|
|
GL_APPLE_ycbcr_422 is not compatible with GL 3.x core contexts.
|
|
|
|
- New GstAppleCoreVideoMemory wrapping CVPixelBuffer's
|
|
|
|
- avfvideosrc now supports renegotiation.
|
|
|
|
### Windows
|
|
|
|
- Various bugs with UDP and multicast were fixed on Windows, mostly related to
|
|
gst-rtsp-server.
|
|
|
|
- A few bugs in directsoundsrc and directsoundsink were fixed that could cause
|
|
the element to lock up. Also the "mute" property on the sink was fixed, and
|
|
a new "device" property for device selection was added to the source.
|
|
|
|
## Known Issues
|
|
|
|
- Building GStreamer applications with the Android NDK r11 is currently not
|
|
supported due to incompatible changes in the NDK. This is expected to be
|
|
fixed for 1.8.1.
|
|
[Bugzilla #763999](https://bugzilla.gnome.org/show_bug.cgi?id=763999)
|
|
|
|
- vp8enc crashes on 32 bit Windows, but was working fine in 1.6. 64 bit
|
|
Windows is unaffected.
|
|
[Bugzilla #763663](https://bugzilla.gnome.org/show_bug.cgi?id=763663)
|
|
|
|
## Contributors
|
|
|
|
Adam Miartus, Alban Bedel, Aleix Conchillo Flaqué, Aleksander Wabik,
|
|
Alessandro Decina, Alex Ashley, Alex Dizengof, Alex Henrie, Alistair Buxton,
|
|
Andreas Cadhalpun, Andreas Frisch, André Draszik, Anthony G. Basile,
|
|
Antoine Jacoutot, Anton Bondarenko, Antonio Ospite, Arjen Veenhuizen,
|
|
Arnaud Vrac, Arun Raghavan, Athanasios Oikonomou, Aurélien Zanelli, Ben Iofel,
|
|
Bob Holcomb, Branko Subasic, Carlos Rafael Giani, Chris Bass, Csaba Toth,
|
|
Daniel Kamil Kozar, Danilo Cesar Lemes de Paula, Dave Craig, David Fernandez,
|
|
David Schleef, David Svensson Fors, David Waring, David Wu, Duncan Palmer,
|
|
Edward Hervey, Egor Zaharov, Etienne Peron, Eunhae Choi, Evan Callaway,
|
|
Evan Nemerson, Fabian Orccon, Florent Thiéry, Florin Apostol, Frédéric Wang,
|
|
George Kiagiadakis, George Yunaev, Göran Jönsson, Graham Leggett,
|
|
Guillaume Desmottes, Guillaume Marquebielle, Haihua Hu, Havard Graff,
|
|
Heinrich Fink, Holger Kaelberer, HoonHee Lee, Hugues Fruchet, Hyunil Park,
|
|
Hyunjun Ko, Ilya Konstantinov, James Stevenson, Jan Alexander Steffens (heftig),
|
|
Jan Schmidt, Jason Litzinger, Jens Georg, Jimmy Ohn, Joan Pau Beltran,
|
|
Joe Gorse, John Chang, John Slade, Jose Antonio Santos Cadenas, Josep Torra,
|
|
Julian Bouzas, Julien Isorce, Julien Moutte, Justin Kim, Kazunori Kobayashi,
|
|
Koop Mast, Lim Siew Hoon, Linus Svensson, Lubosz Sarnecki, Luis de Bethencourt,
|
|
Lukasz Forynski, Manasa Athreya, Marcel Holtmann, Marcin Kolny, Marcus Prebble,
|
|
Mark Nauwelaerts, Maroš Ondrášek, Martin Kelly, Matej Knopp, Mathias Hasselmann,
|
|
Mathieu Duponchelle, Matt Crane, Matthew Marsh, Matthew Waters, Matthieu Bouron,
|
|
Mersad Jelacic, Michael Olbrich, Miguel París Díaz, Mikhail Fludkov,
|
|
Mischa Spiegelmock, Nicola Murino, Nicolas Dufresne, Nicolas Huet,
|
|
Nirbheek Chauhan, Ognyan Tonchev, Olivier Crête, Pablo Anton, Pankaj Darak,
|
|
Paolo Pettinato, Patricia Muscalu, Paul Arzelier, Pavel Bludov, Perry Hung,
|
|
Peter Korsgaard, Peter Seiderer, Petr Viktorin, Philippe Normand,
|
|
Philippe Renon, Philipp Zabel, Philip Van Hoof, Philip Withnall, Piotr Drąg,
|
|
plamot, Polochon\_street, Prashant Gotarne, Rajat Verma, Ramiro Polla,
|
|
Ravi Kiran K N, Reynaldo H. Verdejo Pinochet, Robert Swain, Romain Picard,
|
|
Roman Nowicki, Ross Burton, Ryan Hendrickson, Santiago Carot-Nemesio,
|
|
Scott D Phillips, Sebastian Dröge, Sebastian Rasmussen, Sergey Borovkov,
|
|
Seungha Yang, Sjors Gielen, Song Bing, Sreerenj Balachandran, Srimanta Panda,
|
|
Stavros Vagionitis, Stefan Sauer, Steven Hoving, Stian Selnes, Suhwang Kim,
|
|
Thiago Santos, Thibault Saunier, Thijs Vermeir, Thomas Bluemel, Thomas Roos,
|
|
Thomas Vander Stichele, Tim-Philipp Müller, Tim Sheridan, Ting-Wei Lan,
|
|
Tom Deseyn, Vanessa Chipirrás Navalón, Víctor Manuel Jáquez Leal,
|
|
Vincent Dehors, Vincent Penquerc'h, Vineeth T M, Vivia Nikolaidou,
|
|
Wang Xin-yu (王昕宇), William Manley, Wim Taymans, Wonchul Lee, Xavi Artigas,
|
|
Xavier Claessens, Youness Alaoui,
|
|
|
|
... and many others who have contributed bug reports, translations, sent
|
|
suggestions or helped testing.
|
|
|
|
## Bugs fixed in 1.8
|
|
|
|
More than [~700 bugs][bugs-fixed-in-1.8] have been fixed during
|
|
the development of 1.8.
|
|
|
|
This list does not include issues that have been cherry-picked into the
|
|
stable 1.6 branch and fixed there as well, all fixes that ended up in the
|
|
1.6 branch are also included in 1.8.
|
|
|
|
This list also does not include issues that have been fixed without a bug
|
|
report in bugzilla, so the actual number of fixes is much higher.
|
|
|
|
[bugs-fixed-in-1.8]: https://bugzilla.gnome.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&classification=Platform&limit=0&list_id=107311&order=bug_id&product=GStreamer&query_format=advanced&resolution=FIXED&target_milestone=1.6.1&target_milestone=1.6.2&target_milestone=1.6.3&target_milestone=1.7.0&target_milestone=1.7.1&target_milestone=1.7.2&target_milestone=1.7.3&target_milestone=1.7.4&target_milestone=1.7.90&target_milestone=1.7.91&target_milestone=1.7.92&target_milestone=1.7.x&target_milestone=1.8.0
|
|
|
|
## Stable 1.8 branch
|
|
|
|
After the 1.8.0 release there will be several 1.8.x bug-fix releases which
|
|
will contain bug fixes which have been deemed suitable for a stable branch,
|
|
but no new features or intrusive changes will be added to a bug-fix release
|
|
usually. The 1.8.x bug-fix releases will be made from the git 1.8 branch, which
|
|
is a stable branch.
|
|
|
|
### 1.8.0
|
|
|
|
1.8.0 was released on 24 March 2016.
|
|
|
|
### 1.8.1
|
|
|
|
The first 1.8 bug-fix release (1.8.1) is planned for April 2016.
|
|
|
|
## Schedule for 1.10
|
|
|
|
Our next major feature release will be 1.10, and 1.9 will be the unstable
|
|
development version leading up to the stable 1.10 release. The development
|
|
of 1.9/1.10 will happen in the git master branch.
|
|
|
|
The plan for the 1.10 development cycle is yet to be confirmed, but it is
|
|
expected that feature freeze will be around late July or early August,
|
|
followed by several 1.9 pre-releases and the new 1.10 stable release
|
|
in September.
|
|
|
|
1.10 will be backwards-compatible to the stable 1.8, 1.6, 1.4, 1.2 and 1.0
|
|
release series.
|
|
|
|
- - -
|
|
|
|
*These release notes have been prepared by Tim-Philipp Müller with
|
|
contributions from Sebastian Dröge, Nicolas Dufresne, Edward Hervey, Víctor
|
|
Manuel Jáquez Leal, Arun Raghavan, Thiago Santos, Thibault Saunier, Jan
|
|
Schmidt and Matthew Waters.*
|
|
|
|
*License: [CC BY-SA 4.0](http://creativecommons.org/licenses/by-sa/4.0/)*
|