mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-24 09:10:36 +00:00
Code Issues 1 Projects Releases Wiki Activity

docs: update for 1.0

Browse source
This commit is contained in:
Wim Taymans 2012-10-01 11:58:36 +02:00
parent 579458f613
commit 370d336e9e
3 changed files with 12 additions and 12 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

14
docs/design/draft-subtitle-overlays.txt
View file

@ -1,11 +1,9 @@
=============================================================== ===============================================================
Subtitle overlays, hardware-accelerated decoding and playbin2 Subtitle overlays, hardware-accelerated decoding and playbin
=============================================================== ===============================================================
Status: EARLY DRAFT / BRAINSTORMING Status: EARLY DRAFT / BRAINSTORMING
The following text will use "playbin" synonymous with "playbin2".
=== 1. Background === === 1. Background ===
Subtitles can be muxed in containers or come from an external source. Subtitles can be muxed in containers or come from an external source.
@ -30,7 +28,7 @@ us to allocate and blend whole pictures (1920x1080 AYUV = 8MB,
is only a small rectangle at the bottom. This wastes memory and CPU. is only a small rectangle at the bottom. This wastes memory and CPU.
We could do something better by introducing a new format that only We could do something better by introducing a new format that only
encodes the region(s) of interest, but we don't have such a format yet, and encodes the region(s) of interest, but we don't have such a format yet, and
are not necessarily keen to rewrite this part of the logic in playbin2 are not necessarily keen to rewrite this part of the logic in playbin
at this point - and we can't change existing elements' behaviour, so would at this point - and we can't change existing elements' behaviour, so would
need to introduce new elements for this. need to introduce new elements for this.
@ -58,7 +56,7 @@ map the data back into system memory (and then later back to the GPU).
It's much better to upload the much smaller encoded data to the GPU/DSP It's much better to upload the much smaller encoded data to the GPU/DSP
and then leave it there until rendered. and then leave it there until rendered.
Currently playbin2 only supports subtitles on top of raw decoded video. Currently playbin only supports subtitles on top of raw decoded video.
It will try to find a suitable overlay element from the plugin registry It will try to find a suitable overlay element from the plugin registry
based on the input subtitle caps and the rank. (It is assumed that we based on the input subtitle caps and the rank. (It is assumed that we
will be able to convert any raw video format into any format required will be able to convert any raw video format into any format required
@ -66,7 +64,7 @@ by the overlay using a converter such as videoconvert.)
It will not render subtitles if the video sent to the sink is not It will not render subtitles if the video sent to the sink is not
raw YUV or RGB or if conversions have been disabled by setting the raw YUV or RGB or if conversions have been disabled by setting the
native-video flag on playbin2. native-video flag on playbin.
Subtitle rendering is considered an important feature. Enabling Subtitle rendering is considered an important feature. Enabling
hardware-accelerated decoding by default should not lead to a major hardware-accelerated decoding by default should not lead to a major
@ -174,7 +172,7 @@ Multiple possible solutions come to mind:
to buffers seems more intuitive than sending it interleaved as to buffers seems more intuitive than sending it interleaved as
events. And buffers stored or passed around (e.g. via the events. And buffers stored or passed around (e.g. via the
"last-buffer" property in the sink when doing screenshots via "last-buffer" property in the sink when doing screenshots via
playbin2) always contain all the information needed. playbin) always contain all the information needed.
(d) create a video/x-raw-*-delta format and use a backend-specific videomixer (d) create a video/x-raw-*-delta format and use a backend-specific videomixer
@ -185,7 +183,7 @@ Multiple possible solutions come to mind:
in the video backend plugin. It would also add a concept that in the video backend plugin. It would also add a concept that
might be generally useful (think ximagesrc capture with xdamage). might be generally useful (think ximagesrc capture with xdamage).
However, it would require adding foorender variants of all the However, it would require adding foorender variants of all the
existing overlay elements, and changing playbin2 to that new existing overlay elements, and changing playbin to that new
design, which is somewhat intrusive. And given the general design, which is somewhat intrusive. And given the general
nature of such a new format/API, we would need to take a lot nature of such a new format/API, we would need to take a lot
of care to be able to accommodate all possible use cases when of care to be able to accommodate all possible use cases when

4
docs/design/draft-va.txt
View file

@ -3,7 +3,9 @@ Video Acceleration
Status: Status:
DRAFT. DRAFT. Outdated for 1.0, we want to use video/x-raw in order to
interoperate with all elements that handle video. Optimized handling of
the VA surfaces can be done with the metadata.
Purpose: Purpose:

6
docs/design/part-playbin.txt
View file

@ -1,4 +1,4 @@
playbin2 playbin
-------- --------
The purpose of this element is to decode and render the media contained in a The purpose of this element is to decode and render the media contained in a
@ -48,7 +48,7 @@ Components
- allows for configuration of visualisation element. - allows for configuration of visualisation element.
- allows for enable/disable of visualisation, audio and video. - allows for enable/disable of visualisation, audio and video.
* playbin2 * playbin
- combination of one or more uridecodebin elements to read the uri and subtitle - combination of one or more uridecodebin elements to read the uri and subtitle
uri. uri.
@ -61,7 +61,7 @@ Components
Gapless playback Gapless playback
---------------- ----------------
playbin2 has an "about-to-finish" signal. The application should configure a new playbin has an "about-to-finish" signal. The application should configure a new
uri (and optional suburi) in the callback. When the current media finishes, this uri (and optional suburi) in the callback. When the current media finishes, this
new media will be played next. new media will be played next.