GStreamer plugins written in Rust. *These plugins can be used by applications written in other programming languages as well of course, they are just like any other GStreamer plugins available on the system.*
Find a file
Ivan Molodetskikh 54ae12c8c2 gtk4: Premultiply alpha in GL textures
GTK expects GL textures to have premultiplied alpha. The ones we get
from GStreamer don't, leading to incorrect rendering of semitransparent
frames.

GTK 4.12 gained an API to set a different GL texture format, but it
won't help for older GTK versions. Plus, at the time of writing, it
causes a very slow download/upload path in GTK.

So, use a GTK GL shader node to premultiply the alpha without leaving
the GPU.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1330>
2023-09-20 19:27:57 +03:00
audio Update version to 0.10.11 2023-07-20 14:43:13 +03:00
ci ci: Follow 0.20 branch of the gstreamer-rs repo for the CI template 2023-04-22 12:31:24 +03:00
docs webrtcsink: Add support for d3d11 memory and qsvh264enc 2023-09-20 19:24:31 +03:00
generic Update version to 0.10.11 2023-07-20 14:43:13 +03:00
mux Update version to 0.10.11 2023-07-20 14:43:13 +03:00
net onvifmetadataparse: Skip metadata frames with unrepresentable UTC time 2023-09-20 19:25:31 +03:00
text Update version to 0.10.11 2023-07-20 14:43:13 +03:00
tutorial Update version to 0.10.11 2023-07-20 14:43:13 +03:00
utils Update version to 0.10.11 2023-07-20 14:43:13 +03:00
version-helper Correctly declare 1.64 as minimum supported Rust version 2023-07-05 12:36:57 +03:00
video gtk4: Premultiply alpha in GL textures 2023-09-20 19:27:57 +03:00
.gitignore .gitignore builddir 2021-06-03 09:19:31 +02:00
.gitlab-ci.yml ci: Remove omx=disabled from the documentation job 2023-07-19 09:56:46 +03:00
Cargo.lock Update Cargo.lock 2023-07-20 14:43:23 +03:00
Cargo.toml Add livesync plugin 2022-12-14 18:51:36 +02:00
cargo_wrapper.py meson: Don't require Python 3.8 for cargo_wrapper.py 2023-09-20 19:23:25 +03:00
CHANGELOG.md Update CHANGELOG.md for 0.10.11 2023-07-20 14:43:01 +03:00
deny.toml deny: Update 2023-06-19 18:56:41 +03:00
dependencies.py meson: Handle features detection for gst version in a script 2023-03-14 13:36:15 +02:00
LICENSE-APACHE Change license from LGPLv2.1+ to Apache2/MIT 2017-02-16 17:52:27 +02:00
LICENSE-LGPLv2 Add gst-plugin-togglerecord 2017-12-05 09:56:58 +02:00
LICENSE-MIT Change license from LGPLv2.1+ to Apache2/MIT 2017-02-16 17:52:27 +02:00
LICENSE-MPL-2.0 Add a GTK4 paintable sink plugin 2021-10-13 12:28:51 +03:00
Makefile Clean up Makefile some more 2019-07-06 10:32:22 +03:00
meson.build meson: Fix handling of optional deps 2023-09-20 19:23:55 +03:00
meson_options.txt meson: Fix handling of optional deps 2023-09-20 19:23:55 +03:00
README.md Add mp4 plugin to README.md 2023-02-13 11:56:50 +02:00
rustfmt.toml rustfmt.toml: Add file 2022-04-05 19:13:59 +03:00
update-version.sh update-version.sh: Also update versions in Cargo.lock 2023-04-05 15:12:39 +00:00

gst-plugins-rs crates.io pipeline status

Repository containing various GStreamer plugins and elements written in the Rust programming language.

The plugins build upon the GStreamer Rust bindings. Check the README.md of that repository also for details about how to set-up your development environment.

Plugins

You will find the following plugins in this repository:

  • generic

    • file: A Rust implementation of the standard filesrc and filesink elements

    • sodium: Elements to perform encryption and decryption using libsodium.

    • threadshare: Some popular threaded elements reimplemented using common thread-sharing infrastructure.

  • net

    • aws: Various elements for Amazon AWS services using the AWS SDK library

      • s3src/s3sink: A source and sink element to talk to the Amazon S3 object storage system.
      • s3hlssink: A sink element to store HLS streams on Amazon S3.
      • awstranscriber: an element wrapping the AWS Transcriber service.
      • awstranscribeparse: an element parsing the packets of the AWS Transcriber service.
    • hlssink3: An element for generating MPEG-TS HLS streams.

    • ndi: An NDI plugin containing a source, sink and device provider.

    • onvif: Various elements for parsing, RTP (de)payloading, overlaying of ONVIF timed metadata.

    • raptorq: Encoder/decoder element for RaptorQ RTP FEC mechanism.

    • reqwest: An HTTP source element based on the reqwest library.

    • rtp:

      • rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec.

      • rtpgccbwe: RTP bandwidth estimator based on the Google Congestion Control algorithm.

    • webrtc: WebRTC elements, with batteries included Sink elements for specific signalling protocols.

    • webrtchttp: Simple WebRTC HTTP elements (WHIP/WHEP).

  • audio

    • audiofx: Elements to apply audio effects to a stream

    • claxon: A FLAC decoder based on the Claxon library.

    • csound: A plugin to implement audio effects using the Csound library.

    • lewton: A Vorbis decoder based on the lewton library.

    • spotify: A plugin to access content from Spotify based on the librespot library.

  • video

    • cdg: A parser and renderer for CD+G karaoke data.

    • closedcaption: Plugin to deal with closed caption streams

      • ccdetect: Detects if a stream contains active Closed Captions.
      • cea608overlay: Overlay CEA-608 / EIA-608 closed captions over a video stream.
      • cea608tojson: Convert CEA-608 / EIA-608 closed captions to a JSON stream.
      • cea608tott: Convert CEA-608 / EIA-608 closed captions to timed text.
      • jsontovtt: Convert JSON to timed text.
      • mccenc: Convert CEA-608 / EIA-608 and CEA-708 / EIA-708 closed captions to the MCC format.
      • mccparse: Parse CEA-608 / EIA-608 and CEA-708 / EIA-708 closed captions from the MCC format.
      • sccenc: Convert CEA-608 / EIA-608 closed captions to the MCC format.
      • sccparse: Parse CEA-608 / EIA-608 closed captions from the MCC format.
      • transcriberbin: Convenience bin around transcriber elements like aws_transcriber.
      • tttocea608: Convert timed text to CEA-608 / EIA-608 closed captions.
      • tttojson: Convert timed text to JSON.
    • dav1d: AV1 decoder based on the dav1d library.

    • ffv1: FFV1 decoder based on the ffv1 library.

    • gif: A GIF encoder based on the gif library.

    • gtk4: A GTK4 video sink that provides a GdkPaintable for UI integration.

    • hsv: Plugin with various elements to work with video data in hue, saturation, value format

      • hsvdetector: Mark pixels that are close to a configured color in HSV format.
      • hsvfilter: Apply various transformations in the HSV colorspace.
    • png: PNG encoder based on the png library.

    • rav1e: AV1 encoder based on the rav1e library.

    • videofx: Plugin with various video filters.

      • roundedcorners: Element to make the corners of a video rounded via the alpha channel.
      • colordetect: A pass-through filter able to detect the dominant color(s) on incoming frames, using color-thief.
      • videocompare: Compare similarity of video frames. The element can use different hashing algorithms like Blockhash, DSSIM, and others.
    • webp: WebP decoder based on the libwebp-sys-2 library.

  • mux

    • flavors: FLV demuxer based on the flavors library.

    • fmp4: A fragmented MP4/ISOBMFF/CMAF muxer for generating e.g. DASH/HLS media fragments.

    • mp4: A non-fragmented MP4 muxer for generating MP4 files.

  • text

    • ahead: A plugin to display upcoming text buffers ahead.

    • json: A plugin to convert a stream of JSON objects to a higher level wrapped NDJSON output.

    • regex: A regular expression text filter plugin.

    • wrap: A plugin to perform text wrapping with hyphenation.

  • utils

    • fallbackswitch:

      • fallbackswitch: An element that allows falling back to different sink pads after a timeout based on the sink pads' priorities.
      • fallbacksrc: Element similar to urisourcebin that allows configuring a fallback audio/video if there are problems with the main source.
    • livesync: Element to maintain a continuous live stream from a potentially unstable source.

    • togglerecord: Element to enable starting and stopping multiple streams together.

    • tracers: Plugin with multiple tracers:

      • buffer-lateness: Records lateness of buffers and the reported latency for each pad in a CSV file. Contains a script for visualization.
      • pipeline-snapshot: Creates a .dot file of all pipelines in the application whenever requested.
      • queue-levels: Records queue levels for each queue in a CSV file. Contains a script for visualization.
    • uriplaylistbin: Helper bin to gaplessly play a list of URIs.

Building

gst-plugins-rs relies on cargo-c to generate shared and static C libraries. It can be installed using:

$ cargo install cargo-c

Then you can easily build and test a specific plugin:

$ cargo cbuild -p gst-plugin-cdg
$ GST_PLUGIN_PATH="target/x86_64-unknown-linux-gnu/debug:$GST_PLUGIN_PATH" gst-inspect-1.0 cdgdec

Replace x86_64-unknown-linux-gnu with your system's Rust target triple (rustc -vV).

The plugin can also be installed system-wide:

$ cargo cbuild -p gst-plugin-cdg --prefix=/usr
$ cargo cinstall -p gst-plugin-cdg --prefix=/usr

This will install the plugin to /usr/lib/gstreamer-1.0. You can use --libdir to pass a custom lib directory such as /usr/lib/x86_64-linux-gnu for example.

Note that you can also just use cargo directly to build Rust static libraries and shared C libraries. cargo-c is mostly useful to build static C libraries and generate pkg-config files.

In case cargo complains about dependency versions after a git pull, cargo update may be able to resolve those.

LICENSE

gst-plugins-rs and all crates contained in here are licensed under one of the following licenses

GStreamer itself is licensed under the Lesser General Public License version 2.1 or (at your option) any later version: https://www.gnu.org/licenses/lgpl-2.1.html

Contribution

Any kinds of contributions are welcome as a merge request.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in gst-plugins-rs by you shall be licensed under the license of the plugin it is added to.

For new plugins the MPL-2 license is preferred.