mirrors/gst-plugins-rs
mirrors/gst-plugins-rs
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs.git synced 2024-12-23 02:26:35 +00:00
Code Issues Projects Releases Wiki Activity
GStreamer plugins written in Rust. *These plugins can be used by applications written in other programming languages as well of course, they are just like any other GStreamer plugins available on the system.*
2529 commits 14 branches 101 tags 30 MiB
Rust 96%
JavaScript 1.3%
C 1.1%
Python 0.5%
Meson 0.3%
Other 0.7%
Find a file
François Laignel 299e25ab3c net/aws/transcriber: translate: optional experimental translation tokenization 
This commit adds an optional experimental translation tokenization feature.
It can be activated using the `translation_src_%u` pads property
`tokenization-method`. For the moment, the feature is deactivated by default.

The Translate ws accepts '<span></span>' tags in the input and adds matching
tags in the output. When an 'id' is also provided as an attribute of the
'span', the matching output tag also uses this 'id'.

In the context of close captions, the 'id's are of little use. However, we can
take advantage of the spans in the output to identify translation chunks, which
more or less reflect the rythm of the input transcript.

This commit adds simples spans (no 'id') to the input Transcript Items and
parses the resulting spans in the translated output, assigning the timestamps
and durations sequentially from the input Transcript Items. Edge cases such as
absence of spans, nested spans were observed and are handled here. Similarly,
mismatches between the number of input and output items are taken care of by
some sort of reconcialiation.

Note that this is still experimental and requires further testings.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/1109>
2023-03-14 13:48:32 +00:00
audio Update for remaining gst::Element::link_many() and related API generalization 2023-03-09 17:30:57 +02:00
ci ci: Update to cargo-c 0.9.15 2023-02-20 13:08:46 +02:00
docs net/aws/transcriber: translate: optional experimental translation tokenization 2023-03-14 13:48:32 +00:00
generic Fix indentation broken by cargo clippy --fix 2023-03-09 17:38:41 +02:00
mux fmp4mux: fix hls_live example 2023-03-12 12:58:17 +01:00
net net/aws/transcriber: translate: optional experimental translation tokenization 2023-03-14 13:48:32 +00:00
text Update minimum supported Rust version to 1.66 2023-02-20 11:09:01 +02:00
tutorial Update minimum supported Rust version to 1.66 2023-02-20 11:09:01 +02:00
utils livesync: Support variable framerate in fallback buffer duration calc 2023-03-10 09:18:28 +00:00
version-helper Update minimum supported Rust version to 1.66 2023-02-20 11:09:01 +02:00
video gtk4: Update for glib::Priority API changes 2023-03-12 10:27:16 +02:00
.gitignore .gitignore builddir 2021-06-03 09:19:31 +02:00
.gitlab-ci.yml ci: Update debian jobs to bookworm 2023-03-09 22:09:13 +02:00
Cargo.toml Add livesync plugin 2022-12-14 18:51:36 +02:00
cargo_wrapper.py cargo_wrapper: Write to log with line-buffering 2022-12-29 06:51:17 +05:30
CHANGELOG.md Update CHANGELOG.md for 0.10.4 2023-03-14 14:10:11 +02:00
deny.toml deny: Update 2023-03-11 09:41:41 +02:00
dependencies.py meson: Handle features detection for gst version in a script 2023-03-12 09:16:34 +00:00
LICENSE-APACHE Change license from LGPLv2.1+ to Apache2/MIT 2017-02-16 17:52:27 +02:00
LICENSE-LGPLv2 Add gst-plugin-togglerecord 2017-12-05 09:56:58 +02:00
LICENSE-MIT Change license from LGPLv2.1+ to Apache2/MIT 2017-02-16 17:52:27 +02:00
LICENSE-MPL-2.0 Add a GTK4 paintable sink plugin 2021-10-13 12:28:51 +03:00
Makefile Clean up Makefile some more 2019-07-06 10:32:22 +03:00
meson.build meson: Handle features detection for gst version in a script 2023-03-12 09:16:34 +00:00
meson_options.txt meson: Add an option to build examples 2022-12-28 22:30:11 +05:30
README.md Add mp4 plugin to README.md 2023-02-13 11:56:33 +02:00
rustfmt.toml rustfmt.toml: Add file 2022-04-05 19:13:59 +03:00
update-version.sh update-version.sh: Also update version in meson.build 2022-10-04 21:27:23 +05:30

README.md

gst-plugins-rs crates.io pipeline status

Repository containing various GStreamer plugins and elements written in the Rust programming language.

The plugins build upon the GStreamer Rust bindings. Check the README.md of that repository also for details about how to set-up your development environment.

Plugins

You will find the following plugins in this repository:

  • generic

    • file: A Rust implementation of the standard filesrc and filesink elements

    • sodium: Elements to perform encryption and decryption using libsodium.

    • threadshare: Some popular threaded elements reimplemented using common thread-sharing infrastructure.

  • net

    • aws: Various elements for Amazon AWS services using the AWS SDK library

      • s3src/s3sink: A source and sink element to talk to the Amazon S3 object storage system.
      • s3hlssink: A sink element to store HLS streams on Amazon S3.
      • awstranscriber: an element wrapping the AWS Transcriber service.
      • awstranscribeparse: an element parsing the packets of the AWS Transcriber service.

    • hlssink3: An element for generating MPEG-TS HLS streams.

    • ndi: An NDI plugin containing a source, sink and device provider.

    • onvif: Various elements for parsing, RTP (de)payloading, overlaying of ONVIF timed metadata.

    • raptorq: Encoder/decoder element for RaptorQ RTP FEC mechanism.

    • reqwest: An HTTP source element based on the reqwest library.

    • rtp:

      • rtpav1pay / rtpav1depay: RTP (de)payloader for the AV1 video codec.

      • rtpgccbwe: RTP bandwidth estimator based on the Google Congestion Control algorithm.

    • webrtc: WebRTC elements, with batteries included Sink elements for specific signalling protocols.

    • webrtchttp: Simple WebRTC HTTP elements (WHIP/WHEP).

  • audio

    • audiofx: Elements to apply audio effects to a stream

    • claxon: A FLAC decoder based on the Claxon library.

    • csound: A plugin to implement audio effects using the Csound library.

    • lewton: A Vorbis decoder based on the lewton library.

    • spotify: A plugin to access content from Spotify based on the librespot library.

  • video

    • cdg: A parser and renderer for CD+G karaoke data.

    • closedcaption: Plugin to deal with closed caption streams

      • ccdetect: Detects if a stream contains active Closed Captions.
      • cea608overlay: Overlay CEA-608 / EIA-608 closed captions over a video stream.
      • cea608tojson: Convert CEA-608 / EIA-608 closed captions to a JSON stream.
      • cea608tott: Convert CEA-608 / EIA-608 closed captions to timed text.
      • jsontovtt: Convert JSON to timed text.
      • mccenc: Convert CEA-608 / EIA-608 and CEA-708 / EIA-708 closed captions to the MCC format.
      • mccparse: Parse CEA-608 / EIA-608 and CEA-708 / EIA-708 closed captions from the MCC format.
      • sccenc: Convert CEA-608 / EIA-608 closed captions to the MCC format.
      • sccparse: Parse CEA-608 / EIA-608 closed captions from the MCC format.
      • transcriberbin: Convenience bin around transcriber elements like aws_transcriber.
      • tttocea608: Convert timed text to CEA-608 / EIA-608 closed captions.
      • tttojson: Convert timed text to JSON.

    • dav1d: AV1 decoder based on the dav1d library.

    • ffv1: FFV1 decoder based on the ffv1 library.

    • gif: A GIF encoder based on the gif library.

    • gtk4: A GTK4 video sink that provides a GdkPaintable for UI integration.

    • hsv: Plugin with various elements to work with video data in hue, saturation, value format

      • hsvdetector: Mark pixels that are close to a configured color in HSV format.
      • hsvfilter: Apply various transformations in the HSV colorspace.

    • png: PNG encoder based on the png library.

    • rav1e: AV1 encoder based on the rav1e library.

    • videofx: Plugin with various video filters.

      • roundedcorners: Element to make the corners of a video rounded via the alpha channel.
      • colordetect: A pass-through filter able to detect the dominant color(s) on incoming frames, using color-thief.
      • videocompare: Compare similarity of video frames. The element can use different hashing algorithms like Blockhash, DSSIM, and others.

    • webp: WebP decoder based on the libwebp-sys-2 library.

  • mux

    • flavors: FLV demuxer based on the flavors library.

    • fmp4: A fragmented MP4/ISOBMFF/CMAF muxer for generating e.g. DASH/HLS media fragments.

    • mp4: A non-fragmented MP4 muxer for generating MP4 files.

  • text

    • ahead: A plugin to display upcoming text buffers ahead.

    • json: A plugin to convert a stream of JSON objects to a higher level wrapped NDJSON output.

    • regex: A regular expression text filter plugin.

    • wrap: A plugin to perform text wrapping with hyphenation.

  • utils

    • fallbackswitch:

      • fallbackswitch: An element that allows falling back to different sink pads after a timeout based on the sink pads' priorities.
      • fallbacksrc: Element similar to urisourcebin that allows configuring a fallback audio/video if there are problems with the main source.

    • livesync: Element to maintain a continuous live stream from a potentially unstable source.

    • togglerecord: Element to enable starting and stopping multiple streams together.

    • tracers: Plugin with multiple tracers:

      • buffer-lateness: Records lateness of buffers and the reported latency for each pad in a CSV file. Contains a script for visualization.
      • pipeline-snapshot: Creates a .dot file of all pipelines in the application whenever requested.
      • queue-levels: Records queue levels for each queue in a CSV file. Contains a script for visualization.

    • uriplaylistbin: Helper bin to gaplessly play a list of URIs.

Building

gst-plugins-rs relies on cargo-c to generate shared and static C libraries. It can be installed using:

$ cargo install cargo-c

Then you can easily build and test a specific plugin:

$ cargo cbuild -p gst-plugin-cdg
$ GST_PLUGIN_PATH="target/x86_64-unknown-linux-gnu/debug:$GST_PLUGIN_PATH" gst-inspect-1.0 cdgdec

Replace x86_64-unknown-linux-gnu with your system's Rust target triple (rustc -vV).

The plugin can also be installed system-wide:

$ cargo cbuild -p gst-plugin-cdg --prefix=/usr
$ cargo cinstall -p gst-plugin-cdg --prefix=/usr

This will install the plugin to /usr/lib/gstreamer-1.0. You can use --libdir to pass a custom lib directory such as /usr/lib/x86_64-linux-gnu for example.

Note that you can also just use cargo directly to build Rust static libraries and shared C libraries. cargo-c is mostly useful to build static C libraries and generate pkg-config files.

In case cargo complains about dependency versions after a git pull, cargo update may be able to resolve those.

LICENSE

gst-plugins-rs and all crates contained in here are licensed under one of the following licenses

GStreamer itself is licensed under the Lesser General Public License version 2.1 or (at your option) any later version: https://www.gnu.org/licenses/lgpl-2.1.html

Contribution

Any kinds of contributions are welcome as a merge request.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in gst-plugins-rs by you shall be licensed under the license of the plugin it is added to.

For new plugins the MPL-2 license is preferred.