mirror of
https://gitlab.freedesktop.org/gstreamer/gstreamer.git
synced 2024-11-27 20:21:24 +00:00
audiovisualizer: update README
This commit is contained in:
parent
11590ac0b6
commit
00ac111477
1 changed files with 27 additions and 9 deletions
|
@ -3,9 +3,8 @@ video-rate. It receives audio-data at the sampling-rate. It needs to render
|
||||||
video-frames at frame-rate. The rendering needs n audio samples (depends on
|
video-frames at frame-rate. The rendering needs n audio samples (depends on
|
||||||
subclass). The baseclass takes care of that.
|
subclass). The baseclass takes care of that.
|
||||||
|
|
||||||
Some effects could be enhanced by running geometrictransform elements
|
Some effects could be enhanced by running geometrictransform/effecttc elements
|
||||||
afterwards. A blur and/or videozoom element would be great (vertigotv looks
|
afterwards.
|
||||||
great but has some negotiation issues).
|
|
||||||
|
|
||||||
= Feedback =
|
= Feedback =
|
||||||
* put 'Audio' to klass as well ?
|
* put 'Audio' to klass as well ?
|
||||||
|
@ -36,17 +35,35 @@ spectrascope - done
|
||||||
spacescope - stereo wavescope
|
spacescope - stereo wavescope
|
||||||
- left->x, right->y - done
|
- left->x, right->y - done
|
||||||
- polar mapping
|
- polar mapping
|
||||||
multiscope :
|
wavescope
|
||||||
- like wave/space scope, but run the signal through two filters to split it into
|
- we could have a bouncing line as a base, like a quix:
|
||||||
bass, mid and high (200 Hz, 2000 Hz)
|
- two dots moving on a linear path and getting a new random dx,dy when hitting
|
||||||
- draw 3 wave-scopes into red/gree/blue
|
a border
|
||||||
- when drawing only draw that component to mix colors
|
- the abs(dx/dy) - speed of movement - could be scaled by the sound level
|
||||||
- eventually use the spacescope-position to rotate/shift the wave
|
- we would need to rotate, stretch and clip the waveform drawing to fit the
|
||||||
|
line
|
||||||
|
- we could scratch the rotate part and just stretch/squeeze x and shift/clip y
|
||||||
|
|
||||||
|
xxxscope
|
||||||
|
- have a matrix of source and drawing-functions
|
||||||
|
- sources: audio, spectrum, audio-low, audio-mid, audio-hi
|
||||||
|
- drawing: waves (style, color), space (style,color)
|
||||||
|
- have the usual shade and move operations
|
||||||
|
- have a way to draw each operator in one or more color-channels
|
||||||
|
- we could calculate the sound-level (like in level element) and modulate
|
||||||
|
colors/movements
|
||||||
|
- for filtered low/mid/hi audio we could use different peak-falloffs
|
||||||
|
|
||||||
= TODO =
|
= TODO =
|
||||||
- element maker template
|
- element maker template
|
||||||
- test for baseclass
|
- test for baseclass
|
||||||
|
|
||||||
|
- we probably want a VisBin like the gnome video effects
|
||||||
|
- this way we can specify pipeline fragments
|
||||||
|
- VisBin can use a videomixer to switch effects based on time or song
|
||||||
|
- VisBin can e.g. control a text-overlay to render the title into the
|
||||||
|
visualisation for a while
|
||||||
|
|
||||||
= Test it =
|
= Test it =
|
||||||
|
|
||||||
GST_DEBUG="*:2,*scope*:4"
|
GST_DEBUG="*:2,*scope*:4"
|
||||||
|
@ -55,6 +72,7 @@ GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-inspect scopes
|
||||||
|
|
||||||
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch audiotestsrc ! audioconvert ! wavescope ! colorspace ! ximagesink
|
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch audiotestsrc ! audioconvert ! wavescope ! colorspace ! ximagesink
|
||||||
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! wavescope ! colorspace ! ximagesink
|
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! wavescope ! colorspace ! ximagesink
|
||||||
|
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! wavescope style=lines shade-amount=0x00080402 ! edgetv ! vertigotv ! ximagesink
|
||||||
|
|
||||||
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! spacescope style=lines shade-amount=0x00080402 ! ximagesink
|
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! spacescope style=lines shade-amount=0x00080402 ! ximagesink
|
||||||
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! spacescope style=lines shade-amount=0x00080402 ! vertigotv ! ximagesink
|
GST_PLUGIN_PATH=$GST_PLUGIN_PATH:$PWD gst-launch filesrc location=$HOME/Music/1.mp3 ! decodebin2 ! audioconvert ! spacescope style=lines shade-amount=0x00080402 ! vertigotv ! ximagesink
|
||||||
|
|
Loading…
Reference in a new issue