mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-19 08:11:16 +00:00
Code Issues 1 Projects Releases Wiki Activity
2348 commits 44 branches 1509 tags 629 MiB
Commit graph

133 commits

Author SHA1 Message Date
Thibault Saunier
d60ea5da63 validate:launcher: Set ORC_CODE=backup when running gst unit tests under valgrind 2019-04-17 11:04:45 -04:00
Thibault Saunier
ebf0844d2c validate:launcher: Avoid forking when running gstcheck tests in gdb 2019-04-11 13:17:14 +00:00
Thibault Saunier
446f1d8197 validate:launcher: Make extra_logfiles a set and fix their names 2019-04-11 13:17:14 +00:00
Thibault Saunier
2fcdc27c3a validate:launcher: Remove spurious print 2019-04-11 13:17:14 +00:00
Thibault Saunier
787939f750 validate:launcher: Add a list of well known subpression files from gst-build subprojects 
Fixes https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/38
 2019-04-03 13:38:42 +00:00
Thibault Saunier
ac7efe9500 validate:launcher: Rework expected-issues data format 
Instead of having the issues centered on the test classes, they
are now focusing on the "bug".

And harmise names on `expected_issue` not `expected_failures`
 2019-04-03 13:38:42 +00:00
Thibault Saunier
3a826e1e3d validate:launcher: Implement bug checks for gitlab 
And use new gitlab urls for all the bugs
 2019-04-03 13:38:42 +00:00
Thibault Saunier
8d00a74f1a validate:launcher: Enhance and standardize output 2019-04-03 13:38:42 +00:00
Thibault Saunier
6310145a44 validate:launcher: Set CK_MULTIPLIER=10 in GstCheck tests when using valgrind 
Fixes https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/39
 2019-03-22 11:23:08 -03:00
Thibault Saunier
773f2e456c validate:launcher: Move '_format_config_template' to the utilities 
So it can be reused by GES tests
 2019-03-11 18:14:23 -03:00
Charlie Turner
a443b921a2 validateflow: interpolate folder directories into pipeline descriptions. 
Allow 'pipeline' fields in validateflow to be interpolated with
directory keys like $(medias)s.
 2019-02-21 13:57:17 +00:00
Thibault Saunier
3d3264b342 Revert "validate:launcher: Cache the result of meson introspect" 
This reverts commit 05ce6d3b92.

We can't do that as it breaks meson logic to set envvars
 2019-02-10 01:25:52 -03:00
Thibault Saunier
05ce6d3b92 validate:launcher: Cache the result of meson introspect 
Running it takes quite some time and we can easily cache it.
 2019-02-09 17:24:13 -03:00
Alicia Boya García
e96f2ca714 New validate plugin: validateflow 
validateflow can be used to check the buffers and events flowing through
a custom pipeline match an expectation file. This can be used to test
non-regular-playback use cases like demuxers handling adaptive streaming
fragment pushing.

This patch includes also new actions used for these cases:
`appsrc-push`, `appsrc-eos` and `flush` (plus `checkpoint`, which is
only available with validateflow).
 2019-02-07 18:19:22 +00:00
Thibault Saunier
e8162cc957 validate:launcher: Error out in the check testsuite if rebuilding failed 2019-02-06 21:14:13 +00:00
Mathieu Duponchelle
90c2d32030 Scenarios: override seek flags for RTSP tests 
Our RTSP server is not accurate, it makes no sense to perform
accuracy checks on the client-side segments.
 2019-02-02 02:08:58 +01:00
Thibault Saunier
78781de913 validate:launcher:punittest: Raise an exception if a testsuite can't be loaded 2019-01-30 15:57:13 -03:00
Thibault Saunier
9b69bcad08 validate:launcher: Handle launching launching a sub launcher 
If you use validate-launcher in a meson testsuite, those test now
gets integrated as one unique testsuite (with a pretty long namespace).
 2019-01-26 15:54:00 +00:00
Thibault Saunier
3f4f815500 launcher: Cleanup the way we find python test command line 
By setting it before the test base class adds the current testsuite name in the classname
 2019-01-26 15:54:00 +00:00
Thibault Saunier
9cf213dee0 launcher: Fix test listing in meson VS gstcheck tests 
You might select tests that match Meson but not gstcheck in which
case the 'meson only' variant is exposed but those should never exist.
 2019-01-26 15:54:00 +00:00
Thibault Saunier
a3bab7c66e validate:launcher: Add %(config_path)s in the pipeline desc vars 
When defining pipelines_descriptions to run test on in a `.json` file, you might
need to point to paths in the testsuite directory (for media files URIs
for example), you can now do

 `"pipeline": "filesrc location="$(config_path)s/../medias/some/file.mkv...`
 2019-01-26 10:11:24 -03:00
Alexandru Băluț
9a04ba5000 validate:launcher: Fix error message 2018-12-14 12:00:18 +01:00
Alexandru Băluț
b280850718 validate:launcher: Fix discovery of commands 2018-12-14 11:17:41 +01:00
Thibault Saunier
b0c0c2d846 validate:launcher: Do not CK_FORK on our test 
Otherwise the process can't cleanly quit on assertion because of the way libcheck runner is implemented
 2018-12-07 09:06:50 -03:00
Thibault Saunier
21e23c72fc validate:launcher: Do not take CK_DEFAULT_TIMEOUT into account to set the timeout 
The timeout is what is set in the meson build definition otherwise we will not behave as 'meson test' which we should avoid
 2018-12-06 23:17:29 -03:00
Thibault Saunier
ec9464dd90 validate:launcher: Don't about unexisting tests when filtering tests 
It was wrong
 2018-11-28 10:19:52 -03:00
Thibault Saunier
b971a7cd23 validate:launcher: Fix setting meson tests as "parallel" 2018-11-28 10:11:00 -03:00
Thibault Saunier
9ab1d3b6fb validate:launcher: Avoid using not yet set variables 
And make the file pep8 compliant with latest pep8 checker.
 2018-11-26 10:16:12 -03:00
Thibault Saunier
4bb2648154 validate: launcher: Add a way to load pipeline tests from a scenario 2018-11-25 12:01:12 -03:00
Thibault Saunier
f0cfdf9d14 validate:launcher: Use fakevideosink everywhere it makes sense. 2018-09-07 16:19:40 -03:00
Thibault Saunier
29ef55c469 validate:launcher: Stop spamming envvars in unit tests command printing. 
We used to print the whole environment, making it ugly and hard to
read.
 2018-07-08 17:04:25 -04:00
Thibault Saunier
d80fb50c4b validate:launcher: Add a TestManager to run python tests 
Add a stupid simple testsuite made to be configured from the outside
 2018-06-15 17:57:24 -04:00
Thibault Saunier
58c90448ca validate: launcher: Add support for running tests with a pushfile source 
Introducing the `.media_info.push` media info extension, which is meant
to let the launcher know that those file should run with the "pushfile://"
protocol.

And allow symlinking "normal" `.media_info` to their `.pushfile` variant
so that both can share the exact same content.
 2018-06-15 12:05:14 -04:00
Thibault Saunier
b2e71e1404 validate: media-check: Add a way to skip pluggin parsers 
This is useful when you want to check only the demuxer output.

- Keep the information in the media file so that we can launch media-check
  with the proper arguments in the launcher. Update it accordingly.
- Refactor compare_streams to simplify it, which in the end leads to
  reporting all the issues instead of exiting on the first one.
 2018-06-15 12:05:14 -04:00
Thibault Saunier
b00ab02254 validate:launcher: Cleanup the way we find where -validate tools are 2018-05-13 09:44:17 -04:00
Thibault Saunier
c1f89b4acb validate: launcher: Add a way to simply run SSIM checks on rendered files 
We will run a simple pipeline with the IQA element to run ssim (dssim)
tests on the rendered files, comparing it with a reference file.

For now we use the very empiric 1.0 value as a ssim error threshold and
the goal is basically to detect completely broken renderings.
 2018-05-13 09:44:17 -04:00
Thibault Saunier
c93f1704f8 validate: Add support for the new testbin protocol 2018-05-13 09:44:17 -04:00
Edward Hervey
58fb4f9354 validate: Remove hls.*seek_with_stop blacklisting 
The issue is closed upstream (because of concentrating on decodebin3
instead), and initial forever testing seems to show the issue doesn't
happen anymore
 2018-05-07 17:30:13 +02:00
Thibault Saunier
77ee198b1b validate:launcher: Add support for specifying a workdir in tests 2018-04-15 20:50:22 -03:00
Thibault Saunier
3f66772fa1 check: Use meson introspect to list meson tests 2018-03-20 08:51:04 -03:00
Edward Hervey
01a54641f9 validate: Remove protocol-specific timeouts 
Since we now check position/status of pipeline at regular intevals,
we no longer need to impose a different timeout based on the
protocol used.

Avoids having 4min long timeouts for no reason (30s is enough)
 2017-12-03 12:23:51 +01:00
Edward Hervey
65e2c1567a gstvalidate: Lower timeout to check for rtsp-server to be up 
Check every 100ms, avoids throttling all rtsp tests by 500ms
 2017-12-03 11:38:08 +01:00
Thibault Saunier
4fac7bf9fd validate: launcher: Run rtsp tests against both V1 and V2 
https://bugzilla.gnome.org/show_bug.cgi?id=781446
 2017-09-22 16:31:56 -03:00
Edward Hervey
9ae20ee3e0 validate: Re-enable mxf op2b tests 
https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-25 09:55:02 +02:00
Thibault Saunier
8ab723b153 validate:launcher:check: Make sure to register tests from the testsuite 
Instead of having them listed from the app manager. This is needed
to avoid backtrace as tests now have to be register when setting up
the testsuite.
 2017-07-19 11:49:54 -04:00
Edward Hervey
1cfe980044 validate: Blacklist op2b mxf files 
See https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-19 15:47:28 +02:00
Thibault Saunier
2cf93f491b validate: launcher: Namespace test name with the testsuite name 
Also allowing users to pass test names directly
 2017-07-18 10:54:53 -04:00
Sebastian Dröge
c8cd695bb9 validate: Un-blacklist scrub_forward_seeking.op2b-mpeg2-wave_hd_mxf 
It works now after various mxfdemux changes.

https://bugzilla.gnome.org/show_bug.cgi?id=764025
 2017-07-14 10:37:31 +03:00
Edward Hervey
ee72ae8913 gstvalidate: Re-allow tests that should be fixed 2017-07-13 08:46:05 +02:00
Thibault Saunier
40a08e6080 validate: launcher: Add some missing env variables in command to launch test 2017-07-11 10:11:49 -04:00