mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-10-02 00:32:43 +00:00
Code Issues 1 Projects Releases Wiki Activity
2396 commits 44 branches 1508 tags 323 MiB
Commit graph

98 commits

Author SHA1 Message Date
Mathieu Duponchelle
5a068bff72 validate: Update blacklisting reason for fast forward rtsp 
While https://gitlab.freedesktop.org/gstreamer/gst-rtsp-server/issues/14
was merged, the client side (in particular rtpbasedepayload) still
isn't expected to work appropriately
 2019-08-01 21:04:12 +02:00
Mathieu Duponchelle
93114b55ab json tests: assume all user pipelines can seek reverse 
When doing a targeted test, it is up to the user to make sure
their pipeline + scenario behaves correctly.
 2019-07-26 02:26:20 +02:00
Thibault Saunier
3343f166da validate:launcher: Move get_fakesink_for_media_type to utils 
So it can be reused in other apps like GES
 2019-06-26 12:09:03 -04:00
Thibault Saunier
446f1d8197 validate:launcher: Make extra_logfiles a set and fix their names 2019-04-11 13:17:14 +00:00
Thibault Saunier
2fcdc27c3a validate:launcher: Remove spurious print 2019-04-11 13:17:14 +00:00
Thibault Saunier
ac7efe9500 validate:launcher: Rework expected-issues data format 
Instead of having the issues centered on the test classes, they
are now focusing on the "bug".

And harmise names on `expected_issue` not `expected_failures`
 2019-04-03 13:38:42 +00:00
Thibault Saunier
3a826e1e3d validate:launcher: Implement bug checks for gitlab 
And use new gitlab urls for all the bugs
 2019-04-03 13:38:42 +00:00
Thibault Saunier
8d00a74f1a validate:launcher: Enhance and standardize output 2019-04-03 13:38:42 +00:00
Thibault Saunier
773f2e456c validate:launcher: Move '_format_config_template' to the utilities 
So it can be reused by GES tests
 2019-03-11 18:14:23 -03:00
Charlie Turner
a443b921a2 validateflow: interpolate folder directories into pipeline descriptions. 
Allow 'pipeline' fields in validateflow to be interpolated with
directory keys like $(medias)s.
 2019-02-21 13:57:17 +00:00
Alicia Boya García
e96f2ca714 New validate plugin: validateflow 
validateflow can be used to check the buffers and events flowing through
a custom pipeline match an expectation file. This can be used to test
non-regular-playback use cases like demuxers handling adaptive streaming
fragment pushing.

This patch includes also new actions used for these cases:
`appsrc-push`, `appsrc-eos` and `flush` (plus `checkpoint`, which is
only available with validateflow).
 2019-02-07 18:19:22 +00:00
Mathieu Duponchelle
90c2d32030 Scenarios: override seek flags for RTSP tests 
Our RTSP server is not accurate, it makes no sense to perform
accuracy checks on the client-side segments.
 2019-02-02 02:08:58 +01:00
Thibault Saunier
a3bab7c66e validate:launcher: Add %(config_path)s in the pipeline desc vars 
When defining pipelines_descriptions to run test on in a `.json` file, you might
need to point to paths in the testsuite directory (for media files URIs
for example), you can now do

 `"pipeline": "filesrc location="$(config_path)s/../medias/some/file.mkv...`
 2019-01-26 10:11:24 -03:00
Alexandru Băluț
9a04ba5000 validate:launcher: Fix error message 2018-12-14 12:00:18 +01:00
Alexandru Băluț
b280850718 validate:launcher: Fix discovery of commands 2018-12-14 11:17:41 +01:00
Thibault Saunier
ec9464dd90 validate:launcher: Don't about unexisting tests when filtering tests 
It was wrong
 2018-11-28 10:19:52 -03:00
Thibault Saunier
9ab1d3b6fb validate:launcher: Avoid using not yet set variables 
And make the file pep8 compliant with latest pep8 checker.
 2018-11-26 10:16:12 -03:00
Thibault Saunier
4bb2648154 validate: launcher: Add a way to load pipeline tests from a scenario 2018-11-25 12:01:12 -03:00
Thibault Saunier
f0cfdf9d14 validate:launcher: Use fakevideosink everywhere it makes sense. 2018-09-07 16:19:40 -03:00
Thibault Saunier
58c90448ca validate: launcher: Add support for running tests with a pushfile source 
Introducing the `.media_info.push` media info extension, which is meant
to let the launcher know that those file should run with the "pushfile://"
protocol.

And allow symlinking "normal" `.media_info` to their `.pushfile` variant
so that both can share the exact same content.
 2018-06-15 12:05:14 -04:00
Thibault Saunier
b2e71e1404 validate: media-check: Add a way to skip pluggin parsers 
This is useful when you want to check only the demuxer output.

- Keep the information in the media file so that we can launch media-check
  with the proper arguments in the launcher. Update it accordingly.
- Refactor compare_streams to simplify it, which in the end leads to
  reporting all the issues instead of exiting on the first one.
 2018-06-15 12:05:14 -04:00
Thibault Saunier
b00ab02254 validate:launcher: Cleanup the way we find where -validate tools are 2018-05-13 09:44:17 -04:00
Thibault Saunier
c1f89b4acb validate: launcher: Add a way to simply run SSIM checks on rendered files 
We will run a simple pipeline with the IQA element to run ssim (dssim)
tests on the rendered files, comparing it with a reference file.

For now we use the very empiric 1.0 value as a ssim error threshold and
the goal is basically to detect completely broken renderings.
 2018-05-13 09:44:17 -04:00
Thibault Saunier
c93f1704f8 validate: Add support for the new testbin protocol 2018-05-13 09:44:17 -04:00
Edward Hervey
58fb4f9354 validate: Remove hls.*seek_with_stop blacklisting 
The issue is closed upstream (because of concentrating on decodebin3
instead), and initial forever testing seems to show the issue doesn't
happen anymore
 2018-05-07 17:30:13 +02:00
Edward Hervey
01a54641f9 validate: Remove protocol-specific timeouts 
Since we now check position/status of pipeline at regular intevals,
we no longer need to impose a different timeout based on the
protocol used.

Avoids having 4min long timeouts for no reason (30s is enough)
 2017-12-03 12:23:51 +01:00
Edward Hervey
65e2c1567a gstvalidate: Lower timeout to check for rtsp-server to be up 
Check every 100ms, avoids throttling all rtsp tests by 500ms
 2017-12-03 11:38:08 +01:00
Thibault Saunier
4fac7bf9fd validate: launcher: Run rtsp tests against both V1 and V2 
https://bugzilla.gnome.org/show_bug.cgi?id=781446
 2017-09-22 16:31:56 -03:00
Edward Hervey
9ae20ee3e0 validate: Re-enable mxf op2b tests 
https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-25 09:55:02 +02:00
Edward Hervey
1cfe980044 validate: Blacklist op2b mxf files 
See https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-19 15:47:28 +02:00
Thibault Saunier
2cf93f491b validate: launcher: Namespace test name with the testsuite name 
Also allowing users to pass test names directly
 2017-07-18 10:54:53 -04:00
Sebastian Dröge
c8cd695bb9 validate: Un-blacklist scrub_forward_seeking.op2b-mpeg2-wave_hd_mxf 
It works now after various mxfdemux changes.

https://bugzilla.gnome.org/show_bug.cgi?id=764025
 2017-07-14 10:37:31 +03:00
Edward Hervey
ee72ae8913 gstvalidate: Re-allow tests that should be fixed 2017-07-13 08:46:05 +02:00
Thibault Saunier
3b20a1ccde validate:launcher: Disable seek with stop on RTSP streams 
It is actually not supported
 2017-06-28 13:02:33 -04:00
Thibault Saunier
831464d96f validate:launcher: Avoid useless and expensive deep copies 2017-06-27 16:50:35 -04:00
Thibault Saunier
82dd230ef1 validate:launcher: No need to use -validate as a tracer for RTSP server 
It is now linked into the server app
 2017-06-20 10:43:09 -04:00
Thibault Saunier
543e7a983a validate:launcher: Do not which(None), the rtsp-server command is unset if not avalaible 
https://bugzilla.gnome.org/show_bug.cgi?id=783551
 2017-06-08 12:18:19 -04:00
Thibault Saunier
6772fa7d27 validate: Add 'our own' RTSP server implementation 2017-06-07 11:17:53 -04:00
Thibault Saunier
37de89e6db validate:launcher: Do not run scenarios that need prerolling on RTSP stream 2017-06-07 11:17:53 -04:00
Thibault Saunier
3c62c315a9 validate: Implement RTSP support 2017-06-07 11:17:53 -04:00
Thibault Saunier
4a38efb6a0 validate:launcher: Add missing is_live implementation for FakeMediaDescriptor 2017-06-01 16:57:50 -04:00
Edward Hervey
330ae663dc validate: Improve video fakesink properties 
Try to emulate a bit better a real video sink by making the video
fakesink handle/calculate/report QoS.

Also use the same lateness value as default videosink
 2017-04-04 14:53:30 +02:00
Thibault Saunier
bc3e9505ea validate:launcher: Allow passing extra env var to simple pipeline generator 2017-01-31 08:15:38 -03:00
Thibault Saunier
5fc11cf389 launcher: Make --update-media-info check if generating frames info or not 2016-12-22 10:29:18 -03:00
Thibault Saunier
26692e749c validate:launcher: Stop running test subprocesses in a shell 
And instead properly use a list of argument for the subprocesses.
 2016-12-22 10:07:58 -03:00
Thibault Saunier
1e51aeb942 validate:launcher: Port to Python3 
And sync logging.py with Pitivi version
 2016-11-09 10:13:42 -03:00
Edward Hervey
8c20943a9d validate: Blacklist failing hls tests 
See https://bugzilla.gnome.org/show_bug.cgi?id=773159
 2016-10-18 15:41:11 +02:00
Thibault Saunier
9c9fe14293 meson:validate:test: Properly set paths to run launcher based tests 
Adding a --validate-tools-path option to the launcher, allowing
to pass it from meson.
 2016-09-09 12:24:54 -03:00
Thibault Saunier
03548cd63d validate:launcher: Allow specifying expected tests errors 
In the future instead of blacklisting tests we should define
what error is expected, and this way when the bug is closed,
we will notice, also, it will allow us to check GstValidate
error reporting itself.
 2016-09-08 13:10:29 -03:00
Thibault Saunier
f7f600e730 validate: launcher: Fix the condition to check if we need an http server 
We could be checking if a string was in None

And use gs_string_assign when assigning the first string
without using printf like format.
 2016-09-08 10:39:56 -03:00