mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-11-19 16:21:17 +00:00
Code Issues 1 Projects Releases Wiki Activity
2440 commits 44 branches 1509 tags 635 MiB
Commit graph

146 commits

Author SHA1 Message Date
Edward Hervey
58fb4f9354 validate: Remove hls.*seek_with_stop blacklisting 
The issue is closed upstream (because of concentrating on decodebin3
instead), and initial forever testing seems to show the issue doesn't
happen anymore
 2018-05-07 17:30:13 +02:00
Thibault Saunier
77ee198b1b validate:launcher: Add support for specifying a workdir in tests 2018-04-15 20:50:22 -03:00
Thibault Saunier
3f66772fa1 check: Use meson introspect to list meson tests 2018-03-20 08:51:04 -03:00
Edward Hervey
01a54641f9 validate: Remove protocol-specific timeouts 
Since we now check position/status of pipeline at regular intevals,
we no longer need to impose a different timeout based on the
protocol used.

Avoids having 4min long timeouts for no reason (30s is enough)
 2017-12-03 12:23:51 +01:00
Edward Hervey
65e2c1567a gstvalidate: Lower timeout to check for rtsp-server to be up 
Check every 100ms, avoids throttling all rtsp tests by 500ms
 2017-12-03 11:38:08 +01:00
Thibault Saunier
4fac7bf9fd validate: launcher: Run rtsp tests against both V1 and V2 
https://bugzilla.gnome.org/show_bug.cgi?id=781446
 2017-09-22 16:31:56 -03:00
Edward Hervey
9ae20ee3e0 validate: Re-enable mxf op2b tests 
https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-25 09:55:02 +02:00
Thibault Saunier
8ab723b153 validate:launcher:check: Make sure to register tests from the testsuite 
Instead of having them listed from the app manager. This is needed
to avoid backtrace as tests now have to be register when setting up
the testsuite.
 2017-07-19 11:49:54 -04:00
Edward Hervey
1cfe980044 validate: Blacklist op2b mxf files 
See https://bugzilla.gnome.org/show_bug.cgi?id=785119
 2017-07-19 15:47:28 +02:00
Thibault Saunier
2cf93f491b validate: launcher: Namespace test name with the testsuite name 
Also allowing users to pass test names directly
 2017-07-18 10:54:53 -04:00
Sebastian Dröge
c8cd695bb9 validate: Un-blacklist scrub_forward_seeking.op2b-mpeg2-wave_hd_mxf 
It works now after various mxfdemux changes.

https://bugzilla.gnome.org/show_bug.cgi?id=764025
 2017-07-14 10:37:31 +03:00
Edward Hervey
ee72ae8913 gstvalidate: Re-allow tests that should be fixed 2017-07-13 08:46:05 +02:00
Thibault Saunier
40a08e6080 validate: launcher: Add some missing env variables in command to launch test 2017-07-11 10:11:49 -04:00
Thibault Saunier
3b20a1ccde validate:launcher: Disable seek with stop on RTSP streams 
It is actually not supported
 2017-06-28 13:02:33 -04:00
Thibault Saunier
831464d96f validate:launcher: Avoid useless and expensive deep copies 2017-06-27 16:50:35 -04:00
Thibault Saunier
82dd230ef1 validate:launcher: No need to use -validate as a tracer for RTSP server 
It is now linked into the server app
 2017-06-20 10:43:09 -04:00
Thibault Saunier
543e7a983a validate:launcher: Do not which(None), the rtsp-server command is unset if not avalaible 
https://bugzilla.gnome.org/show_bug.cgi?id=783551
 2017-06-08 12:18:19 -04:00
Thibault Saunier
9a45cd41a9 validate:launcher: Handle test that can't be run in parralel 2017-06-07 15:23:26 -04:00
Thibault Saunier
6772fa7d27 validate: Add 'our own' RTSP server implementation 2017-06-07 11:17:53 -04:00
Thibault Saunier
37de89e6db validate:launcher: Do not run scenarios that need prerolling on RTSP stream 2017-06-07 11:17:53 -04:00
Thibault Saunier
3c62c315a9 validate: Implement RTSP support 2017-06-07 11:17:53 -04:00
Thibault Saunier
4a38efb6a0 validate:launcher: Add missing is_live implementation for FakeMediaDescriptor 2017-06-01 16:57:50 -04:00
Thibault Saunier
dba5675d81 validate:launcher: Add a way to pass arguments to the leak tracer 2017-06-01 16:57:50 -04:00
Thibault Saunier
e9db1c19d0 launcher:check: Ensure to set build dir before rebuilding 2017-04-20 10:13:00 -03:00
Edward Hervey
330ae663dc validate: Improve video fakesink properties 
Try to emulate a bit better a real video sink by making the video
fakesink handle/calculate/report QoS.

Also use the same lateness value as default videosink
 2017-04-04 14:53:30 +02:00
Thibault Saunier
b97c13d0a7 validate:launcher: Fix setting meson build dir 2017-02-24 17:33:08 -03:00
Thibault Saunier
f2b42cbaf8 validate:launcher: Various fixes to make the Test class directly usable 
And the launcher installed with meson usable
 2017-02-21 13:40:28 -03:00
Thibault Saunier
a39ef816a6 validate: launcher: Do not force using current module dir to run check tests 2017-02-21 13:40:28 -03:00
Thibault Saunier
7773ca7765 validate:launcher: Add a way to specify a set of tests to run under the leak tracer 
https://bugzilla.gnome.org/show_bug.cgi?id=767856
 2017-02-10 15:56:11 -03:00
Thibault Saunier
bc3e9505ea validate:launcher: Allow passing extra env var to simple pipeline generator 2017-01-31 08:15:38 -03:00
Thibault Saunier
de2cbda854 validate: Make sure to update children environment from current env 
And minor fix in function call
 2017-01-06 12:12:21 -03:00
Thibault Saunier
30221faa32 validate: check: Enhance test names 2017-01-06 11:48:14 -03:00
Thibault Saunier
ce0d2ee3e1 validate: Fix gstcheck when not running on a meson build dir 2017-01-03 13:11:42 -03:00
Thibault Saunier
0ee2147137 Revert "Revert "validate:launcher: Add an app handler for unit tests described in meson"" 
This reverts commit 5656e2a1b2.
 2017-01-03 13:01:31 -03:00
Edward Hervey
5656e2a1b2 Revert "validate:launcher: Add an app handler for unit tests described in meson" 
This reverts commit a4aa5c60bb.

Does not work outside of gst-build (i.e. validate won't work when used either
installed, in a prefix, or in gst-uninstalled).
 2017-01-02 17:21:14 +01:00
Thibault Saunier
5fc11cf389 launcher: Make --update-media-info check if generating frames info or not 2016-12-22 10:29:18 -03:00
Thibault Saunier
a4aa5c60bb validate:launcher: Add an app handler for unit tests described in meson 
This way we can run all tests with the launcher which brings in many
features.

And add a testsuite for GStreamer unit tests.
 2016-12-22 10:29:18 -03:00
Thibault Saunier
26692e749c validate:launcher: Stop running test subprocesses in a shell 
And instead properly use a list of argument for the subprocesses.
 2016-12-22 10:07:58 -03:00
Thibault Saunier
1e51aeb942 validate:launcher: Port to Python3 
And sync logging.py with Pitivi version
 2016-11-09 10:13:42 -03:00
Edward Hervey
8c20943a9d validate: Blacklist failing hls tests 
See https://bugzilla.gnome.org/show_bug.cgi?id=773159
 2016-10-18 15:41:11 +02:00
Thibault Saunier
9c9fe14293 meson:validate:test: Properly set paths to run launcher based tests 
Adding a --validate-tools-path option to the launcher, allowing
to pass it from meson.
 2016-09-09 12:24:54 -03:00
Thibault Saunier
03548cd63d validate:launcher: Allow specifying expected tests errors 
In the future instead of blacklisting tests we should define
what error is expected, and this way when the bug is closed,
we will notice, also, it will allow us to check GstValidate
error reporting itself.
 2016-09-08 13:10:29 -03:00
Thibault Saunier
f7f600e730 validate: launcher: Fix the condition to check if we need an http server 
We could be checking if a string was in None

And use gs_string_assign when assigning the first string
without using printf like format.
 2016-09-08 10:39:56 -03:00
Thibault Saunier
da327d8625 validate: Add support for Meson as alternative/parallel build system 
https://github.com/mesonbuild/meson
 2016-08-25 15:12:31 -03:00
Edward Hervey
fcff932e09 validate: Un-blacklist tests that are fixed 
the bug reports to which they report have been closed and I can't make
them fail locally.
 2016-08-13 16:56:18 +02:00
Edward Hervey
7d99e780a7 validate: Blacklist more ogg files 
https://bugzilla.gnome.org/show_bug.cgi?id=769545
 2016-08-13 15:39:18 +02:00
Edward Hervey
37771192a6 validate: Blacklist scrub_forward_seeking.op2b-mpeg2-wave_hd_mxf 
See https://bugzilla.gnome.org/show_bug.cgi?id=764025
 2016-08-12 12:33:30 +02:00
Edward Hervey
1e1475d352 validate: Fix usage for non-standard http server port 
Translate the various stream_info URI from the standard port to the
specified port
Make the port option an integer option
 2016-07-04 16:19:09 +02:00
Edward Hervey
b77797da4b validate: Use decodebin3/uridecodebin3 when specified 
Set the USE_PLAYBIN3 environment variable to use those elements instead
of legacy ones.
 2016-06-30 14:58:03 +02:00
Vineeth TM
99f9f3f408 validate:launcher: Add support for relative path while providing file path 
Instead of providing full absolute path while validating the file, should be
able to provide the relative path with respect to the present directory.

https://bugzilla.gnome.org/show_bug.cgi?id=753494
 2016-06-04 12:51:35 +01:00
Thiago Santos
d0a7d9b094 validate: add non-seekable fragment file seek tests to the blacklist 
The file has no index and is not easily seekable, seeking in these
kind of files isn't implemented.
 2016-05-06 21:27:53 -03:00
Thibault Saunier
23ad66c552 validate: launcher: Blacklist dash and HLS failling seeking tests 
As described in https://bugzilla.gnome.org/show_bug.cgi?id=764020
 2016-03-22 19:02:27 +01:00
Thibault Saunier
a566b2c4b9 validate:testsuite: Blacklist validate.hls.playback.scrub_forward_seeking.hls_bibbop as it is racy 2016-03-22 17:46:50 +01:00
Vineeth T M
7d9e9b3b79 validate: Fix wrong condition check when adding tests 
When listing tests, checking whether uri is present or not and displaying error.
But uri does notneed to be present in case of pipeline generator. So the condition check is wrong.
This results in validateelements testsuite not working. Hence modifying the condition to
not error out on valid cases.

https://bugzilla.gnome.org/show_bug.cgi?id=762422
 2016-03-05 12:56:14 +01:00
Vineeth T M
bc66079d2a validate:launcher: handle spaces in transcode output path 
When there are spaces in transcoding output path, then it fails. Hence adding the
path in double quotes

https://bugzilla.gnome.org/show_bug.cgi?id=756217
 2016-02-17 22:33:32 +01:00
Vineeth T M
0f7105d317 validate: launcher: Print error when media-info files not present 
When there are no media-info files present and --generate-media-info
option is not given, then it just fails without printing error.
Printing an error stating, use --generate-media-info if there are no
media info files.
When there are neither media files and media info files, print error
stating the same

https://bugzilla.gnome.org/show_bug.cgi?id=755087
 2015-11-11 10:12:58 +01:00
Sebastian Dröge
3bd31854a8 validate: Un-blacklist seeking HLS tests 
They are reliable enough after 36b80edb72
in gst-plugins-base now.
 2015-10-27 15:51:44 +02:00
Vineeth T M
e7b65fe5df validate: launcher: Fix media_check class name and add double quotes for valgrind logs 
When creating the class names for media check, uri is being used,
instead of the path. Hence converting the uri using uri2path and creating
class name.
Add double quotes for valgrind logs, to support special characters like space

https://bugzilla.gnome.org/show_bug.cgi?id=752808
 2015-10-02 17:43:50 +02:00
Vineeth T M
1b700f13b4 validate: launcher: Support relative path for folder names 
Even though relative paths are supported, right now it does not
work when we give the path as 'media/' present in the current directory.
Adding support for the same.

https://bugzilla.gnome.org/show_bug.cgi?id=754100
 2015-10-02 17:20:18 +02:00
Sebastian Dröge
5b81bb4bc9 validate/launcher: Blacklist some HLS seeking tests again 2015-08-16 17:53:28 +02:00
Thiago Santos
b77f56a234 validate/launcher: Un-blacklist validate.dash.playback.reverse_playback.* 
Fixed now
 2015-08-16 08:50:36 -03:00
Sebastian Dröge
f898f3ec8b validate/launcher: Un-blacklist validate.hls.playback.reverse_playback.* 
It apparently succeeds now.
 2015-08-16 12:26:16 +02:00
Sebastian Dröge
fea86d3556 validate/launcher: De-blacklist some HLS tests 2015-08-15 19:07:02 +02:00
Sebastian Dröge
1f8a5483d3 validate/launcher: Blacklist some DASH tests 2015-08-15 19:04:14 +02:00
Thibault Saunier
bb2532aa54 launcher: Handle override files for media files 
And make sure to create a new dict for extra_env_vars when instanciating
GstValidateTest
 2015-08-15 18:30:53 +02:00
Thibault Saunier
367e6cc4f4 launcher: Make sure MediaDescriptor is set in the GstValidateTest class itself 
It is used there but was set in each and every subclasses
 2015-08-15 18:30:53 +02:00
Vineeth TM
ac172a9ac6 validate:launcher: improve uri generation for --medias-path 
When --medias-paths option is being used, right now we have to
specify the full path, like /home/user/gst/master/media/
But when inside master directory, would like to specify only
media/ and expect it to work. Using os.path.abspath and create uri based on that.
This way we can either just pass media/ or pass the full path as parameters.

https://bugzilla.gnome.org/show_bug.cgi?id=752518
 2015-08-05 16:12:47 -04:00
Nicolas Dufresne
bc297a8295 validate: Enable flac reverse playback tests 
This is now supported and works as expected.
 2015-08-04 08:53:17 -04:00
Vineeth T M
aa6aebe41e validate:launcher: add quotes to the file path 
When folder name contains space or other special characters,
it fails to recognise the same and error is thrown. Adding the path
inside  to recognise the same

https://bugzilla.gnome.org/show_bug.cgi?id=752611
 2015-07-22 16:40:07 +01:00
Vineeth TM
6bf6fe7dec validate:launcher: handle file path in --medias-paths 
right now --medias-paths accepts only directories. Added support to
accept file path as well.

https://bugzilla.gnome.org/show_bug.cgi?id=752692
 2015-07-22 16:35:49 +01:00
Thibault Saunier
4ada36dbfc validate:launcher: Allow passing extra env variables to the tests 
Summary: Depends on D173

Reviewers: Mathieu_Du, gdesmott

Differential Revision: http://phabricator.freedesktop.org/D174
 2015-05-14 15:56:57 +02:00
Guillaume Desmottes
f6681ff003 validate: rename get_valgrind_suppression_file() 
Summary:
This function is actually not specific to valgrind so we can make it more
generic.

Reviewers: thiblahute

Differential Revision: http://phabricator.freedesktop.org/D162
 2015-05-11 21:55:24 +02:00
Guillaume Desmottes
133c415ade validate: display the URL of ignored Valgrind bugs 
Summary:
We don't want to forget about those so best to remind it when starting tests
as we do with blacklisted tests.

Reviewers: thiblahute

Differential Revision: http://phabricator.freedesktop.org/D131
 2015-05-01 15:15:26 +02:00
Thibault Saunier
2cf082c4be validate:launcher: Set more env variable in the launcher command desc 
Summary:
Adding if present:
  * LD_PRELOAD
  * DISPLAY
  * GST_VALIDATE_CONFIG
  * GST_VALIDATE_OVERRIDE

+  enhance the add_env_variable method to more easily set envvar from
current value

Reviewers: Mathieu_Du

Differential Revision: http://phabricator.freedesktop.org/D78
 2015-04-10 16:53:41 +02:00
Thibault Saunier
2fe03f1993 validate:launcher: Move get_current_position from GstValidatePipelineTest to GstValidateTest 
This is where it belongs

Reviewers: Mathieu_Du

Differential Revision: http://phabricator.freedesktop.org/D69
 2015-04-10 16:53:40 +02:00
Guillaume Desmottes
1bb98b49ca validate: GstValidateMediaCheckTest should inherit from GstValidateTest 2015-03-31 09:45:06 +02:00
Thibault Saunier
d1411cfc6a validate:launcher: Add a way to simply run validate default tests on uris 
Summary:
This allows us to easily run all the scenarios on a particular file doing:

  $ gst-validate-launcher validate --validate-check-uri file:///some/media/file.webm

Reviewers: Mathieu_Du

Differential Revision: http://phabricator.freedesktop.org/D36
 2015-03-13 18:04:42 +00:00
Thibault Saunier
d08a6b8e0c validate:launcher: Do not forget to install apps/__init__.py 
It is a python module that should be usable by external apps/testsuites
 2015-03-06 09:39:36 +01:00
Thibault Saunier
c5393f79f3 validate:launcher: Fix typo s/FILE_EXTENDION/FILE_EXTENSION/g 2015-02-19 13:57:30 +01:00
Thibault Saunier
a85ace1783 validate: launcher: Allow discovering scenario from full path 
https://bugzilla.gnome.org/show_bug.cgi?id=743994
 2015-02-14 16:32:10 +01:00
Thibault Saunier
11f923fa52 validate: Fix the check of action that can be *not* executed 
The check was wrong and we ended up allowing seek actions to no be
executed.

API:
    GST_VALIDATE_ACTION_TYPE_NO_EXECUTION_NOT_FATAL

https://bugzilla.gnome.org/show_bug.cgi?id=743994
 2015-02-14 16:32:09 +01:00
Thibault Saunier
eac25a3ad6 validate:launcher: Implement a FakeMediaDescriptor 
This allows us to more cleanly implement Simple pipeline test
generation

https://bugzilla.gnome.org/show_bug.cgi?id=743994
 2015-02-14 16:32:08 +01:00
Thibault Saunier
da31e3914f validate: Enhance support for simple pipeline test generation 
The GstValidatePipelineGenerator was quite limited in term
of configuration for user who just want to specify pipelines
to run with/without scenario.

Enhance the API so that we can properly configure that.

https://bugzilla.gnome.org/show_bug.cgi?id=743994
 2015-02-14 16:32:08 +01:00
Thibault Saunier
5beaf5dfa8 validate: launcher: Set a hard timeout on GstValidate tests if we know the duration 2014-12-08 16:34:48 +01:00
Thibault Saunier
5bfd579bf4 validate: launcher: Make the gstvalidate application a python module 2014-12-07 18:32:37 +01:00
Thibault Saunier
515c8405f0 validate: Remove file specific blacklisted tests 2014-12-05 16:16:53 +01:00
Thibault Saunier
d38307a073 validate: Add a cleaner API to setup tests in testsuite files 
With the testsuite format you will get a setup_tests(tests_manager,
options) function called for each TestManager.

The function will have the exact same role as with old config
file but with a clean API and not magic global variables.

This implies that we need default blacklist to be directly set
on the TestManager and not on options.blacklisted_test
 2014-12-05 16:16:53 +01:00
Thibault Saunier
71566688bf validate: Remove the default testsuite implementation 
The default testsuite implementation should belong to the default
asset repo where we have the corresponding knowledge.

We should style manage a sensible list of known blacklisted tests,
encoding profiles, and generators in GstValidate itself and allow testsuite
actual implementations to easily use them though the register_default_*
methods.

This allow us to be able to remove the ugly execfile() call.
 2014-12-05 12:17:40 +01:00
Thibault Saunier
b5219eaceb validate: Handle unlimited tests duration 
Running full length scenario when the user asks
 2014-11-25 19:41:01 +01:00
Thibault Saunier
65eb14de36 validate: Add an option to update all .media_info files 2014-11-25 19:41:00 +01:00
Thibault Saunier
36a2d61068 validate:launcher: Force clock sync for some protocols 
In HLS for example, not having clock sync might lead to races and failures
do not test that for now
 2014-11-20 12:09:29 +01:00
Thibault Saunier
5d8f6083b4 validate: Add audiomixer test to the default testsuite 2014-11-16 18:27:32 +01:00
Mathieu Duponchelle
7bbd3ed288 apps: gstvalidate.py: fix various pyflakes / uncaught pep8 issues. 
https://bugzilla.gnome.org/show_bug.cgi?id=739208
 2014-10-30 15:40:17 +01:00
Mathieu Duponchelle
8c1e84b5f4 validate-launcher: pep8ify sources. 
https://bugzilla.gnome.org/show_bug.cgi?id=739208
 2014-10-30 15:40:17 +01:00
Mathieu Duponchelle
74ed40c904 launcher: Don't implement product-specific TestManagers. 
This manager will be moved in GES.

https://bugzilla.gnome.org/show_bug.cgi?id=739091
 2014-10-30 15:31:29 +01:00
Mathieu Duponchelle
b0beefacfa validate-launcher: restructure filesystem 
https://bugzilla.gnome.org/show_bug.cgi?id=739091
 2014-10-30 15:31:29 +01:00