Thibault Saunier
e552c18c80
launcher: Handle stack trace information as jenkins expect it in the xunit file
2016-12-01 10:52:32 -03:00
Thibault Saunier
a842f9d511
validate:launcher: Handle missing media info file
2016-11-30 14:07:04 -03:00
Thibault Saunier
b0784ffcb3
validate:launcher: Make sure that the IPC server is shutdown before closing the socket
2016-11-30 07:40:05 -03:00
Thibault Saunier
2959af0761
validate:launcher: Make sure to check string when verifying expected failures
...
The value can potentially be None and we should handle that
2016-11-29 14:47:35 -03:00
Thibault Saunier
acfdd04e01
validate:launcher: Allow specifying timeout as a known issue
...
And minor cleanups
2016-11-28 19:37:08 -03:00
Thibault Saunier
03453961e8
validate:launcher: Properly report stack trace as such in the xunit file
2016-11-28 18:40:00 -03:00
Thibault Saunier
aec8693258
validate:launcher: Remove now useless validatelog
...
We are now doing IPC to communicate with the launcher
so let it simply go to stdout.
2016-11-28 18:40:00 -03:00
Thibault Saunier
e132c11a95
validate:launcher: Handle checking bug status for expected failures
2016-11-28 18:40:00 -03:00
Thibault Saunier
e3731ba839
validate: Minor documentation fixes.
2016-11-17 15:43:15 -03:00
Thibault Saunier
2857eaf2ad
validate: launcher: Allow checking if bugs linked to blacklist is fixed
2016-11-16 17:39:45 -03:00
Thibault Saunier
615fab620a
validate:launcher: Consider wanted tests as whitelisted
2016-11-16 12:02:32 -03:00
Thibault Saunier
8bd0cb13e8
validate:launcher: Timeout if running gdb takes too much time
2016-11-14 18:44:27 -03:00
Thibault Saunier
f5828b2b5c
validate:launcher: Allow running the testsuite N number of times
2016-11-14 13:32:07 -03:00
Thibault Saunier
20879e9c69
validate:launcher: Fix usage in an uninstalled environment
2016-11-09 17:38:04 -03:00
Thibault Saunier
5452672e89
validate:launcher: Try to generate a backtrace on segfaults
2016-11-09 10:19:45 -03:00
Thibault Saunier
1e51aeb942
validate:launcher: Port to Python3
...
And sync logging.py with Pitivi version
2016-11-09 10:13:42 -03:00
Thibault Saunier
d797f94692
validate:launcher: Do not try to set DISPLAY envvar to None
2016-11-02 12:48:49 -03:00
Edward Hervey
a29f4c390c
baseclasses: Also check for minimum number of video-tracks
...
Some scenarios might only be for video files and are meaningless for
audio-only files
2016-10-26 17:34:49 +02:00
Edward Hervey
8c20943a9d
validate: Blacklist failing hls tests
...
See https://bugzilla.gnome.org/show_bug.cgi?id=773159
2016-10-18 15:41:11 +02:00
Thibault Saunier
032fccd7af
meson: Fix installing configured files
2016-09-26 13:36:49 -03:00
Thibault Saunier
41be7bb2a9
validate:launcher: Minor fix in returncode check
2016-09-26 13:36:48 -03:00
Thibault Saunier
e376da4c17
validate:launcher: Do not use unset sent_eos variable
...
And rename class member to sent_eos_time as it is more accurate
2016-09-12 14:21:30 -03:00
Thibault Saunier
9c9fe14293
meson:validate:test: Properly set paths to run launcher based tests
...
Adding a --validate-tools-path option to the launcher, allowing
to pass it from meson.
2016-09-09 12:24:54 -03:00
Thibault Saunier
3ece6a065e
validate: launcher: Always clean all tests at the end
...
Making sure that if an exception of anything happens we will
properly clean all the tests, or at least try to.
2016-09-08 13:10:29 -03:00
Thibault Saunier
03548cd63d
validate:launcher: Allow specifying expected tests errors
...
In the future instead of blacklisting tests we should define
what error is expected, and this way when the bug is closed,
we will notice, also, it will allow us to check GstValidate
error reporting itself.
2016-09-08 13:10:29 -03:00
Thibault Saunier
2fff14e469
validate: Pass information about GstValidate execution over a socket
...
Instead of trying to parsing stdout, generate json messages and
send them over a socket so that gst-validate-launcher can properly
have informations about gst-validate subprocess execution.
2016-09-08 13:10:29 -03:00
Thibault Saunier
23203ca0bd
validate:launcher: Use a xunit reporter only when explicitely specified
2016-09-08 10:39:56 -03:00
Thibault Saunier
8973fa04eb
validate:launcher: Report error and exit when a testsuite could not load
...
Otherwise the user might end up seeing a lot of meaningless logs about
'removed' tests.
2016-09-08 10:39:56 -03:00
Thibault Saunier
f7f600e730
validate: launcher: Fix the condition to check if we need an http server
...
We could be checking if a string was in None
And use gs_string_assign when assigning the first string
without using printf like format.
2016-09-08 10:39:56 -03:00
Mathieu Duponchelle
ec1d8d7d8c
launcher: Add --dump-on-failure switch
...
When the test fails, it can be useful to have the log files dumped
to stdout.
https://bugzilla.gnome.org/show_bug.cgi?id=741092
2016-09-01 03:39:18 +02:00
Thibault Saunier
da327d8625
validate: Add support for Meson as alternative/parallel build system
...
https://github.com/mesonbuild/meson
2016-08-25 15:12:31 -03:00
Edward Hervey
fcff932e09
validate: Un-blacklist tests that are fixed
...
the bug reports to which they report have been closed and I can't make
them fail locally.
2016-08-13 16:56:18 +02:00
Edward Hervey
7d99e780a7
validate: Blacklist more ogg files
...
https://bugzilla.gnome.org/show_bug.cgi?id=769545
2016-08-13 15:39:18 +02:00
Edward Hervey
37771192a6
validate: Blacklist scrub_forward_seeking.op2b-mpeg2-wave_hd_mxf
...
See https://bugzilla.gnome.org/show_bug.cgi?id=764025
2016-08-12 12:33:30 +02:00
Thibault Saunier
5a745829dc
validate: Add jpeg as known format
2016-07-29 15:54:02 -04:00
Thibault Saunier
bcc7a1fcca
validate:launcher: Add h265, opus and vp9 as known formats
2016-07-15 08:56:02 -04:00
Edward Hervey
1e1475d352
validate: Fix usage for non-standard http server port
...
Translate the various stream_info URI from the standard port to the
specified port
Make the port option an integer option
2016-07-04 16:19:09 +02:00
Edward Hervey
b77797da4b
validate: Use decodebin3/uridecodebin3 when specified
...
Set the USE_PLAYBIN3 environment variable to use those elements instead
of legacy ones.
2016-06-30 14:58:03 +02:00
Reynaldo H. Verdejo Pinochet
07fa1b3ca5
validate: fix some recurring typos
2016-06-09 14:31:48 -07:00
Vineeth TM
99f9f3f408
validate:launcher: Add support for relative path while providing file path
...
Instead of providing full absolute path while validating the file, should be
able to provide the relative path with respect to the present directory.
https://bugzilla.gnome.org/show_bug.cgi?id=753494
2016-06-04 12:51:35 +01:00
Guillaume Desmottes
2ddbcb666f
validate: generate valgrind suppression traces
...
Makes fixing easier as then we can just re-use the generated trace.
Reviewed-by: Thibault Saunier <tsaunier@gnome.org>
Differential Revision: https://phabricator.freedesktop.org/D953
2016-05-24 10:28:26 -04:00
Guillaume Desmottes
4322138c8f
validate: fix typo if Xvfb is not installed
...
Reviewed-by: Thibault Saunier <tsaunier@gnome.org>
Differential Revision: https://phabricator.freedesktop.org/D375
2016-05-24 10:28:23 -04:00
Thiago Santos
f4cdbd006b
launcher: set gsettings-backend to prevent weird deadlocks
...
It seems like some sort of forking/dconf/gtype combination can
deadlock occasionally. Setting the gsettings backend to memory
makes it go away.
Same issue: https://cgit.freedesktop.org/gstreamer/gst-plugins-good/commit/tests/check/Makefile.am?id=8e2c1d1de56bddbff22170f8b17473882e0e63f9
2016-05-15 06:34:21 -03:00
Thiago Santos
d0a7d9b094
validate: add non-seekable fragment file seek tests to the blacklist
...
The file has no index and is not easily seekable, seeking in these
kind of files isn't implemented.
2016-05-06 21:27:53 -03:00
Thibault Saunier
83c652ba76
validate: launcher: Make sure to properly setup all testsuites
...
When a first testsuite will set paths, it does not mean that we should
just register following testsuite test manager default tests.
So we need to make a difference between the media paths the user passed
with --media-path and the ones defined by the testsuite.
2016-03-23 20:10:51 +01:00
Thibault Saunier
9190bcf62a
validate:launcher: Handle testslist files even running several testsuites
...
Only if those testsuites do not use the same Tester as we
currently can't know to what testsuite a test belongs.
2016-03-23 20:10:01 +01:00
Thibault Saunier
187df093eb
launcher: Avoid caching all the debug logs in memory
...
And just write the temporary XML file on disc
2016-03-23 12:41:49 +01:00
Thibault Saunier
23ad66c552
validate: launcher: Blacklist dash and HLS failling seeking tests
...
As described in https://bugzilla.gnome.org/show_bug.cgi?id=764020
2016-03-22 19:02:27 +01:00
Thibault Saunier
a566b2c4b9
validate:testsuite: Blacklist validate.hls.playback.scrub_forward_seeking.hls_bibbop as it is racy
2016-03-22 17:46:50 +01:00
Thibault Saunier
621bda9b62
validate: Use GstValidate logging system to print buffering avancement
...
So it can be used in the launcher.
And make sure to properly parse the info in the launcher.
2016-03-21 14:34:27 +01:00