ekwang.lee
6b0f7729e1
validate:launcher: Using surrogateescape error handler
...
Use surrogateescape error handler to convert undecodable bytes without error.
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5008 >
2023-11-28 13:00:15 +00:00
Thibault Saunier
ad68ce7f64
validate: launcher: Make the output markdown file more readable
...
Without ansi color codes and marking logs as such
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5666 >
2023-11-15 19:07:36 +00:00
Thibault Saunier
c530c94239
validate: launcher: Keep gst debug logs in main log fails in debug mode
...
It makes reading the logs much simpler
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5666 >
2023-11-15 19:07:36 +00:00
Jordan Petridis
e436f87ea2
launcher: Fix ambigious python strings
...
```
gst-devtools/validate/launcher/baseclasses.py:2399: SyntaxWarning: invalid escape sequence '\.'
if re.findall("%s\..*\.%s$" % (re.escape(mfile_bname), self.FILE_EXTENSION), f):
gst-devtools/validate/launcher/apps/gstvalidate.py:1354: SyntaxWarning: invalid escape sequence '\.'
("file\.transcode.*mxf",
```
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5541 >
2023-11-11 12:47:12 +00:00
Jordan Yelloz
b1f3722530
gst-validate: Fixed compatibility with Python 3.12
...
config.readfp() was removed in python 3.12 and config.read_file() does the same
thing and has been available since Python 3.2
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5624 >
2023-11-08 15:50:52 -07:00
Alicia Boya García
135f859629
validate: Fix error on GstTest.copy()
...
Fixes regression introduced in ba61160d6c
,
where running check tests with gst-validate-launcher -f would trigger
this exception:
AttributeError: 'GstCheckTest' object has no attribute 'reports'.
Did you mean: 'reporter'?
The member `reports` is meant to be just part of GstValidateTest, but
not other subclasses, even though a usage is still found in the base
class GstTest in the method test_end().
This patch introduces an override of the methods copy() and test_end()
in GstValidateTest so that `reports` is copied and cleared respectively,
but only for validate tests.
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5281 >
2023-09-05 14:16:57 +00:00
Alicia Boya García
ba61160d6c
validate-launcher: Fix race condition on repeated tests
...
Fixes https://gitlab.freedesktop.org/gstreamer/gstreamer/-/issues/2900
The `reports` list was being copied as a reference, therefore, copies of
a test ended up inadvertedly sharing the same list of reports. Reports
added by one instance of the test would be reflected in all instances.
This caused a race condition where, if a test was run on repeat with
gst-validate-launcher -f, very often wrong log file was shown to the
user. For instance, gst-validate-launcher would say "test failed, see
log for iteration7", but iteration7 would contain "TEST PASSED".
Worse, the runner would add the report to that incorrect log file,
mixing problems between different executions of the tests.
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5177 >
2023-08-13 03:18:50 +00:00
Thibault Saunier
1146548c3d
validate:launcher: try to bne more explicit about where to add known failure
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3979 >
2023-02-16 02:39:04 +00:00
Thibault Saunier
c637d90be9
validate:launcher: Handle known return code issue in none validate based tests
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3979 >
2023-02-16 02:39:04 +00:00
Jan Schmidt
794ffe6ec6
validate: Place regex flags at the start of the regex
...
In Python 3.11 it is an error to have regex flags in the middle
of an expression, so make sure they appear at the start.
Fixes https://gitlab.freedesktop.org/gstreamer/gstreamer/-/issues/1630
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3643 >
2022-12-28 10:04:41 +00:00
Thibault Saunier
9abceda343
validate:launcher: Cleanup test uuid when copying it
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3122 >
2022-10-05 20:29:22 +00:00
Thibault Saunier
f3c162cc85
validate: launcher: Add a argument to avoid rereuning flaky tests
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3122 >
2022-10-05 20:29:22 +00:00
Thibault Saunier
1577911d75
validate: launcher: Keep variable framerate from input when possible
...
But disable it if forcing a framerate for some reason
Fixing our support for variable framerate in the encoding profile
serialization format.
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3122 >
2022-10-05 20:29:22 +00:00
Thibault Saunier
f9e6044124
validate: Handle testfiles that need an HTTP server
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/3122 >
2022-10-05 20:29:22 +00:00
Jordan Petridis
272560463c
validate: don't look for the common supression file
...
We no longer have a common submodule
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/2841 >
2022-08-31 14:51:20 +00:00
Thibault Saunier
4de4aa1010
validate: Do not print Known error tests
...
Those are passing tests in practice and it doesn't give any useful information
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/2264 >
2022-04-21 12:50:43 -04:00
Haihua Hu
df0958e855
ximagesink/xvimagesink: use GST_XINITTHREADS to ensure call to XInitThreads
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/2098 >
2022-04-04 15:49:02 +08:00
Thibault Saunier
34d05cd876
validate:launcher: Run validate unit tests as GstValidate tests
...
So we have all the features and we can properly document known issue
for them
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1130 >
2021-10-13 18:01:38 +00:00
Thibault Saunier
7dfaac92fa
validate:launcher: Do not dump on failure test we will retry
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1113 >
2021-10-12 16:59:16 +00:00
Thibault Saunier
23dbfdf70d
validate:launcher: Allow more flexible handling of flaky tests
...
And retry twice flaky tests
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1113 >
2021-10-12 16:59:16 +00:00
Thibault Saunier
ff8d8bbc97
validate:launcher: Fix progress reporting with --n-runs
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1113 >
2021-10-12 16:59:16 +00:00
Thibault Saunier
4762b138b6
validate:launcher: Support retry on failure when using --n-runs
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1113 >
2021-10-12 16:59:16 +00:00
Thibault Saunier
f2efd3b133
validate:launcher: Fix potential invalid index access
...
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/1113 >
2021-10-12 16:59:16 +00:00
Thibault Saunier
2701634c29
Move files from gst-devtools into the "subprojects/gst-devtools/" subdir
2021-09-24 16:15:38 -03:00