mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-25 17:50:36 +00:00
Code Issues 1 Projects Releases Wiki Activity
2523 commits 44 branches 1510 tags 331 MiB
Commit graph

25 commits

Author SHA1 Message Date
Thibault Saunier
b65b2bc2fe validate: Add a mechanism to mark tests as skipped 
And use it when a plugin is missing and the user didn't ask for
failure when it happens

And use the TAP[0] synthax to report it

[0]: https://testanything.org

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-devtools/-/merge_requests/187>
 2020-05-06 22:54:59 +00:00
Stéphane Cerveau
a2e926ff0a gst-validate-launcher: separate known error from passed tests 
Introduce known_error in statistics to keep in mind the expected
error result.
 2020-01-24 14:52:49 +00:00
Thibault Saunier
de007b6819 validate:launcher: Put all logs inside the failure node 
Pleasing gitlab CI reporting system
 2019-04-03 13:38:42 +00:00
Jordan Petridis
31164cf0a6 validate: Report the full test name in the xunit file 
Looks like gitlab prefers this way of representing tests as it
displays only the name field in its junit reports.

Close #32
 2019-01-26 16:55:23 +00:00
Thibault Saunier
5767d553a6 validate:launcher: Make failure as <failure> in our xunit reporter 
I think it was a mistake to call them <error> as the two notions are
different (we marked failed test as "failures" in the <testuite> node).

Should make gitlab happy with our file!
 2018-12-06 15:51:43 -03:00
Edward Hervey
e0f683dde9 validate: Use 'skipped' keyword in xunit xml 
It was always meant to be 'skipped' to be 100% compatible with xunit
xsl.

Makes jenkins happy again
 2018-07-10 13:23:46 +02:00
Thibault Saunier
1055540d55 validate:launcher: Do not print time spent if the testsuite never started 2018-05-15 14:45:52 -04:00
Thibault Saunier
2b40c6c306 launcher: Clean up outpout 
Make our stdout output simpler to follow by:
  - Not printing the tests we launch (it is not really useful in the end)
  - Using `\r` when printing the passed tests
  - Not reprinting all the test in a now useless summary
 2018-03-23 18:12:16 -03:00
Edward Hervey
58e62f651c validate-launcher: Allow running tests out-of-order 
When the --shuffle option is used, the tests will be run out of order.
This optimizes CPU utilization since it allows running synchronized
and unsynchronized tests at the same.
 2017-12-03 11:42:18 +01:00
Thibault Saunier
2c6c25d4bf validate:launcher: Use the number of failed test as exit code 
We used to always return 0, which was not right!
 2017-08-18 11:37:28 -03:00
Thibault Saunier
addd76fc85 validate: Mark tests as SKIPPED when installation is missing a GStreamer plugin 2017-02-07 13:12:09 -03:00
Thibault Saunier
e552c18c80 launcher: Handle stack trace information as jenkins expect it in the xunit file 2016-12-01 10:52:32 -03:00
Thibault Saunier
03453961e8 validate:launcher: Properly report stack trace as such in the xunit file 2016-11-28 18:40:00 -03:00
Thibault Saunier
1e51aeb942 validate:launcher: Port to Python3 
And sync logging.py with Pitivi version
 2016-11-09 10:13:42 -03:00
Thibault Saunier
23203ca0bd validate:launcher: Use a xunit reporter only when explicitely specified 2016-09-08 10:39:56 -03:00
Thibault Saunier
187df093eb launcher: Avoid caching all the debug logs in memory 
And just write the temporary XML file on disc
 2016-03-23 12:41:49 +01:00
Ramiro Polla
d12f55daf4 validate: launcher: Move logfile handling out of Reporter and into Test 
This makes each Test handle its own logfile, allowing the Reporter to
work on multiple tests at the same time.

Patch 5/5 to move logfile handling out of Reporter and into Test.
 2015-02-05 15:18:37 +01:00
Ramiro Polla
500206d3ad validate: launcher: Remove redundant check 
self.out is always available when _get_captured() is called.

Patch 4/5 to move logfile handling out of Reporter and into Test.
 2015-02-05 15:18:37 +01:00
Ramiro Polla
177eee728f validate: launcher: Split test log file handling in Reporter 
Patch 3/5 to move logfile handling out of Reporter and into Test.
 2015-02-05 15:18:37 +01:00
Ramiro Polla
b9357e3b17 validate: launcher: Separate Reporter from current Test 
Instead of saving the current Test in Reporter for every test, use
function parameters to achieve the same goal.

Patch 2/5 to move logfile handling out of Reporter and into Test.
 2015-02-05 15:18:37 +01:00
Ramiro Polla
39a4092434 validate: launcher: Initialize reporter timer before starting all tests 
Patch 1/5 to move logfile handling out of Reporter and into Test.
 2015-02-05 15:18:37 +01:00
Ramiro Polla
9c3606a867 validate: launcher: Always create log files 
Create log files even when stdout redirection is enabled.
This commit partially reverts 20c28de.

https://bugzilla.gnome.org/show_bug.cgi?id=742973
 2015-01-16 16:24:13 +01:00
Ramiro Polla
4e0388c631 validate: launcher: Introduce new parameter for log file redirecting 
Allow log file redirection through the new --redirect-logs parameter.
Keep the old --logs-dir stdout/stderr parameter, but reset to the
default logs directory in that case, and set redirect_logs internally.
This also prevents the creation of an stdout/stderr directory for
writing xunit.xml.

https://bugzilla.gnome.org/show_bug.cgi?id=742973
 2015-01-16 16:24:13 +01:00
Mathieu Duponchelle
8c1e84b5f4 validate-launcher: pep8ify sources. 
https://bugzilla.gnome.org/show_bug.cgi?id=739208
 2014-10-30 15:40:17 +01:00
Mathieu Duponchelle
b0beefacfa validate-launcher: restructure filesystem 
https://bugzilla.gnome.org/show_bug.cgi?id=739091
 2014-10-30 15:31:29 +01:00
Renamed from validate/tools/launcher/reporters.py (Browse further)