Commit graph

122 commits

Author SHA1 Message Date
Thibault Saunier
af383ad0c0 validate:launcher: Move the notion of test generator to the baseclasses
This can be very usefull for all the TestManager and thus exposes a
higher level API for test writers.
2014-07-07 11:27:34 +02:00
Thibault Saunier
aeec108c88 validate:launcher: Move default testsuite to a dedicated file
Making the separation cleaner between the launcher and the test
implementation
2014-07-07 11:27:34 +02:00
Thibault Saunier
71cd2a8ce7 validate:launcher: Not concider all scenarios by default with --wanted-test
Instead let the users activate that with -t ALL
2014-07-07 11:27:34 +02:00
Thibault Saunier
5266fee48c validate:launcher: Let the user set user options in the config file 2014-07-07 11:27:34 +02:00
Thibault Saunier
b9389c85c2 validate:launcher: Use RawTextHelpFormatter to (not) format user help 2014-07-07 11:27:34 +02:00
Thibault Saunier
f10ff2b610 validate:launcher: Add a way to create test suite outside the three
+ Make sure to namespace the API
+ Remove cruft about G_V_PROTOCOL_VIDEO_RESTRICTION_CAPS
2014-07-07 11:27:34 +02:00
Thibault Saunier
5983df47c5 validate:launcher: Cleanup the way we generate tests adding the notion of TestGenerator
Making it easier to extend the testsuite.
2014-07-07 11:27:34 +02:00
Thibault Saunier
4f01b2bd8a validate:launcher:reporter: Sort Final report by results 2014-06-16 16:47:18 +02:00
Thibault Saunier
b8e1c3e64c validate:launcher:ges: Fix rendered duration checking 2014-06-16 16:46:21 +02:00
Thibault Saunier
0bde7bcacb validate: Add a scrub_backward_seeking scenario
+ Make use of it in ges-launch and do not try to seek while playing in
GES as it is not supported yet
2014-05-27 12:33:08 +02:00
Lubosz Sarnecki
1043aa3f55 python: change shebangs to python2 2014-05-19 10:21:07 +02:00
Thibault Saunier
dae0c4ef81 validate: Add a scenario that switches state many intensively
+ Use it by default in the launcher tests
2014-05-07 16:45:27 +02:00
Thibault Saunier
384686a7f7 validate: Minor fix for blacklisted test output formatting 2014-05-07 12:44:51 +02:00
Thibault Saunier
0b4bd7940a validate:launcher: Add an option to only launch the http server 2014-05-07 12:44:51 +02:00
Thibault Saunier
8a295da795 validate: Keep scenario discovering logs in a file 2014-05-07 12:44:51 +02:00
Thibault Saunier
720b9eff47 validate: Properly check that outputed videos have a correct duration 2014-05-07 11:30:39 +02:00
Thibault Saunier
cdb8822ae3 validate: Add the notion of "long" tests so that we can avoid some test to be run if they are too long 2014-05-07 11:30:09 +02:00
Thibault Saunier
bb42d287e7 validate: Fix the name of the sintel blacklisting 2014-05-02 19:00:49 +02:00
Thibault Saunier
5d200f8819 validate: Add a scenario that disable subtitles
+ Clean the sythax to define switch-track action that actually
desactivate the track
2014-05-02 18:30:23 +02:00
Thibault Saunier
867bfec188 validate: Add a scenario that switches subtitle track while paused
+ Integrate it in the launcher
2014-05-02 18:30:23 +02:00
Thibault Saunier
872472feb3 validate:launcher: Sensibly simplify scenario handling 2014-05-02 18:30:23 +02:00
Thibault Saunier
9c5009c724 validate: Use ges-launch recursing path new feature
And fix path to URI conversion
2014-05-02 18:30:23 +02:00
Thibault Saunier
2077e76aa2 validate: Add a gst-validate-launcher documentation 2014-05-02 18:30:23 +02:00
Thibault Saunier
447b299dab validate:launcher: Port OptionParser to ArgParse 2014-05-02 18:30:23 +02:00
Thibault Saunier
5e2b577372 validate: Can not do reverse playback on sintel sample
+ Minor improvement in the CLI
2014-05-02 18:30:23 +02:00
Thibault Saunier
97482e2512 validate:launcher: Do not except meaningless argument in ges-launch 2014-05-02 18:30:23 +02:00
Thibault Saunier
804cdb5ad2 validate: Handle per file special scenarios
When a file is int the same folder as a media file and has a name like:
mediafilename.mkv.scenarios_name.scenario  we run that scenario on that
particular file
2014-05-02 18:30:23 +02:00
Thibault Saunier
da42500df7 validate: Add a scenarios that switchs subtitle track
+ Make it easier and cleaner to tell that a switch is actually disabling
a track type.

And run the scenario in gst-validate-launcher by default
2014-05-02 18:30:22 +02:00
Thibault Saunier
3281add6b5 validate: Add a switch_audio_track_while_paused scenario
And run it as a default
2014-05-02 18:30:22 +02:00
Thibault Saunier
28bd6ee17a launcher: Now using git annex to handle media files 2014-04-28 13:08:17 +02:00
Thibault Saunier
a3a132489a Revert "validate:launcher: Always put gst-validate result as stderr in reports"
This reverts commit 925ff7542b.

Actually jenkins never  truncates on failure stacktrace... we do not
want to set gst-validate as failure stacktrace in our results. That
commit was not usefull.
2014-04-26 09:16:26 +02:00
Thibault Saunier
925ff7542b validate:launcher: Always put gst-validate result as stderr in reports
This way jenkins will always keep the information in its database even
if the test passes
2014-04-26 08:11:20 +02:00
Thibault Saunier
bd936dae4c validate:launcher: Properly set error message when sending EOS did not work 2014-04-25 14:51:28 +02:00
Thibault Saunier
da6dc3882b validate:launcher: Add a way to specify tests filtering only on defaults 2014-04-25 14:51:28 +02:00
Thibault Saunier
be72ec5f6a validate:launcher: Add support for audio track switching scenario 2014-04-25 14:51:28 +02:00
Thibault Saunier
8b4542540c validate:launcher: Make it possible to run any scenario test in gst-validate 2014-04-25 14:33:06 +02:00
Thibault Saunier
8035094128 validate:launcher: Do not run reverse playback on mpegts files 2014-04-25 14:33:06 +02:00
Thibault Saunier
fba15f71c6 validate:launcher: Cleanup media descriptor usage 2014-04-25 14:33:06 +02:00
Thibault Saunier
81b0c74bfa validate:launch: Port to the new media_info format 2014-04-25 14:33:06 +02:00
Thibault Saunier
7133e4b4e0 validate:launcher: Use the new validatelog file
Making the output cleaner and clearer in junit XML file
2014-04-25 14:33:06 +02:00
Thibault Saunier
02abb60a67 validate:launcher: Send SIGINT signal instead of killing the subprocess
This way we get the result from GstValidate even on timeouts
2014-04-22 10:49:13 +02:00
Thibault Saunier
7f54c5dba8 validate:launcher: Always set sync=True on fakesink on playback pipelines
This way we are in closer condition of real sink playback.

+ some minor cleanup in gst-validate.c
2014-04-22 09:42:59 +02:00
Thibault Saunier
bbbd5fe2d0 validate:launcher: ring-buffer-max-size is in bytes 2014-04-17 12:58:48 +02:00
Thibault Saunier
f45524a3cc validate:launcher: Fix default blacklist management 2014-04-15 15:26:36 +02:00
Thibault Saunier
f1851235d5 validate:launcher: Print the number of the test being run 2014-04-02 19:17:24 +02:00
Thibault Saunier
86df60e16f validate:launcher: Fix mixup in media_check tests expected file path 2014-04-02 12:12:11 +02:00
Thibault Saunier
78f91ae8da validate:launcher: Flush stdout each time we print
So everything gets printed on time on windows and jenkins
2014-03-31 14:37:51 +02:00
Thibault Saunier
36a0f6a674 validate: launcher: Use the ConfigPraser object everywhere for file_infos 2014-03-31 11:03:48 +02:00
Thibault Saunier
3d8201d52b validate:launcher: Properly handle missing scenarios on the system 2014-03-28 15:41:30 +01:00
Thibault Saunier
339703d2eb validate:launcher: Handle windows path to construct arguments 2014-03-28 15:00:45 +01:00