Commit graph

73 commits

Author SHA1 Message Date
Thibault Saunier
a406ebb4c2 validate:tools: Add a 'discover-only' option to media-check 2014-02-18 21:07:30 +01:00
Thibault Saunier
1a9119cb33 validate: tools: Add a --fatal-error option to the launcher 2014-02-12 11:23:25 +01:00
Thibault Saunier
2520f4f110 validate: tools: Implement the notion of hard timeout
Allowing to define timeout that is not relative to the last observed number.
2014-02-12 11:23:25 +01:00
Thibault Saunier
2391a56714 validate: tools: Create a class for scenarios 2014-02-12 11:23:25 +01:00
Thibault Saunier
ba1f428351 validate: tools: Change timeouts depending on used protocol 2014-02-12 11:23:25 +01:00
Thibault Saunier
8b8562ea85 validate:tools: Implement Buffering support in the various tools 2014-02-12 11:23:23 +01:00
Thibault Saunier
b3c71bba02 validate:tools: Blacklist some scenario/protocol combinations
And add the option for user to easilly blacklist tests
2014-02-06 12:02:59 +01:00
Thibault Saunier
3bce8f8966 validate:tools: Print test result in the terminal after the end of each test 2014-02-06 12:02:59 +01:00
Thibault Saunier
299a677f09 validate:tools: Add an option to run testforever 2014-02-06 12:02:59 +01:00
Thibault Saunier
d9386f7542 validate: tools: Cleanup the way we return code in position query 2014-02-06 12:02:59 +01:00
Thibault Saunier
d000ca62a4 validate:tools: Use the same semantic for all tests classnames 2014-02-06 12:02:59 +01:00
Thibault Saunier
c0673d7eea validate:tools: Add support for testing http streams locally 2014-02-06 12:02:59 +01:00
Thibault Saunier
c2e5c10767 validate:tools: Some cleanup in gst-validate test launcher 2014-02-06 12:02:59 +01:00
Thibault Saunier
33a744b688 validate:tools: Add actuall tests for media checking 2014-02-06 12:02:58 +01:00
Thibault Saunier
a3e7342eef validate: tools: media-check: When comparing with a file just compare
We do not want to know if the file is seekable etc, but in that case we
want to see that the results are stable throughout the various runs

Also make sure to report an understandable error if the media file info
could not be parsed
2014-02-06 12:02:58 +01:00
Thibault Saunier
677e111f0b validate: tools: Do not dot the pipeline every 50ms, it is a bit exessive 2014-02-06 12:02:58 +01:00
Thibault Saunier
d485180074 validate:tools: Return an exit code != 0 if pipeline can't go to playing
And give some information to the user about why the return code is !=0
everywhere it happens
2014-02-06 12:02:58 +01:00
Thibault Saunier
1c614b9ed9 validate:tools: Add informations about the test in the log files 2014-02-06 12:02:58 +01:00
Thibault Saunier
a6f3d5270c validate:tools: Remove reference to get_backtrace which is not implemented
+ Enhance Message about launched apps
2014-02-06 12:02:58 +01:00
Thibault Saunier
26e3a9e3c5 validate:tools: Do not duplicated name in the classname in xunit reports 2014-02-06 12:02:58 +01:00
Thibault Saunier
654bacebc9 validate:tools: Do not check if position > duration
This is actually done by the scenario themselve. Instead if it is the
case, we return 0, this way it will timeout if it happens too many times
concecutively
2014-02-06 12:02:58 +01:00
Thibault Saunier
6bd9177205 validate:tools: Properly inform the user about the log location when test fails 2014-02-06 12:02:58 +01:00
Thibault Saunier
eb23274a5b validate:tools: Add an option to generate .media_info files
So we can properly choose what media should be tested only placing
media_file as needed.
2014-02-06 12:02:58 +01:00
Thibault Saunier
32e1acbf88 validate:tools: use more scenarios in gst-validate launcher
And ensure that the list does not get mixed up with as we are sharing
"symboles" between all the files
2014-02-06 12:02:58 +01:00
Thibault Saunier
8e81727b87 validate:tools: Do not try to transcode images 2014-02-06 12:02:58 +01:00
Thibault Saunier
32e7b9a55e validate:tools: Minor cleanups 2014-02-06 12:02:58 +01:00
Thibault Saunier
38615bcae2 validate:tools: Fix classname in gst-launch transcoding tests 2014-02-06 12:02:58 +01:00
Thibault Saunier
dc29cc2857 validate:tools: Properly name the project launcher in the report 2014-02-06 12:02:58 +01:00
Thibault Saunier
0b3b456f6a validate:tools: Create the rendering directory if it does not exist 2014-02-06 12:02:58 +01:00
Thibault Saunier
8697dd3da4 validate:tools: Add an option to desativate ANSI colors
And enhance some debugging output
2014-02-06 12:02:58 +01:00
Thibault Saunier
eae7e94f44 validate:tools: Remove our dependency to PyGobject 2014-02-06 12:02:58 +01:00
Thibault Saunier
0c535ef9cf validate:tools: Do not forget to add Makefile.am and main.py 2014-02-06 12:02:58 +01:00
Thibault Saunier
bd3aaded49 validate:tools: Enhance the way we detect if ges-launch can be used
We make sure it has been compiled against gst-validate
2014-02-06 12:02:58 +01:00
Thibault Saunier
c7aa259c78 validate:tools: Set video/webm instead of video/x-matroska as caps for webm
+ some mirore indentation cleanups
2014-02-06 12:02:58 +01:00
Thibault Saunier
384dd33843 validate:tools: Do not forget to keep our ref to file_info g-v-transcode 2014-02-06 12:02:57 +01:00
Thibault Saunier
446e5c88c2 validate:tools: Cleanup how we check result of rendering test
Factor out a method in the utils, and make use of it for both ges-launch and
gst-validate-transcode
2014-02-06 12:02:57 +01:00
Thibault Saunier
ff30c6ba3c validate:tools: Don't give file duration as timeout for gst-validate
We use the other mean letting us actually control the process
advancement.
2014-02-06 12:02:57 +01:00
Thibault Saunier
cdff1c93ca validate:tools: Veryfy test manager are operationnal before using them 2014-02-06 12:02:57 +01:00
Thibault Saunier
e30f6372f9 validate:tools: Move the main function in a dedictaed file 2014-02-06 12:02:57 +01:00
Thibault Saunier
c33d10470f validate:tools: Print some statistic at the end of the test run 2014-02-06 12:02:57 +01:00
Thibault Saunier
d8fc68479c validate:tools: Print position every 50ms in gst-validate 2014-02-06 12:02:57 +01:00
Thibault Saunier
ea7ae57d3b validate:tools: Rename files around and integrate into autotools
File distribution used to be messy, clean it all up. Also make sure the
launcher is integrated into the autotools.
2014-02-06 12:02:57 +01:00
Thibault Saunier
ac9820a435 validate: tools: Enhance error message for GstValidate tests 2014-02-06 12:02:57 +01:00
Thibault Saunier
1f3432a33e validate: tools: Concider timeouts as errors when printing tests 2014-02-06 12:02:57 +01:00
Thibault Saunier
dac5b38a4d validate: tools: Refactor and add a GstValidateTranscodeTest class 2014-02-06 12:02:57 +01:00
Thibault Saunier
e591882794 validate: launcher: add the debug logger from pitivi
It is way more powerfull, simple to use and usefull
than the stock python one and has been proved to work reliably
2014-02-06 12:02:57 +01:00
Thibault Saunier
b51e143fdf validate: tools: Unref the pipeline before the runner and monitor
Avoids segfault in some cases, and monitors and runners have week ref on
their targets.
2014-02-06 12:02:57 +01:00
Thibault Saunier
0d6d397e30 validate: tools: Add a gst-validate test manager 2014-02-06 12:02:57 +01:00
Thibault Saunier
e9b2967504 validate: tools: Cleanup test launcher tool
Previous commit was not meant to be pushed and those two should have
been fixed up together, sorry for the mistake
2014-02-06 12:02:57 +01:00
Thibault Saunier
b4a2ca6286 Add a test launcher tool 2013-12-31 11:45:07 +01:00