Commit graph

620 commits

Author SHA1 Message Date
Thibault Saunier
90d9a686d7 validate: tools: Use the new scenario discovering fearure in the launcher 2014-02-18 21:07:31 +01:00
Thibault Saunier
ba717f6237 validate: Update all scenario to use the new description feature
+ Fix minor issues in scenario files
2014-02-18 21:07:31 +01:00
Thibault Saunier
4467b27b9f validate: Add a way to save details about avalaible scenarios in a file 2014-02-18 21:07:31 +01:00
Thibault Saunier
9e66ac00f6 validate: Add a way to add a "description" to scenario files
Print details about the descriptions when listing scenario in a KeyFile
format

The description can contain any information about the scenario such as its duration before
EOS, how long the pipeline needs to be so the scenario can be applied...etc
2014-02-18 21:07:31 +01:00
Thibault Saunier
efc6938d01 validate: tools: Init gst-validate before listing scenarios
And return 0 when only listing scenarios
2014-02-18 21:07:31 +01:00
Thibault Saunier
6ab7f17386 validate:scenario: Handle backslashes in scenario files 2014-02-18 21:07:31 +01:00
Thibault Saunier
904cdd6411 validate:tools: Rework the way we handle options
Make groups so it is easier for users to find what they look for
By default have 1 single directory where everything is oututed
(main-dir)
Add a way to specify how and where to look for remote assets
2014-02-18 21:07:31 +01:00
Thibault Saunier
ead3eb98a4 validate:tools:launcher: Take into account the position value when rendering
When rendering a files we try to use the size of the outputed file to
determine wether we are timeout or not, but if that fails
try to check the position
2014-02-18 21:07:31 +01:00
Thibault Saunier
10c192f693 validate: Better organize rendered files 2014-02-18 21:07:31 +01:00
Thibault Saunier
ca12b78be3 validate:tools: Use regex for parsing when appropriate 2014-02-18 21:07:31 +01:00
Thibault Saunier
df712e9404 validate:toold: Add a --output-dir parametter 2014-02-18 21:07:31 +01:00
Thibault Saunier
27e3758918 validate:tools: Keep file extension in test classnames
+ add test "namespace" in transcoded files
2014-02-18 21:07:31 +01:00
Thibault Saunier
2718923ae5 validate:tools: Add a class to back pipeline creation in gst-validate 2014-02-18 21:07:31 +01:00
Thibault Saunier
5927a6d8d8 validate:tools: Define supported protocols in an enum 2014-02-18 21:07:31 +01:00
Thibault Saunier
2f689fab73 validate: toold: Properly define scenario properties 2014-02-18 21:07:30 +01:00
Thibault Saunier
cd18609763 validate: Rename simple_backward to reverse_playback as this is what it does 2014-02-18 21:07:30 +01:00
Thibault Saunier
1ecd26eef6 validate:tools: Add namespace in apps global variables
Avoiding conflicts
2014-02-18 21:07:30 +01:00
Thibault Saunier
932fcaf9b8 validate:tools: Allow user to append paths to medias 2014-02-18 21:07:30 +01:00
Thibault Saunier
5e96c79000 validate:tools: Make use of the new seek_with_stop scenario 2014-02-18 21:07:30 +01:00
Thibault Saunier
cd098eb28c validate:tools: Implement the logic of validate ouput parsing in the baseclass
+ Add some logic to check that we are mot playing outside wanted segment
2014-02-18 21:07:30 +01:00
Thibault Saunier
2c52d6374c tools:validate: Make default blacklist handled by managers themselves 2014-02-18 21:07:30 +01:00
Thibault Saunier
7eb1ebde6d validate: data: Avoid using seek.stop time when not necessary
Instead send an EOS.
And add a seek_with_stop scenario to test that particular feature
2014-02-18 21:07:30 +01:00
Thibault Saunier
7ab0447227 validate:tools: Only discover files with media-check 2014-02-18 21:07:30 +01:00
Thibault Saunier
a406ebb4c2 validate:tools: Add a 'discover-only' option to media-check 2014-02-18 21:07:30 +01:00
Thibault Saunier
a61ebe671e data: Let playback until the end on last seek of seek_forward if duration < 30s 2014-02-18 21:07:30 +01:00
Thibault Saunier
1a9119cb33 validate: tools: Add a --fatal-error option to the launcher 2014-02-12 11:23:25 +01:00
Thibault Saunier
2520f4f110 validate: tools: Implement the notion of hard timeout
Allowing to define timeout that is not relative to the last observed number.
2014-02-12 11:23:25 +01:00
Thibault Saunier
2391a56714 validate: tools: Create a class for scenarios 2014-02-12 11:23:25 +01:00
Thibault Saunier
ba1f428351 validate: tools: Change timeouts depending on used protocol 2014-02-12 11:23:25 +01:00
Thibault Saunier
8b8562ea85 validate:tools: Implement Buffering support in the various tools 2014-02-12 11:23:23 +01:00
Thibault Saunier
b3c71bba02 validate:tools: Blacklist some scenario/protocol combinations
And add the option for user to easilly blacklist tests
2014-02-06 12:02:59 +01:00
Thibault Saunier
a88d54aec2 validate: Plug a leak in validate-reporter 2014-02-06 12:02:59 +01:00
Thibault Saunier
7b236c96bf validate:tools: Do not forget to give a ref for reporter's reports
Also enhance a bit report 'wording'
2014-02-06 12:02:59 +01:00
Thibault Saunier
3bce8f8966 validate:tools: Print test result in the terminal after the end of each test 2014-02-06 12:02:59 +01:00
Thibault Saunier
5d172e159e scenario: Enhance explanation about seek execution failure 2014-02-06 12:02:59 +01:00
Thibault Saunier
299a677f09 validate:tools: Add an option to run testforever 2014-02-06 12:02:59 +01:00
Thibault Saunier
d9386f7542 validate: tools: Cleanup the way we return code in position query 2014-02-06 12:02:59 +01:00
Thibault Saunier
d000ca62a4 validate:tools: Use the same semantic for all tests classnames 2014-02-06 12:02:59 +01:00
Thibault Saunier
ac92d5b428 scenario: Do not remove GSource if it has never been set 2014-02-06 12:02:59 +01:00
Thibault Saunier
705f8e7766 data: Add a scenario where we send EOS after 15secs if the duration is > to that 2014-02-06 12:02:59 +01:00
Thibault Saunier
c0673d7eea validate:tools: Add support for testing http streams locally 2014-02-06 12:02:59 +01:00
Thibault Saunier
c2e5c10767 validate:tools: Some cleanup in gst-validate test launcher 2014-02-06 12:02:59 +01:00
Thibault Saunier
33a744b688 validate:tools: Add actuall tests for media checking 2014-02-06 12:02:58 +01:00
Thibault Saunier
a3e7342eef validate: tools: media-check: When comparing with a file just compare
We do not want to know if the file is seekable etc, but in that case we
want to see that the results are stable throughout the various runs

Also make sure to report an understandable error if the media file info
could not be parsed
2014-02-06 12:02:58 +01:00
Thibault Saunier
677e111f0b validate: tools: Do not dot the pipeline every 50ms, it is a bit exessive 2014-02-06 12:02:58 +01:00
Thibault Saunier
d485180074 validate:tools: Return an exit code != 0 if pipeline can't go to playing
And give some information to the user about why the return code is !=0
everywhere it happens
2014-02-06 12:02:58 +01:00
Thibault Saunier
1c614b9ed9 validate:tools: Add informations about the test in the log files 2014-02-06 12:02:58 +01:00
Thibault Saunier
a6f3d5270c validate:tools: Remove reference to get_backtrace which is not implemented
+ Enhance Message about launched apps
2014-02-06 12:02:58 +01:00
Thibault Saunier
26e3a9e3c5 validate:tools: Do not duplicated name in the classname in xunit reports 2014-02-06 12:02:58 +01:00
Thibault Saunier
654bacebc9 validate:tools: Do not check if position > duration
This is actually done by the scenario themselve. Instead if it is the
case, we return 0, this way it will timeout if it happens too many times
concecutively
2014-02-06 12:02:58 +01:00