Thibault Saunier
07b968a4f6
validate:tools: Clean test between runs when running forever
2014-02-19 14:34:10 +01:00
Thibault Saunier
f6bf92cbc9
validate: Do not check result furthers if alredy set as passing
2014-02-19 14:34:10 +01:00
Thibault Saunier
1189c48ff8
validate:launcher: Avoid running useless tests
...
For example we should not check if duration are equal when transcoding
with scenario set.
Also checking if position is in the seeked segment should be done at
a lower level
2014-02-18 21:07:31 +01:00
Thibault Saunier
d377158b42
validate:launcher: Avoid seeking in output files to parse them
...
Tihs creates issue and missing content.
2014-02-18 21:07:31 +01:00
Thibault Saunier
32d9d5dc44
validate:launcher: Properly classify test for media check
2014-02-18 21:07:31 +01:00
Thibault Saunier
0449817c11
validate:launcher: Handle issue with unknown framerate in HLS while transcoding
2014-02-18 21:07:31 +01:00
Thibault Saunier
c3adb05b2a
validate:tools: Handle cases were EOS does not stop the pipeline in the launcher
...
+ Fix parsing of GstClockTime
+ Avoid using play_15s scenario when not necessary
2014-02-18 21:07:31 +01:00
Thibault Saunier
90d9a686d7
validate: tools: Use the new scenario discovering fearure in the launcher
2014-02-18 21:07:31 +01:00
Thibault Saunier
4467b27b9f
validate: Add a way to save details about avalaible scenarios in a file
2014-02-18 21:07:31 +01:00
Thibault Saunier
9e66ac00f6
validate: Add a way to add a "description" to scenario files
...
Print details about the descriptions when listing scenario in a KeyFile
format
The description can contain any information about the scenario such as its duration before
EOS, how long the pipeline needs to be so the scenario can be applied...etc
2014-02-18 21:07:31 +01:00
Thibault Saunier
efc6938d01
validate: tools: Init gst-validate before listing scenarios
...
And return 0 when only listing scenarios
2014-02-18 21:07:31 +01:00
Thibault Saunier
904cdd6411
validate:tools: Rework the way we handle options
...
Make groups so it is easier for users to find what they look for
By default have 1 single directory where everything is oututed
(main-dir)
Add a way to specify how and where to look for remote assets
2014-02-18 21:07:31 +01:00
Thibault Saunier
ead3eb98a4
validate:tools:launcher: Take into account the position value when rendering
...
When rendering a files we try to use the size of the outputed file to
determine wether we are timeout or not, but if that fails
try to check the position
2014-02-18 21:07:31 +01:00
Thibault Saunier
10c192f693
validate: Better organize rendered files
2014-02-18 21:07:31 +01:00
Thibault Saunier
ca12b78be3
validate:tools: Use regex for parsing when appropriate
2014-02-18 21:07:31 +01:00
Thibault Saunier
df712e9404
validate:toold: Add a --output-dir parametter
2014-02-18 21:07:31 +01:00
Thibault Saunier
27e3758918
validate:tools: Keep file extension in test classnames
...
+ add test "namespace" in transcoded files
2014-02-18 21:07:31 +01:00
Thibault Saunier
2718923ae5
validate:tools: Add a class to back pipeline creation in gst-validate
2014-02-18 21:07:31 +01:00
Thibault Saunier
5927a6d8d8
validate:tools: Define supported protocols in an enum
2014-02-18 21:07:31 +01:00
Thibault Saunier
2f689fab73
validate: toold: Properly define scenario properties
2014-02-18 21:07:30 +01:00
Thibault Saunier
cd18609763
validate: Rename simple_backward to reverse_playback as this is what it does
2014-02-18 21:07:30 +01:00
Thibault Saunier
1ecd26eef6
validate:tools: Add namespace in apps global variables
...
Avoiding conflicts
2014-02-18 21:07:30 +01:00
Thibault Saunier
932fcaf9b8
validate:tools: Allow user to append paths to medias
2014-02-18 21:07:30 +01:00
Thibault Saunier
5e96c79000
validate:tools: Make use of the new seek_with_stop scenario
2014-02-18 21:07:30 +01:00
Thibault Saunier
cd098eb28c
validate:tools: Implement the logic of validate ouput parsing in the baseclass
...
+ Add some logic to check that we are mot playing outside wanted segment
2014-02-18 21:07:30 +01:00
Thibault Saunier
2c52d6374c
tools:validate: Make default blacklist handled by managers themselves
2014-02-18 21:07:30 +01:00
Thibault Saunier
7ab0447227
validate:tools: Only discover files with media-check
2014-02-18 21:07:30 +01:00
Thibault Saunier
a406ebb4c2
validate:tools: Add a 'discover-only' option to media-check
2014-02-18 21:07:30 +01:00
Thibault Saunier
1a9119cb33
validate: tools: Add a --fatal-error option to the launcher
2014-02-12 11:23:25 +01:00
Thibault Saunier
2520f4f110
validate: tools: Implement the notion of hard timeout
...
Allowing to define timeout that is not relative to the last observed number.
2014-02-12 11:23:25 +01:00
Thibault Saunier
2391a56714
validate: tools: Create a class for scenarios
2014-02-12 11:23:25 +01:00
Thibault Saunier
ba1f428351
validate: tools: Change timeouts depending on used protocol
2014-02-12 11:23:25 +01:00
Thibault Saunier
8b8562ea85
validate:tools: Implement Buffering support in the various tools
2014-02-12 11:23:23 +01:00
Thibault Saunier
b3c71bba02
validate:tools: Blacklist some scenario/protocol combinations
...
And add the option for user to easilly blacklist tests
2014-02-06 12:02:59 +01:00
Thibault Saunier
3bce8f8966
validate:tools: Print test result in the terminal after the end of each test
2014-02-06 12:02:59 +01:00
Thibault Saunier
299a677f09
validate:tools: Add an option to run testforever
2014-02-06 12:02:59 +01:00
Thibault Saunier
d9386f7542
validate: tools: Cleanup the way we return code in position query
2014-02-06 12:02:59 +01:00
Thibault Saunier
d000ca62a4
validate:tools: Use the same semantic for all tests classnames
2014-02-06 12:02:59 +01:00
Thibault Saunier
c0673d7eea
validate:tools: Add support for testing http streams locally
2014-02-06 12:02:59 +01:00
Thibault Saunier
c2e5c10767
validate:tools: Some cleanup in gst-validate test launcher
2014-02-06 12:02:59 +01:00
Thibault Saunier
33a744b688
validate:tools: Add actuall tests for media checking
2014-02-06 12:02:58 +01:00
Thibault Saunier
a3e7342eef
validate: tools: media-check: When comparing with a file just compare
...
We do not want to know if the file is seekable etc, but in that case we
want to see that the results are stable throughout the various runs
Also make sure to report an understandable error if the media file info
could not be parsed
2014-02-06 12:02:58 +01:00
Thibault Saunier
677e111f0b
validate: tools: Do not dot the pipeline every 50ms, it is a bit exessive
2014-02-06 12:02:58 +01:00
Thibault Saunier
d485180074
validate:tools: Return an exit code != 0 if pipeline can't go to playing
...
And give some information to the user about why the return code is !=0
everywhere it happens
2014-02-06 12:02:58 +01:00
Thibault Saunier
1c614b9ed9
validate:tools: Add informations about the test in the log files
2014-02-06 12:02:58 +01:00
Thibault Saunier
a6f3d5270c
validate:tools: Remove reference to get_backtrace which is not implemented
...
+ Enhance Message about launched apps
2014-02-06 12:02:58 +01:00
Thibault Saunier
26e3a9e3c5
validate:tools: Do not duplicated name in the classname in xunit reports
2014-02-06 12:02:58 +01:00
Thibault Saunier
654bacebc9
validate:tools: Do not check if position > duration
...
This is actually done by the scenario themselve. Instead if it is the
case, we return 0, this way it will timeout if it happens too many times
concecutively
2014-02-06 12:02:58 +01:00
Thibault Saunier
6bd9177205
validate:tools: Properly inform the user about the log location when test fails
2014-02-06 12:02:58 +01:00
Thibault Saunier
eb23274a5b
validate:tools: Add an option to generate .media_info files
...
So we can properly choose what media should be tested only placing
media_file as needed.
2014-02-06 12:02:58 +01:00