Thibault Saunier
bf30bf4fd7
validate:launcher: Add the logic of needed env variables in tests
2014-08-12 13:16:43 +02:00
Thibault Saunier
e81c0093fc
validate:launcher: Expose all classes to be used to create testsuites
...
To create testsuite from outside gst-validate, the user will need to be
able to use the TestGenerator and subclasses of Test that we implement
in the apps, to do so we publicly expose them in the TestManager class
so that user have acces to everything they need.
2014-08-12 13:16:43 +02:00
Thibault Saunier
20c28def3c
validate:launcher: Handle stdout/stderr as possible logfiles
...
Allowing people to get all the logs in the terminal
2014-08-12 13:16:43 +02:00
Thibault Saunier
8e1997d820
validate: Launcher: Add support for the dash protocol
...
And make sure that the HTTP server is started if it is needed to serve
some HLS or DASH streams
2014-08-12 13:16:43 +02:00
Thibault Saunier
631db75718
validate:Launcher: Use the first media path as a path for http server
...
We need to have a default path and the first one sounds like a
reasonnable default.
2014-08-12 13:16:43 +02:00
Thibault Saunier
2da2c6cc56
validate:launcher: Allow limitating local HTTP server bandwith
...
By default we limit its bandwith to 1MBps which is somehow similare to a
good internet connection case.
2014-08-12 13:16:43 +02:00
Thibault Saunier
702992cf7a
validate:launcher: Disable racy HLS tests
...
+ Add need-clock-synk to switch_audio_track_while_paused as it relies on
the clock sync to pause and then display subtitles
2014-08-06 09:08:36 +02:00
Thibault Saunier
bab8a4c3bb
validate:launcher: Take into account exitcode in transcoding tests
...
And disable a few racy tests that were not detected because of that
2014-08-05 11:33:08 +02:00
Thibault Saunier
7875b9a3d9
validate:launcher:testsuite: De activate backward playback where appropriate
...
And re activate it where it works
2014-08-04 13:03:54 +02:00
Thibault Saunier
1bd6b2767f
validate: Avoid readding several time the same test in the tests result list
2014-08-04 13:02:46 +02:00
Thibault Saunier
b9712e336e
validate:launcher: Fix test number print
2014-08-04 13:02:46 +02:00
Thibault Saunier
0dd8e9cd3d
tools: Launcher: Disable validate.file.*.simple.scrub_forward_seeking.synchronized
...
It is still a bit racy and sometimes the seek just does not happen
2014-07-31 17:56:13 +02:00
Thibault Saunier
7057a9fd50
tools: launcher: Disable subtitle track switching scenario on Sintel
...
It is racy at the moment.
2014-07-31 17:43:51 +02:00
Thibault Saunier
1aa0d4eb4a
validate:launcher: Allow informing minimum media duration in scenarios
...
Allowing the launcher to avoid running tests on medias that are not long
enough
2014-07-23 20:43:57 +02:00
Thibault Saunier
24fe345f73
validate:launcher: Always print final report + enhance output
2014-07-23 17:49:44 +02:00
Thibault Saunier
386b572066
validate: launcher: Force clock syncronization for some scenarios
...
In some cases it is necessary that the clock is sync so that all the
actions can be executed.
2014-07-23 17:49:44 +02:00
Thibault Saunier
40003689df
validate: Launcher: Make sure tests are always executed in same order
2014-07-23 13:48:44 +02:00
Thibault Saunier
1cdbba4327
validate: Launcher: Fix a backtrace using self in a @staticmethod
2014-07-22 15:50:47 +02:00
Lubosz Sarnecki
24046a6168
httpserver: launch webserver with the same python interpreter.
2014-07-21 18:01:25 +02:00
Thibault Saunier
cf540d002b
validate:launcher: Fix a backtrace using an undefined method
2014-07-18 16:28:49 +02:00
Thibault Saunier
3cfa480eba
valdate:launcher: Do not refer to self in @staticmethod
...
There is no self in there.
2014-07-17 17:04:59 +02:00
Thibault Saunier
fcb8a77e17
validate:launcher: Avoid using sync=true on fakesinks
...
Making the test run much faster!
2014-07-16 19:38:01 +02:00
Thibault Saunier
b075646451
validate: Launcher: Print total time spent in the final report
2014-07-16 19:37:35 +02:00
Thibault Saunier
f5454f07f0
validate:launcher: Properly check that encoded files have the exact wanted format
2014-07-16 15:47:58 +02:00
Thibault Saunier
fe9ed41d6c
validate:launcher: Add a method to create a GstValidateMediaDescriptor from a uri
2014-07-16 15:47:58 +02:00
Thibault Saunier
265688fcd6
validate:launcher: Move MediaFormatCombination to baseclasses.py
...
+ Add some simple helpers
2014-07-16 15:47:58 +02:00
Thibault Saunier
f1163d61ba
validate:launcher: Implement a GstValidateEncodingTestInterface class
...
Allowing code to be shared between apps that run rendering tests
2014-07-16 15:47:58 +02:00
Thibault Saunier
a735b9eb99
validate:launcher: Implement a MediaDescriptor subclass for xges project files
2014-07-16 15:47:58 +02:00
Thibault Saunier
d61c0d6166
validate:launcher: Make a MediaDescriptor baseclass to be used by any application
2014-07-16 15:47:58 +02:00
Thibault Saunier
89aa70545a
validate:launcher: Give information to users when cloning asset failed
...
It might not be obvious from the stacktrace so it is better to clearly
explain what the failure was when we know it
2014-07-16 15:47:58 +02:00
Thibault Saunier
6beb346aa3
validate:launcher: Fixup the default asset update command
2014-07-16 15:47:58 +02:00
Thibault Saunier
9a69c21acc
validate:launcher: Generate proper EncodingProfiles for audio/video only media files
2014-07-16 15:47:58 +02:00
Thibault Saunier
87cc7da213
validate:launcher: Move the MediaDescriptor class to the baseclasses.py file
2014-07-16 15:47:58 +02:00
Thibault Saunier
58256ab135
validate:launcher: Allow transcoding audio only files 5 time longer than long_limit
...
Transcoding audio is a lot shorter so we can concider that transcoding files that are only
only is 5 time shorter than the actual file (empirical number)
2014-07-16 15:47:58 +02:00
Thibault Saunier
4227655db1
validate: Handle MXF files
2014-07-07 11:27:34 +02:00
Thibault Saunier
7d23d75edb
validate:launcher Add video mixing tests
...
+ Move default_testsuite.py to validate_testsuite.py as we are now
exposing tests that are not enabled by default
2014-07-07 11:27:34 +02:00
Thibault Saunier
af383ad0c0
validate:launcher: Move the notion of test generator to the baseclasses
...
This can be very usefull for all the TestManager and thus exposes a
higher level API for test writers.
2014-07-07 11:27:34 +02:00
Thibault Saunier
aeec108c88
validate:launcher: Move default testsuite to a dedicated file
...
Making the separation cleaner between the launcher and the test
implementation
2014-07-07 11:27:34 +02:00
Thibault Saunier
71cd2a8ce7
validate:launcher: Not concider all scenarios by default with --wanted-test
...
Instead let the users activate that with -t ALL
2014-07-07 11:27:34 +02:00
Thibault Saunier
5266fee48c
validate:launcher: Let the user set user options in the config file
2014-07-07 11:27:34 +02:00
Thibault Saunier
b9389c85c2
validate:launcher: Use RawTextHelpFormatter to (not) format user help
2014-07-07 11:27:34 +02:00
Thibault Saunier
f10ff2b610
validate:launcher: Add a way to create test suite outside the three
...
+ Make sure to namespace the API
+ Remove cruft about G_V_PROTOCOL_VIDEO_RESTRICTION_CAPS
2014-07-07 11:27:34 +02:00
Thibault Saunier
5983df47c5
validate:launcher: Cleanup the way we generate tests adding the notion of TestGenerator
...
Making it easier to extend the testsuite.
2014-07-07 11:27:34 +02:00
Thibault Saunier
4f01b2bd8a
validate:launcher:reporter: Sort Final report by results
2014-06-16 16:47:18 +02:00
Thibault Saunier
b8e1c3e64c
validate:launcher:ges: Fix rendered duration checking
2014-06-16 16:46:21 +02:00
Thibault Saunier
0bde7bcacb
validate: Add a scrub_backward_seeking scenario
...
+ Make use of it in ges-launch and do not try to seek while playing in
GES as it is not supported yet
2014-05-27 12:33:08 +02:00
Lubosz Sarnecki
1043aa3f55
python: change shebangs to python2
2014-05-19 10:21:07 +02:00
Thibault Saunier
dae0c4ef81
validate: Add a scenario that switches state many intensively
...
+ Use it by default in the launcher tests
2014-05-07 16:45:27 +02:00
Thibault Saunier
384686a7f7
validate: Minor fix for blacklisted test output formatting
2014-05-07 12:44:51 +02:00
Thibault Saunier
0b4bd7940a
validate:launcher: Add an option to only launch the http server
2014-05-07 12:44:51 +02:00