gstreamer

mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-12-22 08:17:01 +00:00

Author	SHA1	Message	Date
Thibault Saunier	319e86c81c	validate: Do not unref twice the same list Summary: Depends on D166 Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D167	2015-05-14 15:56:56 +02:00
Thibault Saunier	2e8552eff0	validate:scenario: Add a way to specify the pipeline on which a scenario applies Summary: From within the scenario itself. Depends on D165 Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D166	2015-05-14 15:56:56 +02:00
Thibault Saunier	2548eafd11	validate: Avoid depending on Gst 1.4 Summary: Depends on D117 Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D165	2015-05-14 15:56:56 +02:00
Thibault Saunier	b5d3622b31	validate: Add a gtk plugins that implements action types relative to Gtk Summary: Currently the only supported action is gtk-put-event allowing press and release keyboard keys. Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D117	2015-05-14 15:56:56 +02:00
Thibault Saunier	0969e79607	validate: Always git submodule update from the toplevel directory Otherwise it fails with older git versions	2015-05-12 09:55:58 +02:00
Emanuele Aina	2c3d0c9eab	validate: Reshape documentation Fix some errors, use more Docbook tags and split each command reference in its own file. https://bugzilla.gnome.org/show_bug.cgi?id=749162	2015-05-11 21:56:27 +02:00
Emanuele Aina	1286989c31	validate: Go back to the validate dir after submodule init https://bugzilla.gnome.org/show_bug.cgi?id=749162	2015-05-11 21:56:27 +02:00
Guillaume Desmottes	d548286209	validate: ignore x264 valgrind errors Summary: The x264 code is pretty hardcore so I just opened a bug for now. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D164	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	4927c65710	validate: disable QOS features when running with valgrind Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D156	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	b54a22c9bc	validate: move element_has_klass() to utils Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D163	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	f6681ff003	validate: rename get_valgrind_suppression_file() Summary: This function is actually not specific to valgrind so we can make it more generic. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D162	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	2760da33a3	validate: allow to pass more than one file to GST_VALIDATE_CONFIG Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D161	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	e5e7afd86f	validate: gst_validate_plugin_get_config() return 'core' conf if plugin is NULL Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D160	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	92fa2b5681	validate: add gst_validate_deinit() Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D159	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	596daaed74	validate: don't leak not maching config structures Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D158	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	c2fef15266	validate: factor out create_config() Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D157	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	63ca026b03	validate: display debug info when stopping because EOS Summary: Useful to know if we are executing the 'stop' command provided by the scenario or not. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D155	2015-05-11 21:55:24 +02:00
Guillaume Desmottes	0417e47e50	validate: unref last_caps when destroying pad monitor Reviewers: thiblahute Reviewed By: thiblahute Differential Revision: http://phabricator.freedesktop.org/D150	2015-05-07 11:19:57 +02:00
Guillaume Desmottes	5a5f718900	validate: fix typo in reverse_playback.scenario Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D148	2015-05-06 11:32:33 +02:00
Guillaume Desmottes	c2128e45af	validate: initialize position Summary: Fix invalid read when executing without having the actual position. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D147	2015-05-06 11:32:30 +02:00
Guillaume Desmottes	c08da0041d	validate: be less specific when ignoring the pixman tls leak Summary: I hit the same big in a slightly different code path. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D146	2015-05-06 11:32:26 +02:00
Guillaume Desmottes	007f433d73	update gitignore Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D145	2015-05-04 14:48:26 +02:00
Guillaume Desmottes	b947e1c2ef	use the setup_sink_props_max_lateness config scenario with valgrind Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D141	2015-05-04 14:13:46 +02:00
Guillaume Desmottes	4a8d4ddbf6	validate: add 'target-element-klass' property on set-property action Summary: This allows us to set a property on all the elements of the pipeline matching a specific klass name. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D140	2015-05-04 14:13:45 +02:00
Guillaume Desmottes	316a7bb74d	validate: add 'optional' action keyword Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D139	2015-05-04 13:24:21 +02:00
Guillaume Desmottes	d0a02df6e5	validate: scenario: call _element_added_cb() on existing children Summary: We want to have a chance to set property on all the elements of the pipelines, including the existing children when the element is added. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D138	2015-05-04 13:24:21 +02:00
Guillaume Desmottes	db366e0a37	Fix 'stoped' typo Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D137	2015-05-01 18:19:39 +02:00
Guillaume Desmottes	4c70c57427	validate: add vg suppression for libdrm bug Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D134	2015-05-01 15:15:26 +02:00
Guillaume Desmottes	d1f1fab185	validate: ignore invalid read from libav aac decoding Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D133	2015-05-01 15:15:26 +02:00
Guillaume Desmottes	1c03eb0f71	validate: ignore libvpx valgrind errors Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D132	2015-05-01 15:15:26 +02:00
Guillaume Desmottes	133c415ade	validate: display the URL of ignored Valgrind bugs Summary: We don't want to forget about those so best to remind it when starting tests as we do with blacklisted tests. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D131	2015-05-01 15:15:26 +02:00
Guillaume Desmottes	c5c39d88b1	validate: move look_for_file_in_source_dir and get_valgrind_suppression_file to utils Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D130	2015-05-01 15:15:26 +02:00
Thibault Saunier	6a89662da6	validate: Make sure to run submodule init from the root dir	2015-05-01 00:01:50 +02:00
Thibault Saunier	9bba59d9ba	validate:scenario: Fix 'duration' property of the pause action We preparse it into and set it as GstClockTime in the structures so make sure to use them as such.	2015-04-29 13:22:11 +02:00
Thibault Saunier	753ba408dd	validate:launcher: Concider unset MediaDescriptor duration has 'infinite'	2015-04-28 16:44:42 +02:00
Guillaume Desmottes	8286adc047	validate: ignore a pixman leak which is fixed in master http://phabricator.freedesktop.org/D128	2015-04-23 14:35:44 +02:00
Guillaume Desmottes	2067b173cd	validate: use a bigger hammer to ignore mesa related leaks Looks like some tests are hitting a slightly different code path in udev but the root bug is the same. http://phabricator.freedesktop.org/D128	2015-04-23 14:35:17 +02:00
Thibault Saunier	d59b117174	validate: Update autogen.sh And add a gst-validate.doap file.	2015-04-23 11:52:41 +02:00
Thibault Saunier	15f880858c	Update common submodule	2015-04-23 11:24:14 +02:00
Guillaume Desmottes	044ab241ee	validate: use -debug versions of bins when running from source Summary: Those versions are using rpath instead of libtool's wrappers and so will be faster to start and won't confuse valgrind. Reviewers: thiblahute Differential Revision: http://phabricator.freedesktop.org/D116	2015-04-21 11:19:17 +02:00
Guillaume Desmottes	8c4a3de701	move scenarios to data/scenarios Differential Revision: http://phabricator.freedesktop.org/D115	2015-04-20 15:31:26 +02:00
Guillaume Desmottes	8c2684c9a7	validate: add gstvalidate.supp valgrind suppression file Differential Revision: http://phabricator.freedesktop.org/D115	2015-04-20 15:29:28 +02:00
Guillaume Desmottes	60498f73b3	validate: scenario: fix structure and action leak	2015-04-20 08:35:58 +02:00
Guillaume Desmottes	308fa194a7	validate: report: fix GString leak when early returning	2015-04-20 08:35:58 +02:00
Thibault Saunier	848d660603	validate:pipelinemonitor: Print position only when in state >= PAUSED Reviewers: Mathieu_Du Reviewed By: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D86	2015-04-19 11:58:01 +02:00
Thibault Saunier	31d11ff8c3	validate:launcher: Use full HD screen as default screen size in xvfb	2015-04-19 11:56:29 +02:00
Thibault Saunier	a0b3287d40	validate:launcher: Add a way to run tests without displaying the output Summary: Adding a --no-display option and running Xvfb virtual frame buffer X server. Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D105	2015-04-17 21:51:29 +02:00
Thibault Saunier	76eedece5c	validate:launcher: Error out if valgrind is not available on the system Summary: When the user wants to use valgrind, make sure it is present on the system before doing anything Reviewers: gdesmott Differential Revision: http://phabricator.freedesktop.org/D104	2015-04-17 19:58:18 +02:00
Thibault Saunier	86efbffa32	validate:scenario: Stop scenario execution on stop action And document it properly. Summary: The stop action was defined as "setting state to NULL" but its actual goal is to stop the execution of the scenario. Make sure that the scenario will not try to execute other actions when that one has been executed. Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D103	2015-04-17 19:31:07 +02:00
Thibault Saunier	5d6fcb5727	validate: Gracefully handle absence of TAG on streams Summary: And do not segfault when it happens! Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D99	2015-04-16 13:43:33 +02:00
Thibault Saunier	adbe811175	validate:launcher: Pass GST_VALIDATE_SCENARIO to the subprocess env only Summary: And make sure to remove it from the env if the user has it in its main environment. Without that commit we ended up passing scenarios from previous tests to the following ones where None were specified. Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D98	2015-04-16 12:41:25 +02:00
Guillaume Desmottes	abb9e0ff2a	validate: don't pass NULL to gst_caps_copy()	2015-04-16 12:41:25 +02:00
Guillaume Desmottes	36e69f305a	validate: use GstMediaDescriptorWriter as log handler Allow us to catch warnings when running gst-validate-media-check-1.0.	2015-04-16 12:41:25 +02:00
Guillaume Desmottes	2133207113	validate: media-descriptor-writer: fix string leaks	2015-04-16 12:41:25 +02:00
Young Han Lee	102c13ed6f	validate:launcher: Handle git error properly 'OSError' exception is emitted but not handled properly when git is not installed on running system. https://bugzilla.gnome.org/show_bug.cgi?id=747892	2015-04-15 11:36:28 +02:00
Guillaume Desmottes	8a6494ddf8	validate: set GST_GL_XINITTHREADS This ensure that XInitThreads is called and so gl contexts are properly initialized. https://bugzilla.gnome.org/show_bug.cgi?id=747840 Signed-off-by: Guillaume Desmottes <guillaume.desmottes@collabora.co.uk>	2015-04-14 12:56:32 +02:00
Thibault Saunier	0fcee6ed84	validate:launcher: Make validate the only default testsuite Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D93	2015-04-13 11:27:08 +02:00
Thibault Saunier	5a6d6b9475	validate:launcher: Let the responsibility to update asset to the testsuite Summary: It makes it easier to make sure that the assets needed for a specific testsuite are available when needed Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D92	2015-04-13 11:27:08 +02:00
Thibault Saunier	101ed96b5a	validate:tools: EOS handling is the responsibility of the scenario Summary: If any scenario set Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D90	2015-04-13 11:27:08 +02:00
Ramiro Polla	6bb04c037c	validate:scenario: Add support for waiting on signals and messages Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D88	2015-04-13 11:27:02 +02:00
Thibault Saunier	774dbf9346	validate:scenario: Report disabling plugin issues Summary: + typedef GstValidateActionReturn so it can be used in the introspection + Add GST_VALIDATE_EXECUTE_ACTION_ERROR_REPORTED which should be used to tell Validate that something wrong happened so the sub action won't be executed, but that it should not report an error itself as it has already been handled in the action function. Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D81	2015-04-10 16:53:41 +02:00
Thibault Saunier	69ca5c69cc	validate:scenario: Allow execution of disable-plugin as a config action Summary: And fix a bug where config actions were added to the list of action even if they had already been executed Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D80	2015-04-10 16:53:41 +02:00
Thibault Saunier	25ab37300d	validate:scenarios: Set seek_forward_backward min-media-duration=45 Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D79	2015-04-10 16:53:41 +02:00
Thibault Saunier	2cf082c4be	validate:launcher: Set more env variable in the launcher command desc Summary: Adding if present: * LD_PRELOAD * DISPLAY * GST_VALIDATE_CONFIG * GST_VALIDATE_OVERRIDE + enhance the add_env_variable method to more easily set envvar from current value Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D78	2015-04-10 16:53:41 +02:00
Thibault Saunier	5d7403a6a5	validate: Add a method to easily get plugin configuration Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D77	2015-04-10 16:53:41 +02:00
Thibault Saunier	4dce5054de	validate:plugins: Add support to all GApplication as a test apps Summary: Add a very simple plugin that will allow any GApplication to easily be used with GstValidate using the LD_PRELOAD feature Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D75	2015-04-10 16:53:41 +02:00
Mathieu Duponchelle	23bb7dfdcc	validate: let structs_from_filename be exported. Summary: It is useful for plugins too Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D74	2015-04-10 16:53:41 +02:00
Thibault Saunier	0159c96ab0	validate:scenario: Update Action.repeat field when needed Summary: And print the current repeat value of the action that have such a field Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D73	2015-04-10 16:53:41 +02:00
Thibault Saunier	1e6b188d78	validate:scenario: Alway execute a 'quit' action on EOS Summary: Making scenario more usable with LD_PRELOAD Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D72	2015-04-10 16:53:41 +02:00
Thibault Saunier	460bf61345	validate:scenario: Set the main action structure in fill_structure Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D71	2015-04-10 16:53:40 +02:00
Thibault Saunier	bbd04eef4c	validate:launcher: Use GST_VALIDATE_SCENARIO envvar to set scenarios Summary: Instead of concidering all apps will have a --set-scenario argument which is not going to be the case as soon as we run the tests through LD_PRELOAD Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D70	2015-04-10 16:53:40 +02:00
Thibault Saunier	2fe03f1993	validate:launcher: Move get_current_position from GstValidatePipelineTest to GstValidateTest This is where it belongs Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D69	2015-04-10 16:53:40 +02:00
Wonchul Lee	058d5c6b12	validate: fix typo in scenario file format docs https://bugzilla.gnome.org/show_bug.cgi?id=747487	2015-04-08 10:10:42 +01:00
Guillaume Desmottes	2f643bde2c	validate: scenario: fix caps leak	2015-03-31 09:45:06 +02:00
Guillaume Desmottes	37d0ea4335	validate: media-descriptor: fix filenode->caps leak	2015-03-31 09:45:06 +02:00
Guillaume Desmottes	15918f1e40	validate: transcoding: don't create a second mainloop	2015-03-31 09:45:06 +02:00
Guillaume Desmottes	8b84f76df4	validate: transcoding: don't leak the requested sinkpad from decodebin	2015-03-31 09:45:06 +02:00
Guillaume Desmottes	c8e6b90f4b	validate: pad-monitor: fix caps leak Don't create othercaps when early returning.	2015-03-31 09:45:06 +02:00
Guillaume Desmottes	1bb98b49ca	validate: GstValidateMediaCheckTest should inherit from GstValidateTest	2015-03-31 09:45:06 +02:00
Young Han Lee	75205828c7	validate:launcher: Install config.py for non-development mode Running installed gst-validate-launcher aborted with the following error. File "lib/gst-validate-launcher/python/launcher/baseclasses.py", line 28, in <module> import config ImportError: No module named config This is because config.py is added but not installed in `ba6d209b3f`. https://bugzilla.gnome.org/show_bug.cgi?id=747087	2015-03-31 09:29:16 +02:00
Young Han Lee	4725f4ec09	validate:launcher: Show timeout seconds for timeout result message Current timeout message doesn't show how many seconds a test took and it is timeouted by normal timeout or hard timeout. This patch changes the message like following. 1. normal timeout old : validate.http.playback.reverse_playback.raw_video_mov: Timeout (Application timed out) new : validate.http.playback.reverse_playback.raw_video_mov: Timeout (Application timed out: 120 secs) 2. hard timeout old : validate.http.playback.reverse_playback.raw_video_mov: Timeout (Application timed out) new : validate.http.playback.reverse_playback.raw_video_mov: Timeout (Hard timeout reached: 600 secs) https://bugzilla.gnome.org/show_bug.cgi?id=746957	2015-03-30 13:32:57 +02:00
Young Han Lee	4c7ec6b8b1	validate:launcher: Fix wrong test number with -j option When '-j n' option is given, first n tests print test number 0. This is caused by test_num part of `919db98605`. https://bugzilla.gnome.org/show_bug.cgi?id=747006	2015-03-30 13:02:39 +02:00
Thibault Saunier	ba6d209b3f	validate:launcher: Avoid depending on PyGObject Summary: And rely on our knowledge of the configuration to figure out where the suppression file has been installed Reviewers: gdesmott Differential Revision: http://phabricator.freedesktop.org/D61	2015-03-28 23:35:07 +01:00
Guillaume Desmottes	625fe7b5df	validate: media-descriptor-writer: don't leak info and streaminfo	2015-03-26 15:42:11 +01:00
Guillaume Desmottes	779e44dd36	validate: media-check: don't leak output_file and expected_file	2015-03-26 15:40:50 +01:00
Guillaume Desmottes	4f805422a7	validate: check VALGRIND_ERROR_CODE in Test as well We were doing it only in GstValidateTest which was overriding the default implementation.	2015-03-26 13:59:30 +01:00
Guillaume Desmottes	9ad79ffcbc	validate: don't increase hard_timeout is if it's None Some tests, like the media check ones, have None as hard_timeout.	2015-03-26 13:57:34 +01:00
Guillaume Desmottes	daaa32676c	validate: increase VALGRIND_TIMEOUT_FACTOR 5 wasn't enough for my poor laptop.	2015-03-26 11:29:26 +01:00
Guillaume Desmottes	66a675cde8	validate: increase the normal timeout as well when using valgrind	2015-03-26 11:29:06 +01:00
Guillaume Desmottes	32eac4db44	validate: media-descriptor: fix caps leak gst_pad_get_current_caps() returns a reffed caps.	2015-03-26 10:32:09 +01:00
Guillaume Desmottes	093390981c	also call gst_deinit() in media-check and transcoding More valgrind friendly.	2015-03-26 09:18:44 +01:00
Guillaume Desmottes	f1985bc738	validate: raise an error if valgrind detected issues Differential Revision: http://phabricator.freedesktop.org/D53	2015-03-26 09:18:27 +01:00
Guillaume Desmottes	5456ddbae0	call gst_deinit() when we are done More valgrind friendly.	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	a35614d108	validate: call gst_bus_remove_signal_watch() We are supposed to call gst_bus_remove_signal_watch() for each gst_bus_add_signal_watch() call to prevent leaks.	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	6e776b8f0f	validate: media-descriptor-parser: fix string leak _set_content() doesn't actually consume @content so the caller is responsible freeing it.	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	d9a13b5563	validate: pad-monitor: fix buffers list leak	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	3f0cb5fedf	validate: pad-monitor: fix caps leak	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	81a33d5f6a	validate: fix a bunch of GstBus leaks	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	c23bac2912	validate: store valgrind logs to its own file	2015-03-23 13:41:03 +01:00
Guillaume Desmottes	2aeaa1b279	validate: report: fix invalid read when destroying Report Summary: @report was invalid when we were trying to clear the mutex. validate: scenario: remove weak pointer when destroying action Free an invalid read when the scenario is destroyed after the action. Differential Revision: http://phabricator.freedesktop.org/D44	2015-03-20 15:13:30 +01:00
Guillaume Desmottes	7aa5f85ccd	validate: report: fix invalid read when destroying Report @report was invalid when we were trying to clear the mutex.	2015-03-20 14:49:24 +01:00
Guillaume Desmottes	08a9034576	validate: fix string arguments leaks We are responsible of freeing the string arguments parsed by GOptionContext.	2015-03-20 12:15:03 +01:00
Guillaume Desmottes	ba175368d1	validate: scenario: don't borrow @structure in _fill_action() @structure was borrowed in some code path and wasn't in some other. Make it clearer, and fix a leak, by always copying it.	2015-03-20 11:39:32 +01:00
Guillaume Desmottes	9691136887	validate: override-registry: fix structs list leak The list returned by _lines_get_strutures() needs to be deeply freed.	2015-03-20 11:33:01 +01:00
Guillaume Desmottes	a99c13da4b	validate: scenario: fix scenarios leak	2015-03-20 11:27:29 +01:00
Guillaume Desmottes	38342dfe2e	validate: reporter: fix message leak	2015-03-20 11:25:39 +01:00
Guillaume Desmottes	e9aeca28a8	validate: report: don't shadow the GString variable We were leaking the GString as it's freed outside of the block.	2015-03-20 11:24:27 +01:00
Guillaume Desmottes	3a275d2212	validate: report: fix GStrv leak	2015-03-20 11:24:04 +01:00
Guillaume Desmottes	7373286968	validate: report: fix GStrv leak We borrow the content of the GStrv but were leaking the array itself.	2015-03-20 11:23:29 +01:00
Guillaume Desmottes	cb8348c7b1	launcher: try using gst.supp as valgrind suppressions file https://bugzilla.gnome.org/show_bug.cgi?id=746465	2015-03-20 10:34:49 +01:00
Guillaume Desmottes	3024b3682f	validate: install gst.supp Will be used when running tests inside Valgrind. https://bugzilla.gnome.org/show_bug.cgi?id=746465	2015-03-20 10:34:49 +01:00
Guillaume Desmottes	271f9f3c8e	launcher: add valgrind support Add a --valgrind option to gst-validate-launcher to run the tests inside Valgrind and tune GLib's memory allocator accordingly. Fix https://bugzilla.gnome.org/show_bug.cgi?id=746465	2015-03-20 10:34:49 +01:00
Guillaume Desmottes	2778e501c4	validate: move scenarios to validate/scenarios/ https://bugzilla.gnome.org/show_bug.cgi?id=746465	2015-03-20 10:34:48 +01:00
Guillaume Desmottes	e7762d13cc	validate:launcher: Fix small typo	2015-03-19 12:22:39 +01:00
Thibault Saunier	ad5b5f5369	validate:launcher: Make sure to show apps specific options in the help	2015-03-18 17:06:14 +01:00
Thibault Saunier	e9da098e33	validate:launcher: Fix test number printing	2015-03-18 17:05:57 +01:00
Thibault Saunier	7079d1910d	validate:launcher Rename _other_testsuite_for_tester To _check_tester_has_other_testsuite	2015-03-17 12:41:26 +01:00
Thibault Saunier	919db98605	validate:launcher: Cache all the tests in the runner This way we do not have to re ask all the test managers what tests should be run.	2015-03-17 12:41:26 +01:00
Thibault Saunier	d1411cfc6a	validate:launcher: Add a way to simply run validate default tests on uris Summary: This allows us to easily run all the scenarios on a particular file doing: $ gst-validate-launcher validate --validate-check-uri file:///some/media/file.webm Reviewers: Mathieu_Du Differential Revision: http://phabricator.freedesktop.org/D36	2015-03-13 18:04:42 +00:00
Thibault Saunier	b8c085b319	validate: keep executing actions even after linking up following execution When linking actions execution without waiting on execution context, then idle callback should keep being called so following action keep being executed.	2015-03-13 18:04:42 +00:00
Thibault Saunier	e11646dcca	validate: Add more files to .gitignore Differential Revision: http://phabricator.freedesktop.org/D34	2015-03-10 11:32:15 +01:00
Thibault Saunier	49b2ed5d7a	validate:scenario: Rename get_position to execute_next_action That function was wrongly called and did not correspond to what it actually does.	2015-03-10 11:32:15 +01:00
Vincent Penquerc'h	3bb6ecd6fa	Revert "validate: add non flushing seek support" This reverts commit `3ff55dcc31`. Regressions on the test server, apparently linked to this patchset.	2015-03-09 18:26:37 +00:00
Vincent Penquerc'h	09988a97bf	Revert "validate: use segments to detect success of flushing seeks too" This reverts commit `c47cc7ba90`. Regressions on the test server, apparently linked to this patchset.	2015-03-09 18:26:33 +00:00
Vincent Penquerc'h	d78c20322f	Revert "validate: expect a buffer with discontinuity after a seek" This reverts commit `87064b6994`. Regressions on the test server, apparently linked to this patchset.	2015-03-09 18:26:06 +00:00
Thibault Saunier	08d8e01f21	validate:launcher: Make sure TIMEOUTs do not get converted to ERROR This was a regression introduced in `c0e3d2e4f1`	2015-03-09 18:41:54 +01:00
Vincent Penquerc'h	87064b6994	validate: expect a buffer with discontinuity after a seek https://bugzilla.gnome.org/show_bug.cgi?id=744783	2015-03-09 10:06:34 +00:00
Vincent Penquerc'h	c47cc7ba90	validate: use segments to detect success of flushing seeks too https://bugzilla.gnome.org/show_bug.cgi?id=744783	2015-03-09 10:06:34 +00:00
Vincent Penquerc'h	3ff55dcc31	validate: add non flushing seek support and a couple scenarios using them https://bugzilla.gnome.org/show_bug.cgi?id=744783	2015-03-09 10:06:34 +00:00
Thibault Saunier	d08a6b8e0c	validate:launcher: Do not forget to install apps/__init__.py It is a python module that should be usable by external apps/testsuites	2015-03-06 09:39:36 +01:00
Thibault Saunier	d5ddeaf8c2	validate:scenario: Handle not mandatory action types Summary: There is currently no way to handle the fact that action types might be handled only by a specific application but not handling this action types would not cause any difference for the good execution of the scenario as a whole Differential Revision: http://phabricator.freedesktop.org/D33	2015-03-05 14:55:39 +01:00
Thibault Saunier	a17c214dba	validate:launcher: Better handle GST debug log outputs redirection	2015-03-04 17:57:21 +01:00
Thibault Saunier	c0e3d2e4f1	validate:launcher: First rely on the presence of criticals to set tests result In the case of external applications they might not set their exist code bases on the result of validate so we should rely on what validates as to say first.	2015-03-04 17:30:41 +01:00
Thibault Saunier	88da04e0a0	validate:report: Allow registering of issue types through the introspection Fixing annotations and make GstValidateIssue refcounted We break the ABI in that commit but I do not expect anyone to register issue type outside GstValidate yet. Add padding in the structures so we can avoid breaking the ABI again later.	2015-03-04 17:28:50 +01:00
Thibault Saunier	433c8676dc	validate:monitor: Do not requiere a GstObject as target We can work with any GObject and that allows applications to write monitors for other aspects too	2015-03-04 17:24:52 +01:00
Thibault Saunier	8b261599e4	validate:scenario: Alway execute sub action on action running SYNC Move methods around to avoid needing on top prototypes	2015-03-03 12:31:37 +01:00
Wonchul Lee	5a959aa47b	validate:docs: Rename gst-validate-launch to gst-validate-launcher https://bugzilla.gnome.org/show_bug.cgi?id=745510	2015-03-03 11:34:01 +01:00
Thibault Saunier	34394b0c7a	validate:scenario: Do not execute last sub action twice when ASYNC	2015-03-03 11:33:06 +01:00
Thibault Saunier	7888293f8f	validate:scenario: Properly print sub action as if they were main actions	2015-03-03 10:39:52 +01:00
Emanuele Aina	9e7f713758	validate:docs: Fix typos in Scenario File Format https://bugzilla.gnome.org/show_bug.cgi?id=736160	2015-03-02 16:18:30 +01:00
Thibault Saunier	e40d225614	validate:launcher Do not use git -C as it is relatively recent https://bugzilla.gnome.org/show_bug.cgi?id=736160	2015-03-02 16:18:30 +01:00
Thibault Saunier	ec27b86fa9	validate: Build the preload so when possible	2015-02-26 11:09:23 +01:00
Thibault Saunier	4c13ec7121	validate:launcher: Print the long help in less when possible	2015-02-24 20:39:22 +01:00
Thibault Saunier	6309f8168a	validate:launcher: Mention testsuite implementation in the help	2015-02-24 20:34:43 +01:00
Thibault Saunier	72dedae65d	validate: Define GST_PLUGIN_LDFLAGS as needed	2015-02-23 12:24:39 +01:00
Young Han Lee	2d6c667c9a	validate: Determine development mode using git hash value Development mode has been determined by whether the launcher is in git repo or not. This could be wrong when the launcher is installed to subdirectory of other project's git repo, such as jhbuild. It is normal to install compiled output to subdirectory of your jhbuild. Changed logic gets the first commit hash of current git repo and compares it with gst-devtools' the first commit hash. https://bugzilla.gnome.org/show_bug.cgi?id=744781	2015-02-19 13:57:30 +01:00
Thibault Saunier	c5393f79f3	validate:launcher: Fix typo s/FILE_EXTENDION/FILE_EXTENSION/g	2015-02-19 13:57:30 +01:00
Thibault Saunier	f3adc999f1	validate:scenario: Fix GstValidateAction ABI adding a private structure This way we can easily extend the structure and avoid needing using a union and such	2015-02-19 13:57:30 +01:00
Mathieu Duponchelle	ac1c1aec7c	validate: Test buffer outside of received range. Summary: As part of the preparation for a port to tracer. Test Plan: This is a test, we won't test tests Reviewers: tsaunier Differential Revision: http://internal.opencreed.com:8888/D19	2015-02-19 12:19:46 +01:00
Thibault Saunier	3b6f187d85	validate: Properly notify user about missing plugins This way it is clear in gst-validate-launcher that the failure is due to a missing plugin	2015-02-18 10:07:17 +01:00
Thibault Saunier	f0511cc3a2	validate: Fix wrong sizeof usage sizeof(int) is always <= sizeof(gpointer)	2015-02-17 18:22:12 +01:00
Ramiro Polla	2d5ad1ac62	validate: launcher: Use cElementTree for XML parsing Using cElementTree instead of ElementTree speeds up parsing of media descriptor files. The total time spent parsing XML files drops from ~0.64 s to ~0.24 s, leading to faster initialisation times for gst-validate-launcher. https://bugzilla.gnome.org/show_bug.cgi?id=743293	2015-02-17 17:27:40 +01:00
Thibault Saunier	08afce235c	validate: Print actions directly from the scenario Avoiding user to have to print them in each and every action type implementation. This requires adding some API to prepare actions before printing them. Preparing action in that case mean parsing the values contained in the GstStructure parsing equations and setting back the actual value afterward API: * GstValidatePrepateAction * gst_validate_action_type_set_prepare_function	2015-02-17 17:11:51 +01:00
Thibault Saunier	8b6c521bb1	validate: Fix build on windows Check where libgstvalidate.dll is installed and use that base folder to figure out where GstValidate plugins are installed	2015-02-17 09:23:27 +01:00
Thibault Saunier	62a0db232c	validate: Do not forget to dist _full variant of scrubing scenarios	2015-02-16 20:56:49 +01:00
Thibault Saunier	8e5b495c62	validate: Create a gst-validate-types.h header where we define types And include it from validate.h. This way we avoid to need to typedef GstValidateAction twice, which is a C11 feature	2015-02-16 19:52:12 +01:00
Edward Hervey	a1da4cd733	validate-report: Fix valist usage a va_list always 'exists' (it's a struct). It therefore can't be NULL (and can't be tested) Just use the regular print variant where appropriate.	2015-02-16 19:24:23 +01:00
Thibault Saunier	3d83370770	validate:scenario: Document locking	2015-02-16 17:18:37 +01:00
Thibault Saunier	89e2855964	validate:scenario: Make get_position happen on idle Summary: - Add a way to force action to be executed in their own GSource dispatch, disabling chain action execution API: GstValidateScenario::execute-on-idle property	2015-02-16 17:18:32 +01:00
Thibault Saunier	51593df323	validate:scenario: Add a method to retrieve all remaining actions Not only the next one as it was not making much sense! API: - gst_validate_scenario_get_next_action + gst_validate_scenario_get_actions	2015-02-16 17:18:31 +01:00
Thibault Saunier	16f97e3df6	validate:utils: Fix some annotations	2015-02-16 17:18:31 +01:00
Thibault Saunier	a69af22ca9	validate:scenario: Allow link up of action executions for overriden types Exposing a GstValidateActionType.overriden_type field And properly expose gst_validate_execute_action	2015-02-16 17:18:31 +01:00
Thibault Saunier	19f9172586	validate:reporter: Always print reports in the Gst debug system	2015-02-16 17:18:31 +01:00
Thibault Saunier	6181f7763d	validate: Misc fixes	2015-02-16 17:18:21 +01:00
Thibault Saunier	f4c6ed368e	validate: Properly annotate gst_validate_register_action_type* It does not return any reference to the type	2015-02-14 16:32:12 +01:00
Thibault Saunier	135cb2d2e4	Revert "validate:scenario: Add a way to specify action structure size" This reverts commit b976319ef7f977b8ce910c4b8aa1a843da3b264f. Now that the exact same structure can be used to represent different action types, we can not rely on the structure size to stuff informations into the action. Users should just make use of GstMiniObject.qdata.	2015-02-14 16:32:12 +01:00
Thibault Saunier	a5dab4b378	validate:scenario: We do not own any ref in GstValidateExecuteAction And gst_validate_action_set_done might very well unref the last reference to the action	2015-02-14 16:32:12 +01:00
Thibault Saunier	45f3f3d772	validate: Make sure that the latest action type registration is kept Avoiding to change the behaviour!	2015-02-14 16:32:12 +01:00
Thibault Saunier	e80a7df4d3	validate:scenario: Handle scenario repeat property with sub actions And port change_state_intensive.scenario to it	2015-02-14 16:32:12 +01:00
Thibault Saunier	a5a0722d20	validate:scenario: Add the notion of sub actions Sub action will allow user to executed action right after the previous action has been completed, meaning in the end that both action can be considered as one single action. + Factor out a function to fill an GstValidateAction structure from a GstStructure + Factor out a function to set action playback time	2015-02-14 16:32:12 +01:00
Thibault Saunier	759b087c8c	validate: Document some env variable usage	2015-02-14 16:32:12 +01:00
Thibault Saunier	441513e689	validate: Add an API to cleanly register action type from plugins API: gst_validate_register_action_type_dynamic https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	1194b313af	validate: Rename libfaultinjector to libgstvalidatefaultinjector https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	dae4051ed6	validate: Use plugin name as implementer_namespace when registering action type And document it as a good practice as it will allow us to map plugins and action types https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	cdc6565605	validate: Move the fault_injection plugin to gst/plugins/ https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	5c90a06645	validate: Use an actual GstRegistry to track our plugins Keeping everything internal for now https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	ed43ab1509	validate: Implement fault_injection as a Gs(tValidate)Plugin https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:11 +01:00
Thibault Saunier	a9b27057bb	validate:scenario: Add a way to specify action structure size And return the register GstValidateActionType on registration https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	fbfcf16b20	scenario: Do not concider we are seek_in_paused if executing a new action The new action might change the position on purpose and we should not fail in that case. Also at that point we know the test of position after the seek has been executed + Minor cosmetic fixes https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	be20eb015c	validate:launcher:baseclasses: Avoid raising axception when all getting scenarios https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	00b222f38f	launcher: Use gst-integration-testsuites FDO git repo And make sure that people that were using the old repo get the origin repo properly updated. https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	a85ace1783	validate: launcher: Allow discovering scenario from full path https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	9f5310b1d8	validate: scenario: Add a method to get the following action to be executed API: + gst_validate_scenario_get_next_action https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	8125c46122	validate: Add helper functions ti print actions API: + gst_validate_scenario_get_next_action + gst_validate_reporter_report_simple https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:10 +01:00
Thibault Saunier	16d52a445b	validate: Minor documentation fixes https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	6350bf417e	validate: Set seek_with_stop as needing at least 2secs media files https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	11f923fa52	validate: Fix the check of action that can be not executed The check was wrong and we ended up allowing seek actions to no be executed. API: GST_VALIDATE_ACTION_TYPE_NO_EXECUTION_NOT_FATAL https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	5069e0347c	validate:scenario; Advertise action types that will be executed on addition Adding a flag to the action type And make that code thread safe. https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	c74f33bd17	validate:scenario: Add a Flag fore ActionType that need clocks sync And cleanly use it to set the need-clock-sync field in the scenario properties https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	ef0f78f600	validate: Add the notion of INTERLACED actions An interlaced action is an action that will be executed ASYNC but without that will not block following actions during its execution. The action should be set to done later on at any point during the execution of the scenario. API: + GST_VALIDATE_EXECUTE_ACTION_INTERLACED + GST_VALIDATE_ACTION_TYPE_INTERLACED https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	e7cc086f95	validate: Add a way to retrieve register actoin type from outside API: * GstValidateActionType * gst_validate_get_action_type https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:09 +01:00
Thibault Saunier	eac25a3ad6	validate:launcher: Implement a FakeMediaDescriptor This allows us to more cleanly implement Simple pipeline test generation https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	71d53bb2d3	validate:scenario: Make action->scenario public API It can be usefull for action type implementers https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	8848657ce3	validate:scenario: Add a disable-plugin action type https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	5f888fb5b6	validate: Properly advertise the wait action as ASYNC And add some printing when executing the set-property action https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	da31e3914f	validate: Enhance support for simple pipeline test generation The GstValidatePipelineGenerator was quite limited in term of configuration for user who just want to specify pipelines to run with/without scenario. Enhance the API so that we can properly configure that. https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	bee292f548	validate: Wait for switch-track to complete before executing next action This action type can take some time, we need to make sure that the combiner/input-selector element properly pushed a buffer marked as DISCONT to concider the action is done. https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:08 +01:00
Thibault Saunier	d7b5d57305	validate:scenario: Avoid waiting for 50ms between actions We should be able to execute the next action as soon as the previous one is fully completed, make sure the code tries to do that and does not artificially add some waiting time. And make sure if the gst_validate_action_set_done is called from outside our execution thread, we do not try to execute anything https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:32:07 +01:00
Thibault Saunier	508678cfe1	scenario: Add a signal to notify user when the scenario is DONE executing https://bugzilla.gnome.org/show_bug.cgi?id=743994	2015-02-14 16:31:57 +01:00
Ramiro Polla	d833a51134	validate: launcher: Print test name in Result https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:39 +01:00
Ramiro Polla	c0cefecd23	validate: launcher: Add option to run tests in parallel Patch 4/4 to implement parallel test execution. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:39 +01:00
Ramiro Polla	1f981762c2	validate: launcher: Print test number on result With parallel test execution, it will be hard to track which result relates to which test. Therefore, the test number should be printed along with the results as well. Patch 3/4 to implement parallel test execution. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:39 +01:00
Ramiro Polla	a9a366427e	validate: launcher: Use jobs list to take track of tests running Currently the tests are still run serially. Patch 2/4 to implement parallel test execution. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:38 +01:00
Ramiro Polla	d9097f8bf7	validate: launcher: Use test index instead of counting test numbers Patch 1/4 to implement parallel test execution. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:38 +01:00
Ramiro Polla	9c46f5f889	validate: launcher: Support simultaneous requests in RangeHTTPServer https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:38 +01:00
Ramiro Polla	ef246a497c	validate: launcher: Make TestManager handle waiting for processes Patch 4/4 to make TestManager handle waiting for processes instead of expecting each Test to do it. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:38 +01:00
Ramiro Polla	0026c2804f	validate: launcher: Use a Queue to test for test completion TestManager will use a Queue to track progress for all tests. This commit implements a queue inside Test to simplify the transition. Patch 3/4 to make TestManager handle waiting for processes instead of expecting each Test to do it. https://bugzilla.gnome.org/show_bug.cgi?id=743063	2015-02-05 15:18:38 +01:00
Ramiro Polla	bd4c221141	validate: launcher: Initialize Test start time outside of wait_process wait_process will be moved to TestManager, so the values used to track process update must remain inside Test. Patch 2/4 to make TestManager handle waiting for processes instead of expecting each Test to do it.	2015-02-05 15:18:38 +01:00
Ramiro Polla	498f7002f3	validate: launcher: Split process_update() out of wait_process() Patch 1/4 to make TestManager handle waiting for processes instead of expecting each Test to do it.	2015-02-05 15:18:37 +01:00
Ramiro Polla	d12f55daf4	validate: launcher: Move logfile handling out of Reporter and into Test This makes each Test handle its own logfile, allowing the Reporter to work on multiple tests at the same time. Patch 5/5 to move logfile handling out of Reporter and into Test.	2015-02-05 15:18:37 +01:00
Ramiro Polla	500206d3ad	validate: launcher: Remove redundant check self.out is always available when _get_captured() is called. Patch 4/5 to move logfile handling out of Reporter and into Test.	2015-02-05 15:18:37 +01:00
Ramiro Polla	177eee728f	validate: launcher: Split test log file handling in Reporter Patch 3/5 to move logfile handling out of Reporter and into Test.	2015-02-05 15:18:37 +01:00
Ramiro Polla	b9357e3b17	validate: launcher: Separate Reporter from current Test Instead of saving the current Test in Reporter for every test, use function parameters to achieve the same goal. Patch 2/5 to move logfile handling out of Reporter and into Test.	2015-02-05 15:18:37 +01:00
Ramiro Polla	39a4092434	validate: launcher: Initialize reporter timer before starting all tests Patch 1/5 to move logfile handling out of Reporter and into Test.	2015-02-05 15:18:37 +01:00
Ramiro Polla	bdedd7abb9	validate: launcher: Don't wait for processes longer than necessary	2015-02-05 15:18:36 +01:00
Mathieu Duponchelle	db695185c9	socket interposer: Be even more platform restrictive.	2015-02-03 16:48:49 +01:00
Mathieu Duponchelle	e5976cad43	validate: do not compile for android.	2015-02-03 15:51:34 +01:00
Mathieu Duponchelle	4ce91b98f0	validate: Implement a fault injection library. + And implement a corrupt-socket-recv action + Only compile this on Linux, LD_PRELOAD won't work on Windows. For now the registering of the action is done through a call to socket_interposer_init, this will get better when we refactor the action logic. https://bugzilla.gnome.org/show_bug.cgi?id=743871	2015-02-03 15:30:54 +01:00
Mathieu Duponchelle	89048ad862	validate: tests more issues with caps. https://bugzilla.gnome.org/show_bug.cgi?id=743387	2015-01-26 18:08:47 +01:00
Mathieu Duponchelle	bf2c949aee	validate: Add a test case for caps missing field. + Make the fake decoder have video/x-raw caps. https://bugzilla.gnome.org/show_bug.cgi?id=743387	2015-01-26 18:08:47 +01:00
Mathieu Duponchelle	887349167b	validate: prepare tests for port to tracers backend. https://bugzilla.gnome.org/show_bug.cgi?id=743387	2015-01-26 18:08:47 +01:00
Mathieu Duponchelle	165e35b3f0	bin-monitor: add itself as gobject data.	2015-01-22 22:07:37 +01:00
Ramiro Polla	b29f378296	validate: launcher: Fix test log header output Write log file header before running tests, instead of overwriting the file afterwards. https://bugzilla.gnome.org/show_bug.cgi?id=742966	2015-01-16 16:24:16 +01:00
Ramiro Polla	9c3606a867	validate: launcher: Always create log files Create log files even when stdout redirection is enabled. This commit partially reverts `20c28de`. https://bugzilla.gnome.org/show_bug.cgi?id=742973	2015-01-16 16:24:13 +01:00
Ramiro Polla	4e0388c631	validate: launcher: Introduce new parameter for log file redirecting Allow log file redirection through the new --redirect-logs parameter. Keep the old --logs-dir stdout/stderr parameter, but reset to the default logs directory in that case, and set redirect_logs internally. This also prevents the creation of an stdout/stderr directory for writing xunit.xml. https://bugzilla.gnome.org/show_bug.cgi?id=742973	2015-01-16 16:24:13 +01:00
Thiago Santos	10fe72aa52	pad-monitor: plug caps leak on iterator resync	2015-01-09 14:04:16 -03:00
Thiago Santos	389f6d96b4	pad-monitor: use the same filter caps when querying downstream caps To avoid comparing the real result that has been filtered against a much larger caps that contains all possibilities.	2015-01-09 14:04:13 -03:00
Thibault Saunier	0c48665458	validate: tests: disable g_log handler It messes up our own failures counter And pass test-utils into gst-indent	2014-12-09 10:11:02 +01:00
Thiago Santos	6df63915c2	tests: padmonitor: disable glog handling It messes up our own failures counter	2014-12-08 18:53:55 -03:00
Thiago Santos	7b4df44f61	pad-monitor: get correct caps to check for proxied fields in caps queries Elements should proxy the peer element's caps fields and not what they have currently set on their pads when replying to a caps query	2014-12-08 17:28:47 -03:00
Thiago Santos	af2707d3a3	pad-monitor: Only add pending caps fields for source pads As caps events are downstream, caps set travels from sinks to sources. Adding pending setcaps values to sink pads makes no sense as when a new caps is set on the sink it would compare with values currently set on the source pad, causing a critical failure when renegotiation happens.	2014-12-08 17:28:47 -03:00
Thibault Saunier	1e39db18ad	validate: launcher: Take the timeout as ref timeout to compute hard_timeout when it is provided.	2014-12-08 18:38:46 +01:00
Thibault Saunier	5beaf5dfa8	validate: launcher: Set a hard timeout on GstValidate tests if we know the duration	2014-12-08 16:34:48 +01:00
Thibault Saunier	a2abf628dc	validate: launcher: Force kill subprocess when done with them Making sure that we do not end up having spurious subprocess around	2014-12-08 16:19:20 +01:00
Thiago Santos	d25fb034fa	launcher: baseclass: add missing parameter Fixes "NameError: global name 'options' is not defined"	2014-12-08 08:43:57 -03:00
Thibault Saunier	8450dff17d	validate: launcher: Properly handle non default main dir for the case of the new testsuite files	2014-12-08 10:10:04 +01:00
Thibault Saunier	5bfd579bf4	validate: launcher: Make the gstvalidate application a python module	2014-12-07 18:32:37 +01:00
Thibault Saunier	ce02887627	validate: Remove remaining reference to launcher/apps/validate It has been removed now.	2014-12-06 10:53:37 +01:00
Thibault Saunier	1bc32a888f	validate: Avoid assert removing an already removed signal handler And, make sure that we set the return value != 0 when we receive SIGINT	2014-12-05 20:51:44 +01:00
Thibault Saunier	272032c0b0	validate: Handle setting the HTTP server local path from testsuites	2014-12-05 20:51:44 +01:00
Thibault Saunier	22fba81138	validate: Rename gst-qa-assets to gst-integration-testsuites	2014-12-05 20:51:43 +01:00
Thibault Saunier	130a2892b1	validate: print execution of set_subtitles actions	2014-12-05 19:23:43 +01:00
Thibault Saunier	3dff417fdf	validate: Factor out an LauncherConfig class type to handle configurations Allowing us to more simply define default value and expose an API on top of it	2014-12-05 19:23:43 +01:00
Thibault Saunier	515c8405f0	validate: Remove file specific blacklisted tests	2014-12-05 16:16:53 +01:00
Thibault Saunier	988e9a370e	validate: Let the user know when new tests are added, or tests are REMOVED	2014-12-05 16:16:53 +01:00
Thibault Saunier	d38307a073	validate: Add a cleaner API to setup tests in testsuite files With the testsuite format you will get a setup_tests(tests_manager, options) function called for each TestManager. The function will have the exact same role as with old config file but with a clean API and not magic global variables. This implies that we need default blacklist to be directly set on the TestManager and not on options.blacklisted_test	2014-12-05 16:16:53 +01:00
Thibault Saunier	b852fbcbfb	validate: Add a way to sync all assets, including big ones	2014-12-05 12:17:40 +01:00
Thibault Saunier	71566688bf	validate: Remove the default testsuite implementation The default testsuite implementation should belong to the default asset repo where we have the corresponding knowledge. We should style manage a sensible list of known blacklisted tests, encoding profiles, and generators in GstValidate itself and allow testsuite actual implementations to easily use them though the register_default_* methods. This allow us to be able to remove the ugly execfile() call.	2014-12-05 12:17:40 +01:00
Thibault Saunier	36aed39259	validate: Make sure to at least listen to GStreamer and GLib g_logs If somewhere else someone is overriding the g_log default handler, we would not get notified of anything.	2014-12-05 12:16:55 +01:00
Thibault Saunier	ccbcc04498	validate: Disable coloration of GST_DEBUG logs when we have no-color Do that only when those logs are not saved to a file	2014-12-05 12:16:54 +01:00
Thibault Saunier	582f1cfc06	validate: Factor out a function to print action types parametters + Remove playback-type from the list and just print it	2014-12-05 12:16:54 +01:00
Thiago Santos	db67a92b3f	pad-monitor: do not enforce caps querying rules for converters Some encoders/decoders can also be converters, do not enforce caps proxying rules for them	2014-11-28 17:21:23 -03:00
Vineeth T M	163d286f5b	validate: fix typo in documentation There are some typing mistakes in gst-validate-launcher --help Hence fixing the same. https://bugzilla.gnome.org/show_bug.cgi?id=740833	2014-11-28 11:16:09 +01:00
Thibault Saunier	b5219eaceb	validate: Handle unlimited tests duration Running full length scenario when the user asks	2014-11-25 19:41:01 +01:00
Thibault Saunier	c952886813	validate: Already having a monitor is no error	2014-11-25 19:41:01 +01:00
Thibault Saunier	1753afbe8d	validate: pre commit hook: Do not try to run pep8 on non python files!	2014-11-25 19:41:01 +01:00
Thibault Saunier	62bf27f5e3	validate: Add scub__seeking_full scenarios Which basically do the same thing as scrub__seeking but during throughout the whole duration of the media	2014-11-25 19:41:00 +01:00
Thibault Saunier	b56ebc8a43	validate: Enhance documentation	2014-11-25 19:41:00 +01:00
Thibault Saunier	65eb14de36	validate: Add an option to update all .media_info files	2014-11-25 19:41:00 +01:00
Thibault Saunier	11c49a7db8	validate:scenario: Execute actions without playback time without a valid position If the user did not specify any playback time we should be able to execute actions even if the pipeline can't answer the position query + Make simpler to read the conditions of an action execution	2014-11-25 19:41:00 +01:00
Thibault Saunier	cdfa1ee61b	validate:scenario: Properly handle ASYNC action execution in the API The ->execute function now return a GstValidateExecuteActionReturn which can be set as ASYNC in order to tell the scenario that the action will be executed asynchronously, when the action is done, the caller is responsible for calling gst_validate_action_set_done(); so that the scenario keeps going on. In this commit we make sure that the old API keeps working as GST_VALIDATE_EXECUTE_ACTION_ERROR == FALSE and GST_VALIDATE_EXECUTE_ACTION_OK == TRUE Morevover GstValidateExecuteActionReturn is just a define API: + gst_validate_action_set_done + GstValidateExecuteActionReturn https://bugzilla.gnome.org/show_bug.cgi?id=739854	2014-11-25 19:41:00 +01:00
Thibault Saunier	4cbcb97258	validate: Add a GstValidateActionTypeFlag flag Allowing us to define action types more in detail. Keep backward compatibility, at least with the C API https://bugzilla.gnome.org/show_bug.cgi?id=739854	2014-11-25 19:29:13 +01:00
Thibault Saunier	fcb0f20828	validate: Add a GstValidatePipelineMonitor subclass We had quite a bit of code dedicated to handled GstPipeline monitoring inside GstValidateBinMonitor, cleanly split that code into a new object type https://bugzilla.gnome.org/show_bug.cgi?id=740704	2014-11-25 19:29:13 +01:00
Thibault Saunier	36a2d61068	validate:launcher: Force clock sync for some protocols In HLS for example, not having clock sync might lead to races and failures do not test that for now	2014-11-20 12:09:29 +01:00
Thibault Saunier	057a864223	validate: Don't fail getting master report from a ghostpad without target	2014-11-20 12:09:26 +01:00
Thibault Saunier	6300fb9602	validate: Print current position even if we do not know the rate That could cause gst-validate-launcher to wrongly concider tests as timeout	2014-11-19 20:05:57 +01:00
Thibault Saunier	2be3c04b9b	validate:scenario: Force clock sink for scenarios with a pause action	2014-11-19 17:59:26 +01:00
Thibault Saunier	a15b2544ce	validate: Handle wrong paths when listing avalaible apps User can make mistake or we can have an empty path.	2014-11-19 17:59:26 +01:00
Thibault Saunier	7f8c0c2751	validate: Do not check if first buffer running time is 0 It can perfectly not be 0, so it makes no sense to check that. https://bugzilla.gnome.org/show_bug.cgi?id=739965	2014-11-19 17:59:26 +01:00
Thibault Saunier	5d8f6083b4	validate: Add audiomixer test to the default testsuite	2014-11-16 18:27:32 +01:00
Thibault Saunier	9255a8f876	pad-monitor: Give better details about segment mismatch issues	2014-11-16 18:27:32 +01:00
Thibault Saunier	4a2b9d6431	validate: Be more precise in issue type for wrong seqnum Depending on the type of event where the bug occurs, it is not the same issue type. That allows us to have much precise reports, and better explain the user where the issue stands.	2014-11-16 18:27:32 +01:00
Thibault Saunier	c77089cc62	validate: Fix a few annotation issues	2014-11-16 18:27:32 +01:00
Thibault Saunier	8c6803c467	validate: Add the notion of WAIT_MULTIPLIER for the wait action Allowing the user to decide to wait more, or less, or even not wait for the wait action to execute when running scenarios.	2014-11-16 18:27:32 +01:00
Thibault Saunier	1c2c0e63c2	validate:scenario: Report an EXECUTION_ERROR on action execution failure If the action type handles a better error report type, it should just return TRUE, and report its issue itself.	2014-11-04 17:33:09 +01:00
Thibault Saunier	e2d8096cb7	validate: Do not exit when we can not discover a result file Loggable.error actually exit the process, it is not what we want! + Avoid a backtrace	2014-11-04 17:33:08 +01:00
Edward Hervey	4814110a86	scenario: Allow set-property action to work much earlier By default an action has no playback-time, this makes it actionable immediatly. When no playback-time is set on a set-property action, it will be activated the moment the element is added in the pipeline.	2014-11-04 17:12:00 +01:00
Edward Hervey	6a86f7c1c9	validate-bin-monitor: Initialize local variable Avoids segfaults when freeing them if they didn't get filled in	2014-10-31 16:01:52 +01:00
Mathieu Duponchelle	85587a9aa5	validate: update pre-commit hook. + Allows to run multiple pre-commit hooks. + Always relink the hooks on autogen. + Run pep8 on commited python files. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	7bbd3ed288	apps: gstvalidate.py: fix various pyflakes / uncaught pep8 issues. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	9bdc6e9b6d	validate-launcher: utils: fix various pyflakes / uncaught pep8 issues. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	b30d27e35e	validate-launcher: main: fix various pyflakes / uncaught pep8 issues. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	95065edebd	validate-launcher: loggable: fix various pyflakes / uncaught pep8 issues. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	a0a88e1708	validate-launcher: baseclasses: fix various pyflakes / uncaught pep8 issues. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	8c1e84b5f4	validate-launcher: pep8ify sources. https://bugzilla.gnome.org/show_bug.cgi?id=739208	2014-10-30 15:40:17 +01:00
Mathieu Duponchelle	fa39e0358a	validate-utils: downgrade ERROR to DEBUG. This function is called in places where it is legit for it to return NULL.	2014-10-30 15:39:01 +01:00
Mathieu Duponchelle	4d569b51ed	launcher: add a way to specify an application directory. https://bugzilla.gnome.org/show_bug.cgi?id=739091	2014-10-30 15:31:29 +01:00
Mathieu Duponchelle	74ed40c904	launcher: Don't implement product-specific TestManagers. This manager will be moved in GES. https://bugzilla.gnome.org/show_bug.cgi?id=739091	2014-10-30 15:31:29 +01:00
Mathieu Duponchelle	b0beefacfa	validate-launcher: restructure filesystem https://bugzilla.gnome.org/show_bug.cgi?id=739091	2014-10-30 15:31:29 +01:00
Ramprakash Jelari	eb47b1021f	validate: Fix compiler warning about implicit enum type conversion gst-validate-reporter.c:119:39: error: implicit conversion from enumeration type 'GstValidateReportingDetails' to different enumeration type 'GstValidateInterceptionReturn' [-Werror,-Wenum-conversion] GstValidateInterceptionReturn ret = GST_VALIDATE_SHOW_UNKNOWN; ~~~ ^~~~~~~~~~~~~~~~~~~~~~~~~ gst-validate-reporter.c:124:11: error: implicit conversion from enumeration type 'GstValidateReportingDetails' to different enumeration type 'GstValidateInterceptionReturn' [-Werror,-Wenum-conversion] ret = iface->get_reporting_level (reporter); ~ ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ gst-validate-reporter.c:127:10: error: implicit conversion from enumeration type 'GstValidateInterceptionReturn' to different enumeration type 'GstValidateReportingDetails' [-Werror,-Wenum-conversion] return ret; ~~~~~~ ^~~	2014-10-24 15:19:19 +02:00
Mathieu Duponchelle	6cf2d92b0f	build: We install all headers system wide for now. Will be fixed when the API is deemed stable enough	2014-10-22 14:16:45 +02:00
Mathieu Duponchelle	30aef5ba84	validate: rename GstValidateReportingLevel. Removes the confusion with GstValidateReportLevel. Modeled on GstDebugGraphDetails.	2014-10-21 23:41:04 +02:00
Thibault Saunier	6d0930bb36	validate: Verify that elements always send a segment before pushing EOS EOS is some kind of data flow and thus a segment event should always be pushed before the EOS is sent	2014-10-21 20:40:27 +02:00
Thibault Saunier	23d7df3788	validate: Properly check that the seqnum of the EOS is always properly set In the pipeline, an EOS should always have the same seqnum of the previous SEGMENT event that was received. If the segment is the result of a seek, it should always be the same as the seek seqnum too. + (Mathieu Duponchelle): fix reporting and concatenation tests.	2014-10-21 20:37:23 +02:00
Thibault Saunier	34a9c36edc	validate: Add support for text based override files Allowing user to easily determine the severity of issue types in a config file https://bugzilla.gnome.org/show_bug.cgi?id=737852	2014-10-21 20:23:32 +02:00
Thibault Saunier	b0d39c1c45	validate: Remove unused method gst_media_descriptor_add_frame is not used anywhere https://bugzilla.gnome.org/show_bug.cgi?id=737852	2014-10-21 20:21:58 +02:00
Thibault Saunier	a3513fc952	validate: Move GstStructure file parsing into utils So it can be reused, at least in GstValidate.	2014-10-21 20:21:52 +02:00
Thibault Saunier	8ec61ddac2	validate: report: Simplify the issue ID registering using GQuarks + Remove unused issue types https://bugzilla.gnome.org/show_bug.cgi?id=737790	2014-10-21 20:21:42 +02:00
Thibault Saunier	bb93dbb9fb	validate: Check all buffers when we have the info from MediaDescriptor We now check that each buffer is the expected one for each buffer that come into the decoder. + Fix some minor leaks in test-utils https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:21:36 +02:00
Thibault Saunier	cd9a3640b2	validate:media-descriptor-parser: Add a way to create from a string So it is simple to make use of it from the testsuite https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	f793d06783	report: g_critical are CRITICAL issues! https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	94efe0df85	validate: launcher: Fix printing of errors in final report https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	20633cec19	validate: Add the possibility to generate media infos with frame descs + Fix a little issue when the generation fails. https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	b3fa06c3c1	validate: MediaDescriptors: Add md5sum to buffer informations In the media descriptor files, we now have the md5sum of the actual content of encoded buffers so that we can check that the buffer content is perfectly what is was supposed to be. + Fix the check of whether a frame is a keyframe in the string comparison (g_ascii_strcasecmp return 0 if string matches) https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	50273c42a9	validate: Move some method between GstMediaDescriptorParser and GstMediaDescriptor So that method land where they actually belong. https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	c5dfd9c8c8	validate: Add a way to pass a MediaDescriptor around monitors And add an option in gst-validate so that the user can define what media descriptor file to use. https://bugzilla.gnome.org/show_bug.cgi?id=736138	2014-10-21 20:14:05 +02:00
Thibault Saunier	c8a99218de	validate:media-descriptor: Handle stream with no tags It was segfaulting before.	2014-10-21 20:14:05 +02:00
Thibault Saunier	8fb3e6112c	validate: Add more files to gitignore	2014-10-21 20:14:05 +02:00
Thibault Saunier	8f5347c465	validate: Move some method between GstMediaDescriptorParser and GstMediaDescriptor So that method land where they actually belong.	2014-10-21 20:14:05 +02:00
Mathieu Duponchelle	c542d9c6bc	validate-report / reporter: rework the way we repeat issues. + runner: update reports count algorithm.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	5690a02e0a	pad-monitor: mark the peer pad as EOS too. When a sink pad gets EOS, its src pad monitor should also be marked as EOS (helpful with issue concatenation).	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	0b1d00df25	validate-pad-monitor / runner: Check per-object reporting levels.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	167c29125d	validate-report: Set conditions in which a report can't be master.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	582cebeae6	validate-report: Add a reporting level field and setter.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	030e7e8ba8	validate-runner: implement synthetic report. + Fix criticals logic in validate_runner_printf + Update padmonitor tests + Split validate_report_printf function.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	1993229993	validate-runner: Implement REPORT_NONE for global reporting. Yeah that was tough. Helpful already though, for example: GST_VALIDATE_REPORT_LEVEL=none,x:all gst-validate src name=x ! sink will only report issues reported by the source. + Add test.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	0a1cdb2164	tests: Check monitors correctly determine their reporting level. + [API] gst_validate_reporter_get_reporting_level	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	5cb60060dc	validate-runner / monitor: Let the user single out pads. That's some pretty specific code but it should be helpful. The following syntax can be used : element-name::pad-name. + Free return of gst_object_get_name.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	b21bb1ff34	validate-runner / reporter: Sanitize reports refcounting. The previous code worked but was confusing, the runner didn't actually take the ref it was releasing later. + Fix indentation.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	de554ba417	tests: Test reports refcounts. + Set the element monitor on the element as qdata.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	c943a75766	validate-monitor: Determine the reporting level at setup.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	1d7f15598f	validate-runner: Add code to parse GST_VALIDATE_REPORT_LEVEL. + Extend the tests. + [API] gst_validate_runner_get_default_reporting_level + [API] gst_validate_runner_get_reporting_level_for_name	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	6ed125bfb1	validate-runner: report-level initial work. + Defines reporting levels and document them. + Add API to get the default level. + fix indentation. + fix some typos. + Add the beginning of a reporting test.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	6e08079f8b	validate-pad-monitor: concatenate issues. Fixes https://bugzilla.gnome.org/show_bug.cgi?id=735665 The process is to check for a similar report in intercept_report on the pads of the upstream element, set that report as the master report of the intercepted report, and return REPORTER_KEEP instead of REPORTER_REPORT.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	d747e1cd05	test-utils: add a create_and_monitor element function.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	f001777cc6	validate-reporter: Add some methods + gst_validate_reporter_get_reports + gst_validate_reporter_get_reports_count	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	222a517384	validate-report: Add the notion of master / shadow reports. A master report is a report that has been detected by a monitor to stem from the same issue. It thus contains a list of "shadow reports" which it will browse when printing itself.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	b8ac717297	validate-report: Make the ref / unref functions safer.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	1fcaf8918f	tests/padmonitor: Correcly strdup the result of get_metadata. The const pointer was becoming invalid after the first call to add_metadata, and we ended up setting corrupted data on the second call.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	3e557ca92b	validate-reporter: Add return value to intercept_report. It will allow to drop, keep or report reports.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	6104701268	validate-pad-monitor: Reimplement reporter interface. + Do nothing there for now, except chain up.	2014-10-21 20:13:51 +02:00
Mathieu Duponchelle	fb90aa2ead	validate-reporter: add gst_validate_reporter_get_report. + Add locking.	2014-10-21 20:13:51 +02:00
Thibault Saunier	1cc89414f1	Back to development	2014-10-20 13:38:20 +02:00
Thibault Saunier	ad415424a1	Release 1.4.0	2014-10-20 13:24:29 +02:00
Thibault Saunier	26ef55d622	validate: Print position if it could properly be queried Otherwize we will print meaningless garbage.	2014-10-13 16:30:05 +02:00
Thibault Saunier	4823d998fc	validate:launcher: Minor enhancement in the documentation	2014-10-13 10:32:07 +02:00
Thibault Saunier	99045f7dbb	validate: Rename action type playback_time to playback-time Keeping backward compatiblity with the old naming	2014-10-12 20:19:42 +02:00
Thibault Saunier	02ab99fcbb	validate: Rename gst_validate_add_action_type to gst_validate_register_action_type The _register naming corresponds much better to what the method does and makes it more similar to how we refer to this kind of action in GStreamer. It is a last minute API change, but that API should not change anymore after 1.4 is released.	2014-10-12 20:10:19 +02:00
Thibault Saunier	9158bb36e3	validate: Fix the addition of playback_time in the parameter types	2014-10-12 20:00:03 +02:00
Thibault Saunier	8289f64904	validate: Rename --list-action-types to --inspect-action-type Making clearer the meaning of the parameter and closer to the usual naming in the GStreamer land.	2014-10-12 19:46:39 +02:00
Thibault Saunier	ce87de95ea	validate: Add the 'flags' for the seek action type This was always a mandatory field but was not documented	2014-10-12 19:16:08 +02:00
Anuj Jaiswal	83c0453d81	validate: mishandled pointer criticals Free glist of criticals Signed-off-by: Anuj Jaiswal <anuj.jaiswal@samsung.com> https://bugzilla.gnome.org/show_bug.cgi?id=736313	2014-10-09 20:38:12 -03:00
Thibault Saunier	17bf802515	validate:docs: Add documentation about the default testsuite	2014-10-01 11:02:17 +02:00
Mathieu Duponchelle	8cfffb4a3a	validate-runner: switch to using a GList for the reports. + Return a copy of that list in get_reports. + update tests.	2014-09-30 11:42:42 +02:00
Mathieu Duponchelle	1f1cf83af8	validate-runner: Hide implementation.	2014-09-30 11:42:42 +02:00
Mathieu Duponchelle	855f141453	gst-validate-runner: Add locking for the reports list.	2014-09-30 11:42:42 +02:00
Thibault Saunier	e7315aa78e	Release 1.3.90	2014-09-29 15:37:40 +02:00
Thibault Saunier	b856d5985c	validate:launcher: Factorize code to get a MediaDescriptor name for classname Instead of copy/pasting that code badly	2014-09-12 11:26:48 +02:00
Edward Hervey	490a8f1ed9	validate/docs: Add location of Scenario/Action defines	2014-09-12 10:22:15 +02:00
Anuj Jaiswal	c98f7e7b38	validate: (performance issue)refactor to remove duplicate assignment Signed-off-by: Anuj Jaiswal <anuj.jaiswal@samsung.com> https://bugzilla.gnome.org/show_bug.cgi?id=736412	2014-09-12 09:57:05 +02:00
Thibault Saunier	1649b49f1c	validate: docs: Always dist the launcher directoty Fixing make distcheck	2014-09-12 09:57:05 +02:00
Thibault Saunier	332a51d1f0	validate: Get the Runner reports in order of arrival Making sure they are printed in the right order	2014-09-12 09:57:05 +02:00
Thibault Saunier	7e85c9b0b5	validate: Start a testsuite Currently implemented tests are: * Settup and cleanup on monitor is done properly * Some tests in the PadMonitor are done properly, namely: - Buffer before segment - Buffer outside segment - First buffer running time is always 0 - The Demuxer flow aggregation is properly checked https://bugzilla.gnome.org/show_bug.cgi?id=736379	2014-09-12 09:57:05 +02:00
Edward Hervey	80de4392ce	validate/private: Avoid double typdef Instead just include required (public and local) header gst-validate-scenario.h:43:44: error: redefinition of typedef 'GstValidateActionParameter' is a C11 feature [-Werror,-Wtypedef-redefinition]	2014-09-12 09:49:35 +02:00
Thibault Saunier	07391578c9	validate: Make sphinx documentation generation optionnal	2014-09-06 12:37:30 +02:00
Thibault Saunier	3ff59368f0	validate:launcher: Add needed files to build documentation with sphinx	2014-09-06 12:22:48 +02:00
Thibault Saunier	b843ead1f8	validate: launcher: Cleanup and rename apps to avoid '-' in their name	2014-09-06 11:38:38 +02:00
Thibault Saunier	7838f3ebae	validate:launcher: Avoid '.' before media file extension in test classnames	2014-09-06 10:02:13 +02:00
Felix Schwarz	1a8b460d23	validate:docs: fix spelling mistakes https://bugzilla.gnome.org/show_bug.cgi?id=736160	2014-09-05 23:21:21 +02:00
Thibault Saunier	3755581fd3	validate: Take a const gchar ** in gst_validate_print_action_types This is what we actually need and thus is cleaner.	2014-09-05 23:15:29 +02:00
Thibault Saunier	69165a9f04	validate: Implement the notion of implementer namespace to the action types This allows users to know who implements an action type. + Enhance the printing of all action making it readable.	2014-09-05 23:03:58 +02:00
Thibault Saunier	15f52d4fa3	validate: Add informations on the switch-track action overrided for playbin	2014-09-05 19:30:52 +02:00
Thibault Saunier	34fd5af840	validate: docs: Add some GstValidate usage documentation + Fix minor issues in the gst-validate and gst-validate-transcoding tools documentation	2014-09-05 19:00:23 +02:00
Guillaume Desmottes	f7955f5249	validate: remove redundant pre-condition in monitor_factory_create The same check is already done at the head of the function. https://bugzilla.gnome.org/show_bug.cgi?id=736019	2014-09-05 19:00:23 +02:00
Guillaume Desmottes	f900f53e95	validate: fix a couple of typos in comments https://bugzilla.gnome.org/show_bug.cgi?id=736019	2014-09-05 19:00:23 +02:00
Thibault Saunier	ef64eb0d0e	validate:docs: Sensibly update the usage file	2014-09-05 19:00:23 +02:00
Thibault Saunier	7cfdb5372c	validate: Use a GList to store action types instead of hashtable It is more adapted and allows us to print the action types in a stable maneer.	2014-09-05 19:00:23 +02:00
Thibault Saunier	eb6739c91b	validate: report: Do not repeat type name when printing its details	2014-09-05 19:00:23 +02:00
Thibault Saunier	b4ddea0fd2	validate: Change the version to 1.0.0.1 The 1.0.0.1 means that it is targetting the GStreamer 1.X serie, and is a git version (thus 0.1) GstValidate will most probably not be released and we should try to be able to use it with as many version of the GStreamer 1.X serie as possible.	2014-09-05 19:00:23 +02:00
Thibault Saunier	e5b485d776	validate: Document the API with gtk-doc	2014-09-05 19:00:23 +02:00
Thibault Saunier	45ffbdec07	validate: Add GObject Introspection support	2014-09-05 19:00:23 +02:00
Thibault Saunier	4fd1939b21	validate: Rework the action parameter API Making it possible to properly define parameters, and describe them. + Document all action types!	2014-09-05 19:00:23 +02:00
Thibault Saunier	d29a8e4a77	validate: Add an option to print all avalaible actions with details + Cleanup actions descriptions + Make GstValidateActionType internal only and only expose the structure	2014-09-05 19:00:23 +02:00
Thibault Saunier	45e6d86c92	validate: Use the buffering mode to see if pipeline is live or not	2014-09-05 19:00:23 +02:00
Thibault Saunier	0ad475063d	validate: Do not segfault when receiving a segment on unlink pad For some reason we did no discover that before.	2014-09-05 19:00:23 +02:00
Thibault Saunier	8eeaa1a95f	validate: Make GstValidateActionType a GstMiniObject and expose it in the API	2014-09-05 19:00:23 +02:00
Thibault Saunier	bdc09d2d4a	validate:scenario: Cleanup header and add some padding to classes Let's start making gst-validate ABI and API stable	2014-09-05 19:00:23 +02:00
Anuj Jaiswal	eb16061fa9	gst-validate: fix some minor memory leaks https://bugzilla.gnome.org/show_bug.cgi?id=735099	2014-08-23 11:57:12 +01:00
Mathieu Duponchelle	99204c0018	validate: generate test names with the stream_info filename. And not with the contained uri string, which is variable.	2014-08-19 18:47:18 +02:00
Thibault Saunier	3979c49cd2	validate: The scenario only old a weak ref so unref the weak ref We were unrefing an object we did not actually own a ref on.	2014-08-12 15:14:28 +02:00
Thibault Saunier	161610c26e	validate: Print when we set pipeline state because of buffering	2014-08-12 13:17:20 +02:00
Thibault Saunier	f4db183b2b	validate:launcher: Properly handle libsdir when gst-validate is installed + Fix the _in_devel function + Install the validate default testsuite implementation in the right place	2014-08-12 13:16:43 +02:00
Thibault Saunier	f6c62d071c	validate:launcher: Let testsuite know the actual file in which they are	2014-08-12 13:16:43 +02:00
Thibault Saunier	bf30bf4fd7	validate:launcher: Add the logic of needed env variables in tests	2014-08-12 13:16:43 +02:00
Thibault Saunier	e81c0093fc	validate:launcher: Expose all classes to be used to create testsuites To create testsuite from outside gst-validate, the user will need to be able to use the TestGenerator and subclasses of Test that we implement in the apps, to do so we publicly expose them in the TestManager class so that user have acces to everything they need.	2014-08-12 13:16:43 +02:00
Thibault Saunier	20c28def3c	validate:launcher: Handle stdout/stderr as possible logfiles Allowing people to get all the logs in the terminal	2014-08-12 13:16:43 +02:00
Thibault Saunier	32dac5014a	validate: Allow several outputs in GST_VALIDATE_FILE	2014-08-12 13:16:43 +02:00
Thibault Saunier	8e1997d820	validate: Launcher: Add support for the dash protocol And make sure that the HTTP server is started if it is needed to serve some HLS or DASH streams	2014-08-12 13:16:43 +02:00
Thibault Saunier	631db75718	validate:Launcher: Use the first media path as a path for http server We need to have a default path and the first one sounds like a reasonnable default.	2014-08-12 13:16:43 +02:00
Thibault Saunier	2da2c6cc56	validate:launcher: Allow limitating local HTTP server bandwith By default we limit its bandwith to 1MBps which is somehow similare to a good internet connection case.	2014-08-12 13:16:43 +02:00
Thibault Saunier	702992cf7a	validate:launcher: Disable racy HLS tests + Add need-clock-synk to switch_audio_track_while_paused as it relies on the clock sync to pause and then display subtitles	2014-08-06 09:08:36 +02:00
Thibault Saunier	bab8a4c3bb	validate:launcher: Take into account exitcode in transcoding tests And disable a few racy tests that were not detected because of that	2014-08-05 11:33:08 +02:00
Thibault Saunier	7875b9a3d9	validate:launcher:testsuite: De activate backward playback where appropriate And re activate it where it works	2014-08-04 13:03:54 +02:00
Thibault Saunier	f42f0724e5	validate: Actually accept rounding errors and small mistakes for position WHen seeking in paused the position right after should be pretty much the exact one, but sometimes it can be a little different because of rounding issues and similare.	2014-08-04 13:03:19 +02:00
Thibault Saunier	8518e08dbb	validate: Add a way to avoid printing all the issue in reports Avoiding user to be flooded by information he does not want while debugging	2014-08-04 13:02:46 +02:00
Thibault Saunier	d682bd29a9	validate: Print the report when aborting because of an issue Letting a chance to the user to know what bug he faced!	2014-08-04 13:02:46 +02:00
Thibault Saunier	5c50219fae	validate: Enhance output about critical errors +Lower some warning to INFO	2014-08-04 13:02:46 +02:00
Thibault Saunier	6da09fb919	validate: Allow overrides for scenario issues	2014-08-04 13:02:46 +02:00
Thibault Saunier	1bd6b2767f	validate: Avoid readding several time the same test in the tests result list	2014-08-04 13:02:46 +02:00
Thibault Saunier	b9712e336e	validate:launcher: Fix test number print	2014-08-04 13:02:46 +02:00
Thibault Saunier	0dd8e9cd3d	tools: Launcher: Disable validate.file.*.simple.scrub_forward_seeking.synchronized It is still a bit racy and sometimes the seek just does not happen	2014-07-31 17:56:13 +02:00
Thibault Saunier	7057a9fd50	tools: launcher: Disable subtitle track switching scenario on Sintel It is racy at the moment.	2014-07-31 17:43:51 +02:00
Thibault Saunier	1aa0d4eb4a	validate:launcher: Allow informing minimum media duration in scenarios Allowing the launcher to avoid running tests on medias that are not long enough	2014-07-23 20:43:57 +02:00
Thibault Saunier	24fe345f73	validate:launcher: Always print final report + enhance output	2014-07-23 17:49:44 +02:00
Thibault Saunier	35b6bfb7c8	validate:scenario: Properly check that remaining actions are not 'ending' ones When checking that all action were executed, we need to make sure that actions such as EOS or stop are not taken into account as we might have shorter medias than the duration of the scenario, and that should not be fatal. + Plug a leak on the way	2014-07-23 17:49:44 +02:00
Thibault Saunier	386b572066	validate: launcher: Force clock syncronization for some scenarios In some cases it is necessary that the clock is sync so that all the actions can be executed.	2014-07-23 17:49:44 +02:00
Thibault Saunier	40003689df	validate: Launcher: Make sure tests are always executed in same order	2014-07-23 13:48:44 +02:00
Thiago Santos	3cf3e7a438	gst-validate-scenario: add emit-signal emit-signal action allows to emit signals to elements in scenarios. The implementation only accepts signals without arguments for now but it can be extended to use parameters if needed in the future	2014-07-22 11:59:58 -03:00
Thibault Saunier	1cdbba4327	validate: Launcher: Fix a backtrace using self in a @staticmethod	2014-07-22 15:50:47 +02:00
Thiago Santos	fd7c13d446	gst-validate-scenario: the structure has the type Get the GValue directly from the structure and do not assume everything is stored as a string and use the GstStructure's GValue to set the property to the instances	2014-07-21 22:41:28 -03:00
Thiago Santos	d7c3d652d0	gst-validate: properly set pipeline to null before unref In case it fails when going ready->paused it will remain in ready state and be unref'd in ready, leading to an assertion	2014-07-21 22:01:27 -03:00
Arnaud Vrac	e1b3ec2ad7	validate: Fix build on some custom platforms We need to explicitely pass GLIB_LIBS for GModule as it seems not to be included by GST_ALL_LIBS and we need LIBM	2014-07-21 19:09:58 +02:00
Lubosz Sarnecki	24046a6168	httpserver: launch webserver with the same python interpreter.	2014-07-21 18:01:25 +02:00
Thibault Saunier	7d695fbed4	validate: Dot the pipeline on interuption	2014-07-19 09:48:17 +02:00
Aurélien Zanelli	d1c261f5b1	validate: duplicate strings in gst_validate_issue_new() Do this to avoid discarding 'const' qualifier when using it with constant strings. Moreover it will avoid a g_free on constant string. https://bugzilla.gnome.org/show_bug.cgi?id=733362	2014-07-18 16:28:58 +02:00
Thibault Saunier	cf540d002b	validate:launcher: Fix a backtrace using an undefined method	2014-07-18 16:28:49 +02:00
Thibault Saunier	3cfa480eba	valdate:launcher: Do not refer to self in @staticmethod There is no self in there.	2014-07-17 17:04:59 +02:00
Thibault Saunier	d7d1445e67	validate: Add a set-debug-threshold scenario action Allowing users to activate the debug only at the interesting time	2014-07-17 17:04:59 +02:00
Thibault Saunier	cd55381a5f	validate: Add Gst debugging when using gst-validate printing feature Giving usefull debugging informations in the GSt debug logs	2014-07-17 17:04:59 +02:00
Thibault Saunier	f6884a5a54	validate: Do not auto flush pipeline bus We want to see all messages in our async handler And flush it when we are done.	2014-07-17 12:17:31 +02:00
Thibault Saunier	fcb8a77e17	validate:launcher: Avoid using sync=true on fakesinks Making the test run much faster!	2014-07-16 19:38:01 +02:00
Thibault Saunier	b075646451	validate: Launcher: Print total time spent in the final report	2014-07-16 19:37:35 +02:00
Thibault Saunier	71ae6d3816	validate: Make switch_subtitle_track_while_paused handle states	2014-07-16 18:21:16 +02:00
Thibault Saunier	e07e7cd43e	vaildate: Make disable_subtitle_track_while_paused handle states	2014-07-16 15:47:59 +02:00
Thibault Saunier	ded4bec35a	validate: Make scrub_forward_seeking handle states	2014-07-16 15:47:59 +02:00
Thibault Saunier	f5454f07f0	validate:launcher: Properly check that encoded files have the exact wanted format	2014-07-16 15:47:58 +02:00
Thibault Saunier	fe9ed41d6c	validate:launcher: Add a method to create a GstValidateMediaDescriptor from a uri	2014-07-16 15:47:58 +02:00
Thibault Saunier	265688fcd6	validate:launcher: Move MediaFormatCombination to baseclasses.py + Add some simple helpers	2014-07-16 15:47:58 +02:00
Thibault Saunier	f1163d61ba	validate:launcher: Implement a GstValidateEncodingTestInterface class Allowing code to be shared between apps that run rendering tests	2014-07-16 15:47:58 +02:00
Thibault Saunier	a735b9eb99	validate:launcher: Implement a MediaDescriptor subclass for xges project files	2014-07-16 15:47:58 +02:00
Thibault Saunier	d61c0d6166	validate:launcher: Make a MediaDescriptor baseclass to be used by any application	2014-07-16 15:47:58 +02:00
Thibault Saunier	89aa70545a	validate:launcher: Give information to users when cloning asset failed It might not be obvious from the stacktrace so it is better to clearly explain what the failure was when we know it	2014-07-16 15:47:58 +02:00
Thibault Saunier	6beb346aa3	validate:launcher: Fixup the default asset update command	2014-07-16 15:47:58 +02:00
Thibault Saunier	9a69c21acc	validate:launcher: Generate proper EncodingProfiles for audio/video only media files	2014-07-16 15:47:58 +02:00
Thibault Saunier	87cc7da213	validate:launcher: Move the MediaDescriptor class to the baseclasses.py file	2014-07-16 15:47:58 +02:00
Thibault Saunier	58256ab135	validate:launcher: Allow transcoding audio only files 5 time longer than long_limit Transcoding audio is a lot shorter so we can concider that transcoding files that are only only is 5 time shorter than the actual file (empirical number)	2014-07-16 15:47:58 +02:00
Thibault Saunier	f925c0c1be	validate:media-check: Pass the GError where needed.	2014-07-16 15:47:58 +02:00
Thibault Saunier	822c7eaa6e	validate: Avoid segfault in the error path	2014-07-16 15:47:58 +02:00
Thibault Saunier	f8a37a1c80	validate:media-descriptor-writer: Handle medias with 1 single stream	2014-07-16 15:47:58 +02:00
Thibault Saunier	fa35a10779	validate: Check that after a seek in PAUSED position is perfect In case of ACCURATE seeking, the position after a SEEK in PAUSED state should be exactly the one requested by the user.	2014-07-16 15:47:58 +02:00
Thiago Santos	db21883c0c	scenario: add set_property scenario action Allows setting element's properties during a scenario. Very useful for testing that elements behave correctly when changing properties during playing state https://bugzilla.gnome.org/show_bug.cgi?id=733070	2014-07-11 19:43:20 -03:00
Thibault Saunier	bed0f51d6c	validate: Execute actions if we get seeked in ready state	2014-07-07 11:27:35 +02:00
Thibault Saunier	87ae465c77	validate: Let scenarios tell the apps about whether it handles states The user only needs to add handles-states=true in the description line of the scenario	2014-07-07 11:27:34 +02:00
Thibault Saunier	52e39a4fcb	validate:scenario: Do not care about the position if we are not at least in PAUSED state At that time the position query will be meaningless so we should just go to the next action.	2014-07-07 11:27:34 +02:00
Thibault Saunier	4227655db1	validate: Handle MXF files	2014-07-07 11:27:34 +02:00
Thibault Saunier	1c2d31dd2f	validate:media-check: Changes in tags detection are not fatal issues	2014-07-07 11:27:34 +02:00
Thibault Saunier	7d23d75edb	validate:launcher Add video mixing tests + Move default_testsuite.py to validate_testsuite.py as we are now exposing tests that are not enabled by default	2014-07-07 11:27:34 +02:00
Thibault Saunier	af383ad0c0	validate:launcher: Move the notion of test generator to the baseclasses This can be very usefull for all the TestManager and thus exposes a higher level API for test writers.	2014-07-07 11:27:34 +02:00
Thibault Saunier	aeec108c88	validate:launcher: Move default testsuite to a dedicated file Making the separation cleaner between the launcher and the test implementation	2014-07-07 11:27:34 +02:00
Thibault Saunier	00719fb07e	validate: Properly handle CLOCK_TIME_NONE position and duration values In the value parser.	2014-07-07 11:27:34 +02:00
Thibault Saunier	3607fd8deb	validate: Print the return value at the end Making it easier to know whether the test passed or not.	2014-07-07 11:27:34 +02:00
Thibault Saunier	f708156ff6	validate:scenario: Move the check about whether we are still seeking upper in the function Avoiding to try to get position and do operations on a pipeline that is seeking	2014-07-07 11:27:34 +02:00
Vincent Penquerc'h	4dc3f5171e	validate-scenario: only use valid position/duration Position/duration query may fail, or yield unknown values (eg, unknown duration for live streams). In these cases, we must ensure we do not use those invalid values. https://bugzilla.gnome.org/show_bug.cgi?id=715160	2014-07-07 11:27:34 +02:00
Thibault Saunier	71cd2a8ce7	validate:launcher: Not concider all scenarios by default with --wanted-test Instead let the users activate that with -t ALL	2014-07-07 11:27:34 +02:00
Thibault Saunier	5266fee48c	validate:launcher: Let the user set user options in the config file	2014-07-07 11:27:34 +02:00
Thibault Saunier	b9389c85c2	validate:launcher: Use RawTextHelpFormatter to (not) format user help	2014-07-07 11:27:34 +02:00
Thibault Saunier	f10ff2b610	validate:launcher: Add a way to create test suite outside the three + Make sure to namespace the API + Remove cruft about G_V_PROTOCOL_VIDEO_RESTRICTION_CAPS	2014-07-07 11:27:34 +02:00
Thibault Saunier	150c5bc6b2	validate:scenario: We are not changing state if the set_state failed.	2014-07-07 11:27:34 +02:00
Thibault Saunier	b3a168ed73	validate:scenario: Add a debug category and add some debug	2014-07-07 11:27:34 +02:00
Thibault Saunier	a4d3971709	validate: media-descirptor: Add more infos about discoverer error	2014-07-07 11:27:34 +02:00
Thibault Saunier	5983df47c5	validate:launcher: Cleanup the way we generate tests adding the notion of TestGenerator Making it easier to extend the testsuite.	2014-07-07 11:27:34 +02:00
Thibault Saunier	5c85e4500d	validate:tools: Dot the pipeline on usefull places Meaning on warning and state changes.	2014-07-07 11:27:34 +02:00
Sebastian Dröge	b6c439ee88	validate: Don't call gst_debug_log_valist() if debugging is disabled And also stop leaking a string every time.	2014-06-28 12:33:45 +02:00
Sebastian Dröge	3ecd8352eb	gst-validate: Add $(GIO_LIBS) and $(GIO_CFLAGS) as required	2014-06-28 11:36:27 +02:00
Thibault Saunier	bbe56a4fd9	validate: Fix launcher when running installed	2014-06-17 15:10:41 +02:00
Thibault Saunier	c7c879fc1c	validate: scenarios: Install play_15s.scenario	2014-06-17 14:17:21 +02:00
Thibault Saunier	4f01b2bd8a	validate:launcher:reporter: Sort Final report by results	2014-06-16 16:47:18 +02:00
Thibault Saunier	b8e1c3e64c	validate:launcher:ges: Fix rendered duration checking	2014-06-16 16:46:21 +02:00
Thibault Saunier	e847d7061a	validate: pad-monitor: Do not compare not fixed sinkpad caps fields We are only able to check that the sink pad caps values are inside the src pad value.	2014-06-16 16:43:02 +02:00
Thibault Saunier	93d9032712	scenario: Do not be so tolerant about seek drift	2014-06-16 08:56:30 +02:00
Edward Hervey	0693805e9c	pad-monitor: Handle out-of-segment first buffer If the initial buffer is before segment.start, we don't want to raise the "first buffer doesn't have 0 running-time" issue. Also add debug for tracking issues	2014-06-03 10:05:25 +02:00
Edward Hervey	ca44a11429	validate: Run gst-indent on all code so whitespace. much indent. spacing !	2014-06-03 10:05:25 +02:00
Thibault Saunier	90f5dae534	validate: Depend at least on GLib 2.36	2014-05-27 12:33:08 +02:00
Thibault Saunier	0bde7bcacb	validate: Add a scrub_backward_seeking scenario + Make use of it in ges-launch and do not try to seek while playing in GES as it is not supported yet	2014-05-27 12:33:08 +02:00
Nicolas Dufresne	fea3893686	validate: Don't pass NULL to g_strsplit	2014-05-24 01:28:36 -04:00
Edward Hervey	ebde58f1d1	validate-utils: Fix unitialized variable gst-validate-utils.c:413:7: error: variable 'v0' is used uninitialized whenever 'if' condition is true [-Werror,-Wsometimes-uninitialized] if (c == '!') { ^~~~~~~~ gst-validate-utils.c:424:10: note: uninitialized use occurs here return v0; ^~ gst-validate-utils.c:413:3: note: remove the 'if' if its condition is always false if (c == '!') { ^~~~~~~~~~~~~~~ gst-validate-utils.c:411:13: note: initialize the variable 'v0' to silence this warning gdouble v0; ^ = 0.0 1	2014-05-22 16:13:31 +02:00
Thibault Saunier	1a2f4a3cd3	validate: Move overrides and preload libraries to dedicated folders This way it is cleaner and it is simpler to handle the various compilation dependencies.	2014-05-21 12:00:26 +02:00
Lubosz Sarnecki	1043aa3f55	python: change shebangs to python2	2014-05-19 10:21:07 +02:00
Thibault Saunier	9660a8bd3a	validate: Properly use boolean in XML	2014-05-15 09:46:24 +02:00
Thibault Saunier	92d390bc5d	validate: Improve perf when writing the XML file + Pass the file into gst-indent	2014-05-08 17:48:39 +02:00
Thibault Saunier	dae0c4ef81	validate: Add a scenario that switches state many intensively + Use it by default in the launcher tests	2014-05-07 16:45:27 +02:00
Thibault Saunier	384686a7f7	validate: Minor fix for blacklisted test output formatting	2014-05-07 12:44:51 +02:00
Thibault Saunier	0b4bd7940a	validate:launcher: Add an option to only launch the http server	2014-05-07 12:44:51 +02:00
Thibault Saunier	8a295da795	validate: Keep scenario discovering logs in a file	2014-05-07 12:44:51 +02:00
Thibault Saunier	7590148e20	validate: Avoid using stop value in the fast_forward scenario	2014-05-07 12:44:39 +02:00
Thibault Saunier	720b9eff47	validate: Properly check that outputed videos have a correct duration	2014-05-07 11:30:39 +02:00
Thibault Saunier	cdb8822ae3	validate: Add the notion of "long" tests so that we can avoid some test to be run if they are too long	2014-05-07 11:30:09 +02:00
Thibault Saunier	ac6e463009	scenario: Add a general action to set state	2014-05-07 09:51:19 +02:00
Thibault Saunier	08898ff219	validate: Properly set the pre commit hook	2014-05-07 09:50:28 +02:00
Thibault Saunier	7d55065277	validate:scenario: Pass into gst-indent	2014-05-07 09:46:28 +02:00
Thibault Saunier	cd8000994b	validate: The wait mandatory field is duration	2014-05-07 09:15:34 +02:00
Thibault Saunier	0aff591b2f	validate: Make sure mandatory fields are present when parsing scenarios	2014-05-07 09:11:12 +02:00
Mathieu Duponchelle	7d4abf31e7	scenarios: add a stateless property. This property enables the user to have actions executed independently of the state of the pipeline. Conflicts: validate/gst/validate/gst-validate-scenario.c	2014-05-06 15:37:26 +02:00
Mathieu Duponchelle	1332e9fc4f	scenario: make sure to not execute actions when changing state. Conflicts: validate/gst/validate/gst-validate-scenario.c	2014-05-05 17:21:06 +02:00
Thibault Saunier	49ab41743b	validate: The 'buffering' variable needs to be static We need its value between bus_callback calls to be the same	2014-05-04 09:30:16 +02:00
Luis de Bethencourt	eabcf8f106	gst-validate: some static variables can be local buffering is only used inside the bus_callback, so it can have that local scope. same thing with ret which is only used in the main function.	2014-05-02 17:25:07 -04:00
Luis de Bethencourt	0b01b578ce	gst-validate: small typo in usage summary	2014-05-02 16:53:51 -04:00
Thibault Saunier	aceba228ce	validate: Wait for the PAUSED state to be reached before executing actions	2014-05-02 20:05:28 +02:00
Thibault Saunier	bb42d287e7	validate: Fix the name of the sintel blacklisting	2014-05-02 19:00:49 +02:00
Thibault Saunier	15cceffcf1	validate: Add a scenario to disable subtitle track while paused	2014-05-02 18:50:41 +02:00
Thibault Saunier	fbcee57902	validate: Implement frame by frame writing in the media descriptor writer + Add an option to fully parse media files in the gst-validate-media-check tool	2014-05-02 18:30:23 +02:00
Thibault Saunier	ba38d09961	validate: Execute position right when the pipeline reaches PAUSED We might go to PAUSED SYNC if nothing happens in the pipeline	2014-05-02 18:30:23 +02:00
Thibault Saunier	5d200f8819	validate: Add a scenario that disable subtitles + Clean the sythax to define switch-track action that actually desactivate the track	2014-05-02 18:30:23 +02:00
Thibault Saunier	efb40d9778	validate: Do not execute action when buffering While buffering we should no try to execute anything as we would not be controlling properly the execution. + Activate scrub forward seeking for HTTP streams	2014-05-02 18:30:23 +02:00
Thibault Saunier	867bfec188	validate: Add a scenario that switches subtitle track while paused + Integrate it in the launcher	2014-05-02 18:30:23 +02:00
Thibault Saunier	872472feb3	validate:launcher: Sensibly simplify scenario handling	2014-05-02 18:30:23 +02:00
Thibault Saunier	b37fafa1e6	validate: Plug a minor leak	2014-05-02 18:30:23 +02:00
Thibault Saunier	9c5009c724	validate: Use ges-launch recursing path new feature And fix path to URI conversion	2014-05-02 18:30:23 +02:00
Thibault Saunier	2077e76aa2	validate: Add a gst-validate-launcher documentation	2014-05-02 18:30:23 +02:00
Thibault Saunier	447b299dab	validate:launcher: Port OptionParser to ArgParse	2014-05-02 18:30:23 +02:00
Thibault Saunier	5e2b577372	validate: Can not do reverse playback on sintel sample + Minor improvement in the CLI	2014-05-02 18:30:23 +02:00
Thibault Saunier	97482e2512	validate:launcher: Do not except meaningless argument in ges-launch	2014-05-02 18:30:23 +02:00
Thibault Saunier	804cdb5ad2	validate: Handle per file special scenarios When a file is int the same folder as a media file and has a name like: mediafilename.mkv.scenarios_name.scenario we run that scenario on that particular file	2014-05-02 18:30:23 +02:00
Thibault Saunier	1ffb6b4e1c	validate: Allow specifying scenarios to parse when lisiting them It used to only handle the scenario present in proper paths, we also need to handle special scenarios provided by users on the fly	2014-05-02 18:30:22 +02:00
Thibault Saunier	f165fb41d0	validate: Handle ERROR on the bus when monitoring the pipeline This way the user get a clear information in the report about the issue + sensibly cleanup code	2014-05-02 18:30:22 +02:00
Thibault Saunier	da42500df7	validate: Add a scenarios that switchs subtitle track + Make it easier and cleaner to tell that a switch is actually disabling a track type. And run the scenario in gst-validate-launcher by default	2014-05-02 18:30:22 +02:00
Thibault Saunier	3281add6b5	validate: Add a switch_audio_track_while_paused scenario And run it as a default	2014-05-02 18:30:22 +02:00
Thibault Saunier	a62560bc81	validate: Add an action to set an external URI file on playbin at runtime	2014-05-02 18:30:22 +02:00
Thibault Saunier	2a9e0824b2	validate: Override switch_track action when using a playbin And use the playbin feature for that when the pipeline is based on playbin	2014-05-02 18:30:22 +02:00
Thibault Saunier	3a1db22188	validate: Do not g_strrstr with a NULL pointer as needle	2014-05-02 18:30:22 +02:00
Thibault Saunier	3402d5556a	validate: Print more details when executing the switch_track action + Fix some issue in the memory freeing codepath of GstValidateAction	2014-05-02 18:30:22 +02:00
Thibault Saunier	93bd46dbc2	validate: Do not try to use a NULL iter	2014-05-02 18:30:22 +02:00
Thiago Santos	385d6d4ccd	pad-monitor: check that no buffers are pushed after a pad is EOS Make sure no resources are wasted after elements are done with the current segment	2014-05-02 12:07:53 -03:00
Thibault Saunier	28bd6ee17a	launcher: Now using git annex to handle media files	2014-04-28 13:08:17 +02:00
Thibault Saunier	676602644c	validate: Expose a seeking method so other actions types can seek Other action types might need to seek and we GstValidateScenario need to know about it, add a method others can use to do the seeking	2014-04-26 09:52:37 +02:00
Thibault Saunier	a3a132489a	Revert "validate:launcher: Always put gst-validate result as stderr in reports" This reverts commit `925ff7542b`. Actually jenkins never truncates on failure stacktrace... we do not want to set gst-validate as failure stacktrace in our results. That commit was not usefull.	2014-04-26 09:16:26 +02:00
Thibault Saunier	925ff7542b	validate:launcher: Always put gst-validate result as stderr in reports This way jenkins will always keep the information in its database even if the test passes	2014-04-26 08:11:20 +02:00
Thibault Saunier	4f920dc405	validate: Pass -scenario.c into gst-indent and fix some docs	2014-04-25 18:33:33 +02:00
Thibault Saunier	0c4216d005	validate: Add a "dot-pipeline" action	2014-04-25 18:27:30 +02:00
Thibault Saunier	eb4a70a263	validate: Return a boolean when parsing an enum string	2014-04-25 18:26:50 +02:00
Thibault Saunier	8852633dfc	validate:scenarios: Prefer stop action instead of EOS when appropriate	2014-04-25 14:51:28 +02:00
Thibault Saunier	bd936dae4c	validate:launcher: Properly set error message when sending EOS did not work	2014-04-25 14:51:28 +02:00
Thibault Saunier	da6dc3882b	validate:launcher: Add a way to specify tests filtering only on defaults	2014-04-25 14:51:28 +02:00
Thibault Saunier	be72ec5f6a	validate:launcher: Add support for audio track switching scenario	2014-04-25 14:51:28 +02:00
Thibault Saunier	8b4542540c	validate:launcher: Make it possible to run any scenario test in gst-validate	2014-04-25 14:33:06 +02:00
Thibault Saunier	8035094128	validate:launcher: Do not run reverse playback on mpegts files	2014-04-25 14:33:06 +02:00
Thibault Saunier	fba15f71c6	validate:launcher: Cleanup media descriptor usage	2014-04-25 14:33:06 +02:00
Thibault Saunier	81b0c74bfa	validate:launch: Port to the new media_info format	2014-04-25 14:33:06 +02:00
Thibault Saunier	d280d0dbc9	validate: Add a media-descriptor parser and writer	2014-04-25 14:33:06 +02:00
Thibault Saunier	f6c6043317	validate: Minor printing cleanup	2014-04-25 14:33:06 +02:00
Thibault Saunier	2d7d03d2f7	validate: Add a 'stop' action to stop a pipeline It uses the GST_MESSAGE_REQUEST state with the scenario as a source so that application can stop running when they receive it on the bus.	2014-04-25 14:33:06 +02:00
Thibault Saunier	7133e4b4e0	validate:launcher: Use the new validatelog file Making the output cleaner and clearer in junit XML file	2014-04-25 14:33:06 +02:00
Thibault Saunier	38eda37341	validate: Handle position printing at the monitor level Instead of replicating that code all around	2014-04-23 11:27:44 +02:00
Thibault Saunier	810e432da2	validate: Add printing utilities Allowing the user to print everyting in a file through the GST_VALIDATE_FILE env variable	2014-04-23 11:16:32 +02:00
Thibault Saunier	cac53e9078	validate: Add an action to wait for a given amout of time During that time we will just not execute any new action + Lower WARNING to DEBUG when no playbcak_time is provided for an action, it should just be 0.	2014-04-23 09:37:22 +02:00
Thibault Saunier	21a4888ae7	validate: Check that for raw, buffers are strictly contained in segment For encoded data we might need buffers that have timestamp < segment.start to make sure that we have the keyframe, etc... but for raw data, buffer end should strictly be inside the segment, be more strict about that.	2014-04-22 16:57:21 +02:00
Thibault Saunier	8527d91737	validate: PAR is not a mandatory field Also make it possible to check other not mandatory fields in the future	2014-04-22 16:57:21 +02:00
Thibault Saunier	279625a541	validate: Do not use GST_PTR_FORMAT when reporting It will not work now that we have our own implementation of printf for that in Gst and thus provide us with pretty useless infos	2014-04-22 16:57:21 +02:00
Thibault Saunier	02abb60a67	validate:launcher: Send SIGINT signal instead of killing the subprocess This way we get the result from GstValidate even on timeouts	2014-04-22 10:49:13 +02:00
Thibault Saunier	7f54c5dba8	validate:launcher: Always set sync=True on fakesink on playback pipelines This way we are in closer condition of real sink playback. + some minor cleanup in gst-validate.c	2014-04-22 09:42:59 +02:00
Thibault Saunier	bbbd5fe2d0	validate:launcher: ring-buffer-max-size is in bytes	2014-04-17 12:58:48 +02:00
Thibault Saunier	ad25b4d160	validate: Handle g_log errors at the gst-validate level	2014-04-17 12:23:04 +02:00
Thibault Saunier	8899ad004c	validate: Allow comments in scenario files Comment are per line only and start with #	2014-04-17 11:23:27 +02:00
Thibault Saunier	f45524a3cc	validate:launcher: Fix default blacklist management	2014-04-15 15:26:36 +02:00
Thibault Saunier	f1851235d5	validate:launcher: Print the number of the test being run	2014-04-02 19:17:24 +02:00
Thibault Saunier	6104ed184f	validate: Avoid segfault when discovering fails In that case the x->stream_info might not be set	2014-04-02 19:17:24 +02:00
Thibault Saunier	86df60e16f	validate:launcher: Fix mixup in media_check tests expected file path	2014-04-02 12:12:11 +02:00
Thibault Saunier	78f91ae8da	validate:launcher: Flush stdout each time we print So everything gets printed on time on windows and jenkins	2014-03-31 14:37:51 +02:00
Thibault Saunier	36a0f6a674	validate: launcher: Use the ConfigPraser object everywhere for file_infos	2014-03-31 11:03:48 +02:00
Thibault Saunier	3d8201d52b	validate:launcher: Properly handle missing scenarios on the system	2014-03-28 15:41:30 +01:00
Thibault Saunier	339703d2eb	validate:launcher: Handle windows path to construct arguments	2014-03-28 15:00:45 +01:00
Thibault Saunier	bc40235600	validate:launcher: Handle the fact that win32 apps end with .exe	2014-03-28 15:00:01 +01:00
Thibault Saunier	7e1c83b5b9	validate: Do not build LD_PRELOAD related code on windows And do not forget to link against gst-pbutils	2014-03-28 12:17:25 +01:00
Thibault Saunier	083d303d69	validate: Use GModule to 'dlopen' ovverrides We want gst-validate to be cross platform so use cross platform tools	2014-03-28 10:40:19 +01:00
Thibault Saunier	3408869f49	validate:launcher: Put gst logs in a specific file + Make default timeout 30seconds just in case.	2014-03-28 10:40:19 +01:00
Thibault Saunier	8fdf84b084	validate: launcher: Let the use debug on test fail When a test timeouts, let the user know about the subprocess etc, and let him possibly connect gdb to it.	2014-03-26 20:08:43 +01:00
Thibault Saunier	870df6e4e2	validate:launcher: Do not set sample path to letter in ges-launch	2014-03-26 11:46:48 +01:00
Thibault Saunier	5510b96639	validate:launcher: Start the server only when actually needed to run filtered tests	2014-03-26 11:00:32 +01:00
Thibault Saunier	ff4879c749	validate: Do not query pad caps to check if caps are properly fowarded Query caps will actually get the caps from downstream and those caps might be different in case there is a Filter in between. What we want is to check that the caps set on the internally linked pads are correct.	2014-03-26 10:57:04 +01:00
Thibault Saunier	36f9ba8f52	launcher: Allow user to set media-files directory That was broken by `71dee6c384`	2014-03-19 18:43:38 +01:00
Thibault Saunier	6d8ff8a92a	tools:validate: Start printing position on ASYNC_DONE As this is what is done in the scenarios.	2014-03-19 17:45:36 +01:00
Edward Hervey	12ccebe0a9	launcher: Don't hardcode option defaults Since they are relative to other options, we need to post-process them to get the proper value. Fixes using the launcher with non-default MAIN_DIR	2014-03-19 18:09:09 +01:00
Edward Hervey	c39a44441e	launcher: Warn if MAIN_DIR isn't present And move blacklist file listing to further down	2014-03-19 17:13:14 +01:00
Edward Hervey	e62a2ce4c4	launcher: No need to start a web server when listing tests It's not needed and makes listing faster. Also sort the list of tests	2014-03-19 17:04:14 +01:00
Edward Hervey	71dee6c384	launcher: --sync: Only update/clone git repo if specified Allows: * handling non-git-based asset directory * working offline * working without forcing updates	2014-03-19 17:03:05 +01:00
Edward Hervey	34a5946e6b	validate-scenario: Handle non-set env variable Nothing guarantees it's present/set	2014-03-19 17:02:03 +01:00
Thibault Saunier	50d3d08ab5	validate:scenario: Do not be strict about position after not accurate seek	2014-03-12 15:23:33 +01:00
Thibault Saunier	fbf787889f	validate:scenario: Cleanup output and pass into gst-indent	2014-03-12 14:24:02 +01:00
Thibault Saunier	1bc0a687ee	validate:scenario: Cleanup output of --list-scenarios	2014-03-12 12:21:38 +01:00
Thibault Saunier	e355a17f71	validate: scenario: Load scenario if the name is actually a path to a file	2014-03-12 12:04:52 +01:00
Thibault Saunier	e75e7df0ac	validate: tools: Fix path to media folder	2014-02-19 14:39:30 +01:00
Thibault Saunier	07b968a4f6	validate:tools: Clean test between runs when running forever	2014-02-19 14:34:10 +01:00
Thibault Saunier	f6bf92cbc9	validate: Do not check result furthers if alredy set as passing	2014-02-19 14:34:10 +01:00
Thibault Saunier	33aae792f6	validate:scenario: Pass into gst-indent	2014-02-19 14:34:08 +01:00
Thibault Saunier	5e0e092112	validate: Add actions to the actions list only when they are fully parsed Otherwize in some corner cases they can be executed before they are actually parsed	2014-02-19 14:32:47 +01:00
Thibault Saunier	2f44d15e0b	validate: Ignore EOS actions that can not be executed	2014-02-19 14:32:47 +01:00
Thibault Saunier	68cbc15f35	validate: Handle various paths in GST_VALIDATE_SCENARIOS_PATH	2014-02-18 21:07:31 +01:00
Thibault Saunier	63f8034bec	validate:scenario: Make GstValidateAction a GstMiniObject	2014-02-18 21:07:31 +01:00
Thibault Saunier	04029cb065	validate: Move enums and flags deserialization from scenario to utilities This way it can be reused.	2014-02-18 21:07:31 +01:00
Thibault Saunier	5cfafb4910	validate:scenario: Make the pipeline puiblic This way people can access it from outside the main action implementation.	2014-02-18 21:07:31 +01:00
Thibault Saunier	1189c48ff8	validate:launcher: Avoid running useless tests For example we should not check if duration are equal when transcoding with scenario set. Also checking if position is in the seeked segment should be done at a lower level	2014-02-18 21:07:31 +01:00
Thibault Saunier	d377158b42	validate:launcher: Avoid seeking in output files to parse them Tihs creates issue and missing content.	2014-02-18 21:07:31 +01:00
Thibault Saunier	32d9d5dc44	validate:launcher: Properly classify test for media check	2014-02-18 21:07:31 +01:00
Thibault Saunier	0449817c11	validate:launcher: Handle issue with unknown framerate in HLS while transcoding	2014-02-18 21:07:31 +01:00
Thibault Saunier	c3adb05b2a	validate:tools: Handle cases were EOS does not stop the pipeline in the launcher + Fix parsing of GstClockTime + Avoid using play_15s scenario when not necessary	2014-02-18 21:07:31 +01:00
Thibault Saunier	90d9a686d7	validate: tools: Use the new scenario discovering fearure in the launcher	2014-02-18 21:07:31 +01:00
Thibault Saunier	ba717f6237	validate: Update all scenario to use the new description feature + Fix minor issues in scenario files	2014-02-18 21:07:31 +01:00
Thibault Saunier	4467b27b9f	validate: Add a way to save details about avalaible scenarios in a file	2014-02-18 21:07:31 +01:00
Thibault Saunier	9e66ac00f6	validate: Add a way to add a "description" to scenario files Print details about the descriptions when listing scenario in a KeyFile format The description can contain any information about the scenario such as its duration before EOS, how long the pipeline needs to be so the scenario can be applied...etc	2014-02-18 21:07:31 +01:00
Thibault Saunier	efc6938d01	validate: tools: Init gst-validate before listing scenarios And return 0 when only listing scenarios	2014-02-18 21:07:31 +01:00
Thibault Saunier	6ab7f17386	validate:scenario: Handle backslashes in scenario files	2014-02-18 21:07:31 +01:00
Thibault Saunier	904cdd6411	validate:tools: Rework the way we handle options Make groups so it is easier for users to find what they look for By default have 1 single directory where everything is oututed (main-dir) Add a way to specify how and where to look for remote assets	2014-02-18 21:07:31 +01:00
Thibault Saunier	ead3eb98a4	validate:tools:launcher: Take into account the position value when rendering When rendering a files we try to use the size of the outputed file to determine wether we are timeout or not, but if that fails try to check the position	2014-02-18 21:07:31 +01:00
Thibault Saunier	10c192f693	validate: Better organize rendered files	2014-02-18 21:07:31 +01:00
Thibault Saunier	ca12b78be3	validate:tools: Use regex for parsing when appropriate	2014-02-18 21:07:31 +01:00
Thibault Saunier	df712e9404	validate:toold: Add a --output-dir parametter	2014-02-18 21:07:31 +01:00
Thibault Saunier	27e3758918	validate:tools: Keep file extension in test classnames + add test "namespace" in transcoded files	2014-02-18 21:07:31 +01:00
Thibault Saunier	2718923ae5	validate:tools: Add a class to back pipeline creation in gst-validate	2014-02-18 21:07:31 +01:00
Thibault Saunier	5927a6d8d8	validate:tools: Define supported protocols in an enum	2014-02-18 21:07:31 +01:00
Thibault Saunier	2f689fab73	validate: toold: Properly define scenario properties	2014-02-18 21:07:30 +01:00
Thibault Saunier	cd18609763	validate: Rename simple_backward to reverse_playback as this is what it does	2014-02-18 21:07:30 +01:00
Thibault Saunier	1ecd26eef6	validate:tools: Add namespace in apps global variables Avoiding conflicts	2014-02-18 21:07:30 +01:00
Thibault Saunier	932fcaf9b8	validate:tools: Allow user to append paths to medias	2014-02-18 21:07:30 +01:00
Thibault Saunier	5e96c79000	validate:tools: Make use of the new seek_with_stop scenario	2014-02-18 21:07:30 +01:00
Thibault Saunier	cd098eb28c	validate:tools: Implement the logic of validate ouput parsing in the baseclass + Add some logic to check that we are mot playing outside wanted segment	2014-02-18 21:07:30 +01:00
Thibault Saunier	2c52d6374c	tools:validate: Make default blacklist handled by managers themselves	2014-02-18 21:07:30 +01:00
Thibault Saunier	7eb1ebde6d	validate: data: Avoid using seek.stop time when not necessary Instead send an EOS. And add a seek_with_stop scenario to test that particular feature	2014-02-18 21:07:30 +01:00
Thibault Saunier	7ab0447227	validate:tools: Only discover files with media-check	2014-02-18 21:07:30 +01:00
Thibault Saunier	a406ebb4c2	validate:tools: Add a 'discover-only' option to media-check	2014-02-18 21:07:30 +01:00
Thibault Saunier	a61ebe671e	data: Let playback until the end on last seek of seek_forward if duration < 30s	2014-02-18 21:07:30 +01:00
Thibault Saunier	1a9119cb33	validate: tools: Add a --fatal-error option to the launcher	2014-02-12 11:23:25 +01:00
Thibault Saunier	2520f4f110	validate: tools: Implement the notion of hard timeout Allowing to define timeout that is not relative to the last observed number.	2014-02-12 11:23:25 +01:00
Thibault Saunier	2391a56714	validate: tools: Create a class for scenarios	2014-02-12 11:23:25 +01:00
Thibault Saunier	ba1f428351	validate: tools: Change timeouts depending on used protocol	2014-02-12 11:23:25 +01:00
Thibault Saunier	8b8562ea85	validate:tools: Implement Buffering support in the various tools	2014-02-12 11:23:23 +01:00
Thibault Saunier	b3c71bba02	validate:tools: Blacklist some scenario/protocol combinations And add the option for user to easilly blacklist tests	2014-02-06 12:02:59 +01:00
Thibault Saunier	a88d54aec2	validate: Plug a leak in validate-reporter	2014-02-06 12:02:59 +01:00
Thibault Saunier	7b236c96bf	validate:tools: Do not forget to give a ref for reporter's reports Also enhance a bit report 'wording'	2014-02-06 12:02:59 +01:00
Thibault Saunier	3bce8f8966	validate:tools: Print test result in the terminal after the end of each test	2014-02-06 12:02:59 +01:00
Thibault Saunier	5d172e159e	scenario: Enhance explanation about seek execution failure	2014-02-06 12:02:59 +01:00
Thibault Saunier	299a677f09	validate:tools: Add an option to run testforever	2014-02-06 12:02:59 +01:00
Thibault Saunier	d9386f7542	validate: tools: Cleanup the way we return code in position query	2014-02-06 12:02:59 +01:00
Thibault Saunier	d000ca62a4	validate:tools: Use the same semantic for all tests classnames	2014-02-06 12:02:59 +01:00
Thibault Saunier	ac92d5b428	scenario: Do not remove GSource if it has never been set	2014-02-06 12:02:59 +01:00
Thibault Saunier	705f8e7766	data: Add a scenario where we send EOS after 15secs if the duration is > to that	2014-02-06 12:02:59 +01:00
Thibault Saunier	c0673d7eea	validate:tools: Add support for testing http streams locally	2014-02-06 12:02:59 +01:00
Thibault Saunier	c2e5c10767	validate:tools: Some cleanup in gst-validate test launcher	2014-02-06 12:02:59 +01:00
Thibault Saunier	33a744b688	validate:tools: Add actuall tests for media checking	2014-02-06 12:02:58 +01:00
Thibault Saunier	a3e7342eef	validate: tools: media-check: When comparing with a file just compare We do not want to know if the file is seekable etc, but in that case we want to see that the results are stable throughout the various runs Also make sure to report an understandable error if the media file info could not be parsed	2014-02-06 12:02:58 +01:00
Thibault Saunier	677e111f0b	validate: tools: Do not dot the pipeline every 50ms, it is a bit exessive	2014-02-06 12:02:58 +01:00
Thibault Saunier	d485180074	validate:tools: Return an exit code != 0 if pipeline can't go to playing And give some information to the user about why the return code is !=0 everywhere it happens	2014-02-06 12:02:58 +01:00
Thibault Saunier	1c614b9ed9	validate:tools: Add informations about the test in the log files	2014-02-06 12:02:58 +01:00
Thibault Saunier	a6f3d5270c	validate:tools: Remove reference to get_backtrace which is not implemented + Enhance Message about launched apps	2014-02-06 12:02:58 +01:00
Thibault Saunier	26e3a9e3c5	validate:tools: Do not duplicated name in the classname in xunit reports	2014-02-06 12:02:58 +01:00
Thibault Saunier	654bacebc9	validate:tools: Do not check if position > duration This is actually done by the scenario themselve. Instead if it is the case, we return 0, this way it will timeout if it happens too many times concecutively	2014-02-06 12:02:58 +01:00
Thibault Saunier	6bd9177205	validate:tools: Properly inform the user about the log location when test fails	2014-02-06 12:02:58 +01:00
Thibault Saunier	eb23274a5b	validate:tools: Add an option to generate .media_info files So we can properly choose what media should be tested only placing media_file as needed.	2014-02-06 12:02:58 +01:00
Thibault Saunier	32e1acbf88	validate:tools: use more scenarios in gst-validate launcher And ensure that the list does not get mixed up with as we are sharing "symboles" between all the files	2014-02-06 12:02:58 +01:00
Thibault Saunier	49cca6a329	validate:tools: Play the entire file in simple_backward	2014-02-06 12:02:58 +01:00
Thibault Saunier	6fcd2173eb	validate:tools: Fix the fast forward scenario to handle any file duration	2014-02-06 12:02:58 +01:00
Thibault Saunier	8e81727b87	validate:tools: Do not try to transcode images	2014-02-06 12:02:58 +01:00
Thibault Saunier	9eb665dddf	validate: Properly handle images in the media-info helper In the case of images we should not check reverse playback, fast forward etc... We also should keep the information	2014-02-06 12:02:58 +01:00
Thibault Saunier	32e7b9a55e	validate:tools: Minor cleanups	2014-02-06 12:02:58 +01:00
Thibault Saunier	38615bcae2	validate:tools: Fix classname in gst-launch transcoding tests	2014-02-06 12:02:58 +01:00
Thibault Saunier	dc29cc2857	validate:tools: Properly name the project launcher in the report	2014-02-06 12:02:58 +01:00
Thibault Saunier	0b3b456f6a	validate:tools: Create the rendering directory if it does not exist	2014-02-06 12:02:58 +01:00
Thibault Saunier	8697dd3da4	validate:tools: Add an option to desativate ANSI colors And enhance some debugging output	2014-02-06 12:02:58 +01:00
Thibault Saunier	eae7e94f44	validate:tools: Remove our dependency to PyGobject	2014-02-06 12:02:58 +01:00
Thibault Saunier	0c535ef9cf	validate:tools: Do not forget to add Makefile.am and main.py	2014-02-06 12:02:58 +01:00
Thibault Saunier	bd3aaded49	validate:tools: Enhance the way we detect if ges-launch can be used We make sure it has been compiled against gst-validate	2014-02-06 12:02:58 +01:00
Thibault Saunier	c7aa259c78	validate:tools: Set video/webm instead of video/x-matroska as caps for webm + some mirore indentation cleanups	2014-02-06 12:02:58 +01:00
Thibault Saunier	384dd33843	validate:tools: Do not forget to keep our ref to file_info g-v-transcode	2014-02-06 12:02:57 +01:00
Thibault Saunier	446e5c88c2	validate:tools: Cleanup how we check result of rendering test Factor out a method in the utils, and make use of it for both ges-launch and gst-validate-transcode	2014-02-06 12:02:57 +01:00
Thibault Saunier	ff30c6ba3c	validate:tools: Don't give file duration as timeout for gst-validate We use the other mean letting us actually control the process advancement.	2014-02-06 12:02:57 +01:00
Thibault Saunier	cdff1c93ca	validate:tools: Veryfy test manager are operationnal before using them	2014-02-06 12:02:57 +01:00
Thibault Saunier	e30f6372f9	validate:tools: Move the main function in a dedictaed file	2014-02-06 12:02:57 +01:00
Thibault Saunier	c33d10470f	validate:tools: Print some statistic at the end of the test run	2014-02-06 12:02:57 +01:00
Thibault Saunier	d8fc68479c	validate:tools: Print position every 50ms in gst-validate	2014-02-06 12:02:57 +01:00
Thibault Saunier	ea7ae57d3b	validate:tools: Rename files around and integrate into autotools File distribution used to be messy, clean it all up. Also make sure the launcher is integrated into the autotools.	2014-02-06 12:02:57 +01:00
Thibault Saunier	ac9820a435	validate: tools: Enhance error message for GstValidate tests	2014-02-06 12:02:57 +01:00
Thibault Saunier	1f3432a33e	validate: tools: Concider timeouts as errors when printing tests	2014-02-06 12:02:57 +01:00
Thibault Saunier	dac5b38a4d	validate: tools: Refactor and add a GstValidateTranscodeTest class	2014-02-06 12:02:57 +01:00
Thibault Saunier	e591882794	validate: launcher: add the debug logger from pitivi It is way more powerfull, simple to use and usefull than the stock python one and has been proved to work reliably	2014-02-06 12:02:57 +01:00
Thibault Saunier	b51e143fdf	validate: tools: Unref the pipeline before the runner and monitor Avoids segfault in some cases, and monitors and runners have week ref on their targets.	2014-02-06 12:02:57 +01:00
Thibault Saunier	0d6d397e30	validate: tools: Add a gst-validate test manager	2014-02-06 12:02:57 +01:00
Thibault Saunier	7d0a6efaff	validate: tools: media-info: Fixes in the media file descriptor parsing code We used to always fail when the user was passing something not NULL as err	2014-02-06 12:02:57 +01:00
Thibault Saunier	e9b2967504	validate: tools: Cleanup test launcher tool Previous commit was not meant to be pushed and those two should have been fixed up together, sorry for the mistake	2014-02-06 12:02:57 +01:00
Reynaldo H. Verdejo Pinochet	8c39dbfaa8	validate: fix parallel build Without this, parallel building with > 2 jobs fails. Also, LDFLAGS should not contain -l flags but _LIBADD.	2014-01-30 17:26:16 -03:00
Reynaldo H. Verdejo Pinochet	463ca62ab2	validate: drop unneeded stdio include	2014-01-30 15:47:15 -03:00
Thibault Saunier	b4a2ca6286	Add a test launcher tool	2013-12-31 11:45:07 +01:00
Lubosz Sarnecki	e8db3c67b9	validate: fix installation * install headers * fix libname in pk file	2013-11-25 16:56:11 -03:00
Vincent Penquerc'h	70931813ad	validate-scenarios: list scenarios in GST_VALIDATE_SCENARIOS_PATH GST_VALIDATE_SCENARIOS_PATH was used only for loading scenarios, so any in that path would not be listed by -l. Change-Id: If3cb94867ef3876933bda02477675c8ccf67baaf	2013-11-25 16:56:11 -03:00
Thibault Saunier	e9dee065f7	tools: transcoding: Avoid reencoding unless explicitely specified	2013-11-25 16:56:09 -03:00
Thibault Saunier	a8ae32df6d	pad-monitor: Do not concider TIME_NONE as 0 for serialized events In case we have serialized events right after a buffer that had no timestamp set we concider that last timestamp was 0, but we can actually not concider the timestamp at all in that case as it is only "meaningless value".	2013-11-25 16:55:25 -03:00
Thibault Saunier	1c3340ecbb	tools: Simplify the setting of action scenario vs config scenario This make it easier for user to understand the difference between the two concepts and avoids confusion. Change-Id: Ib42913722c93a1e7e3c8b156173c458230946592 Conflicts: validate/tools/gst-validate-transcoding.c validate/tools/gst-validate.c	2013-11-25 16:55:25 -03:00
Thibault Saunier	9dfee4dffa	scenario: Do not execute anything when listing scenarios	2013-11-25 16:55:25 -03:00
Thibault Saunier	71758d49da	scenario: Add a "set-feature-rank" config action This action can be used to change the rank of a particular element, so you can force a particular element to be used when using autoplugging elements (such as decodebin, encodebin, and friends)	2013-11-25 16:55:25 -03:00
Thibault Saunier	77bba657d1	scenario: Add support for "config" actions, actions executed at parse time This type of actions is used to change some parametter on GStreamer core and it plugins, it can be fore example, to change the rank of a plugin or things like that.	2013-11-25 16:55:25 -03:00
Thibault Saunier	684eb19267	validate-transcoding: Dot pipeline on error	2013-11-13 18:46:15 -03:00
Thibault Saunier	74b86f7793	Properly link against gstreamer-video as it is now needed	2013-10-14 11:25:39 -03:00
Thibault Saunier	123ecb57c1	media-info: Do not use GST_PTR_FORMAT with g_print Fix compilation	2013-10-14 11:20:03 -03:00
Thibault Saunier	3990d7716c	data: Avoid races in the scrub_forward seeking scenario Make sure that it does not last too long if the file is long (scrubing on 10 secs maximum), and make sure that we do not end up seeking after the max duration	2013-10-14 11:07:03 -03:00
Thibault Saunier	182f4e9a41	report: Set refcount=1 when creating a report As it should start with 1 reference, not 0	2013-10-14 11:05:58 -03:00
Thibault Saunier	f8b4235e33	scenario: Add an action that checks the "force-key-unit" event execution	2013-10-09 14:24:42 -03:00
Thibault Saunier	10d1c4560e	scenario: Make the get_clocktime helper a public method So it can be reused outside of the core code	2013-10-09 09:33:06 -03:00
Thibault Saunier	4d59a2720e	pad-monitor: Do not try to compare 2 not fixed values There is no reliable way of checking those values in the case they are not fixed, let's just make sure we get fixed values before executing the check	2013-10-07 19:47:15 -03:00
Thibault Saunier	c2b58f347e	data: Add an adaptive video framerate and size scenario	2013-10-07 17:40:54 -03:00
Thibault Saunier	464b008421	data: Add an adaptive video framerate scenario	2013-10-07 17:18:37 -03:00
Thibault Saunier	2580de34c5	data: Add a scenario where we change the video size on during playback	2013-10-07 15:57:30 -03:00
Thibault Saunier	10442def2f	transcoding: Add a new action to change restriction caps at runtime	2013-10-07 15:57:30 -03:00

... 12 13 14 15 16 ...

1608 commits