Commit graph

211 commits

Author SHA1 Message Date
Thibault Saunier
b55b0f7a74 gitlab: Run valgrind on ges tests
blacklisting python tests for now as those are still leaky/need some python suppressions
2019-04-16 16:47:48 +00:00
Thibault Saunier
074a0eecbf gitlab: Dump launcher logs on failures 2019-04-16 15:47:24 +00:00
Nicolas Dufresne
22a3bfeeb5 gitlab: Disable integration test in cerbero repository
This is minimal fix for this job, we don't build the required
dependency.
2019-04-07 18:00:02 -04:00
Tim-Philipp Müller
57848d32f3 gitlab/ci_template: skip cerbero builds and integration tests for gst-omx
and the integration test for gstreamer-vaapi (we explicitly
remove the vaapi plugin when running integration tests).
2019-04-06 17:45:22 +01:00
Jordan Petridis
8fb9cb147b
gitlab/ci_template: Build gst-omx as well 2019-04-05 19:20:00 +03:00
Thibault Saunier
1a3f1f66cd gitlab: The launcher now generate the right suppression files list
See 787939f750
2019-04-04 17:25:05 -03:00
Matthew Waters
4cbf9a6ed5 gitlab: fix gst-integration-testuite exceptions
Fixes error introduced in
9d32304eb3
https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/94
2019-04-04 21:38:51 +11:00
Thibault Saunier
9d32304eb3 gitlab: Do not run check and apps job on gst-integration-testsuites 2019-04-03 19:13:21 -03:00
Thibault Saunier
edd8ff52e3 ci: Run 'validate' and 'ges' integration testsuites
And use new validate feature to print debug logs URL directly
in the logs instead of dumping the whole files.
2019-04-03 19:13:21 -03:00
Thibault Saunier
e06f324cf1 Update to latest fedora 64 image 2019-04-03 19:13:17 -03:00
Matthew Waters
d3ecc6d741 gitlab: don't build cerbero jobs in gst-build
Fixes https://gitlab.freedesktop.org/gstreamer/gst-ci/issues/17
2019-04-02 23:30:48 +11:00
Matthew Waters
caec83aa1f gitlab/android-examples: only output the resulting apks
The full build directory while useful for debugging is rather large
(almost 1GB per app depending on plugins used).
2019-03-29 01:10:24 +11:00
Matthew Waters
f398562cb3 gitlab: also build-test the android tutorials from gst-docs 2019-03-28 11:25:49 +11:00
Tim-Philipp Müller
42c1dcdf59 gitlab/ci_template: shorten name for gstreamer nodebug build
Shorter and nicer to read with spaces than underscores.
2019-03-27 15:17:23 +00:00
Matthew Waters
be70dc3735 gitlab: disable check target in gst-examples
Not particularly useful there
2019-03-27 13:26:17 +11:00
Matthew Waters
c4a3df759d add CI for gst-examples android build 2019-03-27 12:11:31 +11:00
Matthew Waters
ab873b5e58 gitlab: add a script to clone a repository using manifest details 2019-03-26 21:35:44 +00:00
Jordan Petridis
bc2bd98a75
gitlab/ci_template: disable another test in check
close #12
2019-03-26 13:47:01 +02:00
Jordan Petridis
01624a5051
gitab/ci_template: Update cerbero image 2019-03-26 02:26:55 +02:00
Tim-Philipp Müller
7ed820aa1f gitlab/ci_template: run valgrind tests automatically
Don't valgrind everything for all changes though,
but only those modules most likely to be affected
by changes in the current ci project. So, valgrind

 - gstreamer only for gstreamer core changes
 - gst-plugins-base for core/base changes
 - gst-plugins-good for core/base/good changes
 - gst-plugins-ugly for core/base/ugly changes
 - gst-plugins-bad for core/base/good changes

In other words: don't valgrind core/base if it's
good/bad/ugly that's being changed, for example.
Don't valgrind -good or -ugly for changes in -bad,
etc.

Meaning:

 - for changes in core, valgrind core/base/good/ugly/bad
 - for changes in base, valgrind base/good/ugly/bad
 - for changes in good, valgrind good/bad
 - for changes in ugly, valgrind ugly
 - for changes in bad, valgrind bad

More modules to be added later once they're valgrind
clean on the CI.

https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/80
2019-03-25 17:31:44 +00:00
Tim-Philipp Müller
21733f4057 gitlab/ci_template: add manual valgrind jobs 2019-03-25 17:31:44 +00:00
Nirbheek Chauhan
ad598c3f02 Always print timestamps when running Cerbero
This is useful when doing performance improvements or comparisons.
2019-03-25 21:49:29 +05:30
Thibault Saunier
43d8affe31 Do not run indent on gst-integration-testsuites 2019-03-25 09:32:27 -03:00
Tim-Philipp Müller
b0affb257e gitlab/ci_template: blacklist curlhttpsrc test_multiple_http_requests
Too flaky.

https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/932
2019-03-23 20:04:38 +00:00
Jordan Petridis
d1181c94d5 gitlab/ci_template: add a build that disabled debug logs 2019-03-22 14:57:35 +00:00
Thibault Saunier
74a954ca91 Track gst-integration-testsuites 2019-03-21 18:15:13 -03:00
Jordan Petridis
0831f87561
gitlab/ci_template: refresh the image builds 2019-03-14 20:51:08 +02:00
Matthew Waters
775c0b3520 gitlab: remove the android gst-build target
android is now being tested using cerbero for the binaries we produce.
2019-03-13 13:00:01 -04:00
Matthew Waters
d6779a1d07 gitlab/cerbero-android: build without werror 2019-03-13 10:35:00 -04:00
Nicolas Dufresne
4221153836 CI: Add Android universal builds 2019-03-13 10:35:00 -04:00
Nicolas Dufresne
ae80b863c3 gitlab: Move cerbero jobs in gst-ci
This will allow extending the CI at one place.
2019-03-12 22:56:21 -04:00
Matthew Waters
ed534a2f5a cerbero: enable the werror variant by default 2019-03-11 15:00:57 +00:00
Matthew Waters
d86a39a65b gitlab: update cerbero-fedora image to the latest 2019-03-10 23:57:55 +11:00
Thibault Saunier
907400a2a0 Blacklist check.gstreamer-sharp.SdpTests 2019-03-06 10:47:20 -03:00
Tim-Philipp Müller
badb75f4ed gitlab/ci_template: skip cerbero builds for gst-build changes 2019-03-03 21:57:16 +00:00
Thibault Saunier
f87d553bc4 Enable GstSharp 2019-02-25 19:20:22 -03:00
Jordan Petridis
42335f3100
ci_template: unblacklist test
Should be fixed by the following MR
https://gitlab.freedesktop.org/gstreamer/gst-rtsp-server/merge_requests/20
2019-02-22 14:52:53 +02:00
Tim-Philipp Müller
001e05ab3a gitlab/ci_template: blacklist ges test_auto_transition test
Fails too often.

Reported as https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/63
2019-02-18 14:12:35 +00:00
Sebastian Dröge
c1d7f69fd5 Blacklist racy audiomixer.test_flush_start_flush_stop test
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/555
2019-02-12 11:26:03 +02:00
Philippe Normand
0cde909af1 gitlab: Blacklist another ges test
python.test_timeline.TestTransitions.test_transition_type fails as reported in
https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/62
2019-02-05 13:04:16 +00:00
Philippe Normand
81765960ca gitlab: Blacklist the rtsp-server test_shared_udp test
This test sometimes fails, as reported in
https://gitlab.freedesktop.org/gstreamer/gst-rtsp-server/issues/61
2019-02-05 10:27:39 +00:00
Nicolas Dufresne
b289400a04 Update docker hash
While cleaning up, I got confused since some docker were rebuilt without
but unused. So I broke the build, this should fix it.
2019-01-31 11:39:11 -05:00
Tim-Philipp Müller
e6a39a4eba gitlab/ci_template: blacklist multisocketsink test_add_client test
Unexpected critical/warning: gsignal.c:2641: instance '0x144a770' has no handler with id '2'

Stack trace:
gst_debug_get_stack_trace (gstinfo.c:2788)
gst_check_log_critical_func (gstcheck.c:281)
g_logv (/usr/lib64/libglib-2.0.so.0.5800.2:0x7f40d144e4fb)
g_log (/usr/lib64/libglib-2.0.so.0.5800.2:0x7f40d144e6ef)
g_signal_handler_disconnect (/usr/lib64/libgobject-2.0.so.0.5800.2:0x7f40d13c5a03)
g_cancellable_disconnect (/usr/lib64/libgio-2.0.so.0.5800.2:0x7f40d1238dae)
?? (/usr/lib64/libgio-2.0.so.0.5800.2:0x7f40d1238df8)
?? (/usr/lib64/libglib-2.0.so.0.5800.2:0x7f40d1444045)
?? (/usr/lib64/libglib-2.0.so.0.5800.2:0x7f40d1445407)
ensure_condition (gstmultisocketsink.c:999)
gst_multi_handle_sink_remove_client_link (gstmultihandlesink.c:971)
gst_multi_handle_sink_clear (gstmultihandlesink.c:847)
gst_multi_handle_sink_change_state (gstmultihandlesink.c:2200)
gst_element_change_state (gstelement.c:2952)
gst_element_change_state (gstelement.c:2991)
gst_element_change_state (gstelement.c:2991)
gst_element_set_state_func (gstelement.c:2906)
test_add_client (multisocketsink.c:230)

Likely same root cause as:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/516
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/534
2019-01-16 15:48:40 +00:00
Jordan Petridis
092f6ddd84
gitlab/ci_template: blacklist extra tests
rtpsession.test_multiple_senders_roundrobin_rbs:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/548

elements_audiotestsrc.test_layout:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/535
2019-01-11 11:06:44 +02:00
Jordan Petridis
f951999359
gitlab/ci_template: blacklist even more tests!
gstreamer.gst_gstsystemclock.test_periodic_shot:
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/348

splitmux.test_splitmuxsrc_caps_change:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/547

nle_simple.test_simplest:
https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/57

ges_basic.test_ges_pipeline_change_stat:
https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/58

camerabin.test_single_video_recording:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/864#note_101558

camerabin.test_multiple_video_recordings:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/864#note_101646
2019-01-11 11:06:44 +02:00
Jordan Petridis
0dd20f61ea
gitlab/ci_template: Blacklist some more problematic tests
These tests are somewhat hard to reproduce and don't have an issue
associated with them yet, but they seem to fail quite often in
scenarios where they are run as part of a bigger group of tests

See !61 for more
2019-01-11 11:06:43 +02:00
Jordan Petridis
dcf237a438
ci_template: Remove the j = 1 restriction from check
Previously we were forcing tests to run with j 1 to avoid random
failures/races that occurred due to tests being racy. Majority
of those tests have been blacklisted and this should no longer be
needed.
2019-01-11 11:05:59 +02:00
Nicolas Dufresne
c021fb8310 gitlab: Update to latest cerbero docker image 2019-01-11 03:04:55 +00:00
Nicolas Dufresne
db62f95ba2 gitlab: Remove uneeded mkdir
The cerbero_home is already part of the /cerbero folder that we rsync
at start.
2019-01-10 16:26:49 -05:00
Jordan Petridis
eaa7497fa4
gitlab/ci_template: blacklist another test
camerabin.test_image_video_cycle seems racy:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/864
2019-01-10 11:42:05 +02:00
Jordan Petridis
c54fe7bc89
gitlab/ci_template: Blacklist more tests
pipelines_parse_launch.delayed_link:
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/345

gst_gstsystemclock.test_async_sync_interaction:
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/346

gst_gstsystemclock.test_periodic_multi:
https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/347

rtpbin.test_cleanup_recv:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/546
2019-01-10 10:41:52 +02:00
Jordan Petridis
b22e113e7a
gitlab/ci_template: blacklist another splitmux test
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/544
2019-01-08 22:31:06 +02:00
Jordan Petridis
0530c4e0e7
gitlab/ci_template: Blacklist another flvmux test
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/543
2019-01-08 22:21:40 +02:00
Nicolas Dufresne
2396e18358 gitlab: Re-add ARCH parameter to cerbero deps jobs
This is required and was removed without proper testing.
2019-01-08 13:22:02 -05:00
Nicolas Dufresne
5a55d5103d CI: Add Win32 and Win64 cross builds 2019-01-08 10:31:19 -05:00
Jordan Petridis
6f8e23359a
gitlab/ci_template: update the sha of the images 2019-01-08 08:16:05 +02:00
Jordan Petridis
f072577905
gitlab/ci_template: Factor out the image uris to variables
This avoids duplication and makes them easier to update and keep
in sync.
2019-01-08 08:15:59 +02:00
Sebastian Dröge
5cd4bea651 gitlab: Unblacklist check.gst-plugins-good.elements_splitmux.test_splitmuxsrc_sparse_streams
Was caused by a bug in a MR.
2019-01-07 14:39:32 +02:00
Sebastian Dröge
14a4f360f2 gitlab: Blacklist 4 more tests
check.gst-plugins-base.pipelines_tcp.test_that_tcpserversink_and_tcpclientsrc_are_symmetrical:
  https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/221

check.gstreamer.elements_capsfilter.test_unfixed_downstream_caps:
  https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/335

check.gst-rtsp-server.gst_rtspclientsink.test_record:
  https://gitlab.freedesktop.org/gstreamer/gst-rtsp-server/issues/55

check.gst-plugins-good.elements_splitmux.test_splitmuxsrc_sparse_streams:
  https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/542
2019-01-07 14:33:50 +02:00
Thibault Saunier
652af10840 gitlab: Stop blacklisting check.gst-devtools.validate_padmonitor.buffer
https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/34 has been closed
2019-01-03 19:31:18 +01:00
Nicolas Dufresne
00d2fd776c ci: Update cerbero docker image
This new image contains source cache, which should speed first fork and
cold cache cases.
2018-12-18 14:05:37 -05:00
Sebastian Dröge
ea7a482326 ci_template.yml: blacklist one more tests in check
check.gst-editing-services.nle_complex.test_one_expandable_another occasionally fails.

https://gitlab.freedesktop.org/gstreamer/gst-editing-services/issues/55
2018-12-18 18:53:06 +02:00
Tim-Philipp Müller
8eec47d8fe ci_template: blacklist flaky gst-devtools.validate_padmonitor.buffer test
https://gitlab.freedesktop.org/gstreamer/gst-devtools/issues/34
2018-12-18 11:07:04 +00:00
Sebastian Dröge
57ec9441d2 ci_template.yml: blacklist one more tests in check
check.gst-plugins-bad.elements_netsim.netsim_stress occasionally fails.

https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/849
2018-12-17 11:43:34 +02:00
Sebastian Dröge
da4edd6950 ci_template.yml: Unblacklist test in check
gstpad.test_pad_probe_block_add_remove does not fail anymore.

https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
2018-12-14 20:39:36 +02:00
Jordan Petridis
0592481638
ci_template: bump the expiration time of artifacts
build job artifacts are the ones that consume much space, and
thus only set to 5 days, might lower it if space is an issue.

Otherwise rest job artifacts are just logs, text and xml files.
2018-12-14 14:11:46 +02:00
Jordan Petridis
31991e6e0d
Revert "ci_template.yml: blacklist another test in check"
This reverts commit d922144894.

This was duplicate of 7f03e972ee
2018-12-14 14:11:45 +02:00
Jordan Petridis
d922144894
ci_template.yml: blacklist another test in check
check.gstreamer.gst_gstpad.test_pad_probe_block_add_remove
occasianlly fails.

https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
2018-12-14 13:33:48 +02:00
Sebastian Dröge
17e25299e8 ci_template.yml: blacklist two more tests in check
check.gst-plugins-bad.elements_shm.test_shm_live
check.gst-plugins-good.elements_splitmux.test_splitmuxsink_async
occasionally fail.

https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/531
https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/847
2018-12-14 12:34:21 +02:00
Sebastian Dröge
7f03e972ee ci_template.yml: blacklist another test in check
gstpad.test_pad_probe_block_add_remove occasionally fails.

https://gitlab.freedesktop.org/gstreamer/gstreamer/issues/339
2018-12-14 11:59:48 +02:00
Jordan Petridis
c2c72edc9b
ci_template.yml: blacklist another test in check
check.gst-plugins-good.elements_flvmux.test_incrementing_timestamps
occasianlly fails.

https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/530
2018-12-13 21:46:20 +02:00
Xavier Claessens
6542818ffb android: Use the new docker image 2018-12-13 14:13:01 -05:00
Jordan Petridis
39f535986b
ci_template: enable h264parse.test_parse_packetized test again
Remove check.gst-plugins-bad.elements_h264parse.test_parse_packetized
from the blacklist since the relevant issue [1] seems to have been
resolved with the following MR [2]

[1] https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/issues/842
[2] https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/merge_requests/69
2018-12-13 17:19:18 +02:00
Nicolas Dufresne
5a3cf8360c CI: Don't reset cache on fetch
This is not needed since we only do run without cache or from a deps
cache for the specific cerbero commit we are building. This will speed
up builds in cerbero/ project when the source cache is missing.
2018-12-12 10:12:26 -05:00
Jordan Petridis
1c68f94c68
ci_template: another blacklisted test in check
gst-plugins-good.elements_rtpbin.test_sender_eos
is occasionally failing.

For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/527
2018-12-11 22:57:46 +02:00
Jordan Petridis
f32f70d79b
ci_template: Blacklist another test in check
gst-plugins-base.elements_multisocketsink.test_client_next_keyframe
is occasionally failing somehow in the CI.

For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/516
2018-12-11 20:33:18 +02:00
Jordan Petridis
5eb652177c
ci_template: do not .test in the cerbero repo
We already disable the .build inhereted build jobs, and thus the
tests fail to run since they depend on them. Cerbero doesn't need
to run them anyway.
2018-12-11 13:25:56 +02:00
Jordan Petridis
d25392f3e1
ci_template: Report ccache stats for build jobs 2018-12-10 21:35:38 +02:00
Jordan Petridis
a529757dec
ci_template: blacklist a problematic test in check
Also pass --dump-on-failure in the job. While the logs are
artifacts and they are integrated in the MRs, its not as
convinient to findout out what is failling if you are looking
into just a job log, of a commit. Thus make it show logs are also
priting on stdout/stderr.
2018-12-10 20:35:29 +02:00
Jordan Petridis
830507f202
ci_template: Blacklist problematic tests 2018-12-10 17:12:26 +02:00
Jordan Petridis
7151af0270
ci_template.yml: Run the check test suite!!!
Add a fedora job that runs the 'check' tests with
gst-validate-launcher. Its fairly well abstracted so the same
template can be used to add the rest of the test-suites fairly
soon.
2018-12-10 14:45:56 +02:00
Jordan Petridis
c9ee22d4c3
Revert "ci_template.yml: Temporarly disable builddir artifact"
This reverts commit 6ddb35c3c4.

A hotfix has been deployed, lets see how it goes.
2018-12-10 14:45:56 +02:00
Jordan Petridis
830b24df3e
ci_template: Remove duplicate key
Looks like this slipped past the review of !47
2018-12-10 11:50:49 +02:00
Nicolas Dufresne
d399288f15 CI: Enable cerbero builds for all projects 2018-12-09 18:19:06 -05:00
Nicolas Dufresne
00b67289b1 CI: Place cerbero docker image: in the template
This avoids having to duplicate that path into cerbero/ project and will
ease later updates.
2018-12-09 16:30:31 -05:00
Nicolas Dufresne
4291812f75 CI: Add cerbero docker SHA
No job activated yet.
2018-12-09 15:32:28 -05:00
Nicolas Dufresne
d19082b726 gitlab: Limit cerbero ccache to 1.7G
Testing showed that we need 1.6G to store all the objects. This limit
will prevent the cache from growing over time. Compressing the cache
can take a lot of time.
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
fcbfb3dc68 gitlab: Use cache key for cerbero builds
The key is set to cerbero_${ARCH}. This should help maintain a smaller
cache size and will avoid other jobs from overriding our cerbero-sources
cache.
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
e2595530ad gitlab: Don't build gst-build in cerbero repository 2018-12-09 19:12:07 +00:00
Nicolas Dufresne
d7322403f2 gitlab: Add orc and cerbero to manifest 2018-12-09 19:12:07 +00:00
Nicolas Dufresne
b1e3b9e6ab gitlab: Add cerbero build template and x86_64 build 2018-12-09 19:12:07 +00:00
Jordan Petridis
932a9c2137
ci_template: Use a cache key specific to each job 2018-12-09 04:34:35 +02:00
Thibault Saunier
5856b05f30 build_manifest: fetch remote refname before checking out right commit
Working around https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/95
2018-12-06 07:23:30 -03:00
Thibault Saunier
7cb3feec19 build_manifest: Include remote refname in the manifest 2018-12-06 07:23:30 -03:00
Thibault Saunier
8932df0c2d buildmanifest: Move away from the gitlab API and use plain git to retrieve branch names
Makes the code much simpler
2018-12-06 00:09:17 -03:00
Jan Alexander Steffens (heftig)
4493ab0bb8
ci_template: Use git diff --quiet for checking for changes
Checking the exit code of git diff --quiet is preferred over looking
whether git diff produces any output.
2018-12-05 22:26:07 +01:00
Jan Alexander Steffens (heftig)
5b664cd00f
ci_template: Don't use command substitution with find
GNU find has operations like -exec and -delete that operate without the
brittleness of applying shell word splitting to its output.

In addition, it won't fail if no files were matched.
2018-12-05 22:26:07 +01:00
Jordan Petridis
9e8d215f90
ci_template: Add a gst-indent job 2018-12-03 17:39:09 +02:00
Nicolas Dufresne
597544cd61 build_manifest: Increase the number of search results
This increase the number of search results when looking up user
branches to 100 items. This should be sufficient for all of our users.

Fixes #3
2018-12-01 11:33:44 -05:00
Jordan Petridis
06c76e1d63
CI: Update image uris 2018-12-01 15:20:38 +02:00