Commit graph

345 commits

Author SHA1 Message Date
Tim-Philipp Müller
1ab716b71d citemplate: add support for .indentignore file to indent job
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1465

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/328>
2020-08-05 00:32:17 +01:00
Jordan Petridis
91c85b7ca9 citemplate: skip integration testsuites for gstreamer-sharp
Close #80

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/326>
2020-07-26 12:25:55 +00:00
Jordan Petridis
c44f415a4b citemplate: make it so docker builds only run for detached pipelines
Currently, if you have a MR open, there 2 pipelines being
triggered. One normal, and one detached.

Previously, if you were to rebuild an image, the jobs of the
docker build stage would be executed concurrently, race
and end up both rebuilding the image.

Make them manual for normal pipelines to avoid such occurrence
and waste of resources.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/320>
2020-07-26 09:57:43 +00:00
Jordan Petridis
fe54d6d8cd citemplate: properly pin the image of the docs job
we don't need the image to be copied or rebuilt, as
its currently pinned shortly and won't change anytime soon.

ammends dc48666742 !324

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/325>
2020-07-24 18:54:50 +03:00
Jordan Petridis
dc48666742 citemplate: revert the docs job to the previous image build
The update to f31 from !271 triggered an error in hotdoc it seems,
so rollback for now till we figure it out.

https://gitlab.freedesktop.org/gdesmott/gst-plugins-base/-/jobs/3764215

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/324>
2020-07-23 15:19:46 +03:00
Jordan Petridis
a892850eb2 docker/fedora: update base to fedora 31
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/271>
2020-07-23 06:58:10 +00:00
Nirbheek Chauhan
af11a2cd52 gitlab: Support android tarballs compressed with xz
Needed for
https://gitlab.freedesktop.org/gstreamer/cerbero/-/merge_requests/540.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/322>
2020-07-11 01:28:37 +05:30
Mathieu Duponchelle
13c2d964da gitlab: update hotdoc
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/321>
2020-07-10 01:09:26 +02:00
Jordan Petridis
4fd36e5d73 docker/fedora: add gtest to get openh264 to build again
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/315>
2020-07-03 16:38:46 +03:00
Matthew Waters
3f6395c2e9 gst-build: only enable werror for gst recipes
It may throws various warning that are treated as errors for other
repositories

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/171>
2020-07-03 15:20:30 +03:00
Jordan Petridis
a5135b1596 citemplate: use the default keyword for our global policy
It was introduced in a recentish release along with pipelines
for merge requests, but it required the use of rules.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Jordan Petridis
d57693328b citemplate: avoid the need to upgrade buildah in docker build
We only need the newer version from the image, to support
the --arch arg, but we don't really use it yet so we
could live without it.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Jordan Petridis
f5569ad5dc citemplate: run check in gst-examples but not integration tests
gst-example contains tests for check but not integrations suite

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Jordan Petridis
e18eb064c1 citemplate: run the docs job in more modules
Needed to catch regressions in the docs cache files.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Jordan Petridis
efdb7c545c citemplate: slightly improve logging of docker build jobs
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Guillaume Desmottes
dbc4ca1b2f ci: use gst-indent from docker image
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
2020-07-03 09:47:27 +00:00
Thibault Saunier
b6ccc2169f gitlab: Update hotdoc 2020-07-02 18:09:32 +02:00
Mathieu Duponchelle
51d0c73074 ci_template: update hotdoc 2020-07-01 19:02:38 +02:00
Nirbheek Chauhan
70f6af0e81 msys2: Fix pacman update
Match the official steps by MSYS2 upstream for updating on CI:

https://github.com/msys2/setup-msys2/blob/master/main.js#L98

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/317>
2020-06-30 18:17:07 +05:30
Jordan Petridis
e94919137c citemplate: check if the gitlab registry is enabled on the fork
If its not CI_REGISTRY_IMAGE will be null and break the job.
Instead paste a helpful message with the documentation on how
to enable the registry.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/316>
2020-06-30 00:12:45 +03:00
Jordan Petridis
41e979e1e4 citemplate: remove tag restriction for docker builds jobs
There isn't anything particular that needs to be on the gstreamer
runners, and the other shared runners should be able to handle
them fine.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/314>
2020-06-29 15:43:31 +00:00
Guillaume Desmottes
0a085866ae docker: move gst-indent script into docker image
This script is now very stable, so downloading it everytime is no longer useful.
It can also helps avoid network errors when running ci jobs.

Fix #70

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/306>
2020-06-29 17:12:00 +03:00
Jordan Petridis
5c490de1bd citemplate: also check the forked registry for image builds
In case you are developing a set of changes in a module, in
conjunction with a branch in gst-ci, you will end up with
a template with a different tag than the upstream repo, which
will be refferencing your gst-ci forked registry.

But that image won't existin in the namespace the
module would be running at, so we need to copy it from there.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
2020-06-26 12:14:28 +00:00
Jordan Petridis
3a004f7ca4 citemplate: use the fd.o pre existing buildah image to build containers
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
2020-06-26 12:14:28 +00:00
Jordan Petridis
cece45eacb ci_template: merge docker builds into the normal pipeline
Port the build docker jobs to the template and integrate it into
the pipeline. Then change the image uris to the new system,
and the user forked registries.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
2020-06-26 12:14:28 +00:00
Jordan Petridis
fe959679b8 .gitlab-ci.yml: adapt the docker build jobs to be more like citemplates
This is the inital step towards migrating our docker images setup
to something closer and eventually freedesktop/citemplates [1]

The idea is that jobs always run from the registry in your fork. If the
image sha/id matches the one from the upstream registry, its copied
over else a new one is build, pushed and tested.

Only change the fedora job for now while testing.

[1]: https://gitlab.freedesktop.org/freedesktop/ci-templates

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
2020-06-26 12:14:28 +00:00
Thibault Saunier
592124a46b gitlab: Update hotdoc
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/312>
2020-06-25 19:05:19 -04:00
Thibault Saunier
f9881240ae gitlab: Update hotdoc to 0.12.2
Adding Since markers check

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/310>
2020-06-23 18:03:04 -04:00
Thibault Saunier
78577cffaf ci: Update to hotdoc 2020-06-23 14:20:48 -04:00
Jordan Petridis
7beb52a6e0 citemplate: upate the cerbero image
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/307>
2020-06-18 11:54:47 +03:00
Nicolas Dufresne
f0eea49641 CI: Combine deps and build for cerbero builds
This change combine the deps and the build step when running cerbero CI in
cerbero repository itself. This removes avoidable usage of large artifacts.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/303>
2020-06-17 13:28:44 +00:00
Jordan Petridis
869fa72595 docker/windows: update msys snapshot
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/297>
2020-06-16 01:54:02 +05:30
Thibault Saunier
e4ba926955 gitlab: Enforce documentation cache updates 2020-06-08 13:58:25 +00:00
Thibault Saunier
3a620ac384 ci: Update fedora image 2020-06-04 12:48:31 -04:00
Thibault Saunier
d72551ddc4 gitlab: Update hotdoc to latest release 2020-06-04 12:34:15 -04:00
Mathieu Duponchelle
1f07629c3c ci_template: pin hotdoc to pre fundamental documentation 2020-06-04 17:56:00 +02:00
Mathieu Duponchelle
5455320869 ci_template: pin hotdoc to pre gst cache format change 2020-06-04 17:29:49 +02:00
Thibault Saunier
3839f8ab87 gitlab: Enable docs only when building the doc 2020-06-03 22:39:33 -04:00
Jordan Petridis
dbe39079ee ci_template: windows: clone the gst-build specified in the manifest
In all our other builds, we are using the clone_manifest_ref script
to fetch the revision of gst-build that we discover in the manifest.
For the windows job this was missed it seems, but didn't cause
any issues till now cause it only affected the gst-build MRs.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/296>
2020-06-02 11:13:09 +03:00
Thibault Saunier
929a611889 ci: Check valgrind for all modules on gst-devtools
Now that we have [`gst-tester`] all module are starting to be tested
with `gst-validate` (core and -base already have validate based unit
tests) so we need to ensure that changes there do not break those
modules.

[gst-tester]: https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/461

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/294>
2020-05-29 22:19:14 +00:00
Tim-Philipp Müller
92b78216d4 ci_template: update cerbero build-deps for gst-validate -> gst-devtools-1.0 rename
https://gitlab.freedesktop.org/gstreamer/gst-devtools/-/merge_requests/199
https://gitlab.freedesktop.org/gstreamer/cerbero/-/merge_requests/490

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/295>
2020-05-29 13:05:02 +01:00
Stéphane Cerveau
0928a89125 gst-omx: update vcu-omx-il public release branch
Use release 2020.01 for the xilinx zynq target
from https://github.com/Xilinx/vcu-omx-il

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/293>
2020-05-21 15:40:27 +02:00
Matthew Waters
95b35ceaf1 android: update to gradle 5.6.4 without --no-search-upwards
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/291>
2020-05-09 00:04:23 +10:00
Matthew Waters
c23bdae050 ci: run CI for the new vulkan android example
HACK: pointing to user repo
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/291>
2020-05-09 00:04:17 +10:00
Jordan Petridis
6576f2f7b7 ci_template: try harder to cleanup after build jobs
Let's try extra hard to clean after ourselves, cause gitlab-runner
occasionally decides to reuse existing, polluted, volumes...

so much for clean build environments...

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/288>
2020-04-27 15:39:45 +03:00
Jordan Petridis
2f504610b3 ci_tepmlate: disable the msys job again
Its still broken and keeps haning randomly... 😢️

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/284>
2020-04-23 16:59:24 +03:00
Jordan Petridis
f546834e6c ci_template: enable the windows x86 and msys native jobs again
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/281>
2020-04-23 07:57:02 +00:00
Jordan Petridis
b36d813f5b ci_template: don't use prebuilt binaries for test jobs
Previously we were optimizing for cpu time, so we where building
gst-build once and then exporting that to be used by the test jobs.
However this meant that we where uploading 200mb (previously 600mb)
zipped of artifacts and then re-downloading them for each test job.
This caused big costs in terms of cloud egress since the runners
aren't hosted on the same cloud as the storage/artifacts instance.

Instead we are going to be rebuilding gst-build for each test
job from now, it also doesn't take more time than the network
i/o would of downloading the artifacts, so the impact of rebuilding
shouldn't be noticebly.

We are also using pinned git refs the modules we rebuild from
the manifest, so the binaries should be reproducible for the most
part (minus things like .pyc files).

Close #68

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/280>
2020-04-22 09:23:18 +03:00
Nicolas Dufresne
95f9b25683 ci: Always allow redirect when using curl
This done by specifying -L parameter. Some of the FDO infrastructure is using
redirect.
2020-04-19 14:30:43 -04:00
Jordan Petridis
815976e4aa
ci_template: avoid exporting the mediafiles into build artifacts
Previously we where accidently exporting the whole repo of
gst-integration-testsuites which includes 350mb of raw media
files and made the artifacts storage explode through the roof
along with the CI bills fd.o had to pay for uploading and
redownloading the artifacts

To deal with this, we clean all the media files from the builddir
and when needed we copy them over from the cache in the docker image,
and then git fetch the repo.

Close #69
2020-04-17 22:46:34 +03:00