mirrors/gstreamer
mirrors/gstreamer
1
1
Fork 0
mirror of https://gitlab.freedesktop.org/gstreamer/gstreamer.git synced 2024-07-02 12:45:51 +00:00
Code Issues 1 Projects Releases Wiki Activity
595 commits 44 branches 1505 tags 438 MiB
Commit graph

422 commits

Author SHA1 Message Date
Nirbheek Chauhan 37bdeb200a Revert "cerbero ci: Actually use the new cerbero_setup.sh script" 
This reverts commit ef981bafc9.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/352>
 2020-09-24 05:37:46 +05:30
Nirbheek Chauhan 6208a61946 cerbero ci: Add hacks for build tools 
Instead of putting a hammer-like symlink to ../../gstreamer/cerbero,
do recipe-specific relocation hacks. Fixes random errors like:

```
++ ln -sf /builds/nirbheek/cerbero ../../gstreamer/cerbero
ln: ../../gstreamer/cerbero/cerbero: cannot overwrite directory
```

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/350>
 2020-09-23 12:50:16 +05:30
Nirbheek Chauhan 98e3c7d8b8 cerbero ci: Refactor cerbero_before_script 
We were doing a few things suboptimally:

1. Making a symlink from the current directory to
   ../../gstreamer/cerbero so that build-tools kept working, which
   should not be necessary since cerbero relocates all binaries inside
   the cerbero homedir after extracting the cache.

2. Hard-coding the cerbero builddir when building on Windows because
   `pwd` was outputting an MSYS-style path which Python can't read

3. rsync-ing all the contents of $CERBERO_HOST_DIR, which is
   bad because we should be building on top of the artifact cache.
   The only thing we want from $CERBERO_HOST_DIR is cerbero-sources
   (the network cache), and we can setup the toolchain during
   bootstrap with the new --system and --toolchains arguments which
   were split out of --system-only.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/350>
 2020-09-22 21:58:59 +05:30
Nirbheek Chauhan ef981bafc9 cerbero ci: Actually use the new cerbero_setup.sh script 
Revert after merging.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/350>
 2020-09-22 18:41:39 +05:30
Nirbheek Chauhan 0c7275212a manifest: Check all deps logs when picking cerbero commit 
Instead of picking the 'slowest build', look at all the deps logs and
pick the commit that is mentioned in the maximum number of deps logs.

In practice, this will either be the newest commit or the previous
commit. If it's not the newest commit, we will warn and use an older
one.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/349>
 2020-09-22 16:59:48 +05:30
Jordan Petridis 386e40c22e citemplate: set PYTHONFAULTHANDLER for tests 
In case python segfaults, which might happen for things with
a C-FFI like pygobject, make it so we get a proper backtrace.

https://docs.python.org/3/using/cmdline.html#envvar-PYTHONFAULTHANDLER

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/341>
 2020-09-22 08:15:19 +00:00
Nicolas Dufresne dec76861ea manifest: Fix URL for cerbero deps log 
There was a missing 'f' prefix, so the {branch} was not expanded.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/348>
 2020-09-21 11:57:59 -04:00
Nicolas Dufresne 808fc283f3 manifest: Build useful error message 
This helps detecting issue with optional steps like cerbero deps
lookup.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/348>
 2020-09-21 11:57:26 -04:00
Nirbheek Chauhan 705e375893 Revert "cerbero ci: Also disable the deps build" 
This reverts commit 555c49f9d1.

The job is working fine now and takes slightly more time than the iOS
build, so it can be re-enabled.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/347>
 2020-09-21 19:33:17 +05:30
Nirbheek Chauhan eed018920c cerbero ci: Sprinkle some 'time' commands in the script 
Sprinkle some 'time' commands so we can measure how long things take
and we can know where to spend time optimizing first.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/346>
 2020-09-19 12:00:15 +05:30
Nirbheek Chauhan 01c53ebf02 ci: Switch cerbero script URL back to gst-ci master 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/345>
 2020-09-18 01:44:26 +05:30
Nirbheek Chauhan 555c49f9d1 cerbero ci: Also disable the deps build 
There seems to be some issues uploading the cache from the Windows
runner.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/344>
 2020-09-18 00:02:27 +05:30
Nirbheek Chauhan dab27ee564 cerbero ci: Try to fix deps build on the gstreamer namespace 
Can't ln twice: it does a cp on MSYS.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/344>
 2020-09-17 23:23:02 +05:30
Nirbheek Chauhan f24e7b721a cerbero ci: Don't expand the ssh private key 
Because of set -x we were printing the key into the CI logs:
https://gitlab.freedesktop.org/gstreamer/cerbero/-/jobs/4572836#L797

Don't ever expand the variable in shell.
 2020-09-17 23:18:30 +05:30
Nirbheek Chauhan bdbec90a49 Switch MSVC job to manual till we can upload deps cache 
The deps cache job is failing:

https://gitlab.freedesktop.org/gstreamer/cerbero/-/jobs/4568410

Because of which MRs in other repos are unable to download the cache
and are building everything from scratch, which is inflating CI times
to 2 hours:

https://gitlab.freedesktop.org/marian/gst-plugins-bad/-/jobs/4567025

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/343>
 2020-09-17 16:58:07 +05:30
Jordan Petridis 260935e39e citemplate: post-merge fix for url path 
switch it so it looks at the stable branch for the cerbero_setup
script.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/342>
 2020-09-17 02:14:55 +03:00
Jordan Petridis b857a5ada1 citemplate: add initial cerbero msvc builds 
This commit adds the last bits needed to have a working
CI job of cerbero using mingw and msvc17 toolchain.

It adds a new stage to the docker image that mirrors
the setup of the cerbero fedora docker build, and
tweaks the cerbero_setup script run by jobs with
a couple windows specific fixes.

Close #39

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/334>
 2020-09-16 20:56:14 +03:00
Jordan Petridis 6ffc323ff5 gitlab/cerbero_setup.sh: refactor some tests to if/else statments 
and replace the ccache check

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/329>
 2020-09-15 16:42:58 +00:00
Jordan Petridis 7d46f1ac5e ci_template: move the cerbero scripts from yaml to a new file 
Its hard to manage ever growing bash scripts in yaml, and
its even harder to run them locally to reproduce the environment.

This is essentially a copy-paste of the scripts, to make review
easier. We can refactor later.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/329>
 2020-09-15 16:42:58 +00:00
Jordan Petridis 050aec524b citemplate: workaround stale subproject cache 
The revision of the wrap for pygobject was switched recently [1]

[1]: https://gitlab.freedesktop.org/gstreamer/gst-build/-/merge_requests/189

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/339>
 2020-09-15 17:24:32 +03:00
Jordan Petridis fd7b78a918 docker/fedora: install more debug symbols 
These are needed for the webrtcbin tests

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/339>
 2020-09-15 16:24:51 +03:00
Jordan Petridis 0f50f3901e cerbero/fedora: install which into the image 
We used to get this as transient dependency it seems,
which broke rebuilds of the img once w/e pkg was
depending on it, stopped.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/338>
 2020-09-10 01:01:30 +03:00
Jordan Petridis 58df3e6f58 citemplate: update the buildah bootstrap image 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/338>
 2020-09-09 17:35:25 +03:00
Jordan Petridis dd43637fce ci_template: correctly spell the global var 
Close #83

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/337>
 2020-09-09 16:05:00 +03:00
Jordan Petridis 2a3589dc2d citemplate: rework gitlab rules 
Rework rules of jobs to prever duplicate pipelines.

https://docs.gitlab.com/ce/ci/yaml/README.html#prevent-duplicate-pipelines

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/331>
 2020-08-27 15:39:35 +03:00
Jordan Petridis 524a75e6ff ci_template: remove rules from the docker build 
We can run the jobs always automatically since, most of the
time they will be copying/reffing the existance image in the
registry.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/331>
 2020-08-27 15:35:12 +03:00
Nirbheek Chauhan 159e0e8134 citemplate: Allow spaces in filenames when indenting 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/328>
 2020-08-06 01:34:18 +05:30
Tim-Philipp Müller 1ab716b71d citemplate: add support for .indentignore file to indent job 
See https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/1465

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/328>
 2020-08-05 00:32:17 +01:00
Jordan Petridis 91c85b7ca9 citemplate: skip integration testsuites for gstreamer-sharp 
Close #80

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/326>
 2020-07-26 12:25:55 +00:00
Jordan Petridis c44f415a4b citemplate: make it so docker builds only run for detached pipelines 
Currently, if you have a MR open, there 2 pipelines being
triggered. One normal, and one detached.

Previously, if you were to rebuild an image, the jobs of the
docker build stage would be executed concurrently, race
and end up both rebuilding the image.

Make them manual for normal pipelines to avoid such occurrence
and waste of resources.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/320>
 2020-07-26 09:57:43 +00:00
Jordan Petridis fe54d6d8cd citemplate: properly pin the image of the docs job 
we don't need the image to be copied or rebuilt, as
its currently pinned shortly and won't change anytime soon.

ammends dc48666742 !324

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/325>
 2020-07-24 18:54:50 +03:00
Jordan Petridis dc48666742 citemplate: revert the docs job to the previous image build 
The update to f31 from !271 triggered an error in hotdoc it seems,
so rollback for now till we figure it out.

https://gitlab.freedesktop.org/gdesmott/gst-plugins-base/-/jobs/3764215

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/324>
 2020-07-23 15:19:46 +03:00
Jordan Petridis a892850eb2 docker/fedora: update base to fedora 31 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/271>
 2020-07-23 06:58:10 +00:00
Nirbheek Chauhan af11a2cd52 gitlab: Support android tarballs compressed with xz 
Needed for
https://gitlab.freedesktop.org/gstreamer/cerbero/-/merge_requests/540.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/322>
 2020-07-11 01:28:37 +05:30
Mathieu Duponchelle 13c2d964da gitlab: update hotdoc 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/321>
 2020-07-10 01:09:26 +02:00
Jordan Petridis 4fd36e5d73 docker/fedora: add gtest to get openh264 to build again 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/315>
 2020-07-03 16:38:46 +03:00
Matthew Waters 3f6395c2e9 gst-build: only enable werror for gst recipes 
It may throws various warning that are treated as errors for other
repositories

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/171>
 2020-07-03 15:20:30 +03:00
Jordan Petridis a5135b1596 citemplate: use the default keyword for our global policy 
It was introduced in a recentish release along with pipelines
for merge requests, but it required the use of rules.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Jordan Petridis d57693328b citemplate: avoid the need to upgrade buildah in docker build 
We only need the newer version from the image, to support
the --arch arg, but we don't really use it yet so we
could live without it.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Jordan Petridis f5569ad5dc citemplate: run check in gst-examples but not integration tests 
gst-example contains tests for check but not integrations suite

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Jordan Petridis e18eb064c1 citemplate: run the docs job in more modules 
Needed to catch regressions in the docs cache files.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Jordan Petridis efdb7c545c citemplate: slightly improve logging of docker build jobs 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Guillaume Desmottes dbc4ca1b2f ci: use gst-indent from docker image 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/318>
 2020-07-03 09:47:27 +00:00
Thibault Saunier b6ccc2169f gitlab: Update hotdoc 2020-07-02 18:09:32 +02:00
Mathieu Duponchelle 51d0c73074 ci_template: update hotdoc 2020-07-01 19:02:38 +02:00
Nirbheek Chauhan 70f6af0e81 msys2: Fix pacman update 
Match the official steps by MSYS2 upstream for updating on CI:

https://github.com/msys2/setup-msys2/blob/master/main.js#L98

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/317>
 2020-06-30 18:17:07 +05:30
Jordan Petridis e94919137c citemplate: check if the gitlab registry is enabled on the fork 
If its not CI_REGISTRY_IMAGE will be null and break the job.
Instead paste a helpful message with the documentation on how
to enable the registry.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/316>
 2020-06-30 00:12:45 +03:00
Jordan Petridis 41e979e1e4 citemplate: remove tag restriction for docker builds jobs 
There isn't anything particular that needs to be on the gstreamer
runners, and the other shared runners should be able to handle
them fine.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/314>
 2020-06-29 15:43:31 +00:00
Guillaume Desmottes 0a085866ae docker: move gst-indent script into docker image 
This script is now very stable, so downloading it everytime is no longer useful.
It can also helps avoid network errors when running ci jobs.

Fix #70

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/306>
 2020-06-29 17:12:00 +03:00
Jordan Petridis 5c490de1bd citemplate: also check the forked registry for image builds 
In case you are developing a set of changes in a module, in
conjunction with a branch in gst-ci, you will end up with
a template with a different tag than the upstream repo, which
will be refferencing your gst-ci forked registry.

But that image won't existin in the namespace the
module would be running at, so we need to copy it from there.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
 2020-06-26 12:14:28 +00:00
Jordan Petridis 3a004f7ca4 citemplate: use the fd.o pre existing buildah image to build containers 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
 2020-06-26 12:14:28 +00:00
Jordan Petridis cece45eacb ci_template: merge docker builds into the normal pipeline 
Port the build docker jobs to the template and integrate it into
the pipeline. Then change the image uris to the new system,
and the user forked registries.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
 2020-06-26 12:14:28 +00:00
Jordan Petridis fe959679b8 .gitlab-ci.yml: adapt the docker build jobs to be more like citemplates 
This is the inital step towards migrating our docker images setup
to something closer and eventually freedesktop/citemplates [1]

The idea is that jobs always run from the registry in your fork. If the
image sha/id matches the one from the upstream registry, its copied
over else a new one is build, pushed and tested.

Only change the fedora job for now while testing.

[1]: https://gitlab.freedesktop.org/freedesktop/ci-templates

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/308>
 2020-06-26 12:14:28 +00:00
Thibault Saunier 592124a46b gitlab: Update hotdoc 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/312>
 2020-06-25 19:05:19 -04:00
Thibault Saunier f9881240ae gitlab: Update hotdoc to 0.12.2 
Adding Since markers check

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/310>
 2020-06-23 18:03:04 -04:00
Thibault Saunier 78577cffaf ci: Update to hotdoc 2020-06-23 14:20:48 -04:00
Jordan Petridis 7beb52a6e0 citemplate: upate the cerbero image 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/307>
 2020-06-18 11:54:47 +03:00
Nicolas Dufresne f0eea49641 CI: Combine deps and build for cerbero builds 
This change combine the deps and the build step when running cerbero CI in
cerbero repository itself. This removes avoidable usage of large artifacts.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/303>
 2020-06-17 13:28:44 +00:00
Jordan Petridis 869fa72595 docker/windows: update msys snapshot 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/297>
 2020-06-16 01:54:02 +05:30
Thibault Saunier e4ba926955 gitlab: Enforce documentation cache updates 2020-06-08 13:58:25 +00:00
Thibault Saunier 3a620ac384 ci: Update fedora image 2020-06-04 12:48:31 -04:00
Thibault Saunier d72551ddc4 gitlab: Update hotdoc to latest release 2020-06-04 12:34:15 -04:00
Mathieu Duponchelle 1f07629c3c ci_template: pin hotdoc to pre fundamental documentation 2020-06-04 17:56:00 +02:00
Mathieu Duponchelle 5455320869 ci_template: pin hotdoc to pre gst cache format change 2020-06-04 17:29:49 +02:00
Thibault Saunier 3839f8ab87 gitlab: Enable docs only when building the doc 2020-06-03 22:39:33 -04:00
Jordan Petridis dbe39079ee ci_template: windows: clone the gst-build specified in the manifest 
In all our other builds, we are using the clone_manifest_ref script
to fetch the revision of gst-build that we discover in the manifest.
For the windows job this was missed it seems, but didn't cause
any issues till now cause it only affected the gst-build MRs.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/296>
 2020-06-02 11:13:09 +03:00
Thibault Saunier 929a611889 ci: Check valgrind for all modules on gst-devtools 
Now that we have [`gst-tester`] all module are starting to be tested
with `gst-validate` (core and -base already have validate based unit
tests) so we need to ensure that changes there do not break those
modules.

[gst-tester]: https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/461

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/294>
 2020-05-29 22:19:14 +00:00
Tim-Philipp Müller 92b78216d4 ci_template: update cerbero build-deps for gst-validate -> gst-devtools-1.0 rename 
https://gitlab.freedesktop.org/gstreamer/gst-devtools/-/merge_requests/199
https://gitlab.freedesktop.org/gstreamer/cerbero/-/merge_requests/490

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/295>
 2020-05-29 13:05:02 +01:00
Stéphane Cerveau 0928a89125 gst-omx: update vcu-omx-il public release branch 
Use release 2020.01 for the xilinx zynq target
from https://github.com/Xilinx/vcu-omx-il

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/293>
 2020-05-21 15:40:27 +02:00
Matthew Waters 95b35ceaf1 android: update to gradle 5.6.4 without --no-search-upwards 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/291>
 2020-05-09 00:04:23 +10:00
Matthew Waters c23bdae050 ci: run CI for the new vulkan android example 
HACK: pointing to user repo
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/291>
 2020-05-09 00:04:17 +10:00
Jordan Petridis 6576f2f7b7 ci_template: try harder to cleanup after build jobs 
Let's try extra hard to clean after ourselves, cause gitlab-runner
occasionally decides to reuse existing, polluted, volumes...

so much for clean build environments...

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/288>
 2020-04-27 15:39:45 +03:00
Jordan Petridis 2f504610b3 ci_tepmlate: disable the msys job again 
Its still broken and keeps haning randomly... 😢️

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/284>
 2020-04-23 16:59:24 +03:00
Jordan Petridis f546834e6c ci_template: enable the windows x86 and msys native jobs again 
Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/281>
 2020-04-23 07:57:02 +00:00
Jordan Petridis b36d813f5b ci_template: don't use prebuilt binaries for test jobs 
Previously we were optimizing for cpu time, so we where building
gst-build once and then exporting that to be used by the test jobs.
However this meant that we where uploading 200mb (previously 600mb)
zipped of artifacts and then re-downloading them for each test job.
This caused big costs in terms of cloud egress since the runners
aren't hosted on the same cloud as the storage/artifacts instance.

Instead we are going to be rebuilding gst-build for each test
job from now, it also doesn't take more time than the network
i/o would of downloading the artifacts, so the impact of rebuilding
shouldn't be noticebly.

We are also using pinned git refs the modules we rebuild from
the manifest, so the binaries should be reproducible for the most
part (minus things like .pyc files).

Close #68

Part-of: <https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/280>
 2020-04-22 09:23:18 +03:00
Nicolas Dufresne 95f9b25683 ci: Always allow redirect when using curl 
This done by specifying -L parameter. Some of the FDO infrastructure is using
redirect.
 2020-04-19 14:30:43 -04:00
Jordan Petridis 815976e4aa
ci_template: avoid exporting the mediafiles into build artifacts 
Previously we where accidently exporting the whole repo of
gst-integration-testsuites which includes 350mb of raw media
files and made the artifacts storage explode through the roof
along with the CI bills fd.o had to pay for uploading and
redownloading the artifacts

To deal with this, we clean all the media files from the builddir
and when needed we copy them over from the cache in the docker image,
and then git fetch the repo.

Close #69
 2020-04-17 22:46:34 +03:00
Jordan Petridis 7676363645
ci_template: avoid building libnice tests and examples in the subproject 
We don't run the libnice testsuite, and when binaries are built
they consume ~45mb of space. This increases the size of the artifacts
we export from the gst-build job for the testsuite and drives up
the storage and bandwith costs when re-downloading the artifacts.

Similary disable the test targets of couple other subprojects as well
 2020-04-17 21:59:10 +03:00
Nicolas Dufresne 8cb3a84d97 Don't let marge run post-merge pipeline 
This is a small regression from previous change.
 2020-04-17 13:48:18 -04:00
Jordan Petridis 26c45d6ca3 clone_manifest_ref: add the ability to fetch instead of cloning the repo 2020-04-17 05:30:01 +00:00
Nicolas Dufresne d692406ab1 ci: Let Marge the merge bot trigger our CI 
We have notice that a lot of CI activity is cause by user pushing to their
branch after having created an MR. To reduce our CI foot-print, the CI will
now only be automatically triggered when a reviewer assign the MR to the merge
bot. It will still be possible to run the CI manually but the result of that
CI won't be used by Marge.
 2020-04-16 13:04:31 -04:00
Jordan Petridis 2871b293e1
ci_template: reduce the size of exported artifacts in gst-build jobs 
This is initial work looking over the deps subprojects and
cleaning up the low hanging fruits. Saves about 90mb compressed.
 2020-04-10 21:57:45 +03:00
Jordan Petridis 42830e91f6
windows: udpate the docker image 
This is a rebuild of the image to acount for an issue
with a security update during February 2020

https://support.microsoft.com/en-us/help/4542617/you-might-encounter-issues-when-using-windows-server-containers-with-t

This also means we can drop the gstreamer-windows tag
that was added in 32c91139a4
 2020-04-07 18:55:56 +03:00
Matthew Waters 45d4e8ebc0 Update cerbero and android docker images 
Partial revert of 9ed6305e1f

For post-merge of android ndk-21 as part of:
https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/266
https://gitlab.freedesktop.org/gstreamer/cerbero/-/merge_requests/463
 2020-04-06 21:52:59 +10:00
Matthew Waters 9ed6305e1f docker/cerbero: checkout proposed ndk-21 cerbero branch 2020-04-06 11:50:21 +10:00
Nicolas Dufresne e137093def ci: Update to use new external storage for cerbero deps 
The goal of this change is to reduce egress on the FDO servers.
 2020-04-03 16:31:45 -04:00
Matthew Waters b00c68e69e gitlab: don't upload gst-build artifacts we never use 2020-04-02 23:42:41 +11:00
Matthew Waters 18f285f15c gitlab: compress deps using xz on master 
Results in a better compression for artifacts that are going to be used
multiple times.
 2020-03-31 13:30:22 +11:00
Nirbheek Chauhan 6c379762c2 gst-build: Disabling uploading of artifacts for now 
It seems to be timing out with high frequency only on Windows runners.

```
Version:      12.8.0
00:47
Git revision: 1b659122
Git branch:   12-8-stable
GO version:   go1.13.7
Built:        2020-02-22T03:03:07+0000
OS/Arch:      windows/amd64
Uploading artifacts...
gst-build/build/meson-logs/: found 2 matching files
WARNING: Failed to load system CertPool: crypto/x509: system root pool is not available on Windows
ERROR: Job failed (system failure): aborted: <nil>
```

See: https://gitlab.freedesktop.org/gstreamer/gst-ci/-/merge_requests/261
 2020-03-28 16:34:03 +05:30
Seungha Yang e0544b256f ci_template: Increase timeout of -good valgrind 
splitmux unit test includes encoding task which might require more time
to finish test
 2020-03-28 18:15:47 +09:00
Nirbheek Chauhan a5686ae478 gst-build: Disable vs2017 x86 job too 
This might be related to the same issue described in the previous
commit: Till we can update the container image to the Feb 11 security
update, x86 executables and in general the container image will behave
badly because of:

https://support.microsoft.com/en-us/help/4542617/you-might-encounter-issues-when-using-windows-server-containers-with-t

vs2017 x86 has been failing with a runner system failure while
uploading artifacts / submitting job status:

```
Uploading artifacts...
gst-build/build/meson-logs/: found 2 matching files
WARNING: Failed to load system CertPool: crypto/x509: system root pool is not available on Windows
ERROR: Job failed (system failure): aborted: <nil>
```

https://gitlab.freedesktop.org/slomo/gst-plugins-good/-/jobs/2084184

Disable it for now.
 2020-03-27 20:54:28 +05:30
Nirbheek Chauhan 32c91139a4 gst-build: Only use gstreamer runners for windows jobs 
Till we can update the container image to the Feb 11 security update,
all x86 executables will crash because of:

https://support.microsoft.com/en-us/help/4542617/you-might-encounter-issues-when-using-windows-server-containers-with-t

So restrict to the gstreamer runners that are running an older Windows
version. For example:

```
subprojects\gstreamer\gst\parse\meson.build:10:0: ERROR: Command
  "c:\python38\python.exe
  C:\builds\thaytan\gst-plugins-good\gst-build\subprojects\gstreamer\gst\parse\get_flex_version.py
  C:\builds\thaytan\gst-plugins-good\gst-build\subprojects\win-flex-bison-binaries\win_flex.exe"
  failed with status 1.
```

https://gitlab.freedesktop.org/thaytan/gst-plugins-good/-/jobs/2066909

```
meson.build:1:0: ERROR: Executables created by c compiler cl are not runnable.
```

https://gitlab.freedesktop.org/nirbheek/gst-ci/-/jobs/2070394
 2020-03-26 19:57:18 +05:30
Nirbheek Chauhan 3d06b08d49 gst-build: Always include meson-logs in the artifacts 
Can't figure out build errors without this.
 2020-03-26 18:56:38 +05:30
Nicolas Dufresne 8ba527416c ci: Re-enable example builds for MR 
As we should still build the examples to make sure they are not broken.

Reported-by: Matthew Waters <matthew@centricular.com>
 2020-03-25 17:22:09 -04:00
Nicolas Dufresne 54d94f7444 ci: Always run CI for gst-docs 
We have an external cron that rely on this to pull and update the doc on the
webpage.

Fixes #64
 2020-03-25 14:36:48 -04:00
Nicolas Dufresne 70ac883275 ci: Remove uneeded cerbero jobs from gst-docs CI 2020-03-25 14:00:20 -04:00
Nicolas Dufresne cf21e723e3 ci: Switch msys2 job to manual 
This will reduce the excessive load on the runners which are having issues
with this job in particuliar. We will revisit when we better understand the
runners issues.
 2020-03-23 15:35:35 -04:00
Nicolas Dufresne a8941a8566 ci: Replace REGEX variables 
Passing regex as variable does not really works, we ended up matching the
regex as a string instead. Replace all REGEX variable with rules: override.
It is longer but more reliable.

Related to !247
Fixes #63
 2020-03-18 09:45:31 -04:00
Guillaume Desmottes bbc624175d ci: disable Rust jobs for now 
They are not reliable enough (#53) and generated artifacts are too big (#61)
so disable them until those issues are solved.

Fix https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/issues/97
 2020-03-18 09:00:17 +01:00
Nicolas Dufresne 21584e4610 ci: Fix gstreamer-full job to run in gst-build 
It was set to gst-omx by accident instead.
 2020-03-17 21:38:34 -04:00