Commit graph

477 commits

Author SHA1 Message Date
Jordan Petridis
c0caae0722 docker/windows: use direct download links from mirrors
Else Invoke-WebRequest gets redirected and ends up downloading
html page. Possibly due to an unkown user-agent? who knows.
2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
21df205069 docker/windows: Download and install MSYS for Cerbero 2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
d8e87dc89a docker/windows: Install CMake for Cerbero 2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
6267810f3a docker/windows: Fix 7zip extract command for MSYS2
-Wait is only needed for Start-Process. Also, explicitly extract the
tar file into C:\ -- don't assume the current directory is C:\
2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
cfb15f47b8 docker/windows: Clarify some MSYS2 install steps 2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
1ae8f6491f docker/windows: Update python, git, and MSYS2
The git update is particularly important because of security
vulnerabilities on Windows related to NTFS.
2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
b722709cad docker/windows: Use load-balancing for sourceforge URLs
Instead of using a specific mirror, which may be slow or might
disappear.
2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
cec8de9054 docker/windows: Install Python to a path without spaces
This is needed for Cerbero since Autotools cannot handle paths to
binaries that have spaces in them.
2020-01-29 17:39:46 +00:00
Nirbheek Chauhan
ddf9f8962f docker/windows: Download Python installer as python3-installer
Having a binary called 'python3' anywhere that might accidentally end
up in PATH is asking for trouble.
2020-01-29 17:39:46 +00:00
Philippe Normand
a86020a9bf
docker/fedora: Install libdav1d
This library is required for the gst-plugins-rs rsdav1d plugin build.
2020-01-29 16:28:59 +02:00
Guillaume Desmottes
8ea2989e0b gitlab: run gst-plugins-rs tests
Fix #46
2020-01-24 11:58:02 +05:30
Guillaume Desmottes
44f421e9e5 gitlab: override 'except' on build rust job
The parent job has an except rule on gst-plugins-rs which was inherited
preventing the job to be run on gst-plugins-rs updates.

Fix #51
2020-01-24 11:31:29 +05:30
Guillaume Desmottes
44c286fffd docker: fedora: install libsodium
Used by a Rust plugin.
2020-01-17 08:49:31 +00:00
Guillaume Desmottes
7fb6c56784 gitlab: move gst-plugins-rs to its own job
Building Rust code is significantly slowing down ci so do it only for
projects which could make gst-plugins-rs regress.
2020-01-17 12:52:03 +05:30
Nicolas Dufresne
9e7b8f9392 CI: integration: Split this test in 4 jobs
That job was the slowest, now each jobs takes about 12 minutes, which
makes it slightly faster then msys2 jobs, and sometime iOS due to low
bandwidth and low availibility of OSX runners.
2020-01-15 10:10:28 -05:00
Guillaume Desmottes
b9c68041b2 gitlab: cache CARGO_HOME in shared cache 2020-01-15 15:10:10 +05:30
Guillaume Desmottes
8e1b1c43c7 gitlab: enable gst-plugins-rs in build fedora jobs 2020-01-13 09:15:11 +05:30
Guillaume Desmottes
5fc211d107 gitlab: don't run gst-plugins-rs tests
They are not working with CI atm, see #46
2020-01-13 09:15:11 +05:30
Nirbheek Chauhan
10326927d5 gitlab-ci: Fix docker tag when pushing image
Missed in https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/213
2020-01-08 23:46:35 +05:30
Guillaume Desmottes
f46a0d33c0 gitlab: build gst-omx with zynq as target
Build just the minimum to be able to build gst-omx with this specific
target.
2020-01-08 10:03:02 +00:00
Nirbheek Chauhan
eedde1884a gitlab-ci.yml: Allow tagging images built on upstream branches
If we're on the gstreamer namespace, we should push all images built
on that namespace to the registry. This is needed to, f.ex., update
the docker image used in stable builds. This is needed for:
https://gitlab.freedesktop.org/gstreamer/cerbero/merge_requests/367
2020-01-07 12:58:21 +05:30
Nirbheek Chauhan
6b09187d21 docker/cerbero: Do not manually install nasm when building image
This is pulled in correctly via cerbero's bootstrap deps now.
2020-01-07 02:37:55 +05:30
Guillaume Desmottes
e41650913e gitlab: disable most jobs for gst-plugins-rs
No need to run jobs which are not building gst-plugins-rs.
2020-01-02 14:03:26 +05:30
Nirbheek Chauhan
d0fbcac3df gitlab/gst-build: Disable building rust plugins
gst-build now includes gst-plugins-rs, but gst-plugins-rs CI does not
run the gst-build CI jobs, so MRs can easily break gst-build CI.

F.ex: https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/merge_requests/186#note_371696

Disable this till that's resolved.
2019-12-25 17:11:17 +05:30
Guillaume Desmottes
d175858bad gitlab: update Fedora image
Include Rust environnement fix.
2019-12-23 14:24:17 +05:30
Guillaume Desmottes
8a85aa6eba docker: export RUSTUP/CARGO_HOME in container
The rust binaries (rustc) needs those variables to be defined to work
properly.
2019-12-23 11:53:22 +05:30
Guillaume Desmottes
2976046506 gitlab: update fedora image
Use image with Rust.
2019-12-20 15:45:17 +05:30
Guillaume Desmottes
af9982cffe docker/fedora: install Rust
Needed to build gst-plugins-rs, see gst-plugins-rs!205
2019-12-20 13:43:40 +05:30
Xavier Claessens
511ffe9fa1 Update fedora image 2019-12-18 13:47:01 -05:00
Xavier Claessens
0b3645f7fd docker/fedora: Update meson to 0.52.1 2019-12-18 10:48:14 -05:00
Eric Marks
f4d335bc8c docker/fedora: Install libcaca and aalib
Add libcaca-devel and aalib-devel to dependencies so that cacasink and
aasink can be built.
2019-12-17 16:30:07 -05:00
Jordan Petridis
51ff579cec
ci_template: limit cerbero jobs to the GStreamer tagged runners
CCache tends to consume a lot of space which taxes heavily some
of the shared runners. Limit the mahcines the job can run
to those were we can ensure they will not have issues with
the storage.
2019-12-11 17:55:59 +02:00
Matthew Waters
aa18f639b5 gitlab: enable ios builds by default
They are small enough now to not impact the overall running time of a CI
pipeline.
2019-12-06 00:53:24 +11:00
Tim-Philipp Müller
926fcc52b9 ci_template: bump timeout for msys2 job 2019-12-05 00:38:15 +00:00
Jordan Petridis
bc7f2feb5b
windows: fix invalid powershell syntax
```
At line:1 char:34
+ cd $env:CI_PROJECT_DIR/gst-build && python git-update --no-interactio ...
+                                  ~~
The token '&&' is not a valid statement separator in this version.
    + CategoryInfo          : ParserError: (:) [], ParentContainsErrorRecordEx
   ception
    + FullyQualifiedErrorId : InvalidEndOfLine
```

This is not bash, but powershell, hue hue hue
2019-12-05 00:59:34 +02:00
Jordan Petridis
5c0ad2facd
ci_template: make sure powershell hard exists on errors
We set the env var as the shell of the image, but looks like
the gitlab runner is overriding that.
2019-12-05 00:59:34 +02:00
Jordan Petridis
b3aa9b5286
windows: Migrate to windows 1809 base
Rebuild the windows docker image against the current ltsc [1]
of server 2019. This requires moving some of the msys setup
to the runner job cause it causes docker build to hang

Switch the job tags so they now use the 1809 runner, instead
of 1607.

Tweak the PATHs in the msys job so bash doesn't complain about
slashes..

Lastly, increase the timeout of the windows jobs, as msys2
installs its deps at runtime

[1] https://docs.microsoft.com/en-us/windows-server/get-started-19/servicing-channels-19
2019-12-04 18:45:22 +02:00
Matthew Waters
9c7c52f5b9 gitlab: build cerbero android/ios for gst-docs examples 2019-12-03 10:37:16 +11:00
Jordan Petridis
626be8a012
ci_template: Increase the timeout of gst-builds more
Need to take into account I/O needed to upload artficats
and download docker images.
2019-12-03 00:53:02 +02:00
Jordan Petridis
d382cb0b75
ci_template: Bump the timeout limit from 10 to 15min for windows 2019-12-01 14:46:27 +02:00
Jordan Petridis
ae90b9a042 ci_template: set per-job timeouts for builds
In case a build gets stuck for whatever reason,
happens from time to time on windows,
try to baild out quickly.

For cerbero builds, set the timeout to 3h which
according to the docs should also be able to
override the project defined timeout
Fix #19

https://docs.gitlab.com/ce/ci/yaml/README.html#timeout
2019-11-28 14:47:13 +00:00
Jordan Petridis
be6d2b4cf2 ci_template: Use a host-mapped volume for the ccache directory
Use hardcoded path for the cache, so it will be shared by
all jobs of all gstreamer projects running on the same runner host. This
should increase the hit rate and decrease the worst case storage used.

Adaptation of https://gitlab.freedesktop.org/mesa/mesa/merge_requests/2818

See https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/120
2019-11-28 10:46:34 +00:00
Matthew Waters
d153e0d7ed update for macos 10.15 making / read-only
We've moved the host cached cerbero directory to /Users/gst-ci/cerbero
instead now.
2019-11-28 14:00:25 +11:00
Jordan Petridis
4b20b2dbb3 ci_template.yml: Update the windows image used 2019-11-26 17:42:14 +00:00
Jordan Petridis
2fadd6e3d0 docker/windows: update the version of various deps we install 2019-11-26 17:42:14 +00:00
Jordan Petridis
3b700eb09a
ci_template: skip unnecessary jobs for gst-integration-testsuites
Close #42
2019-11-22 16:03:52 +02:00
Jordan Petridis
d19360b37e
ci_template: set the TIMEOUT_FACTOR of gst-validate-launcher to 2
We have lots of tests that timeout on the CI due to a high load
of jobs on the CI runners. Let's try giving them a bit more time
and see how its going.
2019-11-19 21:58:43 +02:00
Nirbheek Chauhan
6b48c9c003 ci_template.yml: Use the new docker cerbero-fedora image
This has nasm temporarily added in it using
https://gitlab.freedesktop.org/gstreamer/gst-ci/merge_requests/179
2019-11-10 15:26:48 +05:30
Nirbheek Chauhan
4e93f92783 docker/cerbero: Temporarily add nasm to the system setup
We will later install it as part of the cerbero bootstrap step when
generating the image after
https://gitlab.freedesktop.org/gstreamer/cerbero/merge_requests/320 is
merged.
2019-11-10 04:27:14 +05:30
Jordan Petridis
bd66c756ef
citemplate: Tag test jobs to only run on the dedicated runners
Avoid spreading the jobs on lower power runners which ends
up trippling the execution time of the testsuites and/or timing out.
2019-11-07 11:54:29 +01:00