Jordan Petridis
1c68f94c68
ci_template: another blacklisted test in check
...
gst-plugins-good.elements_rtpbin.test_sender_eos
is occasionally failing.
For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-good/issues/527
2018-12-11 22:57:46 +02:00
Jordan Petridis
f32f70d79b
ci_template: Blacklist another test in check
...
gst-plugins-base.elements_multisocketsink.test_client_next_keyframe
is occasionally failing somehow in the CI.
For more see:
https://gitlab.freedesktop.org/gstreamer/gst-plugins-base/issues/516
2018-12-11 20:33:18 +02:00
Jordan Petridis
5eb652177c
ci_template: do not .test in the cerbero repo
...
We already disable the .build inhereted build jobs, and thus the
tests fail to run since they depend on them. Cerbero doesn't need
to run them anyway.
2018-12-11 13:25:56 +02:00
Jordan Petridis
d25392f3e1
ci_template: Report ccache stats for build jobs
2018-12-10 21:35:38 +02:00
Jordan Petridis
a529757dec
ci_template: blacklist a problematic test in check
...
Also pass --dump-on-failure in the job. While the logs are
artifacts and they are integrated in the MRs, its not as
convinient to findout out what is failling if you are looking
into just a job log, of a commit. Thus make it show logs are also
priting on stdout/stderr.
2018-12-10 20:35:29 +02:00
Jordan Petridis
830507f202
ci_template: Blacklist problematic tests
2018-12-10 17:12:26 +02:00
Jordan Petridis
7151af0270
ci_template.yml: Run the check test suite!!!
...
Add a fedora job that runs the 'check' tests with
gst-validate-launcher. Its fairly well abstracted so the same
template can be used to add the rest of the test-suites fairly
soon.
2018-12-10 14:45:56 +02:00
Jordan Petridis
c9ee22d4c3
Revert "ci_template.yml: Temporarly disable builddir artifact"
...
This reverts commit 6ddb35c3c4
2018-12-10 14:45:56 +02:00
Jordan Petridis
830b24df3e
ci_template: Remove duplicate key
...
Looks like this slipped past the review of !47
2018-12-10 11:50:49 +02:00
Nicolas Dufresne
d399288f15
CI: Enable cerbero builds for all projects
2018-12-09 18:19:06 -05:00
Nicolas Dufresne
00b67289b1
CI: Place cerbero docker image: in the template
...
This avoids having to duplicate that path into cerbero/ project and will
ease later updates.
2018-12-09 16:30:31 -05:00
Nicolas Dufresne
4291812f75
CI: Add cerbero docker SHA
...
No job activated yet.
2018-12-09 15:32:28 -05:00
Nicolas Dufresne
d19082b726
gitlab: Limit cerbero ccache to 1.7G
...
Testing showed that we need 1.6G to store all the objects. This limit
will prevent the cache from growing over time. Compressing the cache
can take a lot of time.
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
fcbfb3dc68
gitlab: Use cache key for cerbero builds
...
The key is set to cerbero_${ARCH}. This should help maintain a smaller
cache size and will avoid other jobs from overriding our cerbero-sources
cache.
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
e2595530ad
gitlab: Don't build gst-build in cerbero repository
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
d7322403f2
gitlab: Add orc and cerbero to manifest
2018-12-09 19:12:07 +00:00
Nicolas Dufresne
b1e3b9e6ab
gitlab: Add cerbero build template and x86_64 build
2018-12-09 19:12:07 +00:00
Jordan Petridis
932a9c2137
ci_template: Use a cache key specific to each job
2018-12-09 04:34:35 +02:00
Thibault Saunier
5856b05f30
build_manifest: fetch remote refname before checking out right commit
...
Working around https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/95
2018-12-06 07:23:30 -03:00
Thibault Saunier
7cb3feec19
build_manifest: Include remote refname in the manifest
2018-12-06 07:23:30 -03:00
Thibault Saunier
8932df0c2d
buildmanifest: Move away from the gitlab API and use plain git to retrieve branch names
...
Makes the code much simpler
2018-12-06 00:09:17 -03:00
Jan Alexander Steffens (heftig)
4493ab0bb8
ci_template: Use git diff --quiet for checking for changes
...
Checking the exit code of git diff --quiet is preferred over looking
whether git diff produces any output.
2018-12-05 22:26:07 +01:00
Jan Alexander Steffens (heftig)
5b664cd00f
ci_template: Don't use command substitution with find
...
GNU find has operations like -exec and -delete that operate without the
brittleness of applying shell word splitting to its output.
In addition, it won't fail if no files were matched.
2018-12-05 22:26:07 +01:00
Jordan Petridis
9e8d215f90
ci_template: Add a gst-indent job
2018-12-03 17:39:09 +02:00
Nicolas Dufresne
597544cd61
build_manifest: Increase the number of search results
...
This increase the number of search results when looking up user
branches to 100 items. This should be sufficient for all of our users.
Fixes #3
2018-12-01 11:33:44 -05:00
Jordan Petridis
06c76e1d63
CI: Update image uris
2018-12-01 15:20:38 +02:00
Xavier Claessens
e89c402e14
Update docker images to latest
2018-11-28 13:39:16 -05:00
Jordan Petridis
f085d34a32
docker: Move android into a unified image
2018-11-27 16:07:57 +02:00
Tim-Philipp Müller
ed9ae8bb2b
ci-template: build with --werror by default
2018-11-25 23:26:20 +00:00
Thibault Saunier
5321d73fa9
Add a script to import the GStreamer documentation inside the fdo server
2018-11-25 13:47:49 -03:00
Jordan Petridis
e89fad1455
gitlab/ci_template.yml: rework the CI stages
...
Idea is that in order to not consume many resources for broken
builds, we will have a basic stage where just one simple set of
build and test jobs is run. If that passes we will continue with
the rest of the Pipeline suite.
2018-11-23 20:48:54 +02:00
Jordan Petridis
2bb429bbf0
gitlab/ci_template.yml: add dependencies block to the .build template
2018-11-23 19:05:12 +02:00
Jordan Petridis
67fcaad29e
Revert "Avoid duplication between ci_template.yml and .gitlab-ci.yml"
...
This reverts commit 6bdd1ead996bdd1ead99 (note_81275)
2018-11-23 19:05:12 +02:00
Xavier Claessens
6bdd1ead99
Avoid duplication between ci_template.yml and .gitlab-ci.yml
2018-11-22 16:51:31 -05:00
Xavier Claessens
1f326e2693
Add Android arm64 cross build
2018-11-22 14:59:35 -05:00
Xavier Claessens
68a71431b8
Build Ubuntu base image
2018-11-22 13:24:26 -05:00
Jordan Petridis
cc5ff7d8f0
CI: Test both the ci_template as well as local changes
...
Instead of just overwritting the template build jobs, test both
so we avoid regressions.
See [1] for more
[1] 1858a709e6
2018-11-22 16:26:34 +02:00
Jordan Petridis
bf92771e45
gitlab/ci_template.yml: Use tagged docker image for the manifest job
2018-11-22 13:18:03 +02:00
Jordan Petridis
c930a3a229
gitlab/ci_template.yml: Use correct yaml syntax
...
single quotes in yaml don't escape special charters which
causes the env variable to never be resolved to its proper path.
2018-11-22 12:55:52 +02:00
Thibault Saunier
01beb70022
gitlab: Update the docker image we use
...
so we have latest fix for gst-build git-update script
2018-11-21 21:27:39 -03:00
Thibault Saunier
2414895a53
build_manifest: Add the "path" attribute to projects
...
When the local path and the name are different, both have to be
specified, it is now required since we add the '.git' to the name.
2018-11-21 20:37:12 -03:00
Thibault Saunier
10ffa6f1af
build_manifest: Add the to repo names to avoid spamming about redirections
2018-11-14 10:55:14 -03:00
Thibault Saunier
10ae6d0326
build_manifest: Never use users 'master' branch for repos we are not explicitely building
...
People very often do not update them leading to random and weird failures
2018-11-14 10:55:14 -03:00
Thibault Saunier
d8ebbea1f0
build_manifest: Make sure to respect GitLab currently built SHA
2018-11-14 10:14:08 -03:00
Thibault Saunier
12d067f249
Revert "Revert me when merged"
...
This reverts commit 5cff46553e913e5ab13e63561edaa519a4ca904f.
2018-11-13 14:15:41 -03:00
Thibault Saunier
d02fd933d3
Revert me when merged
...
Stopping the circular dependency.
2018-11-13 16:51:36 +00:00
Thibault Saunier
0cfe2cee41
gitlab: Handle checking out the right gst-ci branch to call build_manifest
2018-11-13 16:51:36 +00:00
Jordan Petridis
48f3063daf
build_manifest.py: Use CI_PROJECT_NAMESPACE instead of GITLAB_USER
...
GITLAB_USER_* variables represent the user *that triggered* the job,
which might not match the user that owns the namespace of the fork.
This happens frequently with rebase, where the one who triggers the
rebase is the one that appears in the GITLAB_USER_* vars.
Instead use the CI_PROJECT_NAMESPACE variable to search the user's
projects. If CI_PROJECT_NAMESPACE has the value of a Group namespace
search_user_namespace returns 404.
2018-11-13 13:20:32 +02:00
Jordan Petridis
e3d2c345b6
ci_template: Update docker image tags
2018-11-12 18:57:42 +02:00
Víctor Manuel Jáquez Leal
1858a709e6
ci_template.yml: enable gstreamer-vaapi
2018-11-12 16:04:13 +00:00
Víctor Manuel Jáquez Leal
d1b80b835b
build_manifest.py: Add gstreamer-vaapi
2018-11-12 16:04:13 +00:00
Jordan Petridis
b335b4416b
build_manifest.py: Silence irrelevant logs
...
The group API querries where removed in 2320cfaf
2018-11-12 16:51:22 +02:00
Jordan Petridis
6ddb35c3c4
ci_template.yml: Temporarly disable builddir artifact
...
We won't use it till the tests land, and the fd.o runners are
getting overloading causing jobs to fail with 500 error during
artifact upload. [1]
Thus disable this feature temporarly.
[1]: https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/44
2018-11-09 21:29:41 +02:00
Jordan Petridis
ece0ea97bf
Add an initial template of a gitlab-ci config
...
This is meant to be used with the `include:` featrue of gitlab [1]
in order to provide the same CI pipeline for all the gstreamer
modules.
[1] https://docs.gitlab.com/ce/ci/yaml/README.html#include
2018-11-09 16:22:10 +02:00
Edward Hervey
7a51b846f5
build-manifest: Remove reference to anongit
...
And make the gitlab one the "origin"
2018-11-09 14:08:17 +00:00
Jordan Petridis
fa20357221
build_manifest.py: remove get_hostname function
...
Not really needed anymore now that it just calls urlparse.
2018-11-06 16:25:53 +02:00
Jordan Petridis
9d637f6694
build_manifest.py: Hardcode the project ids of upstream repos.
...
Since we can't use the group api to query their id, see previous
commit, we are going to hard code the upstream project id for the
time being.
2018-11-06 16:25:53 +02:00
Jordan Petridis
2320cfaffd
build_manifest: Drop the group search for now
...
Since we can't authenticate with the CI_JOB_TOKEN it needs a
workaroud. Currently it falls back to the upstream repo which is
good enough to get us going.
2018-11-05 15:18:38 +02:00
Jordan Petridis
7ff131879b
build_manifest.py: Fix the api querries
...
Previously the script assumed that the best match will be the first
result, but that's not always the case apparently.
2018-11-05 14:41:50 +02:00
Jordan Petridis
39e2ddf788
build_manifest.py: avoid duplicate / in requests
2018-11-05 14:41:50 +02:00
Jordan Petridis
76d38faf20
build_manifest.py: remove request assertion
...
This does indeed brake things
2018-11-05 14:41:50 +02:00
Jordan Petridis
b5b71baddb
build_manifest.py: Prefer a custom token if set
...
In order to be able to query the Gitlab Group API we need to be
authenticated. CI_JOB_TOKEN for public jobs has a non-meaningfull
value which does not actually authenticate the Runner to the
intance.
2018-11-05 14:41:50 +02:00
Jordan Petridis
02b57af288
build_manifest.py: add some basic logging
2018-11-05 14:41:50 +02:00
Jordan Petridis
41a4ca4c8e
build_manifest.py: preserve env vars when running tests
...
pytest will happily run all the tests in the same proccess,
which means if one mutates an environment variable, the change
will bleed to the rest of the tests.
2018-11-05 14:31:52 +02:00
Jordan Petridis
f4d6e7e9c6
build_manifest.py: Avoid duplicating some code
2018-11-05 14:31:52 +02:00
Jordan Petridis
07a1480fc9
build_manifest.py: Avoid making the CI variables global
...
There are half of the variables compared to what was used before,
and now they are only used once so its not needed for them anymore
to be global.
This allows running the tests without needing to pre-define them
in your local environment, since the ones needed are mocked in the
tests code anyway.
2018-11-05 14:31:52 +02:00
Jordan Petridis
2e2864cde7
build_manifest.py: Properly query the group namepsace
...
Add a function to query groups, so the fallback code will
be functional once gstreamer migrates to gitlab.
2018-11-05 14:31:52 +02:00
Jordan Petridis
490e936dd1
build_manifest.py: Remove an unnecessary if branch
...
I can't think of a scenario where this would be hit, and can't
trigger make the find_reposiroty_sha function return None either.
2018-11-05 14:31:52 +02:00
Jordan Petridis
64c0e6fba3
build_manifest.py: Remove an early exit branch
...
find_repository_sha will conclude to the same result so
we can remove the whole if branch and extra variables
that it needed.
2018-11-05 14:31:52 +02:00
Jordan Petridis
e042a76031
build_manifest.py: Test the find_repository_sha function
2018-11-05 14:31:52 +02:00
Jordan Petridis
412d980b62
build_manifest.py: Handle bad requests
2018-11-05 14:31:52 +02:00
Jordan Petridis
10b1812e70
build_manifest.py: Use more descriprive variable name
2018-11-05 14:31:52 +02:00
Jordan Petridis
45c89ece12
build_manifest.py: Make the needed env vars global variables
2018-11-05 14:31:52 +02:00
Jordan Petridis
17195ea3aa
build_manifest.py: add a failure test case for branches
2018-11-05 14:31:52 +02:00
Jordan Petridis
ea5459e127
build_manifest.py: search user namespaces instead of global
...
Previously find_repository_sha would do a global search of
all the projects in the gitlab instance. This ports it to
use the user namespace endpoint.
Additionally seems like the else: block never worked.
2018-11-05 14:31:52 +02:00
Jordan Petridis
0b9a8b5cac
build_manifest.py: Add a function to search user namespace of projects
...
Also fix a type annotation error in the request functions.
2018-11-05 14:31:52 +02:00
Jordan Petridis
ca9b1362b3
build_manifest.py: Make sure the remote always ends with a slash
...
that's how `git-update` in `gst-build` expects it to be
2018-11-05 14:31:52 +02:00
Jordan Petridis
dc275a204e
build_manifest.py: Query the exact branch needed
2018-11-05 14:31:51 +02:00
Jordan Petridis
7ad193f276
build_manifest.py: Add a FIXME comment
2018-11-05 11:24:12 +02:00
Jordan Petridis
7ede52d7c7
build_manifest.py: Use the project path not the name
...
The project path is what's shown in the url bar, ex
gitlab.example.com/john/gstreamer -> path == gstreamer
The project name is defined in project settings and its just.
Its more common to change the name of a fork than its path.
2018-11-05 11:24:12 +02:00
Jordan Petridis
61c5d7b6cf
build_manifest.py: split the request function in two
...
Make it so it does not depend on env variables so it will be easier
to test.
2018-11-05 11:24:12 +02:00
Jordan Petridis
6772fa76aa
build_manifest.py: Split the hostname resolution from the requests
2018-11-05 11:24:12 +02:00
Jordan Petridis
9c53cd0db0
build_manifest.py: abstract over the gitlab instance base_url
2018-11-05 11:24:12 +02:00
Jordan Petridis
6e77bfb893
build_manifest.py: Use .format instead %s for templates
2018-11-05 11:24:12 +02:00
Jordan Petridis
c457ca0570
build_manifest.py: Use fstrings for string formatting
2018-11-05 11:24:12 +02:00
Jordan Petridis
095c93c62c
build_manifest.py: add type annotations
2018-11-05 11:24:12 +02:00
Thibault Saunier
a080432a32
gitlab: Add a script to build manifest from a gitlab CI context
2018-10-26 16:36:20 +03:00
