Jordan Petridis
b335b4416b
build_manifest.py: Silence irrelevant logs
...
The group API querries where removed in 2320cfaf
2018-11-12 16:51:22 +02:00
Jordan Petridis
8fbce56d69
CI: Change the push policy of the docker images
...
If we are in a fork of the project, we would like to be able
to overwrite the `:latest` tag if the registry from any branch
so we won't have to manually overwrite the image tag in the
build/test jobs in the .gitlab-ci.yml file
2018-11-12 15:54:23 +02:00
Jordan Petridis
345afee677
CI: Overwrite the build job from the template
...
Make it so when we build a new image in `gst-ci` it gets
picked up automatically by the job in this repo. For the template
itself we want the images to me be versioned and reproducible.
2018-11-12 15:54:23 +02:00
Nicolas Dufresne
64e3b154cd
gitlab-ci: Only run scripts test on related code
...
Right now we only have one test against build_manifest.py, it
is not needed to run this test if that code haven't changed.
It's really easy to add more file or set a wild card in the
future.
2018-11-10 20:35:10 -05:00
Nicolas Dufresne
ba98b4138a
gitlab-ci: Use quote for "test" stage
...
This is just for consistency, no really needed.
2018-11-10 20:34:21 -05:00
Thibault Saunier
8b34f1e9f6
Also run the main CI template in .gitlab-ci.yml
...
Rename some job otherwise some names where too similare.
2018-11-09 20:45:08 -03:00
Jordan Petridis
6ddb35c3c4
ci_template.yml: Temporarly disable builddir artifact
...
We won't use it till the tests land, and the fd.o runners are
getting overloading causing jobs to fail with 500 error during
artifact upload. [1]
Thus disable this feature temporarly.
[1]: https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/44
2018-11-09 21:29:41 +02:00
Jordan Petridis
ece0ea97bf
Add an initial template of a gitlab-ci config
...
This is meant to be used with the `include:` featrue of gitlab [1]
in order to provide the same CI pipeline for all the gstreamer
modules.
[1] https://docs.gitlab.com/ce/ci/yaml/README.html#include
2018-11-09 16:22:10 +02:00
Edward Hervey
7a51b846f5
build-manifest: Remove reference to anongit
...
And make the gitlab one the "origin"
2018-11-09 14:08:17 +00:00
Jordan Petridis
9e0abc3c3b
docker: Use the upstream registry to build images
2018-11-09 15:05:38 +02:00
Jordan Petridis
dcbd3f91d4
Do not hardcode env variables
2018-11-08 20:50:13 +02:00
Jordan Petridis
17e6d06735
Docker Fedora: Add more dependencies
...
Also make the indentation 4-space widgth and consinstant
2018-11-08 20:50:13 +02:00
Jordan Petridis
d9604ca8d2
Build the docker images and push them to the gitalb registry
2018-11-07 16:15:43 +02:00
Thibault Saunier
2c1531ab57
Remove autotools support and update meson.
...
This simplifies our docker images and we should focus on meson
support for our new CI system!
2018-11-07 16:15:43 +02:00
Thibault Saunier
8ad477eb0e
docker: Add a dockerfile to export test result with allure
...
based on alpine
2018-11-07 16:15:43 +02:00
Thibault Saunier
778359feb8
docker: Add an archlinux dockerfile
2018-11-07 16:15:43 +02:00
Thibault Saunier
fc8b90123d
docker: ubuntu: Update to 18.04
2018-11-07 16:15:43 +02:00
Thibault Saunier
f1ea83a297
docker: fedora: Update to fedora 29
2018-11-07 16:15:43 +02:00
Jordan Petridis
fa20357221
build_manifest.py: remove get_hostname function
...
Not really needed anymore now that it just calls urlparse.
2018-11-06 16:25:53 +02:00
Jordan Petridis
9d637f6694
build_manifest.py: Hardcode the project ids of upstream repos.
...
Since we can't use the group api to query their id, see previous
commit, we are going to hard code the upstream project id for the
time being.
2018-11-06 16:25:53 +02:00
Jordan Petridis
2320cfaffd
build_manifest: Drop the group search for now
...
Since we can't authenticate with the CI_JOB_TOKEN it needs a
workaroud. Currently it falls back to the upstream repo which is
good enough to get us going.
2018-11-05 15:18:38 +02:00
Jordan Petridis
7ff131879b
build_manifest.py: Fix the api querries
...
Previously the script assumed that the best match will be the first
result, but that's not always the case apparently.
2018-11-05 14:41:50 +02:00
Jordan Petridis
39e2ddf788
build_manifest.py: avoid duplicate / in requests
2018-11-05 14:41:50 +02:00
Jordan Petridis
76d38faf20
build_manifest.py: remove request assertion
...
This does indeed brake things
2018-11-05 14:41:50 +02:00
Jordan Petridis
b5b71baddb
build_manifest.py: Prefer a custom token if set
...
In order to be able to query the Gitlab Group API we need to be
authenticated. CI_JOB_TOKEN for public jobs has a non-meaningfull
value which does not actually authenticate the Runner to the
intance.
2018-11-05 14:41:50 +02:00
Jordan Petridis
02b57af288
build_manifest.py: add some basic logging
2018-11-05 14:41:50 +02:00
Jordan Petridis
41a4ca4c8e
build_manifest.py: preserve env vars when running tests
...
pytest will happily run all the tests in the same proccess,
which means if one mutates an environment variable, the change
will bleed to the rest of the tests.
2018-11-05 14:31:52 +02:00
Jordan Petridis
f4d6e7e9c6
build_manifest.py: Avoid duplicating some code
2018-11-05 14:31:52 +02:00
Jordan Petridis
07a1480fc9
build_manifest.py: Avoid making the CI variables global
...
There are half of the variables compared to what was used before,
and now they are only used once so its not needed for them anymore
to be global.
This allows running the tests without needing to pre-define them
in your local environment, since the ones needed are mocked in the
tests code anyway.
2018-11-05 14:31:52 +02:00
Jordan Petridis
0fd632e833
CI: run the build_manifest.py tests
2018-11-05 14:31:52 +02:00
Jordan Petridis
2e2864cde7
build_manifest.py: Properly query the group namepsace
...
Add a function to query groups, so the fallback code will
be functional once gstreamer migrates to gitlab.
2018-11-05 14:31:52 +02:00
Jordan Petridis
490e936dd1
build_manifest.py: Remove an unnecessary if branch
...
I can't think of a scenario where this would be hit, and can't
trigger make the find_reposiroty_sha function return None either.
2018-11-05 14:31:52 +02:00
Jordan Petridis
64c0e6fba3
build_manifest.py: Remove an early exit branch
...
find_repository_sha will conclude to the same result so
we can remove the whole if branch and extra variables
that it needed.
2018-11-05 14:31:52 +02:00
Jordan Petridis
e042a76031
build_manifest.py: Test the find_repository_sha function
2018-11-05 14:31:52 +02:00
Jordan Petridis
412d980b62
build_manifest.py: Handle bad requests
2018-11-05 14:31:52 +02:00
Jordan Petridis
10b1812e70
build_manifest.py: Use more descriprive variable name
2018-11-05 14:31:52 +02:00
Jordan Petridis
45c89ece12
build_manifest.py: Make the needed env vars global variables
2018-11-05 14:31:52 +02:00
Jordan Petridis
17195ea3aa
build_manifest.py: add a failure test case for branches
2018-11-05 14:31:52 +02:00
Jordan Petridis
ea5459e127
build_manifest.py: search user namespaces instead of global
...
Previously find_repository_sha would do a global search of
all the projects in the gitlab instance. This ports it to
use the user namespace endpoint.
Additionally seems like the else: block never worked.
2018-11-05 14:31:52 +02:00
Jordan Petridis
0b9a8b5cac
build_manifest.py: Add a function to search user namespace of projects
...
Also fix a type annotation error in the request functions.
2018-11-05 14:31:52 +02:00
Jordan Petridis
ca9b1362b3
build_manifest.py: Make sure the remote always ends with a slash
...
that's how `git-update` in `gst-build` expects it to be
2018-11-05 14:31:52 +02:00
Jordan Petridis
dc275a204e
build_manifest.py: Query the exact branch needed
2018-11-05 14:31:51 +02:00
Jordan Petridis
7ad193f276
build_manifest.py: Add a FIXME comment
2018-11-05 11:24:12 +02:00
Jordan Petridis
7ede52d7c7
build_manifest.py: Use the project path not the name
...
The project path is what's shown in the url bar, ex
gitlab.example.com/john/gstreamer -> path == gstreamer
The project name is defined in project settings and its just.
Its more common to change the name of a fork than its path.
2018-11-05 11:24:12 +02:00
Jordan Petridis
61c5d7b6cf
build_manifest.py: split the request function in two
...
Make it so it does not depend on env variables so it will be easier
to test.
2018-11-05 11:24:12 +02:00
Jordan Petridis
6772fa76aa
build_manifest.py: Split the hostname resolution from the requests
2018-11-05 11:24:12 +02:00
Jordan Petridis
9c53cd0db0
build_manifest.py: abstract over the gitlab instance base_url
2018-11-05 11:24:12 +02:00
Jordan Petridis
6e77bfb893
build_manifest.py: Use .format instead %s for templates
2018-11-05 11:24:12 +02:00
Jordan Petridis
c457ca0570
build_manifest.py: Use fstrings for string formatting
2018-11-05 11:24:12 +02:00
Jordan Petridis
095c93c62c
build_manifest.py: add type annotations
2018-11-05 11:24:12 +02:00
