51 commits

Author	SHA1	Message	Date
Jordan Petridis	cc5ff7d8f0	CI: Test both the ci_template as well as local changes ... Instead of just overwritting the template build jobs, test both so we avoid regressions. See [1] for more [1] 1858a709e6	2018-11-22 16:26:34 +02:00
Jordan Petridis	bf92771e45	gitlab/ci_template.yml: Use tagged docker image for the manifest job	2018-11-22 13:18:03 +02:00
Jordan Petridis	c930a3a229	gitlab/ci_template.yml: Use correct yaml syntax ... single quotes in yaml don't escape special charters which causes the env variable to never be resolved to its proper path.	2018-11-22 12:55:52 +02:00
Thibault Saunier	01beb70022	gitlab: Update the docker image we use ... so we have latest fix for gst-build git-update script	2018-11-21 21:27:39 -03:00
Thibault Saunier	2414895a53	build_manifest: Add the "path" attribute to projects ... When the local path and the name are different, both have to be specified, it is now required since we add the '.git' to the name.	2018-11-21 20:37:12 -03:00
Thibault Saunier	10ffa6f1af	build_manifest: Add the to repo names to avoid spamming about redirections	2018-11-14 10:55:14 -03:00
Thibault Saunier	10ae6d0326	build_manifest: Never use users 'master' branch for repos we are not explicitely building ... People very often do not update them leading to random and weird failures	2018-11-14 10:55:14 -03:00
Thibault Saunier	d8ebbea1f0	build_manifest: Make sure to respect GitLab currently built SHA	2018-11-14 10:14:08 -03:00
Thibault Saunier	12d067f249	Revert "Revert me when merged" ... This reverts commit 5cff46553e913e5ab13e63561edaa519a4ca904f.	2018-11-13 14:15:41 -03:00
Thibault Saunier	d02fd933d3	Revert me when merged ... Stopping the circular dependency.	2018-11-13 16:51:36 +00:00
Thibault Saunier	0cfe2cee41	gitlab: Handle checking out the right gst-ci branch to call build_manifest	2018-11-13 16:51:36 +00:00
Jordan Petridis	48f3063daf	build_manifest.py: Use CI_PROJECT_NAMESPACE instead of GITLAB_USER ... GITLAB_USER_* variables represent the user *that triggered* the job, which might not match the user that owns the namespace of the fork. This happens frequently with rebase, where the one who triggers the rebase is the one that appears in the GITLAB_USER_* vars. Instead use the CI_PROJECT_NAMESPACE variable to search the user's projects. If CI_PROJECT_NAMESPACE has the value of a Group namespace search_user_namespace returns 404.	2018-11-13 13:20:32 +02:00
Jordan Petridis	e3d2c345b6	ci_template: Update docker image tags	2018-11-12 18:57:42 +02:00
Víctor Manuel Jáquez Leal	1858a709e6	ci_template.yml: enable gstreamer-vaapi	2018-11-12 16:04:13 +00:00
Víctor Manuel Jáquez Leal	d1b80b835b	build_manifest.py: Add gstreamer-vaapi	2018-11-12 16:04:13 +00:00
Jordan Petridis	b335b4416b	build_manifest.py: Silence irrelevant logs ... The group API querries where removed in 2320cfaf but the log was forgotten. The headers print was meant to be just for debugging.	2018-11-12 16:51:22 +02:00
Jordan Petridis	6ddb35c3c4	ci_template.yml: Temporarly disable builddir artifact ... We won't use it till the tests land, and the fd.o runners are getting overloading causing jobs to fail with 500 error during artifact upload. [1] Thus disable this feature temporarly. [1]: https://gitlab.freedesktop.org/freedesktop/freedesktop/issues/44	2018-11-09 21:29:41 +02:00
Jordan Petridis	ece0ea97bf	Add an initial template of a gitlab-ci config ... This is meant to be used with the `include:` featrue of gitlab [1] in order to provide the same CI pipeline for all the gstreamer modules. [1] https://docs.gitlab.com/ce/ci/yaml/README.html#include	2018-11-09 16:22:10 +02:00
Edward Hervey	7a51b846f5	build-manifest: Remove reference to anongit ... And make the gitlab one the "origin"	2018-11-09 14:08:17 +00:00
Jordan Petridis	fa20357221	build_manifest.py: remove get_hostname function ... Not really needed anymore now that it just calls urlparse.	2018-11-06 16:25:53 +02:00
Jordan Petridis	9d637f6694	build_manifest.py: Hardcode the project ids of upstream repos. ... Since we can't use the group api to query their id, see previous commit, we are going to hard code the upstream project id for the time being.	2018-11-06 16:25:53 +02:00
Jordan Petridis	2320cfaffd	build_manifest: Drop the group search for now ... Since we can't authenticate with the CI_JOB_TOKEN it needs a workaroud. Currently it falls back to the upstream repo which is good enough to get us going.	2018-11-05 15:18:38 +02:00
Jordan Petridis	7ff131879b	build_manifest.py: Fix the api querries ... Previously the script assumed that the best match will be the first result, but that's not always the case apparently.	2018-11-05 14:41:50 +02:00
Jordan Petridis	39e2ddf788	build_manifest.py: avoid duplicate / in requests	2018-11-05 14:41:50 +02:00
Jordan Petridis	76d38faf20	build_manifest.py: remove request assertion ... This does indeed brake things	2018-11-05 14:41:50 +02:00
Jordan Petridis	b5b71baddb	build_manifest.py: Prefer a custom token if set ... In order to be able to query the Gitlab Group API we need to be authenticated. CI_JOB_TOKEN for public jobs has a non-meaningfull value which does not actually authenticate the Runner to the intance.	2018-11-05 14:41:50 +02:00
Jordan Petridis	02b57af288	build_manifest.py: add some basic logging	2018-11-05 14:41:50 +02:00
Jordan Petridis	41a4ca4c8e	build_manifest.py: preserve env vars when running tests ... pytest will happily run all the tests in the same proccess, which means if one mutates an environment variable, the change will bleed to the rest of the tests.	2018-11-05 14:31:52 +02:00
Jordan Petridis	f4d6e7e9c6	build_manifest.py: Avoid duplicating some code	2018-11-05 14:31:52 +02:00
Jordan Petridis	07a1480fc9	build_manifest.py: Avoid making the CI variables global ... There are half of the variables compared to what was used before, and now they are only used once so its not needed for them anymore to be global. This allows running the tests without needing to pre-define them in your local environment, since the ones needed are mocked in the tests code anyway.	2018-11-05 14:31:52 +02:00
Jordan Petridis	2e2864cde7	build_manifest.py: Properly query the group namepsace ... Add a function to query groups, so the fallback code will be functional once gstreamer migrates to gitlab.	2018-11-05 14:31:52 +02:00
Jordan Petridis	490e936dd1	build_manifest.py: Remove an unnecessary if branch ... I can't think of a scenario where this would be hit, and can't trigger make the find_reposiroty_sha function return None either.	2018-11-05 14:31:52 +02:00
Jordan Petridis	64c0e6fba3	build_manifest.py: Remove an early exit branch ... find_repository_sha will conclude to the same result so we can remove the whole if branch and extra variables that it needed.	2018-11-05 14:31:52 +02:00
Jordan Petridis	e042a76031	build_manifest.py: Test the find_repository_sha function	2018-11-05 14:31:52 +02:00
Jordan Petridis	412d980b62	build_manifest.py: Handle bad requests	2018-11-05 14:31:52 +02:00
Jordan Petridis	10b1812e70	build_manifest.py: Use more descriprive variable name	2018-11-05 14:31:52 +02:00
Jordan Petridis	45c89ece12	build_manifest.py: Make the needed env vars global variables	2018-11-05 14:31:52 +02:00
Jordan Petridis	17195ea3aa	build_manifest.py: add a failure test case for branches	2018-11-05 14:31:52 +02:00
Jordan Petridis	ea5459e127	build_manifest.py: search user namespaces instead of global ... Previously find_repository_sha would do a global search of all the projects in the gitlab instance. This ports it to use the user namespace endpoint. Additionally seems like the else: block never worked.	2018-11-05 14:31:52 +02:00
Jordan Petridis	0b9a8b5cac	build_manifest.py: Add a function to search user namespace of projects ... Also fix a type annotation error in the request functions.	2018-11-05 14:31:52 +02:00
Jordan Petridis	ca9b1362b3	build_manifest.py: Make sure the remote always ends with a slash ... that's how `git-update` in `gst-build` expects it to be	2018-11-05 14:31:52 +02:00
Jordan Petridis	dc275a204e	build_manifest.py: Query the exact branch needed	2018-11-05 14:31:51 +02:00
Jordan Petridis	7ad193f276	build_manifest.py: Add a FIXME comment	2018-11-05 11:24:12 +02:00
Jordan Petridis	7ede52d7c7	build_manifest.py: Use the project path not the name ... The project path is what's shown in the url bar, ex gitlab.example.com/john/gstreamer -> path == gstreamer The project name is defined in project settings and its just. Its more common to change the name of a fork than its path.	2018-11-05 11:24:12 +02:00
Jordan Petridis	61c5d7b6cf	build_manifest.py: split the request function in two ... Make it so it does not depend on env variables so it will be easier to test.	2018-11-05 11:24:12 +02:00
Jordan Petridis	6772fa76aa	build_manifest.py: Split the hostname resolution from the requests	2018-11-05 11:24:12 +02:00
Jordan Petridis	9c53cd0db0	build_manifest.py: abstract over the gitlab instance base_url	2018-11-05 11:24:12 +02:00
Jordan Petridis	6e77bfb893	build_manifest.py: Use .format instead %s for templates	2018-11-05 11:24:12 +02:00
Jordan Petridis	c457ca0570	build_manifest.py: Use fstrings for string formatting	2018-11-05 11:24:12 +02:00
Jordan Petridis	095c93c62c	build_manifest.py: add type annotations	2018-11-05 11:24:12 +02:00