mirrors/woodpecker
1
0
Fork 0
mirror of https://github.com/woodpecker-ci/woodpecker.git synced 2024-11-19 00:11:16 +00:00
Code Issues Projects Releases Wiki Activity
4744 commits 21 branches 74 tags 147 MiB
Commit graph

182 commits

Author SHA1 Message Date
Anbraten
e269890643
Allow multiple when conditions (#1087) 
Co-authored-by: 6543 <6543@obermui.de>
Co-authored-by: LamaAni <zshotan@bloomberg.net>
 2022-08-14 19:32:49 +02:00
Florian Märkl
7031904dbe
Wait to finish reading logs before calling Wait() on pipeline (#1010) 
This fixes errors like the following and chopped off logs ...
 2022-07-31 17:12:15 +02:00
6543
1e8d4cc455
Update jsonschema and pipeline linting 2022-07-19 15:09:39 +02:00
6543
d2556a0613
Update jsonschema and define "services" (#1036) 
Co-authored-by: Anbraten <anton@ju60.de>
 2022-07-19 15:01:36 +02:00
6543
69ec44075c
Let single line command be a single command (#1009) 
* rm go-shlex usage

* update
 2022-07-19 07:20:27 +02:00
6543
8da0ee47f7
Use variables in pipeline (#1026) 
use yaml aliases (https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases) to have pipeline `variables`

Co-authored-by: qwerty287 <80460567+qwerty287@users.noreply.github.com>
Co-authored-by: Anbraten <anton@ju60.de>
 2022-07-17 18:25:56 +02:00
6543
31bad81979
Use external lib to convert yaml to json (#1028) 
this move shared/yml/* into an independent lib
 2022-07-17 17:23:31 +02:00
Florian Märkl
4879e922c1
Avoid calling /bin/env in local backend (#1011) 
/bin/env was used to resolve a command name against PATH and pass
additional environment variables.
All of this can also be achieved using functionality already provided by
go's exec lib, which will then internally pass the appropriate arguments
to e.g. execve.
 2022-07-04 20:27:17 +02:00
Florian Märkl
061596d802
Gracefully handle non-zero exit code in local backend (#1002) 
A non-zero exit code signifies a pipeline failure, but is not a fatal error in the agent.
Since exec reports this as exec.ExitError, this has to be handled explicitly.
This also fixes logs not being shown on build errors.
 2022-07-02 15:56:08 +02:00
6543
9449b67da9
fix regression from 81dcdea2be (missmatch) 2022-06-16 23:11:27 +02:00
6543
068063655b
Make pipeline runtime log with description (#970) 
* introduce runtime descriptors to pipeline runtime

* nit return orig error at traceStep()

* more logging

* refactor

Co-authored-by: Zav Shotan <zshotan@bloomberg.net>
 2022-06-15 18:11:20 +02:00
Zav Shotan
81dcdea2be
Add support for steps to be a list (instead of dict) (#826) 
- Support for pipeline/containers as list
- Support for container name in logs (step.Name)

Co-authored-by: Zav Shotan <zshotan@bloomberg.net>
Co-authored-by: 6543 <6543@obermui.de>
 2022-06-13 23:13:09 +02:00
Arno Hautala
cdbba4c306
fix run_on references with runs_on in docs (#965) 2022-06-10 05:44:26 +02:00
Anbraten
e79ad00826
Add agent tagging / filtering for pipelines (#902) 
Officially support labels for pipelines and agents to improve pipeline picking. 

* add pipeline labels
* update, improve docs  and add migration
* update proto file

---
closes #304 & #860
 2022-05-31 01:12:18 +02:00
6543
e2e094cfda
Revert "Do not run clone step if no pipeline step will run (#877)" 
This reverts commit f05f918b8d.
 2022-05-20 05:20:17 +02:00
qwerty287
f05f918b8d
Do not run clone step if no pipeline step will run (#877) 
Skip the clone step and ignore hook/pipeline if no pipeline step except clone would run. The status reported back to the forge is `success`.

Closes https://github.com/woodpecker-ci/woodpecker/issues/778
 2022-05-18 23:25:14 +02:00
6543
7cf5a1545e
Drop deprecated environment vars (#920) 2022-05-17 17:26:35 +02:00
6543
4136df7551
Drop VarArgs in steps in favour of settings (#919) 
* drop VarArgs in steps in favour of settings
* update unit tests
 2022-05-17 16:43:05 +02:00
qwerty287
687d57217d
Fix branch condition on tags (#917) 
* Fix branch condition on tags

* Add docs

* Update docs/docs/20-usage/20-pipeline-syntax.md

Co-authored-by: Anbraten <anton@ju60.de>
 2022-05-16 20:04:00 +02:00
Zav Shotan
acbcc53872
Added support for step errors when executing backend (#817) 
When executing a backend step, in case of failure of the specific step, the run is marked as errored but the step error is missing.

Added:
1. Log for the backend error (without trace)
2. Mark the step as errored with exit code 126 (Could not execute).

Co-authored-by: Zav Shotan <zshotan@bloomberg.net>
Co-authored-by: Anton Bracke <anton@ju60.de>
 2022-05-11 13:40:44 +02:00
Anbraten
62a1fd8dcb
Add support to define a custom docker network and enable docker ipv6 (#893) 
- Add support to define a custom docker network and enable docker ipv6
- Adjust docs
 2022-04-29 15:15:32 +02:00
qwerty287
9c6c4559a7
Add SSH backend (#861) 
Add SSH backend that runs commands via SSH.

Close #848
 2022-04-29 12:30:50 +02:00
John Olheiser
67d76248a3
Take in an io.Reader instead of file path (#885) 
Signed-off-by: jolheiser <john.olheiser@gmail.com>
 2022-04-19 10:40:48 +02:00
mscherer
16cf59163e
Do not ignore failure to clean up the context (#876) 2022-04-07 01:08:04 +02:00
6543
58303dd2a7
Move value of default clone image into shared constant package (#873) 2022-04-06 15:30:49 +02:00
mscherer
c3788d943f
Fix insecure /tmp usage in local backend (#872) 
Since /tmp is writable by everybody, a user could precreate
/tmp/woodpecker with 777 permissions, allowing them to modify the
pipeline while it is being run, or preventing the pipeline from running.

And since os.MkdirAll error code wasn't checked, the same attacker
could have precreated the directory where the pipeline is executed to
mess with the run, allowing code execution under the UID of the
agent (who has access to the toke, to communicate with the server, which
mean a attacker could inject a fake agent, steal credentials, etc)
 2022-04-06 03:33:00 +02:00
Anbraten
6ae7e2cc4f
Fix uppercase from_secrets (#842) 
Secret names where matched based on their lowercase value already just the conversion to lowercase for `from_secrets` was missing.
 2022-03-19 12:34:32 +01:00
Anthony Wang
80c72b590c
Add support to run pipelines using a local backend (#709) 
This adds support for #559. I tested using [this .woodpecker.yml](https://git.exozy.me/Ta180m/Hello-world/src/branch/main/.woodpecker.yml) on my self-hosted [Woodpecker instance](https://ci.exozy.me/Ta180m/Hello-world). I was also able to get this to build [Hugo websites](https://ci.exozy.me/Ta180m/howtuwu/build/1). It's currently very simplistic but works!

close #559
 2022-03-10 22:07:02 +01:00
eleith
e0d8d13a91
fix pipeline schema to support branch as an array in 'when' (#836) 2022-03-09 15:49:06 +01:00
Anbraten
e178b7b4b2
Improve agent backend loading and suppress expectable errors (#818) 
* improve agent loop loading backend once

* supress container not found or stopped warnings
 2022-03-08 16:21:43 +01:00
6543
a3ac393264
Use shared func for registering Sigterm on a context (#799) 2022-02-28 09:27:31 +01:00
Lukas Bachschwell
a2315fe931
Do not filter on linux/amd64 per default (#805) 
* Do not filter on linux/amd64 per default & add tests

Tasks with no platform would otherwise not perform on runners with different OS/ARCH combos

Signed-off-by: Lukas Bachschwell <lukas@lbsfilm.at>
Co-authored-by: 6543 <6543@obermui.de>
 2022-02-26 22:54:28 +01:00
6543
8ae124d5e6
Remove unused code (#797) 
* delete empty code files

* delete outdated readme

* delete unused code

* dedup license
 2022-02-25 21:42:45 +01:00
6543
505cf8c09a
make gRPC error "to many keepalive pings" only show up in trace logs (#787) 
hotfix #717

This comes from the agent being inactive / not sending and requesting any data if there a no pipelines waiting for him to execute. GRPC seems to only allow 2 pings without calling an actual endpoint before closing the connection. I think this will be indirectly solved in the moment we implement something like #536

https://github.com/grpc/grpc/blob/master/doc/keepalive.md

Co-authored-by: Anbraten <anton@ju60.de>
 2022-02-24 15:53:44 +01:00
Zav Shotan
905350fa15
Add support for default clone image environment variable (#769) 
This allows for custom clone images for deployment in air-gap systems.

Co-authored-by: Zav Shotan <zshotan@bloomberg.net>
 2022-02-10 17:05:19 +01:00
mscherer
3b52afab93
Use DOCKER_HOST env to search for docker before searching for a hardcode docker socket (#763) 
Fix #757
 2022-02-09 00:08:20 +01:00
6543
95ce87fa1b
Fix path schema (#723) 
- allow array for path
- remove "include:" as it is default case
- run tests on schema changes too
 2022-01-29 14:26:00 +01:00
Anthony Wang
be11e57976
Fix avivable -> available typo in backend.go (#710) 2022-01-20 18:21:57 +01:00
6543
04eb7935db
Improve compile pipeline (#699) 
Refactor
- use constants for strings
- more tests
- move constraint code into own package

Enhance
- all constrains use doublestart (glob pattern matching) now

Co-authored-by: Anbraten <anton@ju60.de>
 2022-01-17 14:43:30 +01:00
Philipp
366701fde7
Fix multiline secrets replacer (#700) 
* Fix multiline secrets replacer

* Add tests
 2022-01-16 22:57:37 +01:00
6543
03638b2934
pipeline backend: remove unused var (#683) 2022-01-09 23:28:41 +01:00
6543
7986eba002
Hide multi line secrets from log (#671) 
close #388
 2022-01-08 20:39:52 +01:00
6543
2f91bdd4a0
gofumpt -w -l -extra . (#661) 2022-01-05 21:50:23 +01:00
6543
dec0eeeed7
Use global branch filter only on events containing branch info (#659) 
- close #581
- delete unused code
- simplify code
- add check to procBuilder to fail on invalid config
 2022-01-05 17:54:44 +01:00
Philipp
4f015edc05
Add repo to when block (#642) 
Co-authored-by: 6543 <6543@obermui.de>
 2021-12-30 02:30:08 +01:00
6543
ce5247c675
pipeline env migrate CI_TAG & CI_PULL_REQUEST to new CI_COMMIT_TAG & CI_COMMIT_PULL_REQUEST (#624) 
* CI_TAG => CI_COMMIT_TAG

* CI_PULL_REQUEST => CI_COMMIT_PULL_REQUEST

* add TODO for drop with v0.16.0 development
 2021-12-19 17:01:03 +01:00
6543
3bd87cda66
use woodpeckerci/plugin-git:latest for clone (#617) 2021-12-18 23:05:25 +01:00
John Olheiser
9e8d1a9294
Get secrets in settings (#604) 
* Get secrets in settings

Signed-off-by: jolheiser <john.olheiser@gmail.com>

* Add error test

Signed-off-by: jolheiser <john.olheiser@gmail.com>

* Add docs

Signed-off-by: jolheiser <john.olheiser@gmail.com>
 2021-12-13 13:33:07 -06:00
6543
0061edcbe2
Remove gopkg.in/yaml.v2 (#583) 
* rm "gopkg.in/yaml.v2"

* fix UnmarshalYAML for Networks & Ulimits
 2021-12-08 23:35:51 +01:00
6543
e7cfa902a6
Another fix for settings field in pipeline config (#579) 
close #578

- adjust to new settings field own pipeline config
- more test coverage
- Fix environment parse of settings
- Fix pipeline schema
 2021-12-08 18:17:52 +01:00
6543
1172dc3311
Write own yaml2json func (#570) 
* fix regression of #384 
 * add more tests
 2021-12-07 01:13:02 +01:00
Anbraten
ffed327564
Remove ghodss/yaml (#384) 2021-12-06 18:17:31 +00:00
John Olheiser
71b9179078
Move plugin config to root.pipeline.[step].settings (#464) 
* Move Vargs to Settings

* Allow both until deprecation

* Add more tests

* Adjust schema

* Add missing detach option, fix schema tests


Signed-off-by: jolheiser <john.olheiser@gmail.com>
Co-authored-by: 6543 <6543@obermui.de>
Co-authored-by: Anbraten <anton@ju60.de>
 2021-12-04 16:44:18 +01:00
6543
fc6a2a9975
Remove github.com/kr/pretty in favor of assert.EqualValues() (#564) 
* remove github.com/kr/pretty in favor of assert.EqualValues()

* code format
 2021-12-04 13:23:33 +01:00
Lukas
680d003a29
Add linter revive (#554) 
* Add linter revive

* Add underscore to variable name to prevent shadowing

* Remove unnecessary leading underscore

* Revert changes to vendor file

* export ConfigFetcher as interface

* no 'yoda conditions'

* rename envsubst

Co-authored-by: 6543 <6543@obermui.de>
 2021-12-01 14:22:06 +01:00
6543
e072e4cce7
Fix pipeline backend autodetect (#545) 
* refactor:
 - rename IsAvivable -> IsAvailable
 - drop depricated Kill
 - make sure backends implement interface
 - rename backend struct for ide (better info)

* docker backend fix autodetect
 2021-11-27 02:29:14 +01:00
Anbraten
c1a8884d62
Add backend selection for agent (#463) 
- add backend selection option
- by default it will auto-detect a backend
 2021-11-26 03:34:48 +01:00
Anbraten
f2b6a5c9c5
Fix passing of netrc credentials to clone step (#492) 
closes #479
 2021-11-25 21:30:03 +01:00
Anbraten
063d0bb32a
Replace DRONE_ with CI_ variables in pipeline steps (#427) 
Dropped support for `DRONE_*` environment variables in pipeline steps. Pipeline meta-data can be accessed with `CI_*` variables.
  - `CI_*` prefix replaces `DRONE_*`
  - `CI` value is now `woodpecker`
  - `DRONE=true` has been removed
 2021-11-25 20:43:31 +01:00
Lukas
fac0e16996
Add linter staticcheck (#535) 
* Add linter staticcheck

Co-authored-by: 6543 <6543@obermui.de>
 2021-11-25 17:15:36 +01:00
Lukas
116c310820
Add linter misspell (#530) 
* Add linter misspell

* Fix spelling

Co-authored-by: Anbraten <anton@ju60.de>
 2021-11-24 02:01:12 +01:00
Lukas
25bf91bd37
Add linter whitespace (#531) 2021-11-24 01:31:11 +01:00
6543
fe31fb1e06
Drop error only on purpose or else report back or log (#514) 
- Remove Deadcode
- Simplify Code
- Drop error only on purpose
 2021-11-23 15:36:52 +01:00
6543
ca8e215cfa
Migrate to Xorm (#474) 
close #234

* Migrate store
* Migrate tests
* Rewrite migrations
* Init fresh DB in on step
* Rm old stuff (meddler, sql files, dead code, ...)
 2021-11-13 20:18:06 +01:00
6543
aca5fddcf3
Use Goblin Assert as intended (#501) 
this allow for better debugging if an error occur
 2021-11-04 14:42:25 +01:00
6543
0bb62be303
Embedding libcompose types for yaml parsing (#495) 
since github.com/docker/libcompose is deprecated, unmaintained and archived.

and license is the same as woodpecker's, we can just copy stuff into woodpecker directly.
(we only use types of that project anyway)
 2021-10-30 17:52:02 +02:00
6543
6828057f66
Switch default git plugin (#449) 
* update pipeline samples

* update docs

* use woodpeckerci/plugin-git:latest as default

* code format nit
 2021-10-15 19:54:28 -05:00
Anbraten
4cc8594b63
Update links to woodpecker-ci.org (#445) 2021-10-14 18:13:57 +02:00
John Olheiser
4276a04f0c
Move entirely to zerolog (#426) 
Completely switch to zerolog

(Remove usage of logrus and std logger)

Signed-off-by: jolheiser <john.olheiser@gmail.com>
Co-authored-by: 6543 <6543@obermui.de>
 2021-10-12 09:25:13 +02:00
Masaya Watanabe
7913d6db95
Fix channel buffer used with signal.Notify (#421) 
Co-authored-by: Anbraten <anton@ju60.de>
 2021-10-09 03:14:25 +02:00
Masaya Watanabe
01ebbd8c2d
Fix json tag for Pos at struct Line (#422) 2021-10-09 02:43:44 +02:00
luzpaz
9b687a923e
Fix various typos (#416) 
Fix various typos found via `codespell -q 3 -S vendor -L pullrequest,pullrequests`
 2021-10-08 18:35:56 +02:00
6543
3254a7ca00
Fix config schema (typo in pipeline.step.when.platform) (#417) 
* fix schema

* fix test fixtures
 2021-10-08 18:10:17 +02:00
6543
5d8e60808d
Move cli exec flags to own file (#380) 
Co-authored-by: Anbraten <anton@ju60.de>
 2021-10-03 15:07:39 +02:00
Anbraten
bb37836600
Replace drone strings with woodpecker (#391) 
Co-authored-by: 6543 <6543@obermui.de>
 2021-10-02 10:59:34 +02:00
Anbraten
ba0286d055
Remove unused files (#392) 2021-10-02 10:25:26 +02:00
6543
7f3a6eb17f
Update Generated Proto Code (#351) 
update generated code (definitions, client implementation & server interface)
and add documentation how to generate
 2021-09-29 02:10:09 +02:00
Anbraten
0fa271f465
Add json schema and cli lint command (#342) 
- Add json schema file
- Add tests to validate sample pipeline files
- Add new command `lint` to cli to test a directory or single file to use correct schema

Example:  `woodpecker-cli lint ./pipeline/schema/.woodpecker/`

---
close #275 
preparation for #276 


Co-authored-by: 6543 <6543@obermui.de>
 2021-09-27 02:38:15 +02:00
6543
da6fa0ec70
Use moby definitions for docker pipeline backend (#364) 
* Migrate from docker to moby

* moby as interface docker as implementation

* Migrate deprecated func
 2021-09-26 21:51:59 +02:00
Anbraten
07d793f727
Migrate go-docker to docker/docker (#363) 
closes #325
 2021-09-26 14:43:14 +02:00
6543
0bd10fa507
Cleanup Code (#348) 
* Fix "Empty slice declaration using a literal"
* Fix "collides with imported package name"
* Remove unused code in pipeline
* Remove unused oauth2.providerAuthHeaderWorks()
* Add TODOs
* Format Code
* Cleanup doublestar import
* Migrate deprecated functions

Co-authored-by: Anbraten <anton@ju60.de>
 2021-09-24 16:29:26 +02:00
Jacob Floyd
e34daae0cf
Move cncd/pipeline/pipeline/ to pipeline/ (#347) 
* Refactor: move cncd/pipeline/ to pipeline/

* Refactor: move pipeline/pipeline/ to pipeline/
 2021-09-24 13:18:34 +02:00