Commit graph

729 commits

Author SHA1 Message Date
Marian Steinbach
17b8867b96
Clean up config environment variables for server and agent (#218)
The goal here is to make consistent use of configuration environment variables prefixed `WOODPECKER_`. Where several variants existed, this PR aims to remove all but one option, leaving the most explicit.

This PR only changes server and agent code, but not documentation, in order to keep the PR digestible. Once we have consensus that this is correct, I'll change docs accordingly.

User (rather: admin) facing changes in this PR:

- In general, support for all server and agent config environment variables (env vars) starting with `DRONE_` is removed. The according `WOODPECKER_*` variables must be used instead.
- The env var `WOODPECKER_HOST` replaces `DRONE_HOST`, and `DRONE_SERVER_HOST`.
- The env var `WOODPECKER_AGENT_SECRET` is used to configure the shared secret which agents use to authenticate against the server. It replaces `WOODPECKER_SECRET`, `DRONE_SECRET`, `WOODPECKER_PASSWORD`, `DRONE_PASSWORD`, and `DRONE_AGENT_SECRET`.
- The env var `WOODPECKER_DATABASE_DRIVER` replaces `DRONE_DATABASE_DRIVER` and `DATABASE_DRIVER`.
- The env var `WOODPECKER_DATABASE_DATASOURCE` replaces `DRONE_DATABASE_DATASOURCE` and `DATABASE_CONFIG`.
2021-09-28 15:43:44 +02:00
Anbraten
6144f16631
Remove unsupported pipeline file extension "yaml" (#373)
Docs, `sanitizePath` and json-schema do not mention / support `.yaml` (only `.yml`) files so they should simply be ignored.
2021-09-28 14:07:25 +02:00
6543
e3499f610d
Pass down context.Context (#371)
* pass context down to remote clients

* make tests work

* add ctx to Refresh() and use it

* bitbucketserver

* code format

* plugin interface: add todo context

* solve todo

* RM TODO by using context.WithTimeout

* refactor & fix

* Apply suggestions from code review

Co-authored-by: Anbraten <anton@ju60.de>

* go fmt

* Update server/remote/coding/coding.go

Co-authored-by: Anbraten <anton@ju60.de>

Co-authored-by: Anbraten <anton@ju60.de>
2021-09-28 12:56:59 +02:00
6543
c0888de86b
Delete Gerrit placeholder (#372) 2021-09-28 10:22:34 +02:00
6543
f81bd8c656
Extend Logging & Report to WebHook Caller back if pulls are disabled (#369)
* Add more logging 
* Format Code
* Add TODOs
* Fix nits
* Delete two unused functions
* Report to WebHook Caller back if pulls are disabled
2021-09-27 23:32:08 +02:00
6543
a94807efeb
Refactor: move model/ to server/model/ (#366) 2021-09-27 19:51:55 +02:00
6543
06d83c7b0e
Remote Gitea drop basic auth support (#365)
you now have to set **gitea-client** and **gitea-secret**.
2021-09-27 08:11:11 +02:00
Anbraten
bd19f90756
Replace www-path with www-proxy option for development (#248)
By adding a new ENV variable called `WOODPECKER_WWW_PROXY` it is possible to serve a webinterface via a proxy configured by the `WOODPECKER_WWW_PROXY` value for development instead of serving the interface from the bundled code or from some folder location as the old `WOODPECKER_WWW` option allowed. Using a proxy allows developing the UI with hot-reloading.
2021-09-27 00:22:23 +02:00
6543
5a05a7fe6b
Make configFetcher fallback work for gitea (#357)
#299 who closed #133 did not take into account, that that gitea (and eventually) other forges do return 200 and empty string if file was not found - this make configFetcher more resilient
2021-09-26 01:23:17 +02:00
6543
d8cd4925ec
If config is no dir asume its a folder (#354)
If config is no dir assume its a folder (user do not always add / suffix)
2021-09-25 02:56:05 +02:00
6543
0bd10fa507
Cleanup Code (#348)
* Fix "Empty slice declaration using a literal"
* Fix "collides with imported package name"
* Remove unused code in pipeline
* Remove unused oauth2.providerAuthHeaderWorks()
* Add TODOs
* Format Code
* Cleanup doublestar import
* Migrate deprecated functions

Co-authored-by: Anbraten <anton@ju60.de>
2021-09-24 16:29:26 +02:00
Jacob Floyd
e34daae0cf
Move cncd/pipeline/pipeline/ to pipeline/ (#347)
* Refactor: move cncd/pipeline/ to pipeline/

* Refactor: move pipeline/pipeline/ to pipeline/
2021-09-24 13:18:34 +02:00
Jacob Floyd
a0d008e071
Move cncd/{logging,pubsub,queue}/ to server/{logging,pubsub,queue}/ (#346)
* Move cncd/{logging,pubsub,queue}/ to server/{logging,pubsub,queue}/

* Update REAMDEs and include history

Co-authored-by: Anbraten <anton@ju60.de>

Co-authored-by: Anbraten <anton@ju60.de>
2021-09-23 22:29:09 +02:00
Jacob Floyd
780c902a6b
Refactor: move remote/ to server/remote/ (#344) 2021-09-23 18:25:51 +02:00
Jacob Floyd
e2b59787c1
Move plugins/ package to server/plugins/ (#343) 2021-09-23 16:12:46 +02:00
Jacob Floyd
5fe712cca6
Move package store/ to server/store/ (#341)
* Refactor: move store/ to server/store/

* fix pipeline for moved tests

Co-authored-by: 6543 <6543@obermui.de>
2021-09-23 13:33:59 +02:00
Jacob Floyd
b8f55f31e2
Move router package to server/router/ (#339) 2021-09-22 22:41:32 +02:00
Jacob Floyd
35a45b7961
Reorganize code into server/{api,grpc,shared} packages (#337)
* move api code to server/api
* move grpc server for agent communication to server/grpc
* move server.Config to server/config.go as it is used by both server/api and server/grpc
* move shared code used by server/api and server/grpc to server/shared
2021-09-22 20:48:01 +02:00
Jacob Floyd
7f4a205764
Remove legacy/unused code + misc cleanups (#331)
* delete obsolete cncd code

jsonrpc2 client+server, and the utils that used them (piped, pipec)
are not used anymore.

jsonrpc2 was replaced with grpc
piped+pipec were replaced by agents

* delete duplicate section in swagger file

* comment typos

* go mod tidy (websocket+jsonrpc2 no longer used)

* go mod vendor

Co-authored-by: Anbraten <anton@ju60.de>
2021-09-21 17:35:32 +02:00
Anbraten
5653577d7e
Fix sanitizePath (#326)
With #299 the `sanitizePath` has a bug now. If no special config (empty string) has been set it falls back to default values, but the `sanitizePath` function  the used the pipelince-config-path to sanitize pipeline names.
2021-09-21 04:21:13 +02:00
Anbraten
894df351ee
Remove push, tag and deployment webhook filters (#281)
- remove `AllowPush`, `AllowTag`,  `AllowDeploy` options.
- keep `AllowPullRequest` option and disable it by default

---
close #265 
close #243
2021-09-18 16:28:35 +02:00
Anbraten
289f0c9ad6
Change pipeline config path resolution (#299)
# Config resolution
- pipeline-config setting empty / not specified (default): `.woodpecker/` => `.woodpecker.yml` => `.drone.yml`
- pipeline-config setting defined by user: try that file / folder and no fallback (if a user sets some special value that is normally done for some reason)

# Changes
- pipeline-config setting will be empty by default
- remove fallback setting for config loading (simplifies config)

---
closes #133

---

* adjust config fetching mechanism

* default path empty

* remove fallback flag from ui and db
2021-09-17 21:40:43 +02:00
Anbraten
34cfabb56d
Fix filter pipeline config files (#279)
closes #271 

- filter pipeline config folders for `.yml` and `.yaml` files
- improve `fetchConfig` tests
- update remote mock and correct wrong folder name `mock` => `mocks` to match package name
- fix: return correct filename for fallback
- improve config loading by checking if folder or not before sending api call
2021-08-30 22:54:21 +02:00
Anbraten
8aeae0a651
Use custom config path to sanitize build names (#280)
fix #270
2021-08-29 22:25:41 +02:00
Anbraten
1a67fc6e99
Use server-host as source for public links and warn if it is set to localhost (#251)
* Use server-host as source for public links

* use config and rm GetURL()

* fix: solve import cycle

Co-authored-by: 6543 <6543@obermui.de>
2021-08-20 16:32:52 +02:00
6543
70958acc44
update / remove drone dependencies (#236)
* include github.com/drone/signal

* update github.com/drone/envsubst

* move github.com/woodpecker-ci/expr to woodpecker org
2021-06-30 19:15:28 +02:00
Alex Eftimie
2ff91e6a05
Add support for path-prefix condition (#174)
Example:
```yaml
when:
  path: '*.md'
```

should match only builds in which the commit added/removed or modified files with the *.md extension

Co-authored-by: 6543 <6543@obermui.de>
2021-06-28 23:50:35 +02:00
Paweł Bogusławski
68dbd488a9
Using configured server URL instead of obtained from request (#175)
Woodpecker should use configured server URL when creating self
URL-s for VCS UI and not depend on URL read from request. In
case of internal calls like answers for webhooks from Gitea
on backend, address in URL may be internal and this causes
Gitea to display CI status for commit with intenal URL
to woodpecker not external one.
2021-06-28 19:28:18 +02:00
6543
bfc4aa8059
Enforce code format (#228)
* format .drone.yml & go code

* improve .editorconfig

* extend Makefile

* enforce go code format

* fix space

* update deps

* clean up
2021-06-22 12:34:35 +02:00
Laszlo Fogas
c7ebd68232 Relaced laszlocph/woodpecker with woodpecker-ci/woodpecker 2021-05-25 14:08:27 +02:00
Laszlo Fogas
5ea7098569 Go 1.16, go fmt, go modules update 2021-02-19 09:43:03 +01:00
Laszlo Fogas
14636cc226
Merge pull request #119 from imduffy15/owner-filter
Add whitelist for syncable owners
2020-05-20 06:53:24 +02:00
Ian
1f8b3c4a45 Fix mistakes caused from splitting out into PRs 2020-05-19 13:20:29 +01:00
Ian
0d90789422 Add whitelist for syncable owners 2020-05-18 16:58:59 +01:00
Ian
a11db91e49 Upgrade dependencies 2020-05-18 16:41:15 +01:00
Laszlo Fogas
a63a74053e Administration articles moved 2019-11-13 20:04:14 +01:00
Laszlo Fogas
0970d3a971 Make version number visible in UI 2019-11-12 21:42:05 +01:00
Laszlo Fogas
8dee34878d Version is now a string coming from ldlags and git tags 2019-11-12 21:10:16 +01:00
Laszlo Fogas
61a14df51b Pull in frontend 2019-11-12 14:27:39 +01:00
Laszlo Fogas
e2a7917c83
Merge pull request #74 from mhmxs/test-parallel
Make test execution parallel in server
2019-10-08 15:52:21 +02:00
mhmxs
1196222a14 Make test execution parallel in server 2019-10-06 20:30:06 +02:00
mhmxs
72743424fa Proc status update tests 2019-10-04 18:27:46 +02:00
Laszlo Fogas
d8fe50dfa7 Iterating on cance;ation logic 2019-09-16 15:19:09 +02:00
mhmxs
db4876aabc Create separate Go file for proc status updates 2019-09-15 07:29:45 +02:00
mhmxs
53258bf989 Format source code 2019-09-14 14:21:16 +02:00
mhmxs
fd361ddf2a Create separate Go file for build status updates 2019-09-14 14:20:16 +02:00
Laszlo Fogas
1c306dd1d4 Surface parsing error in branch filter 2019-09-09 09:53:54 +02:00
Laszlo Fogas
630c383181 Project is renamed to Woodpecker 2019-08-27 13:07:19 +02:00
Laszlo Fogas
1f83f0f198 After filterItemsWithMissingDependencies introduced, the next id can be higher than the length of procs 2019-07-23 14:10:44 +02:00
Laszlo Fogas
3bb0f64025 Handling zero-steps as transitive dependencies 2019-07-22 14:29:15 +02:00
Laszlo Fogas
6879bf62cb Handling zero-step pipelines as multi-pipeline depedencies 2019-07-22 14:13:46 +02:00
Laszlo Fogas
ed51df29b3 Factor out sideeffects 2019-07-22 13:45:01 +02:00
Laszlo Fogas
b7f61fc81d Queue knows about skipped tasks now to handle transitive deps 2019-07-22 12:44:03 +02:00
Laszlo Fogas
906c0c7a0d Merge remote-tracking branch 'origin/master' into zero-steps
* origin/master:
  Reinstate simplified gating logic
2019-07-20 21:15:50 +02:00
Laszlo Fogas
d560643b26 Calculating build steps early on to cut short cases without any runnable steps 2019-07-19 10:13:02 +02:00
Laszlo Fogas
c303a4d463 If there are no steps, it shouldn't yield a proc 2019-07-19 09:18:40 +02:00
Laszlo Fogas
2edc5fcfb7 Pid ID refactor 2019-07-19 09:17:47 +02:00
Laszlo Fogas
2cd5d8c02b Reinstate simplified gating logic 2019-07-18 14:21:05 +02:00
Laszlo Fogas
05ca66cc97 Moved to woodpecker-ui 2019-07-09 13:23:08 +02:00
Laszlo Fogas
1d564e978f More prometheus metrics, refactoring 2019-06-28 14:28:41 +02:00
Laszlo Fogas
8bb5770636 Endpoint that blocks until there are running builds 2019-06-28 08:42:06 +02:00
Laszlo Fogas
d39dd6f2ff Pause/Resume queue 2019-06-28 08:29:57 +02:00
Laszlo Fogas
ace264fe2f Persist intended URL through the OAuth flow 2019-06-27 08:25:00 +02:00
Laszlo Fogas
8d79f8671e Fallback to default config. Allows incremental rollout of custom-path 2019-06-25 13:45:43 +02:00
Laszlo Fogas
84564f9ae5 .drone.yml takes precedence over configured path. Allows incremental rollout 2019-06-25 09:46:18 +02:00
Laszlo Fogas
580b7b272f Pipeline path configurable 2019-06-24 09:04:30 +02:00
Laszlo Fogas
eed92421c9 Branch conditions on pipelines 2019-06-19 09:36:54 +02:00
Laszlo Fogas
fded153328 Gated builds is disabled as I don't understand the feature 2019-06-19 09:01:17 +02:00
Laszlo Fogas
69de8face1 Handling canceled, skipped builds 2019-06-19 08:36:13 +02:00
Laszlo Fogas
1d47ba8a32 Status line for each pipeline on Github 2019-06-17 10:48:40 +02:00
Laszlo Fogas
a433591afa Introducing runs_on to run pipelines on failure 2019-06-17 09:06:36 +02:00
Laszlo Fogas
2253ca66db Tasks should not run on error, unless specified 2019-06-16 15:56:32 +02:00
Laszlo Fogas
a22747f5c3 Sort later, so it is sorted in restarts too 2019-06-16 15:55:55 +02:00
Laszlo Fogas
6a2c3f129c Factor into functions 2019-06-16 10:54:31 +02:00
Laszlo Fogas
001d645471 Order files alphabetically 2019-06-13 18:09:25 +02:00
Laszlo Fogas
a3ec40d438 Fifo queue with dependencies 2019-06-13 18:02:26 +02:00
Laszlo Fogas
f9c5fcec0d N:N relationship between build and config. Restarts work 2019-06-11 10:50:50 +02:00
Laszlo Fogas
3fe710bbe4 1:n relationship for build-config 2019-06-07 10:40:16 +02:00
Laszlo Fogas
105a0708fe Refactor 2019-06-05 15:58:27 +02:00
Laszlo Fogas
dbfbd15238 Moved proc id changes closer to each other 2019-06-05 10:36:16 +02:00
Laszlo Fogas
435083db9e Handling channel close 2019-06-05 10:08:49 +02:00
Laszlo Fogas
5cc4dca56f Fetching multiple pipelines from Github, skipping some logic for now 2019-06-04 15:04:18 +02:00
Laszlo Fogas
df50b7ef40 Testing procBuilder 2019-06-01 13:02:26 +02:00
Laszlo Fogas
c9f2346c2c Supporting multiple yamls in procBuilder 2019-06-01 13:02:26 +02:00
Laszlo Fogas
8199fe4a21 Fixed tests 2019-06-01 13:01:50 +02:00
Laszlo Fogas
4cce34d5bf Moved things closer that belong together 2019-06-01 13:00:19 +02:00
Laszlo Fogas
ddabcde3e3 Factored to a better place 2019-06-01 12:52:30 +02:00
Laszlo Fogas
21d6552b4b It's okay 2019-06-01 10:59:35 +02:00
Laszlo Fogas
8cec8ed0d5 Dryness 2019-06-01 10:27:28 +02:00
Laszlo Fogas
73aa46405a Factored into file 2019-06-01 10:17:02 +02:00
Laszlo Fogas
43c44cfbd6 Factored into named functions 2019-06-01 10:08:41 +02:00
Laszlo Fogas
f25317599a Unlimited 2019-06-01 09:45:20 +02:00
Laszlo Fogas
a4541ac901 Pull in cncd/* for simpler workflow 2019-04-06 15:44:04 +02:00
Laszlo Fogas
ca5817ffc2 Renamed package 2019-04-04 20:51:20 +02:00
Niall Sheridan
a55fa44589 Recover panic on closed channel
Related to #2480

Signed-off-by: Niall Sheridan <nsheridan@squarespace.com>
2018-11-14 11:27:41 +00:00
Brad Rydzewski
eb96456909 fix for #2480 2018-10-18 22:33:56 -07:00
Delfer
ea2c72b4b4 Add ability to restart build of any state 2018-04-06 17:54:24 +03:00
Brad Rydzewski
c78ce27d76
Merge pull request #2386 from fbcbarbosa/patch-1
Fix EventStreamSSE Memory Leak
2018-03-30 09:39:41 -07:00
Fernando Barbosa
00f72ef206
Fix EventStreamSSE Memory Leak
The `Config.Services.Pubsub.Subscribe` is being initialized with the global Gin Context. This causes the publisher object to [hang at line 58](https://github.com/cncd/pubsub/blob/master/pub.go#L58) and the goroutine remains opened indefinetly, which can be a source of memory leak.

Setting it to the locally defined ctx object correctly causes the goroutine to close when the function exits due to the deferred close.

See https://discourse.drone.io/t/memory-leak-on-drone-server/1884 for further information.
2018-03-27 19:19:22 -03:00
Thomas Boerger
398ca972bc
Fixed wrong variable name 2018-03-27 22:50:55 +02:00