Create docs for v2.4.x (#3507)
|
@ -246,14 +246,18 @@ const config: Config = {
|
||||||
sidebarPath: require.resolve('./sidebars.js'),
|
sidebarPath: require.resolve('./sidebars.js'),
|
||||||
editUrl: 'https://github.com/woodpecker-ci/woodpecker/edit/main/docs/',
|
editUrl: 'https://github.com/woodpecker-ci/woodpecker/edit/main/docs/',
|
||||||
includeCurrentVersion: true,
|
includeCurrentVersion: true,
|
||||||
lastVersion: '2.3',
|
lastVersion: '2.4',
|
||||||
versions: {
|
versions: {
|
||||||
current: {
|
current: {
|
||||||
label: 'Next',
|
label: 'Next',
|
||||||
banner: 'unreleased',
|
banner: 'unreleased',
|
||||||
},
|
},
|
||||||
|
'2.4': {
|
||||||
|
label: '2.4.x',
|
||||||
|
},
|
||||||
'2.3': {
|
'2.3': {
|
||||||
label: '2.3.x',
|
label: '2.3.x',
|
||||||
|
banner: 'unmaintained',
|
||||||
},
|
},
|
||||||
'2.2': {
|
'2.2': {
|
||||||
label: '2.2.x',
|
label: '2.2.x',
|
||||||
|
|
89
docs/versioned_docs/version-2.4/10-intro.md
Normal file
|
@ -0,0 +1,89 @@
|
||||||
|
# Welcome to Woodpecker
|
||||||
|
|
||||||
|
Woodpecker is a simple yet powerful CI/CD engine with great extensibility. It focuses on executing pipelines inside [containers](https://opencontainers.org/).
|
||||||
|
If you are already using containers in your daily workflow, you'll for sure love Woodpecker.
|
||||||
|
|
||||||
|
![woodpecker](woodpecker.png)
|
||||||
|
|
||||||
|
## `.woodpecker.yaml`
|
||||||
|
|
||||||
|
- Place your pipeline in a file named `.woodpecker.yaml` in your repository
|
||||||
|
- Pipeline steps can be named as you like
|
||||||
|
- Run any command in the commands section
|
||||||
|
|
||||||
|
```yaml title=".woodpecker.yaml"
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- echo "This is the build step"
|
||||||
|
- name: a-test-step
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- echo "Testing.."
|
||||||
|
```
|
||||||
|
|
||||||
|
### Steps are containers
|
||||||
|
|
||||||
|
- Define any container image as context
|
||||||
|
- either use your own and install the needed tools in a custom image
|
||||||
|
- or search for available images that are already tailored for your needs in image registries like [Docker Hub](https://hub.docker.com/search?type=image)
|
||||||
|
- List the commands that should be executed in the container
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
- image: debian
|
||||||
|
+ image: mycompany/image-with-awscli
|
||||||
|
commands:
|
||||||
|
- aws help
|
||||||
|
```
|
||||||
|
|
||||||
|
### File changes are incremental
|
||||||
|
|
||||||
|
- Woodpecker clones the source code in the beginning
|
||||||
|
- File changes are persisted throughout individual steps as the same volume is being mounted in all steps
|
||||||
|
|
||||||
|
```yaml title=".woodpecker.yaml"
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- touch myfile
|
||||||
|
- name: a-test-step
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- cat myfile
|
||||||
|
```
|
||||||
|
|
||||||
|
## Plugins are straightforward
|
||||||
|
|
||||||
|
- If you copy the same shell script from project to project
|
||||||
|
- Pack it into a plugin instead
|
||||||
|
- And make the yaml declarative
|
||||||
|
- Plugins are Docker images with your script as an entrypoint
|
||||||
|
|
||||||
|
```dockerfile title="Dockerfile"
|
||||||
|
FROM laszlocloud/kubectl
|
||||||
|
COPY deploy /usr/local/deploy
|
||||||
|
ENTRYPOINT ["/usr/local/deploy"]
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash title="deploy"
|
||||||
|
kubectl apply -f $PLUGIN_TEMPLATE
|
||||||
|
```
|
||||||
|
|
||||||
|
```yaml title=".woodpecker.yaml"
|
||||||
|
steps:
|
||||||
|
deploy-to-k8s:
|
||||||
|
image: laszlocloud/my-k8s-plugin
|
||||||
|
settings:
|
||||||
|
template: config/k8s/service.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
See [plugin docs](./20-usage/51-plugins/10-overview.md).
|
||||||
|
|
||||||
|
## Continue reading
|
||||||
|
|
||||||
|
- [Create a Woodpecker pipeline for your repository](./20-usage/10-intro.md)
|
||||||
|
- [Setup your own Woodpecker instance](./30-administration/00-deployment/00-overview.md)
|
72
docs/versioned_docs/version-2.4/20-usage/10-intro.md
Normal file
|
@ -0,0 +1,72 @@
|
||||||
|
# Getting started
|
||||||
|
|
||||||
|
## Repository Activation
|
||||||
|
|
||||||
|
To activate your project navigate to your account settings. You will see a list of repositories which can be activated with a simple toggle. When you activate your repository, Woodpecker automatically adds webhooks to your forge (e.g. GitHub, Gitea, ...).
|
||||||
|
|
||||||
|
Webhooks are used to trigger pipeline executions. When you push code to your repository, open a pull request, or create a tag, your forge will automatically send a webhook to Woodpecker which will in turn trigger the pipeline execution.
|
||||||
|
|
||||||
|
![repository list](repo-list.png)
|
||||||
|
|
||||||
|
## Required Permissions
|
||||||
|
|
||||||
|
The user who enables a repo in Woodpecker must have `Admin` rights on that repo, so that Woodpecker can add the webhook.
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Note that manually creating webhooks yourself is not possible.
|
||||||
|
This is because webhooks are signed using a per-repository secret key which is not exposed to end users.
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
To configure your pipeline you must create a `.woodpecker.yaml` file in the root of your repository. The `.woodpecker.yaml` file is used to define your pipeline steps.
|
||||||
|
|
||||||
|
:::note
|
||||||
|
We support most of YAML 1.2, but preserve some behavior from 1.1 for backward compatibility.
|
||||||
|
Read more at: [https://github.com/go-yaml/yaml](https://github.com/go-yaml/yaml/tree/v3)
|
||||||
|
:::
|
||||||
|
|
||||||
|
Example pipeline configuration:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: postgres
|
||||||
|
image: postgres:9.4.5
|
||||||
|
environment:
|
||||||
|
- POSTGRES_USER=myapp
|
||||||
|
```
|
||||||
|
|
||||||
|
Example pipeline configuration with multiple, serial steps:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: backend
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
- name: frontend
|
||||||
|
image: node:6
|
||||||
|
commands:
|
||||||
|
- npm install
|
||||||
|
- npm test
|
||||||
|
|
||||||
|
- name: notify
|
||||||
|
image: plugins/slack
|
||||||
|
channel: developers
|
||||||
|
username: woodpecker
|
||||||
|
```
|
||||||
|
|
||||||
|
## Execution
|
||||||
|
|
||||||
|
To trigger your first pipeline execution you can push code to your repository, open a pull request, or push a tag. Any of these events triggers a webhook from your forge and execute your pipeline.
|
After Width: | Height: | Size: 31 KiB |
|
@ -0,0 +1,63 @@
|
||||||
|
# Terminology
|
||||||
|
|
||||||
|
## Woodpecker architecture
|
||||||
|
|
||||||
|
![Woodpecker architecture](architecture.svg)
|
||||||
|
|
||||||
|
## Pipeline, workflow & step
|
||||||
|
|
||||||
|
![Relation between pipelines, workflows and steps](pipeline-workflow-step.svg)
|
||||||
|
|
||||||
|
## Glossary
|
||||||
|
|
||||||
|
- **Woodpecker CI**: The project name around Woodpecker.
|
||||||
|
- **Woodpecker**: An open-source tool that executes [pipelines][Pipeline] on your code.
|
||||||
|
- **Server**: The component of Woodpecker that handles webhooks from forges, orchestrates agents, and sends status back. It also serves the API and web UI for administration and configuration.
|
||||||
|
- **Agent**: A component of Woodpecker that executes [pipelines][Pipeline] (specifically one or more [workflows][Workflow]) with a specific backend (e.g. [Docker][], Kubernetes, [local][Local]). It connects to the server via GRPC.
|
||||||
|
- **CLI**: The Woodpecker command-line interface (CLI) is a terminal tool used to administer the server, to execute pipelines locally for debugging / testing purposes, and to perform tasks like linting pipelines.
|
||||||
|
- **Pipeline**: A sequence of [workflows][Workflow] that are executed on the code. [Pipelines][Pipeline] are triggered by events.
|
||||||
|
- **Workflow**: A sequence of steps and services that are executed as part of a [pipeline][Pipeline]. Workflows are represented by YAML files. Each [workflow][Workflow] has its own isolated [workspace][Workspace], and often additional resources like a shared network (docker).
|
||||||
|
- **Steps**: Individual commands, actions or tasks within a [workflow][Workflow].
|
||||||
|
- **Code**: Refers to the files tracked by the version control system used by the [forge][Forge].
|
||||||
|
- **Repos**: Short for repositories, these are storage locations where code is stored.
|
||||||
|
- **Forge**: The hosting platform or service where the repositories are hosted.
|
||||||
|
- **Workspace**: A folder shared between all steps of a [workflow][Workflow] containing the repository and all the generated data from previous steps.
|
||||||
|
- **Event**: Triggers the execution of a [pipeline][Pipeline], such as a [forge][Forge] event like `push`, or `manual` triggered manually from the UI.
|
||||||
|
- **Commit**: A defined state of the code, usually associated with a version control system like Git.
|
||||||
|
- **Matrix**: A configuration option that allows the execution of [workflows][Workflow] for each value in the [matrix][Matrix].
|
||||||
|
- **Service**: A service is a step that is executed from the start of a [workflow][Workflow] until its end. It can be accessed by name via the network from other steps within the same [workflow][Workflow].
|
||||||
|
- **Plugins**: [Plugins][Plugin] are extensions that provide pre-defined actions or commands for a step in a [workflow][Workflow]. They can be configured via settings.
|
||||||
|
- **Container**: A lightweight and isolated environment where commands are executed.
|
||||||
|
- **YAML File**: A file format used to define and configure [workflows][Workflow].
|
||||||
|
- **Dependency**: [Workflows][Workflow] can depend on each other, and if possible, they are executed in parallel.
|
||||||
|
- **Status**: Status refers to the outcome of a step or [workflow][Workflow] after it has been executed, determined by the internal command exit code. At the end of a [workflow][Workflow], its status is sent to the [forge][Forge].
|
||||||
|
- **Service extension**: Some parts of woodpecker internal services like secrets storage or config fetcher can be replaced through service extensions.
|
||||||
|
|
||||||
|
## Pipeline events
|
||||||
|
|
||||||
|
- `push`: A push event is triggered when a commit is pushed to a branch.
|
||||||
|
- `pull_request`: A pull request event is triggered when a pull request is opened or a new commit is pushed to it.
|
||||||
|
- `pull_request_closed`: A pull request closed event is triggered when a pull request is closed or merged.
|
||||||
|
- `tag`: A tag event is triggered when a tag is pushed.
|
||||||
|
- `release`: A release event is triggered when a release, pre-release or draft is created. (You can apply further filters using [evaluate](../20-workflow-syntax.md#evaluate) with [environment variables](../50-environment.md#built-in-environment-variables).)
|
||||||
|
- `manual`: A manual event is triggered when a user manually triggers a pipeline.
|
||||||
|
- `cron`: A cron event is triggered when a cron job is executed.
|
||||||
|
|
||||||
|
## Conventions
|
||||||
|
|
||||||
|
Sometimes there are multiple terms that can be used to describe something. This section lists the preferred terms to use in Woodpecker:
|
||||||
|
|
||||||
|
- Environment variables `*_LINK` should be called `*_URL`. In the code use `URL()` instead of `Link()`
|
||||||
|
- Use the term **pipelines** instead of the previous **builds**
|
||||||
|
- Use the term **steps** instead of the previous **jobs**
|
||||||
|
|
||||||
|
<!-- References -->
|
||||||
|
|
||||||
|
[Pipeline]: ../20-workflow-syntax.md
|
||||||
|
[Workflow]: ../25-workflows.md
|
||||||
|
[Forge]: ../../30-administration/11-forges/10-overview.md
|
||||||
|
[Plugin]: ../51-plugins/10-overview.md
|
||||||
|
[Workspace]: ../20-workflow-syntax.md#workspace
|
||||||
|
[Matrix]: ../30-matrix-workflows.md
|
||||||
|
[Docker]: ../../30-administration/22-backends/10-docker.md
|
||||||
|
[Local]: ../../30-administration/22-backends/20-local.md
|
After Width: | Height: | Size: 21 KiB |
758
docs/versioned_docs/version-2.4/20-usage/20-workflow-syntax.md
Normal file
|
@ -0,0 +1,758 @@
|
||||||
|
# Workflow syntax
|
||||||
|
|
||||||
|
The workflow section defines a list of steps to build, test and deploy your code. Steps are executed serially, in the order in which they are defined. If a step returns a non-zero exit code, the workflow and therefore all other workflows and the pipeline immediately aborts and returns a failure status.
|
||||||
|
|
||||||
|
Example steps:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: backend
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
- name: frontend
|
||||||
|
image: node
|
||||||
|
commands:
|
||||||
|
- npm install
|
||||||
|
- npm run test
|
||||||
|
- npm run build
|
||||||
|
```
|
||||||
|
|
||||||
|
In the above example we define two steps, `frontend` and `backend`. The names of these steps are completely arbitrary.
|
||||||
|
|
||||||
|
The name is optional, if not added the steps will be numerated.
|
||||||
|
|
||||||
|
Another way to name a step is by using dictionaries:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
backend:
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
frontend:
|
||||||
|
image: node
|
||||||
|
commands:
|
||||||
|
- npm install
|
||||||
|
- npm run test
|
||||||
|
- npm run build
|
||||||
|
```
|
||||||
|
|
||||||
|
## Skip Commits
|
||||||
|
|
||||||
|
Woodpecker gives the ability to skip individual commits by adding `[SKIP CI]` or `[CI SKIP]` to the commit message. Note this is case-insensitive.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
git commit -m "updated README [CI SKIP]"
|
||||||
|
```
|
||||||
|
|
||||||
|
## Steps
|
||||||
|
|
||||||
|
Every step of your workflow executes commands inside a specified container. The defined commands are executed serially.
|
||||||
|
The associated commit is checked out with git to a workspace which is mounted to every step of the workflow as the working directory.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: backend
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
+ - go build
|
||||||
|
+ - go test
|
||||||
|
```
|
||||||
|
|
||||||
|
### File changes are incremental
|
||||||
|
|
||||||
|
- Woodpecker clones the source code in the beginning of the workflow
|
||||||
|
- Changes to files are persisted through steps as the same volume is mounted to all steps
|
||||||
|
|
||||||
|
```yaml title=".woodpecker.yaml"
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- echo "test content" > myfile
|
||||||
|
- name: a-test-step
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- cat myfile
|
||||||
|
```
|
||||||
|
|
||||||
|
### `image`
|
||||||
|
|
||||||
|
Woodpecker pulls the defined image and uses it as environment to execute the workflow step commands, for plugins and for service containers.
|
||||||
|
|
||||||
|
When using the `local` backend, the `image` entry is used to specify the shell, such as Bash or Fish, that is used to run the commands.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
+ image: golang:1.6
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
- name: publish
|
||||||
|
+ image: plugins/docker
|
||||||
|
repo: foo/bar
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
+ image: mysql
|
||||||
|
```
|
||||||
|
|
||||||
|
Woodpecker supports any valid Docker image from any Docker registry:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
image: golang
|
||||||
|
image: golang:1.7
|
||||||
|
image: library/golang:1.7
|
||||||
|
image: index.docker.io/library/golang
|
||||||
|
image: index.docker.io/library/golang:1.7
|
||||||
|
```
|
||||||
|
|
||||||
|
Woodpecker does not automatically upgrade container images. Example configuration to always pull the latest image when updates are available:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang:latest
|
||||||
|
+ pull: true
|
||||||
|
```
|
||||||
|
|
||||||
|
Learn more how you can use images from [different registries](./41-registries.md).
|
||||||
|
|
||||||
|
### `commands`
|
||||||
|
|
||||||
|
Commands of every step are executed serially as if you would enter them into your local shell.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: backend
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
+ - go build
|
||||||
|
+ - go test
|
||||||
|
```
|
||||||
|
|
||||||
|
There is no magic here. The above commands are converted to a simple shell script. The commands in the above example are roughly converted to the below script:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
#!/bin/sh
|
||||||
|
set -e
|
||||||
|
|
||||||
|
go build
|
||||||
|
go test
|
||||||
|
```
|
||||||
|
|
||||||
|
The above shell script is then executed as the container entrypoint. The below docker command is an (incomplete) example of how the script is executed:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker run --entrypoint=build.sh golang
|
||||||
|
```
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Only build steps can define commands. You cannot use commands with plugins or services.
|
||||||
|
:::
|
||||||
|
|
||||||
|
### `entrypoint`
|
||||||
|
|
||||||
|
Allows you to specify the entrypoint for containers. Note that this must be a list of the command and its arguments (e.g. `["/bin/sh", "-c"]`).
|
||||||
|
|
||||||
|
### `environment`
|
||||||
|
|
||||||
|
Woodpecker provides the ability to pass environment variables to individual steps.
|
||||||
|
|
||||||
|
For more details, check the [environment docs](./50-environment.md).
|
||||||
|
|
||||||
|
### `secrets`
|
||||||
|
|
||||||
|
Woodpecker provides the ability to store named parameters external to the YAML configuration file, in a central secret store. These secrets can be passed to individual steps of the workflow at runtime.
|
||||||
|
|
||||||
|
For more details, check the [secrets docs](./40-secrets.md).
|
||||||
|
|
||||||
|
### `failure`
|
||||||
|
|
||||||
|
Some of the steps may be allowed to fail without causing the whole workflow and therefore pipeline to report a failure (e.g., a step executing a linting check). To enable this, add `failure: ignore` to your step. If Woodpecker encounters an error while executing the step, it will report it as failed but still executes the next steps of the workflow, if any, without affecting the status of the workflow.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: backend
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
+ failure: ignore
|
||||||
|
```
|
||||||
|
|
||||||
|
### `when` - Conditional Execution
|
||||||
|
|
||||||
|
Woodpecker supports defining a list of conditions for a step by using a `when` block. If at least one of the conditions in the `when` block evaluate to true the step is executed, otherwise it is skipped. A condition can be a check like:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: slack
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
+ when:
|
||||||
|
+ - event: pull_request
|
||||||
|
+ repo: test/test
|
||||||
|
+ - event: push
|
||||||
|
+ branch: main
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `repo`
|
||||||
|
|
||||||
|
Example conditional execution by repository:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: slack
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
+ when:
|
||||||
|
+ - repo: test/test
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `branch`
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Branch conditions are not applied to tags.
|
||||||
|
:::
|
||||||
|
|
||||||
|
Example conditional execution by branch:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: slack
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
+ when:
|
||||||
|
+ - branch: main
|
||||||
|
```
|
||||||
|
|
||||||
|
> The step now triggers on main branch, but also if the target branch of a pull request is `main`. Add an event condition to limit it further to pushes on main only.
|
||||||
|
|
||||||
|
Execute a step if the branch is `main` or `develop`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- branch: [main, develop]
|
||||||
|
```
|
||||||
|
|
||||||
|
Execute a step if the branch starts with `prefix/*`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- branch: prefix/*
|
||||||
|
```
|
||||||
|
|
||||||
|
The branch matching is done using [doublestar](https://github.com/bmatcuk/doublestar/#usage), note that a pattern starting with `*` should be put between quotes and a literal `/` needs to be escaped. A few examples:
|
||||||
|
|
||||||
|
- `*\\/*` to match patterns with exactly 1 `/`
|
||||||
|
- `*\\/**` to match patters with at least 1 `/`
|
||||||
|
- `*` to match patterns without `/`
|
||||||
|
- `**` to match everything
|
||||||
|
|
||||||
|
Execute a step using custom include and exclude logic:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- branch:
|
||||||
|
include: [main, release/*]
|
||||||
|
exclude: [release/1.0.0, release/1.1.*]
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `event`
|
||||||
|
|
||||||
|
Available events: `push`, `pull_request`, `pull_request_closed`, `tag`, `release`, `deployment`, `cron`, `manual`
|
||||||
|
|
||||||
|
Execute a step if the build event is a `tag`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- event: tag
|
||||||
|
```
|
||||||
|
|
||||||
|
Execute a step if the pipeline event is a `push` to a specified branch:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
when:
|
||||||
|
- event: push
|
||||||
|
+ branch: main
|
||||||
|
```
|
||||||
|
|
||||||
|
Execute a step for multiple events:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- event: [push, tag, deployment]
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `cron`
|
||||||
|
|
||||||
|
This filter **only** applies to cron events and filters based on the name of a cron job.
|
||||||
|
|
||||||
|
Make sure to have a `event: cron` condition in the `when`-filters as well.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- event: cron
|
||||||
|
cron: sync_* # name of your cron job
|
||||||
|
```
|
||||||
|
|
||||||
|
[Read more about cron](./45-cron.md)
|
||||||
|
|
||||||
|
#### `ref`
|
||||||
|
|
||||||
|
The `ref` filter compares the git reference against which the workflow is executed.
|
||||||
|
This allows you to filter, for example, tags that must start with **v**:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- event: tag
|
||||||
|
ref: refs/tags/v*
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `status`
|
||||||
|
|
||||||
|
There are use cases for executing steps on failure, such as sending notifications for failed workflow / pipeline. Use the status constraint to execute steps even when the workflow fails:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: slack
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
+ when:
|
||||||
|
+ - status: [ success, failure ]
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `platform`
|
||||||
|
|
||||||
|
:::note
|
||||||
|
This condition should be used in conjunction with a [matrix](./30-matrix-workflows.md#example-matrix-pipeline-using-multiple-platforms) workflow as a regular workflow will only be executed by a single agent which only has one arch.
|
||||||
|
:::
|
||||||
|
|
||||||
|
Execute a step for a specific platform:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- platform: linux/amd64
|
||||||
|
```
|
||||||
|
|
||||||
|
Execute a step for a specific platform using wildcards:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- platform: [linux/*, windows/amd64]
|
||||||
|
```
|
||||||
|
|
||||||
|
<!-- markdownlint-disable no-duplicate-heading -->
|
||||||
|
|
||||||
|
#### `environment`
|
||||||
|
|
||||||
|
<!-- markdownlint-enable no-duplicate-heading -->
|
||||||
|
|
||||||
|
Execute a step for deployment events matching the target deployment environment:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- environment: production
|
||||||
|
- event: deployment
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `matrix`
|
||||||
|
|
||||||
|
Execute a step for a single matrix permutation:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- matrix:
|
||||||
|
GO_VERSION: 1.5
|
||||||
|
REDIS_VERSION: 2.8
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `instance`
|
||||||
|
|
||||||
|
Execute a step only on a certain Woodpecker instance matching the specified hostname:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- instance: stage.woodpecker.company.com
|
||||||
|
```
|
||||||
|
|
||||||
|
#### `path`
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Path conditions are applied only to **push** and **pull_request** events.
|
||||||
|
It is currently **only available** for GitHub, GitLab and Gitea (version 1.18.0 and newer)
|
||||||
|
:::
|
||||||
|
|
||||||
|
Execute a step only on a pipeline with certain files being changed:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- path: 'src/*'
|
||||||
|
```
|
||||||
|
|
||||||
|
You can use [glob patterns](https://github.com/bmatcuk/doublestar#patterns) to match the changed files and specify if the step should run if a file matching that pattern has been changed `include` or if some files have **not** been changed `exclude`.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- path:
|
||||||
|
include: ['.woodpecker/*.yaml', '*.ini']
|
||||||
|
exclude: ['*.md', 'docs/**']
|
||||||
|
ignore_message: '[ALL]'
|
||||||
|
```
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Passing a defined ignore-message like `[ALL]` inside the commit message will ignore all path conditions.
|
||||||
|
:::
|
||||||
|
|
||||||
|
#### `evaluate`
|
||||||
|
|
||||||
|
Execute a step only if the provided evaluate expression is equal to true. Both built-in [`CI_`](./50-environment.md#built-in-environment-variables) and custom variables can be used inside the expression.
|
||||||
|
|
||||||
|
The expression syntax can be found in [the docs](https://github.com/expr-lang/expr/blob/master/docs/language-definition.md) of the underlying library.
|
||||||
|
|
||||||
|
Run on pushes to the default branch for the repository `owner/repo`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- evaluate: 'CI_PIPELINE_EVENT == "push" && CI_REPO == "owner/repo" && CI_COMMIT_BRANCH == CI_REPO_DEFAULT_BRANCH'
|
||||||
|
```
|
||||||
|
|
||||||
|
Run on commits created by user `woodpecker-ci`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- evaluate: 'CI_COMMIT_AUTHOR == "woodpecker-ci"'
|
||||||
|
```
|
||||||
|
|
||||||
|
Skip all commits containing `please ignore me` in the commit message:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- evaluate: 'not (CI_COMMIT_MESSAGE contains "please ignore me")'
|
||||||
|
```
|
||||||
|
|
||||||
|
Run on pull requests with the label `deploy`:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- evaluate: 'CI_COMMIT_PULL_REQUEST_LABELS contains "deploy"'
|
||||||
|
```
|
||||||
|
|
||||||
|
Skip step only if `SKIP=true`, run otherwise or if undefined:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
when:
|
||||||
|
- evaluate: 'SKIP != "true"'
|
||||||
|
```
|
||||||
|
|
||||||
|
### `depends_on`
|
||||||
|
|
||||||
|
Normally steps of a workflow are executed serially in the order in which they are defined. As soon as you set `depends_on` for a step a [directed acyclic graph](https://en.wikipedia.org/wiki/Directed_acyclic_graph) will be used and all steps of the workflow will be executed in parallel besides the steps that have a dependency set to another step using `depends_on`:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build # build will be executed immediately
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
|
||||||
|
- name: deploy
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
repo: foo/bar
|
||||||
|
+ depends_on: [build, test] # deploy will be executed after build and test finished
|
||||||
|
|
||||||
|
- name: test # test will be executed immediately as no dependencies are set
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
### `volumes`
|
||||||
|
|
||||||
|
Woodpecker gives the ability to define Docker volumes in the YAML. You can use this parameter to mount files or folders on the host machine into your containers.
|
||||||
|
|
||||||
|
For more details check the [volumes docs](./70-volumes.md).
|
||||||
|
|
||||||
|
### `detach`
|
||||||
|
|
||||||
|
Woodpecker gives the ability to detach steps to run them in background until the workflow finishes.
|
||||||
|
|
||||||
|
For more details check the [service docs](./60-services.md#detachment).
|
||||||
|
|
||||||
|
### `directory`
|
||||||
|
|
||||||
|
Using `directory`, you can set a subdirectory of your repository or an absolute path inside the Docker container in which your commands will run.
|
||||||
|
|
||||||
|
## `services`
|
||||||
|
|
||||||
|
Woodpecker can provide service containers. They can for example be used to run databases or cache containers during the execution of workflow.
|
||||||
|
|
||||||
|
For more details check the [services docs](./60-services.md).
|
||||||
|
|
||||||
|
## `workspace`
|
||||||
|
|
||||||
|
The workspace defines the shared volume and working directory shared by all workflow steps. The default workspace matches the pattern `/woodpecker/src/github.com/octocat/hello-world`, based on your repository URL.
|
||||||
|
|
||||||
|
The workspace can be customized using the workspace block in the YAML file:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+workspace:
|
||||||
|
+ base: /go
|
||||||
|
+ path: src/github.com/octocat/hello-world
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang:latest
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
The base attribute defines a shared base volume available to all steps. This ensures your source code, dependencies and compiled binaries are persisted and shared between steps.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
workspace:
|
||||||
|
+ base: /go
|
||||||
|
path: src/github.com/octocat/hello-world
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: deps
|
||||||
|
image: golang:latest
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go test
|
||||||
|
- name: build
|
||||||
|
image: node:latest
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
```
|
||||||
|
|
||||||
|
This would be equivalent to the following docker commands:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker volume create my-named-volume
|
||||||
|
|
||||||
|
docker run --volume=my-named-volume:/go golang:latest
|
||||||
|
docker run --volume=my-named-volume:/go node:latest
|
||||||
|
```
|
||||||
|
|
||||||
|
The path attribute defines the working directory of your build. This is where your code is cloned and will be the default working directory of every step in your build process. The path must be relative and is combined with your base path.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
workspace:
|
||||||
|
base: /go
|
||||||
|
+ path: src/github.com/octocat/hello-world
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash
|
||||||
|
git clone https://github.com/octocat/hello-world \
|
||||||
|
/go/src/github.com/octocat/hello-world
|
||||||
|
```
|
||||||
|
|
||||||
|
<!-- markdownlint-disable no-duplicate-heading -->
|
||||||
|
|
||||||
|
## `matrix`
|
||||||
|
|
||||||
|
<!-- markdownlint-enable no-duplicate-heading -->
|
||||||
|
|
||||||
|
Woodpecker has integrated support for matrix builds. Woodpecker executes a separate build task for each combination in the matrix, allowing you to build and test a single commit against multiple configurations.
|
||||||
|
|
||||||
|
For more details check the [matrix build docs](./30-matrix-workflows.md).
|
||||||
|
|
||||||
|
## `labels`
|
||||||
|
|
||||||
|
You can set labels for your workflow to select an agent to execute the workflow on. An agent will pick up and run a workflow when **every** label assigned to it matches the agents labels.
|
||||||
|
|
||||||
|
To set additional agent labels, check the [agent configuration options](../30-administration/15-agent-config.md#woodpecker_filter_labels). Agents will have at least four default labels: `platform=agent-os/agent-arch`, `hostname=my-agent`, `backend=docker` (type of the agent backend) and `repo=*`. Agents can use a `*` as a wildcard for a label. For example `repo=*` will match every repo.
|
||||||
|
|
||||||
|
Workflow labels with an empty value will be ignored.
|
||||||
|
By default, each workflow has at least the `repo=your-user/your-repo-name` label. If you have set the [platform attribute](#platform) for your workflow it will have a label like `platform=your-os/your-arch` as well.
|
||||||
|
|
||||||
|
You can add additional labels as a key value map:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+labels:
|
||||||
|
+ location: europe # only agents with `location=europe` or `location=*` will be used
|
||||||
|
+ weather: sun
|
||||||
|
+ hostname: "" # this label will be ignored as it is empty
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
### Filter by platform
|
||||||
|
|
||||||
|
To configure your workflow to only be executed on an agent with a specific platform, you can use the `platform` key.
|
||||||
|
Have a look at the official [go docs](https://go.dev/doc/install/source) for the available platforms. The syntax of the platform is `GOOS/GOARCH` like `linux/arm64` or `linux/amd64`.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
Assuming we have two agents, one `linux/arm` and one `linux/amd64`. Previously this workflow would have executed on **either agent**, as Woodpecker is not fussy about where it runs the workflows. By setting the following option it will only be executed on an agent with the platform `linux/arm64`.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+labels:
|
||||||
|
+ platform: linux/arm64
|
||||||
|
|
||||||
|
steps:
|
||||||
|
[...]
|
||||||
|
```
|
||||||
|
|
||||||
|
## `variables`
|
||||||
|
|
||||||
|
Woodpecker supports using [YAML anchors & aliases](https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases) as variables in the workflow configuration.
|
||||||
|
|
||||||
|
For more details and examples check the [Advanced usage docs](./90-advanced-usage.md)
|
||||||
|
|
||||||
|
## `clone`
|
||||||
|
|
||||||
|
Woodpecker automatically configures a default clone step if not explicitly defined. When using the `local` backend, the [plugin-git](https://github.com/woodpecker-ci/plugin-git) binary must be on your `$PATH` for the default clone step to work. If not, you can still write a manual clone step.
|
||||||
|
|
||||||
|
You can manually configure the clone step in your workflow for customization:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+clone:
|
||||||
|
+ git:
|
||||||
|
+ image: woodpeckerci/plugin-git
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
Example configuration to override depth:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
clone:
|
||||||
|
- name: git
|
||||||
|
image: woodpeckerci/plugin-git
|
||||||
|
+ settings:
|
||||||
|
+ partial: false
|
||||||
|
+ depth: 50
|
||||||
|
```
|
||||||
|
|
||||||
|
Example configuration to use a custom clone plugin:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
clone:
|
||||||
|
git:
|
||||||
|
+ image: octocat/custom-git-plugin
|
||||||
|
```
|
||||||
|
|
||||||
|
Example configuration to clone Mercurial repository:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
clone:
|
||||||
|
- name: hg
|
||||||
|
+ image: plugins/hg
|
||||||
|
+ settings:
|
||||||
|
+ path: bitbucket.org/foo/bar
|
||||||
|
```
|
||||||
|
|
||||||
|
### Git Submodules
|
||||||
|
|
||||||
|
To use the credentials that cloned the repository to clone it's submodules, update `.gitmodules` to use `https` instead of `git`:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
[submodule "my-module"]
|
||||||
|
path = my-module
|
||||||
|
-url = git@github.com:octocat/my-module.git
|
||||||
|
+url = https://github.com/octocat/my-module.git
|
||||||
|
```
|
||||||
|
|
||||||
|
To use the ssh git url in `.gitmodules` for users cloning with ssh, and also use the https url in Woodpecker, add `submodule_override`:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
clone:
|
||||||
|
- name: git
|
||||||
|
image: woodpeckerci/plugin-git
|
||||||
|
settings:
|
||||||
|
recursive: true
|
||||||
|
+ submodule_override:
|
||||||
|
+ my-module: https://github.com/octocat/my-module.git
|
||||||
|
|
||||||
|
steps:
|
||||||
|
...
|
||||||
|
```
|
||||||
|
|
||||||
|
## `skip_clone`
|
||||||
|
|
||||||
|
By default Woodpecker is automatically adding a clone step. This clone step can be configured by the [clone](#clone) property. If you do not need a `clone` step at all you can skip it using:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
skip_clone: true
|
||||||
|
```
|
||||||
|
|
||||||
|
## `when` - Global workflow conditions
|
||||||
|
|
||||||
|
Woodpecker gives the ability to skip whole workflows (not just steps #when---conditional-execution-1) based on certain conditions by a `when` block. If all conditions in the `when` block evaluate to true the workflow is executed, otherwise it is skipped, but treated as successful and other workflows depending on it will still continue.
|
||||||
|
|
||||||
|
For more information about the specific filters, take a look at the [step-specific `when` filters](#when---conditional-execution).
|
||||||
|
|
||||||
|
Example conditional execution by branch:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+when:
|
||||||
|
+ branch: main
|
||||||
|
+
|
||||||
|
steps:
|
||||||
|
- name: slack
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
```
|
||||||
|
|
||||||
|
The workflow now triggers on `main`, but also if the target branch of a pull request is `main`.
|
||||||
|
|
||||||
|
<!-- markdownlint-disable no-duplicate-heading -->
|
||||||
|
|
||||||
|
## `depends_on`
|
||||||
|
|
||||||
|
<!-- markdownlint-enable no-duplicate-heading -->
|
||||||
|
|
||||||
|
Woodpecker supports to define multiple workflows for a repository. Those workflows will run independent from each other. To depend them on each other you can use the [`depends_on`](./25-workflows.md#flow-control) keyword.
|
||||||
|
|
||||||
|
## `runs_on`
|
||||||
|
|
||||||
|
Workflows that should run even on failure should set the `runs_on` tag. See [here](./25-workflows.md#flow-control) for an example.
|
||||||
|
|
||||||
|
## Privileged mode
|
||||||
|
|
||||||
|
Woodpecker gives the ability to configure privileged mode in the YAML. You can use this parameter to launch containers with escalated capabilities.
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Privileged mode is only available to trusted repositories and for security reasons should only be used in private environments. See [project settings](./71-project-settings.md#trusted) to enable trusted mode.
|
||||||
|
:::
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: docker
|
||||||
|
environment:
|
||||||
|
- DOCKER_HOST=tcp://docker:2375
|
||||||
|
commands:
|
||||||
|
- docker --tls=false ps
|
||||||
|
|
||||||
|
- name: services
|
||||||
|
docker:
|
||||||
|
image: docker:dind
|
||||||
|
commands: dockerd-entrypoint.sh --storage-driver=vfs --tls=false
|
||||||
|
+ privileged: true
|
||||||
|
```
|
118
docs/versioned_docs/version-2.4/20-usage/25-workflows.md
Normal file
|
@ -0,0 +1,118 @@
|
||||||
|
# Workflows
|
||||||
|
|
||||||
|
A pipeline has at least one workflow. A workflow is a set of steps that are executed in sequence using the same workspace which is a shared folder containing the repository and all the generated data from previous steps.
|
||||||
|
|
||||||
|
In case there is a single configuration in `.woodpecker.yaml` Woodpecker will create a pipeline with a single workflow.
|
||||||
|
|
||||||
|
By placing the configurations in a folder which is by default named `.woodpecker/` Woodpecker will create a pipeline with multiple workflows each named by the file they are defined in. Only `.yml` and `.yaml` files will be used and files in any subfolders like `.woodpecker/sub-folder/test.yaml` will be ignored.
|
||||||
|
|
||||||
|
You can also set some custom path like `.my-ci/pipelines/` instead of `.woodpecker/` in the [project settings](./71-project-settings.md).
|
||||||
|
|
||||||
|
## Benefits of using workflows
|
||||||
|
|
||||||
|
- faster lint/test feedback, the workflow doesn't have to run fully to have a lint status pushed to the remote
|
||||||
|
- better organization of a pipeline along various concerns using one workflow for: testing, linting, building and deploying
|
||||||
|
- utilizing more agents to speed up the execution of the whole pipeline
|
||||||
|
|
||||||
|
## Example workflow definition
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Please note that files are only shared between steps of the same workflow (see [File changes are incremental](./20-workflow-syntax.md#file-changes-are-incremental)). That means you cannot access artifacts e.g. from the `build` workflow in the `deploy` workflow.
|
||||||
|
If you still need to pass artifacts between the workflows you need use some storage [plugin](./51-plugins/10-overview.md) (e.g. one which stores files in an Amazon S3 bucket).
|
||||||
|
:::
|
||||||
|
|
||||||
|
```bash
|
||||||
|
.woodpecker/
|
||||||
|
├── .build.yaml
|
||||||
|
├── .deploy.yaml
|
||||||
|
├── .lint.yaml
|
||||||
|
└── .test.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
```yaml title=".woodpecker/.build.yaml"
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo building
|
||||||
|
- sleep 5
|
||||||
|
```
|
||||||
|
|
||||||
|
```yaml title=".woodpecker/.deploy.yaml"
|
||||||
|
steps:
|
||||||
|
- name: deploy
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo deploying
|
||||||
|
|
||||||
|
depends_on:
|
||||||
|
- lint
|
||||||
|
- build
|
||||||
|
- test
|
||||||
|
```
|
||||||
|
|
||||||
|
```yaml title=".woodpecker/.test.yaml"
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo testing
|
||||||
|
- sleep 5
|
||||||
|
|
||||||
|
depends_on:
|
||||||
|
- build
|
||||||
|
```
|
||||||
|
|
||||||
|
```yaml title=".woodpecker/.lint.yaml"
|
||||||
|
steps:
|
||||||
|
- name: lint
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo linting
|
||||||
|
- sleep 5
|
||||||
|
```
|
||||||
|
|
||||||
|
## Status lines
|
||||||
|
|
||||||
|
Each workflow will report its own status back to your forge.
|
||||||
|
|
||||||
|
## Flow control
|
||||||
|
|
||||||
|
The workflows run in parallel on separate agents and share nothing.
|
||||||
|
|
||||||
|
Dependencies between workflows can be set with the `depends_on` element. A workflow doesn't execute until all of its dependencies finished successfully.
|
||||||
|
|
||||||
|
The name for a `depends_on` entry is the filename without the path, leading dots and without the file extension `.yml` or `.yaml`. If the project config for example uses `.woodpecker/` as path for CI files with a file named `.woodpecker/.lint.yaml` the corresponding `depends_on` entry would be `lint`.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: deploy
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo deploying
|
||||||
|
|
||||||
|
+depends_on:
|
||||||
|
+ - lint
|
||||||
|
+ - build
|
||||||
|
+ - test
|
||||||
|
```
|
||||||
|
|
||||||
|
Workflows that need to run even on failures should set the `runs_on` tag.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: notify
|
||||||
|
image: debian:stable-slim
|
||||||
|
commands:
|
||||||
|
- echo notifying
|
||||||
|
|
||||||
|
depends_on:
|
||||||
|
- deploy
|
||||||
|
|
||||||
|
+runs_on: [ success, failure ]
|
||||||
|
```
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Some workflows don't need the source code, like creating a notification on failure.
|
||||||
|
Read more about `skip_clone` at [pipeline syntax](./20-workflow-syntax.md#skip_clone)
|
||||||
|
:::
|
143
docs/versioned_docs/version-2.4/20-usage/30-matrix-workflows.md
Normal file
|
@ -0,0 +1,143 @@
|
||||||
|
# Matrix workflows
|
||||||
|
|
||||||
|
Woodpecker has integrated support for matrix workflows. Woodpecker executes a separate workflow for each combination in the matrix, allowing you to build and test against multiple configurations.
|
||||||
|
|
||||||
|
Example matrix definition:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
GO_VERSION:
|
||||||
|
- 1.4
|
||||||
|
- 1.3
|
||||||
|
REDIS_VERSION:
|
||||||
|
- 2.6
|
||||||
|
- 2.8
|
||||||
|
- 3.0
|
||||||
|
```
|
||||||
|
|
||||||
|
Example matrix definition containing only specific combinations:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
include:
|
||||||
|
- GO_VERSION: 1.4
|
||||||
|
REDIS_VERSION: 2.8
|
||||||
|
- GO_VERSION: 1.5
|
||||||
|
REDIS_VERSION: 2.8
|
||||||
|
- GO_VERSION: 1.6
|
||||||
|
REDIS_VERSION: 3.0
|
||||||
|
```
|
||||||
|
|
||||||
|
## Interpolation
|
||||||
|
|
||||||
|
Matrix variables are interpolated in the YAML using the `${VARIABLE}` syntax, before the YAML is parsed. This is an example YAML file before interpolating matrix parameters:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
GO_VERSION:
|
||||||
|
- 1.4
|
||||||
|
- 1.3
|
||||||
|
DATABASE:
|
||||||
|
- mysql:8
|
||||||
|
- mysql:5
|
||||||
|
- mariadb:10.1
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang:${GO_VERSION}
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: ${DATABASE}
|
||||||
|
```
|
||||||
|
|
||||||
|
Example YAML file after injecting the matrix parameters:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
- image: golang:${GO_VERSION}
|
||||||
|
+ image: golang:1.4
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
+ environment:
|
||||||
|
+ - GO_VERSION=1.4
|
||||||
|
+ - DATABASE=mysql:8
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
- image: ${DATABASE}
|
||||||
|
+ image: mysql:8
|
||||||
|
```
|
||||||
|
|
||||||
|
## Examples
|
||||||
|
|
||||||
|
### Example matrix pipeline based on Docker image tag
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
TAG:
|
||||||
|
- 1.7
|
||||||
|
- 1.8
|
||||||
|
- latest
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang:${TAG}
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
### Example matrix pipeline based on container image
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
IMAGE:
|
||||||
|
- golang:1.7
|
||||||
|
- golang:1.8
|
||||||
|
- golang:latest
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: ${IMAGE}
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
### Example matrix pipeline using multiple platforms
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
platform:
|
||||||
|
- linux/amd64
|
||||||
|
- linux/arm64
|
||||||
|
|
||||||
|
labels:
|
||||||
|
platform: ${platform}
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
image: alpine
|
||||||
|
commands:
|
||||||
|
- echo "I am running on ${platform}"
|
||||||
|
|
||||||
|
- name: test-arm-only
|
||||||
|
image: alpine
|
||||||
|
commands:
|
||||||
|
- echo "I am running on ${platform}"
|
||||||
|
- echo "Arm is cool!"
|
||||||
|
when:
|
||||||
|
platform: linux/arm*
|
||||||
|
```
|
||||||
|
|
||||||
|
:::note
|
||||||
|
If you want to control the architecture of a pipeline on a Kubernetes runner, see [the nodeSelector documentation of the Kubernetes backend](../30-administration/22-backends/40-kubernetes.md#node-selector).
|
||||||
|
:::
|
133
docs/versioned_docs/version-2.4/20-usage/40-secrets.md
Normal file
|
@ -0,0 +1,133 @@
|
||||||
|
# Secrets
|
||||||
|
|
||||||
|
Woodpecker provides the ability to store named parameters external to the YAML configuration file, in a central secret store. These secrets can be passed to individual steps of the pipeline at runtime.
|
||||||
|
|
||||||
|
Woodpecker provides three different levels to add secrets to your pipeline. The following list shows the priority of the different levels. If a secret is defined in multiple levels, will be used following this priorities: Repository secrets > Organization secrets > Global secrets.
|
||||||
|
|
||||||
|
1. **Repository secrets**: They are available to all pipelines of an repository.
|
||||||
|
2. **Organization secrets**: They are available to all pipelines of an organization.
|
||||||
|
3. **Global secrets**: Can be configured by an instance admin.
|
||||||
|
They are available to all pipelines of the **whole** Woodpecker instance and should therefore **only** be used for secrets that are allowed to be read by **all** users.
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
### Use secrets in commands
|
||||||
|
|
||||||
|
Secrets are exposed to your pipeline steps and plugins as uppercase environment variables and can therefore be referenced in the commands section of your pipeline,
|
||||||
|
once their usage is declared in the `secrets` section:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: docker
|
||||||
|
commands:
|
||||||
|
+ - echo $docker_username
|
||||||
|
+ - echo $DOCKER_PASSWORD
|
||||||
|
+ secrets: [ docker_username, DOCKER_PASSWORD ]
|
||||||
|
```
|
||||||
|
|
||||||
|
The case of the environment variables is not changed, but secret matching is done case-insensitively. In the example above, `DOCKER_PASSWORD` would also match if the secret is called `docker_password`.
|
||||||
|
|
||||||
|
### Use secrets in settings and environment
|
||||||
|
|
||||||
|
You can set an setting or environment value from secrets using the `from_secret` syntax.
|
||||||
|
|
||||||
|
In this example, the secret named `secret_token` would be passed to the setting named `token`,which will be available in the plugin as environment variable named `PLUGIN_TOKEN` (See [plugins](./51-plugins/20-creating-plugins.md#settings) for details), and to the environment variable `TOKEN_ENV`.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: my-plugin
|
||||||
|
+ environment:
|
||||||
|
+ TOKEN_ENV:
|
||||||
|
+ from_secret: secret_token
|
||||||
|
+ settings:
|
||||||
|
+ token:
|
||||||
|
+ from_secret: secret_token
|
||||||
|
```
|
||||||
|
|
||||||
|
### Note about parameter pre-processing
|
||||||
|
|
||||||
|
Please note parameter expressions are subject to pre-processing. When using secrets in parameter expressions they should be escaped.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: docker
|
||||||
|
commands:
|
||||||
|
- - echo ${docker_username}
|
||||||
|
- - echo ${DOCKER_PASSWORD}
|
||||||
|
+ - echo $${docker_username}
|
||||||
|
+ - echo $${DOCKER_PASSWORD}
|
||||||
|
secrets: [ docker_username, DOCKER_PASSWORD ]
|
||||||
|
```
|
||||||
|
|
||||||
|
### Use in Pull Requests events
|
||||||
|
|
||||||
|
Secrets are not exposed to pull requests by default. You can override this behavior by creating the secret and enabling the `pull_request` event type, either in UI or by CLI, see below.
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Please be careful when exposing secrets to pull requests. If your repository is open source and accepts pull requests your secrets are not safe. A bad actor can submit a malicious pull request that exposes your secrets.
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Image filter
|
||||||
|
|
||||||
|
To prevent abusing your secrets from malicious usage, you can limit a secret to a list of images. If enabled they are not available to any other plugin (steps without user-defined commands). If you or an attacker defines explicit commands, the secrets will not be available to the container to prevent leaking them.
|
||||||
|
|
||||||
|
## Adding Secrets
|
||||||
|
|
||||||
|
Secrets are added to the Woodpecker in the UI or with the CLI.
|
||||||
|
|
||||||
|
### CLI Examples
|
||||||
|
|
||||||
|
Create the secret using default settings. The secret will be available to all images in your pipeline, and will be available to all push, tag, and deployment events (not pull request events).
|
||||||
|
|
||||||
|
```bash
|
||||||
|
woodpecker-cli secret add \
|
||||||
|
-repository octocat/hello-world \
|
||||||
|
-name aws_access_key_id \
|
||||||
|
-value <value>
|
||||||
|
```
|
||||||
|
|
||||||
|
Create the secret and limit to a single image:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
woodpecker-cli secret add \
|
||||||
|
-repository octocat/hello-world \
|
||||||
|
+ -image plugins/s3 \
|
||||||
|
-name aws_access_key_id \
|
||||||
|
-value <value>
|
||||||
|
```
|
||||||
|
|
||||||
|
Create the secrets and limit to a set of images:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
woodpecker-cli secret add \
|
||||||
|
-repository octocat/hello-world \
|
||||||
|
+ -image plugins/s3 \
|
||||||
|
+ -image peloton/woodpecker-ecs \
|
||||||
|
-name aws_access_key_id \
|
||||||
|
-value <value>
|
||||||
|
```
|
||||||
|
|
||||||
|
Create the secret and enable for multiple hook events:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
woodpecker-cli secret add \
|
||||||
|
-repository octocat/hello-world \
|
||||||
|
-image plugins/s3 \
|
||||||
|
+ -event pull_request \
|
||||||
|
+ -event push \
|
||||||
|
+ -event tag \
|
||||||
|
-name aws_access_key_id \
|
||||||
|
-value <value>
|
||||||
|
```
|
||||||
|
|
||||||
|
Loading secrets from file using curl `@` syntax. This is the recommended approach for loading secrets from file to preserve newlines:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
woodpecker-cli secret add \
|
||||||
|
-repository octocat/hello-world \
|
||||||
|
-name ssh_key \
|
||||||
|
+ -value @/root/ssh/id_rsa
|
||||||
|
```
|
73
docs/versioned_docs/version-2.4/20-usage/41-registries.md
Normal file
|
@ -0,0 +1,73 @@
|
||||||
|
# Registries
|
||||||
|
|
||||||
|
Woodpecker provides the ability to add container registries in the settings of your repository. Adding a registry allows you to authenticate and pull private images from a container registry when using these images as a step inside your pipeline. Using registry credentials can also help you avoid rate limiting when pulling images from public registries.
|
||||||
|
|
||||||
|
## Images from private registries
|
||||||
|
|
||||||
|
You must provide registry credentials in the UI in order to pull private container images defined in your YAML configuration file.
|
||||||
|
|
||||||
|
These credentials are never exposed to your steps, which means they cannot be used to push, and are safe to use with pull requests, for example. Pushing to a registry still requires setting credentials for the appropriate plugin.
|
||||||
|
|
||||||
|
Example configuration using a private image:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
+ image: gcr.io/custom/golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
Woodpecker matches the registry hostname to each image in your YAML. If the hostnames match, the registry credentials are used to authenticate to your registry and pull the image. Note that registry credentials are used by the Woodpecker agent and are never exposed to your build containers.
|
||||||
|
|
||||||
|
Example registry hostnames:
|
||||||
|
|
||||||
|
- Image `gcr.io/foo/bar` has hostname `gcr.io`
|
||||||
|
- Image `foo/bar` has hostname `docker.io`
|
||||||
|
- Image `qux.com:8000/foo/bar` has hostname `qux.com:8000`
|
||||||
|
|
||||||
|
Example registry hostname matching logic:
|
||||||
|
|
||||||
|
- Hostname `gcr.io` matches image `gcr.io/foo/bar`
|
||||||
|
- Hostname `docker.io` matches `golang`
|
||||||
|
- Hostname `docker.io` matches `library/golang`
|
||||||
|
- Hostname `docker.io` matches `bradyrydzewski/golang`
|
||||||
|
- Hostname `docker.io` matches `bradyrydzewski/golang:latest`
|
||||||
|
|
||||||
|
:::note
|
||||||
|
The flow above doesn't work in Kubernetes. There is [workaround](../30-administration/22-backends/40-kubernetes.md#images-from-private-registries).
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Global registry support
|
||||||
|
|
||||||
|
To make a private registry globally available, check the [server configuration docs](../30-administration/10-server-config.md#global-registry-setting).
|
||||||
|
|
||||||
|
## GCR registry support
|
||||||
|
|
||||||
|
For specific details on configuring access to Google Container Registry, please view the docs [here](https://cloud.google.com/container-registry/docs/advanced-authentication#using_a_json_key_file).
|
||||||
|
|
||||||
|
## Local Images
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
For this, privileged rights are needed only available to admins. In addition, this only works when using a single agent.
|
||||||
|
:::
|
||||||
|
|
||||||
|
It's possible to build a local image by mounting the docker socket as a volume.
|
||||||
|
|
||||||
|
With a `Dockerfile` at the root of the project:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build-image
|
||||||
|
image: docker
|
||||||
|
commands:
|
||||||
|
- docker build --rm -t local/project-image .
|
||||||
|
volumes:
|
||||||
|
- /var/run/docker.sock:/var/run/docker.sock
|
||||||
|
|
||||||
|
- name: build-project
|
||||||
|
image: local/project-image
|
||||||
|
commands:
|
||||||
|
- ./build.sh
|
||||||
|
```
|
34
docs/versioned_docs/version-2.4/20-usage/45-cron.md
Normal file
|
@ -0,0 +1,34 @@
|
||||||
|
# Cron
|
||||||
|
|
||||||
|
To configure cron jobs you need at least push access to the repository.
|
||||||
|
|
||||||
|
## Add a new cron job
|
||||||
|
|
||||||
|
1. To create a new cron job adjust your pipeline config(s) and add the event filter to all steps you would like to run by the cron job:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: sync_locales
|
||||||
|
image: weblate_sync
|
||||||
|
settings:
|
||||||
|
url: example.com
|
||||||
|
token:
|
||||||
|
from_secret: weblate_token
|
||||||
|
+ when:
|
||||||
|
+ event: cron
|
||||||
|
+ cron: "name of the cron job" # if you only want to execute this step by a specific cron job
|
||||||
|
```
|
||||||
|
|
||||||
|
1. Create a new cron job in the repository settings:
|
||||||
|
|
||||||
|
![cron settings](./cron-settings.png)
|
||||||
|
|
||||||
|
The supported schedule syntax can be found at <https://pkg.go.dev/github.com/robfig/cron?utm_source=godoc#hdr-CRON_Expression_Format>. If you need general understanding of the cron syntax <https://crontab.guru/> is a good place to start and experiment.
|
||||||
|
|
||||||
|
Examples: `@every 5m`, `@daily`, `0 30 * * * *` ...
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Woodpeckers cron syntax starts with seconds instead of minutes as used by most linux cron schedulers.
|
||||||
|
|
||||||
|
Example: "At minute 30 every hour" would be `0 30 * * * *` instead of `30 * * * *`
|
||||||
|
:::
|
224
docs/versioned_docs/version-2.4/20-usage/50-environment.md
Normal file
|
@ -0,0 +1,224 @@
|
||||||
|
# Environment variables
|
||||||
|
|
||||||
|
Woodpecker provides the ability to pass environment variables to individual pipeline steps. Note that these can't overwrite any existing, built-in variables. Example pipeline step with custom environment variables:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
+ environment:
|
||||||
|
+ CGO: 0
|
||||||
|
+ GOOS: linux
|
||||||
|
+ GOARCH: amd64
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
Please note that the environment section is not able to expand environment variables. If you need to expand variables they should be exported in the commands section.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
- environment:
|
||||||
|
- - PATH=$PATH:/go
|
||||||
|
commands:
|
||||||
|
+ - export PATH=$PATH:/go
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
`${variable}` expressions are subject to pre-processing. If you do not want the pre-processor to evaluate your expression it must be escaped:
|
||||||
|
:::
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- - export PATH=${PATH}:/go
|
||||||
|
+ - export PATH=$${PATH}:/go
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
## Built-in environment variables
|
||||||
|
|
||||||
|
This is the reference list of all environment variables available to your pipeline containers. These are injected into your pipeline step and plugins containers, at runtime.
|
||||||
|
|
||||||
|
| NAME | Description |
|
||||||
|
| -------------------------------- | ------------------------------------------------------------------------------------------------------------------ |
|
||||||
|
| `CI` | CI environment name (value: `woodpecker`) |
|
||||||
|
| | **Repository** |
|
||||||
|
| `CI_REPO` | repository full name `<owner>/<name>` |
|
||||||
|
| `CI_REPO_OWNER` | repository owner |
|
||||||
|
| `CI_REPO_NAME` | repository name |
|
||||||
|
| `CI_REPO_REMOTE_ID` | repository remote ID, is the UID it has in the forge |
|
||||||
|
| `CI_REPO_SCM` | repository SCM (git) |
|
||||||
|
| `CI_REPO_URL` | repository web URL |
|
||||||
|
| `CI_REPO_CLONE_URL` | repository clone URL |
|
||||||
|
| `CI_REPO_CLONE_SSH_URL` | repository SSH clone URL |
|
||||||
|
| `CI_REPO_DEFAULT_BRANCH` | repository default branch (main) |
|
||||||
|
| `CI_REPO_PRIVATE` | repository is private |
|
||||||
|
| `CI_REPO_TRUSTED` | repository is trusted |
|
||||||
|
| | **Current Commit** |
|
||||||
|
| `CI_COMMIT_SHA` | commit SHA |
|
||||||
|
| `CI_COMMIT_REF` | commit ref |
|
||||||
|
| `CI_COMMIT_REFSPEC` | commit ref spec |
|
||||||
|
| `CI_COMMIT_BRANCH` | commit branch (equals target branch for pull requests) |
|
||||||
|
| `CI_COMMIT_SOURCE_BRANCH` | commit source branch (empty if event is not `pull_request` or `pull_request_closed`) |
|
||||||
|
| `CI_COMMIT_TARGET_BRANCH` | commit target branch (empty if event is not `pull_request` or `pull_request_closed`) |
|
||||||
|
| `CI_COMMIT_TAG` | commit tag name (empty if event is not `tag`) |
|
||||||
|
| `CI_COMMIT_PULL_REQUEST` | commit pull request number (empty if event is not `pull_request` or `pull_request_closed`) |
|
||||||
|
| `CI_COMMIT_PULL_REQUEST_LABELS` | labels assigned to pull request (empty if event is not `pull_request` or `pull_request_closed`) |
|
||||||
|
| `CI_COMMIT_MESSAGE` | commit message |
|
||||||
|
| `CI_COMMIT_AUTHOR` | commit author username |
|
||||||
|
| `CI_COMMIT_AUTHOR_EMAIL` | commit author email address |
|
||||||
|
| `CI_COMMIT_AUTHOR_AVATAR` | commit author avatar |
|
||||||
|
| `CI_COMMIT_PRERELEASE` | release is a pre-release (empty if event is not `release`) |
|
||||||
|
| | **Current pipeline** |
|
||||||
|
| `CI_PIPELINE_NUMBER` | pipeline number |
|
||||||
|
| `CI_PIPELINE_PARENT` | number of parent pipeline |
|
||||||
|
| `CI_PIPELINE_EVENT` | pipeline event (see [pipeline events](../20-usage/15-terminiology/index.md#pipeline-events)) |
|
||||||
|
| `CI_PIPELINE_URL` | link to the web UI for the pipeline |
|
||||||
|
| `CI_PIPELINE_FORGE_URL` | link to the forge's web UI for the commit(s) or tag that triggered the pipeline |
|
||||||
|
| `CI_PIPELINE_DEPLOY_TARGET` | pipeline deploy target for `deployment` events (i.e. production) |
|
||||||
|
| `CI_PIPELINE_STATUS` | pipeline status (success, failure) |
|
||||||
|
| `CI_PIPELINE_CREATED` | pipeline created UNIX timestamp |
|
||||||
|
| `CI_PIPELINE_STARTED` | pipeline started UNIX timestamp |
|
||||||
|
| `CI_PIPELINE_FINISHED` | pipeline finished UNIX timestamp |
|
||||||
|
| `CI_PIPELINE_FILES` | changed files (empty if event is not `push` or `pull_request`), it is undefined if more than 500 files are touched |
|
||||||
|
| | **Current workflow** |
|
||||||
|
| `CI_WORKFLOW_NAME` | workflow name |
|
||||||
|
| | **Current step** |
|
||||||
|
| `CI_STEP_NAME` | step name |
|
||||||
|
| `CI_STEP_NUMBER` | step number |
|
||||||
|
| `CI_STEP_STATUS` | step status (success, failure) |
|
||||||
|
| `CI_STEP_STARTED` | step started UNIX timestamp |
|
||||||
|
| `CI_STEP_FINISHED` | step finished UNIX timestamp |
|
||||||
|
| `CI_STEP_URL` | URL to step in UI |
|
||||||
|
| | **Previous commit** |
|
||||||
|
| `CI_PREV_COMMIT_SHA` | previous commit SHA |
|
||||||
|
| `CI_PREV_COMMIT_REF` | previous commit ref |
|
||||||
|
| `CI_PREV_COMMIT_REFSPEC` | previous commit ref spec |
|
||||||
|
| `CI_PREV_COMMIT_BRANCH` | previous commit branch |
|
||||||
|
| `CI_PREV_COMMIT_SOURCE_BRANCH` | previous commit source branch |
|
||||||
|
| `CI_PREV_COMMIT_TARGET_BRANCH` | previous commit target branch |
|
||||||
|
| `CI_PREV_COMMIT_URL` | previous commit link in forge |
|
||||||
|
| `CI_PREV_COMMIT_MESSAGE` | previous commit message |
|
||||||
|
| `CI_PREV_COMMIT_AUTHOR` | previous commit author username |
|
||||||
|
| `CI_PREV_COMMIT_AUTHOR_EMAIL` | previous commit author email address |
|
||||||
|
| `CI_PREV_COMMIT_AUTHOR_AVATAR` | previous commit author avatar |
|
||||||
|
| | **Previous pipeline** |
|
||||||
|
| `CI_PREV_PIPELINE_NUMBER` | previous pipeline number |
|
||||||
|
| `CI_PREV_PIPELINE_PARENT` | previous pipeline number of parent pipeline |
|
||||||
|
| `CI_PREV_PIPELINE_EVENT` | previous pipeline event (see [pipeline events](../20-usage/15-terminiology/index.md#pipeline-events)) |
|
||||||
|
| `CI_PREV_PIPELINE_URL` | previous pipeline link in CI |
|
||||||
|
| `CI_PREV_PIPELINE_FORGE_URL` | previous pipeline link to event in forge |
|
||||||
|
| `CI_PREV_PIPELINE_DEPLOY_TARGET` | previous pipeline deploy target for `deployment` events (ie production) |
|
||||||
|
| `CI_PREV_PIPELINE_STATUS` | previous pipeline status (success, failure) |
|
||||||
|
| `CI_PREV_PIPELINE_CREATED` | previous pipeline created UNIX timestamp |
|
||||||
|
| `CI_PREV_PIPELINE_STARTED` | previous pipeline started UNIX timestamp |
|
||||||
|
| `CI_PREV_PIPELINE_FINISHED` | previous pipeline finished UNIX timestamp |
|
||||||
|
| |   |
|
||||||
|
| `CI_WORKSPACE` | Path of the workspace where source code gets cloned to |
|
||||||
|
| | **System** |
|
||||||
|
| `CI_SYSTEM_NAME` | name of the CI system: `woodpecker` |
|
||||||
|
| `CI_SYSTEM_URL` | link to CI system |
|
||||||
|
| `CI_SYSTEM_HOST` | hostname of CI server |
|
||||||
|
| `CI_SYSTEM_VERSION` | version of the server |
|
||||||
|
| | **Forge** |
|
||||||
|
| `CI_FORGE_TYPE` | name of forge (gitea, github, ...) |
|
||||||
|
| `CI_FORGE_URL` | root URL of configured forge |
|
||||||
|
| | **Internal** - Please don't use! |
|
||||||
|
| `CI_SCRIPT` | Internal script path. Used to call pipeline step commands. |
|
||||||
|
| `CI_NETRC_USERNAME` | Credentials for private repos to be able to clone data. (Only available for specific images) |
|
||||||
|
| `CI_NETRC_PASSWORD` | Credentials for private repos to be able to clone data. (Only available for specific images) |
|
||||||
|
| `CI_NETRC_MACHINE` | Credentials for private repos to be able to clone data. (Only available for specific images) |
|
||||||
|
|
||||||
|
## Global environment variables
|
||||||
|
|
||||||
|
If you want specific environment variables to be available in all of your pipelines use the `WOODPECKER_ENVIRONMENT` setting on the Woodpecker server. Note that these can't overwrite any existing, built-in variables.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_ENVIRONMENT=first_var:value1,second_var:value2
|
||||||
|
```
|
||||||
|
|
||||||
|
These can be used, for example, to manage the image tag used by multiple projects.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_ENVIRONMENT=GOLANG_VERSION:1.18
|
||||||
|
```
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
- image: golang:1.18
|
||||||
|
+ image: golang:${GOLANG_VERSION}
|
||||||
|
commands:
|
||||||
|
- [...]
|
||||||
|
```
|
||||||
|
|
||||||
|
## String Substitution
|
||||||
|
|
||||||
|
Woodpecker provides the ability to substitute environment variables at runtime. This gives us the ability to use dynamic settings, commands and filters in our pipeline configuration.
|
||||||
|
|
||||||
|
Example commit substitution:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
+ tags: ${CI_COMMIT_SHA}
|
||||||
|
```
|
||||||
|
|
||||||
|
Example tag substitution:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
+ tags: ${CI_COMMIT_TAG}
|
||||||
|
```
|
||||||
|
|
||||||
|
## String Operations
|
||||||
|
|
||||||
|
Woodpecker also emulates bash string operations. This gives us the ability to manipulate the strings prior to substitution. Example use cases might include substring and stripping prefix or suffix values.
|
||||||
|
|
||||||
|
| OPERATION | DESCRIPTION |
|
||||||
|
| ------------------ | ------------------------------------------------ |
|
||||||
|
| `${param}` | parameter substitution |
|
||||||
|
| `${param,}` | parameter substitution with lowercase first char |
|
||||||
|
| `${param,,}` | parameter substitution with lowercase |
|
||||||
|
| `${param^}` | parameter substitution with uppercase first char |
|
||||||
|
| `${param^^}` | parameter substitution with uppercase |
|
||||||
|
| `${param:pos}` | parameter substitution with substring |
|
||||||
|
| `${param:pos:len}` | parameter substitution with substring and length |
|
||||||
|
| `${param=default}` | parameter substitution with default |
|
||||||
|
| `${param##prefix}` | parameter substitution with prefix removal |
|
||||||
|
| `${param%%suffix}` | parameter substitution with suffix removal |
|
||||||
|
| `${param/old/new}` | parameter substitution with find and replace |
|
||||||
|
|
||||||
|
Example variable substitution with substring:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
+ tags: ${CI_COMMIT_SHA:0:8}
|
||||||
|
```
|
||||||
|
|
||||||
|
Example variable substitution strips `v` prefix from `v.1.0.0`:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: docker
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
+ tags: ${CI_COMMIT_TAG##v}
|
||||||
|
```
|
|
@ -0,0 +1,45 @@
|
||||||
|
# Plugins
|
||||||
|
|
||||||
|
Plugins are pipeline steps that perform pre-defined tasks and are configured as steps in your pipeline. Plugins can be used to deploy code, publish artifacts, send notification, and more.
|
||||||
|
|
||||||
|
They are automatically pulled from the default container registry the agent's have configured.
|
||||||
|
|
||||||
|
Example pipeline using the Docker and Slack plugins:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
- name: publish
|
||||||
|
image: plugins/docker
|
||||||
|
settings:
|
||||||
|
repo: foo/bar
|
||||||
|
tags: latest
|
||||||
|
|
||||||
|
- name: notify
|
||||||
|
image: plugins/slack
|
||||||
|
settings:
|
||||||
|
channel: dev
|
||||||
|
```
|
||||||
|
|
||||||
|
## Plugin Isolation
|
||||||
|
|
||||||
|
Plugins are just pipeline steps. They share the build workspace, mounted as a volume, and therefore have access to your source tree.
|
||||||
|
|
||||||
|
## Finding Plugins
|
||||||
|
|
||||||
|
For official plugins, you can use the Woodpecker plugin index:
|
||||||
|
|
||||||
|
- [Official Woodpecker Plugins](https://woodpecker-ci.org/plugins)
|
||||||
|
|
||||||
|
:::tip
|
||||||
|
There are also other plugin lists with additional plugins. Keep in mind that [Drone](https://www.drone.io/) plugins are generally supported, but could need some adjustments and tweaking.
|
||||||
|
|
||||||
|
- [Drone Plugins](http://plugins.drone.io)
|
||||||
|
- [Geeklab Woodpecker Plugins](https://woodpecker-plugins.geekdocs.de/)
|
||||||
|
|
||||||
|
:::
|
|
@ -0,0 +1,122 @@
|
||||||
|
# Creating plugins
|
||||||
|
|
||||||
|
Creating a new plugin is simple: Build a Docker container which uses your plugin logic as the ENTRYPOINT.
|
||||||
|
|
||||||
|
## Settings
|
||||||
|
|
||||||
|
To allow users to configure the behavior of your plugin, you should use `settings:`.
|
||||||
|
|
||||||
|
These are passed to your plugin as uppercase env vars with a `PLUGIN_` prefix.
|
||||||
|
Using a setting like `url` results in an env var named `PLUGIN_URL`.
|
||||||
|
|
||||||
|
Characters like `-` are converted to an underscore (`_`). `some_String` gets `PLUGIN_SOME_STRING`.
|
||||||
|
CamelCase is not respected, `anInt` get `PLUGIN_ANINT`.
|
||||||
|
|
||||||
|
### Basic settings
|
||||||
|
|
||||||
|
Using any basic YAML type (scalar) will be converted into a string:
|
||||||
|
|
||||||
|
| Setting | Environment value |
|
||||||
|
| -------------------- | ---------------------------- |
|
||||||
|
| `some-bool: false` | `PLUGIN_SOME_BOOL="false"` |
|
||||||
|
| `some_String: hello` | `PLUGIN_SOME_STRING="hello"` |
|
||||||
|
| `anInt: 3` | `PLUGIN_ANINT="3"` |
|
||||||
|
|
||||||
|
### Complex settings
|
||||||
|
|
||||||
|
It's also possible to use complex settings like this:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: plugin
|
||||||
|
image: foo/plugin
|
||||||
|
settings:
|
||||||
|
complex:
|
||||||
|
abc: 2
|
||||||
|
list:
|
||||||
|
- 2
|
||||||
|
- 3
|
||||||
|
```
|
||||||
|
|
||||||
|
Values like this are converted to JSON and then passed to your plugin. In the example above, the environment variable `PLUGIN_COMPLEX` would contain `{"abc": "2", "list": [ "2", "3" ]}`.
|
||||||
|
|
||||||
|
### Secrets
|
||||||
|
|
||||||
|
Secrets should be passed as settings too. Therefore, users should use [`from_secret`](../40-secrets.md#use-secrets-in-settings-and-environment).
|
||||||
|
|
||||||
|
## Plugin library
|
||||||
|
|
||||||
|
For Go, we provide a plugin library you can use to get easy access to internal env vars and your settings. See <https://codeberg.org/woodpecker-plugins/go-plugin>.
|
||||||
|
|
||||||
|
## Example plugin
|
||||||
|
|
||||||
|
This provides a brief tutorial for creating a Woodpecker webhook plugin, using simple shell scripting, to make HTTP requests during the build pipeline.
|
||||||
|
|
||||||
|
### What end users will see
|
||||||
|
|
||||||
|
The below example demonstrates how we might configure a webhook plugin in the YAML file:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: webhook
|
||||||
|
image: foo/webhook
|
||||||
|
settings:
|
||||||
|
url: https://example.com
|
||||||
|
method: post
|
||||||
|
body: |
|
||||||
|
hello world
|
||||||
|
```
|
||||||
|
|
||||||
|
### Write the logic
|
||||||
|
|
||||||
|
Create a simple shell script that invokes curl using the YAML configuration parameters, which are passed to the script as environment variables in uppercase and prefixed with `PLUGIN_`.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
#!/bin/sh
|
||||||
|
|
||||||
|
curl \
|
||||||
|
-X ${PLUGIN_METHOD} \
|
||||||
|
-d ${PLUGIN_BODY} \
|
||||||
|
${PLUGIN_URL}
|
||||||
|
```
|
||||||
|
|
||||||
|
### Package it
|
||||||
|
|
||||||
|
Create a Dockerfile that adds your shell script to the image, and configures the image to execute your shell script as the main entrypoint.
|
||||||
|
|
||||||
|
```dockerfile
|
||||||
|
# please pin the version, e.g. alpine:3.19
|
||||||
|
FROM alpine
|
||||||
|
ADD script.sh /bin/
|
||||||
|
RUN chmod +x /bin/script.sh
|
||||||
|
RUN apk -Uuv add curl ca-certificates
|
||||||
|
ENTRYPOINT /bin/script.sh
|
||||||
|
```
|
||||||
|
|
||||||
|
Build and publish your plugin to the Docker registry. Once published, your plugin can be shared with the broader Woodpecker community.
|
||||||
|
|
||||||
|
```shell
|
||||||
|
docker build -t foo/webhook .
|
||||||
|
docker push foo/webhook
|
||||||
|
```
|
||||||
|
|
||||||
|
Execute your plugin locally from the command line to verify it is working:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
docker run --rm \
|
||||||
|
-e PLUGIN_METHOD=post \
|
||||||
|
-e PLUGIN_URL=https://example.com \
|
||||||
|
-e PLUGIN_BODY="hello world" \
|
||||||
|
foo/webhook
|
||||||
|
```
|
||||||
|
|
||||||
|
## Best practices
|
||||||
|
|
||||||
|
- Build your plugin for different architectures to allow many users to use them.
|
||||||
|
At least, you should support `amd64` and `arm64`.
|
||||||
|
- Provide binaries for users using the `local` backend.
|
||||||
|
These should also be built for different OS/architectures.
|
||||||
|
- Use [built-in env vars](../50-environment.md#built-in-environment-variables) where possible.
|
||||||
|
- Do not use any configuration except settings (and internal env vars). This means: Don't require using [`environment`](../50-environment.md) and don't require specific secret names.
|
||||||
|
- Add a `docs.md` file, listing all your settings and plugin metadata ([example](https://codeberg.org/woodpecker-plugins/plugin-docker-buildx/src/branch/main/docs.md)).
|
||||||
|
- Add your plugin to the [plugin index](/plugins) using your `docs.md` ([the example above in the index](https://woodpecker-ci.org/plugins/Docker%20Buildx)).
|
|
@ -0,0 +1,7 @@
|
||||||
|
label: 'Plugins'
|
||||||
|
# position: 2
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
||||||
|
link:
|
||||||
|
type: 'doc'
|
||||||
|
id: 'overview'
|
114
docs/versioned_docs/version-2.4/20-usage/60-services.md
Normal file
|
@ -0,0 +1,114 @@
|
||||||
|
# Services
|
||||||
|
|
||||||
|
Woodpecker provides a services section in the YAML file used for defining service containers.
|
||||||
|
The below configuration composes database and cache containers.
|
||||||
|
|
||||||
|
Services are accessed using custom hostnames.
|
||||||
|
In the example below, the MySQL service is assigned the hostname `database` and is available at `database:3306`.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: mysql
|
||||||
|
|
||||||
|
- name: cache
|
||||||
|
image: redis
|
||||||
|
```
|
||||||
|
|
||||||
|
You can define a port and a protocol explicitly:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: mysql
|
||||||
|
ports:
|
||||||
|
- 3306
|
||||||
|
|
||||||
|
- name: wireguard
|
||||||
|
image: wg
|
||||||
|
ports:
|
||||||
|
- 51820/udp
|
||||||
|
```
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
Service containers generally expose environment variables to customize service startup such as default usernames, passwords and ports. Please see the official image documentation to learn more.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: mysql
|
||||||
|
+ environment:
|
||||||
|
+ - MYSQL_DATABASE=test
|
||||||
|
+ - MYSQL_ALLOW_EMPTY_PASSWORD=yes
|
||||||
|
|
||||||
|
- name: cache
|
||||||
|
image: redis
|
||||||
|
```
|
||||||
|
|
||||||
|
## Detachment
|
||||||
|
|
||||||
|
Service and long running containers can also be included in the pipeline section of the configuration using the detach parameter without blocking other steps. This should be used when explicit control over startup order is required.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
|
||||||
|
- name: database
|
||||||
|
image: redis
|
||||||
|
+ detach: true
|
||||||
|
|
||||||
|
- name: test
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go test
|
||||||
|
```
|
||||||
|
|
||||||
|
Containers from detached steps will terminate when the pipeline ends.
|
||||||
|
|
||||||
|
## Initialization
|
||||||
|
|
||||||
|
Service containers require time to initialize and begin to accept connections. If you are unable to connect to a service you may need to wait a few seconds or implement a backoff.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
+ - sleep 15
|
||||||
|
- go get
|
||||||
|
- go test
|
||||||
|
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: mysql
|
||||||
|
```
|
||||||
|
|
||||||
|
## Complete Pipeline Example
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
services:
|
||||||
|
- name: database
|
||||||
|
image: mysql
|
||||||
|
environment:
|
||||||
|
- MYSQL_DATABASE=test
|
||||||
|
- MYSQL_ROOT_PASSWORD=example
|
||||||
|
steps:
|
||||||
|
- name: get-version
|
||||||
|
image: ubuntu
|
||||||
|
commands:
|
||||||
|
- ( apt update && apt dist-upgrade -y && apt install -y mysql-client 2>&1 )> /dev/null
|
||||||
|
- sleep 30s # need to wait for mysql-server init
|
||||||
|
- echo 'SHOW VARIABLES LIKE "version"' | mysql -uroot -hdatabase test -pexample
|
||||||
|
```
|
27
docs/versioned_docs/version-2.4/20-usage/70-volumes.md
Normal file
|
@ -0,0 +1,27 @@
|
||||||
|
# Volumes
|
||||||
|
|
||||||
|
Woodpecker gives the ability to define Docker volumes in the YAML. You can use this parameter to mount files or folders on the host machine into your containers.
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Volumes are only available to trusted repositories and for security reasons should only be used in private environments. See [project settings](./71-project-settings.md#trusted) to enable trusted mode.
|
||||||
|
:::
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: docker
|
||||||
|
commands:
|
||||||
|
- docker build --rm -t octocat/hello-world .
|
||||||
|
- docker run --rm octocat/hello-world --test
|
||||||
|
- docker push octocat/hello-world
|
||||||
|
- docker rmi octocat/hello-world
|
||||||
|
volumes:
|
||||||
|
+ - /var/run/docker.sock:/var/run/docker.sock
|
||||||
|
```
|
||||||
|
|
||||||
|
Please note that Woodpecker mounts volumes on the host machine. This means you must use absolute paths when you configure volumes. Attempting to use relative paths will result in an error.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
-volumes: [ ./certs:/etc/ssl/certs ]
|
||||||
|
+volumes: [ /etc/ssl/certs:/etc/ssl/certs ]
|
||||||
|
```
|
|
@ -0,0 +1,52 @@
|
||||||
|
# Project settings
|
||||||
|
|
||||||
|
As the owner of a project in Woodpecker you can change project related settings via the web interface.
|
||||||
|
|
||||||
|
![project settings](./project-settings.png)
|
||||||
|
|
||||||
|
## Pipeline path
|
||||||
|
|
||||||
|
The path to the pipeline config file or folder. By default it is left empty which will use the following configuration resolution `.woodpecker/*.{yaml,yml}` -> `.woodpecker.yaml` -> `.woodpecker.yml`. If you set a custom path Woodpecker tries to load your configuration or fails if no configuration could be found at the specified location. To use a [multiple workflows](./25-workflows.md) with a custom path you have to change it to a folder path ending with a `/` like `.woodpecker/`.
|
||||||
|
|
||||||
|
## Repository hooks
|
||||||
|
|
||||||
|
Your Version-Control-System will notify Woodpecker about events via webhooks. If you want your pipeline to only run on specific webhooks, you can check them with this setting.
|
||||||
|
|
||||||
|
## Allow pull requests
|
||||||
|
|
||||||
|
Enables handling webhook's pull request event. If disabled, then pipeline won't run for pull requests.
|
||||||
|
|
||||||
|
## Protected
|
||||||
|
|
||||||
|
Every pipeline initiated by an webhook event needs to be approved by a project members with push permissions before being executed.
|
||||||
|
The protected option can be used as an additional review process before running potentially harmful pipelines. Especially if pipelines can be executed by third-parties through pull-requests.
|
||||||
|
|
||||||
|
## Trusted
|
||||||
|
|
||||||
|
If you set your project to trusted, a pipeline step and by this the underlying containers gets access to escalated capabilities like mounting volumes.
|
||||||
|
|
||||||
|
:::note
|
||||||
|
|
||||||
|
Only server admins can set this option. If you are not a server admin this option won't be shown in your project settings.
|
||||||
|
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Only inject netrc credentials into trusted containers
|
||||||
|
|
||||||
|
Cloning pipeline step may need git credentials. They are injected via netrc. By default, they're only injected if this option is enabled, the repo is trusted ([see above](#trusted)) or the image is a trusted clone image. If you uncheck the option, git credentials will be injected into any container in clone step.
|
||||||
|
|
||||||
|
## Project visibility
|
||||||
|
|
||||||
|
You can change the visibility of your project by this setting. If a user has access to a project they can see all builds and their logs and artifacts. Settings, Secrets and Registries can only be accessed by owners.
|
||||||
|
|
||||||
|
- `Public` Every user can see your project without being logged in.
|
||||||
|
- `Internal` Only authenticated users of the Woodpecker instance can see this project.
|
||||||
|
- `Private` Only you and other owners of the repository can see this project.
|
||||||
|
|
||||||
|
## Timeout
|
||||||
|
|
||||||
|
After this timeout a pipeline has to finish or will be treated as timed out.
|
||||||
|
|
||||||
|
## Cancel previous pipelines
|
||||||
|
|
||||||
|
By enabling this option for a pipeline event previous pipelines of the same event and context will be canceled before starting the newly triggered one.
|
18
docs/versioned_docs/version-2.4/20-usage/80-badges.md
Normal file
|
@ -0,0 +1,18 @@
|
||||||
|
# Status Badges
|
||||||
|
|
||||||
|
Woodpecker has integrated support for repository status badges. These badges can be added to your website or project readme file to display the status of your code.
|
||||||
|
|
||||||
|
## Badge endpoint
|
||||||
|
|
||||||
|
```uri
|
||||||
|
<scheme>://<hostname>/api/badges/<repo-id>/status.svg
|
||||||
|
```
|
||||||
|
|
||||||
|
The status badge displays the status for the latest build to your default branch (e.g. main). You can customize the branch by adding the `branch` query parameter.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
-<scheme>://<hostname>/api/badges/<repo-id>/status.svg
|
||||||
|
+<scheme>://<hostname>/api/badges/<repo-id>/status.svg?branch=<branch>
|
||||||
|
```
|
||||||
|
|
||||||
|
Please note status badges do not include pull request results, since the status of a pull request does not provide an accurate representation of your repository state.
|
129
docs/versioned_docs/version-2.4/20-usage/90-advanced-usage.md
Normal file
|
@ -0,0 +1,129 @@
|
||||||
|
# Advanced usage
|
||||||
|
|
||||||
|
## Advanced YAML syntax
|
||||||
|
|
||||||
|
YAML has some advanced syntax features that can be used like variables to reduce duplication in your pipeline config:
|
||||||
|
|
||||||
|
### Anchors & aliases
|
||||||
|
|
||||||
|
You can use [YAML anchors & aliases](https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases) as variables in your pipeline config.
|
||||||
|
|
||||||
|
To convert this:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
image: golang:1.18
|
||||||
|
commands: go test ./...
|
||||||
|
- name: build
|
||||||
|
image: golang:1.18
|
||||||
|
commands: build
|
||||||
|
```
|
||||||
|
|
||||||
|
Just add a new section called **variables** like this:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
+variables:
|
||||||
|
+ - &golang_image 'golang:1.18'
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
- image: golang:1.18
|
||||||
|
+ image: *golang_image
|
||||||
|
commands: go test ./...
|
||||||
|
- name: build
|
||||||
|
- image: golang:1.18
|
||||||
|
+ image: *golang_image
|
||||||
|
commands: build
|
||||||
|
```
|
||||||
|
|
||||||
|
### Map merges and overwrites
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
variables:
|
||||||
|
- &base-plugin-settings
|
||||||
|
target: dist
|
||||||
|
recursive: false
|
||||||
|
try: true
|
||||||
|
- &special-setting
|
||||||
|
special: true
|
||||||
|
- &some-plugin codeberg.org/6543/docker-images/print_env
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: develop
|
||||||
|
image: *some-plugin
|
||||||
|
settings:
|
||||||
|
<<: [*base-plugin-settings, *special-setting] # merge two maps into an empty map
|
||||||
|
when:
|
||||||
|
branch: develop
|
||||||
|
|
||||||
|
- name: main
|
||||||
|
image: *some-plugin
|
||||||
|
settings:
|
||||||
|
<<: *base-plugin-settings # merge one map and ...
|
||||||
|
try: false # ... overwrite original value
|
||||||
|
ongoing: false # ... adding a new value
|
||||||
|
when:
|
||||||
|
branch: main
|
||||||
|
```
|
||||||
|
|
||||||
|
### Sequence merges
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
variables:
|
||||||
|
pre_cmds: &pre_cmds
|
||||||
|
- echo start
|
||||||
|
- whoami
|
||||||
|
post_cmds: &post_cmds
|
||||||
|
- echo stop
|
||||||
|
hello_cmd: &hello_cmd
|
||||||
|
- echo hello
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: step1
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- <<: *pre_cmds # prepend a sequence
|
||||||
|
- echo exec step now do dedicated things
|
||||||
|
- <<: *post_cmds # append a sequence
|
||||||
|
- name: step2
|
||||||
|
image: debian
|
||||||
|
commands:
|
||||||
|
- <<: [*pre_cmds, *hello_cmd] # prepend two sequences
|
||||||
|
- echo echo from second step
|
||||||
|
- <<: *post_cmds
|
||||||
|
```
|
||||||
|
|
||||||
|
### References
|
||||||
|
|
||||||
|
- [Official YAML specification](https://yaml.org/spec/1.2.2/#3222-anchors-and-aliases)
|
||||||
|
- [YAML Cheatsheet](https://learnxinyminutes.com/docs/yaml)
|
||||||
|
|
||||||
|
## Persisting environment data between steps
|
||||||
|
|
||||||
|
One can create a file containing environment variables, and then source it in each step that needs them.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: init
|
||||||
|
image: bash
|
||||||
|
commands:
|
||||||
|
- echo "FOO=hello" >> envvars
|
||||||
|
- echo "BAR=world" >> envvars
|
||||||
|
|
||||||
|
- name: debug
|
||||||
|
image: bash
|
||||||
|
commands:
|
||||||
|
- source envvars
|
||||||
|
- echo $FOO
|
||||||
|
```
|
||||||
|
|
||||||
|
## Declaring global variables
|
||||||
|
|
||||||
|
As described in [Global environment variables](./50-environment.md#global-environment-variables), you can define global variables:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_ENVIRONMENT=first_var:value1,second_var:value2
|
||||||
|
```
|
||||||
|
|
||||||
|
Note that this tightly couples the server and app configurations (where the app is a completely separate application). But this is a good option for truly global variables which should apply to all steps in all pipelines for all apps.
|
4
docs/versioned_docs/version-2.4/20-usage/_category_.yaml
Normal file
|
@ -0,0 +1,4 @@
|
||||||
|
label: 'Usage'
|
||||||
|
# position: 2
|
||||||
|
collapsible: true
|
||||||
|
collapsed: false
|
BIN
docs/versioned_docs/version-2.4/20-usage/cron-settings.png
Normal file
After Width: | Height: | Size: 40 KiB |
BIN
docs/versioned_docs/version-2.4/20-usage/project-settings.png
Normal file
After Width: | Height: | Size: 165 KiB |
BIN
docs/versioned_docs/version-2.4/20-usage/repo-list.png
Normal file
After Width: | Height: | Size: 21 KiB |
|
@ -0,0 +1,92 @@
|
||||||
|
# Deployment
|
||||||
|
|
||||||
|
A Woodpecker deployment consists of two parts:
|
||||||
|
|
||||||
|
- A server which is the heart of Woodpecker and ships the web interface.
|
||||||
|
- Next to one server, you can deploy any number of agents which will run the pipelines.
|
||||||
|
|
||||||
|
Each agent is able to process one pipeline step by default.
|
||||||
|
If you have four agents installed and connected to the Woodpecker server, your system will process four workflows in parallel.
|
||||||
|
|
||||||
|
:::tip
|
||||||
|
You can add more agents to increase the number of parallel workflows or set the agent's `WOODPECKER_MAX_WORKFLOWS=1` environment variable to increase the number of parallel workflows for that agent.
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Which version of Woodpecker should I use?
|
||||||
|
|
||||||
|
Woodpecker is having two different kinds of releases: **stable** and **next**.
|
||||||
|
|
||||||
|
To find out more about the differences between the two releases, please read the [FAQ](/faq#which-version-of-woodpecker-should-i-use).
|
||||||
|
|
||||||
|
### Stable releases
|
||||||
|
|
||||||
|
We release a new version every four weeks and will release the current state of the `main` branch.
|
||||||
|
If there are security fixes or critical bug fixes, we'll release them directly.
|
||||||
|
There are no backports or similar.
|
||||||
|
|
||||||
|
#### Versioning
|
||||||
|
|
||||||
|
We use [Semantic Versioning](https://semver.org/) to be able,
|
||||||
|
to communicate when admins have to do manual migration steps and when they can just bump versions up.
|
||||||
|
|
||||||
|
#### Breaking changes
|
||||||
|
|
||||||
|
As of semver guidelines, breaking changes will be released as a major version. We will hold back
|
||||||
|
breaking changes to not release many majors each containing just a few breaking changes.
|
||||||
|
Prior to the release of a major version, a release candidate (RC) will be published to allow easy testing,
|
||||||
|
the actual release will be about a week later.
|
||||||
|
|
||||||
|
## Hardware Requirements
|
||||||
|
|
||||||
|
Below are minimal resources requirements for Woodpecker components itself:
|
||||||
|
|
||||||
|
| Component | Memory | CPU |
|
||||||
|
| --------- | ------ | --- |
|
||||||
|
| Server | 200 MB | 1 |
|
||||||
|
| Agent | 32 MB | 1 |
|
||||||
|
|
||||||
|
Note, that those values do not include the operating system or workload (pipelines execution) resources consumption.
|
||||||
|
|
||||||
|
In addition you need at least some kind of database which requires additional resources depending on the selected database system.
|
||||||
|
|
||||||
|
## Installation
|
||||||
|
|
||||||
|
You can install Woodpecker on multiple ways:
|
||||||
|
|
||||||
|
- Using [docker-compose](./10-docker-compose.md) with the official [container images](./10-docker-compose.md#docker-images)
|
||||||
|
- Using [Kubernetes](./20-kubernetes.md) via the Woodpecker Helm chart
|
||||||
|
- Using binaries, DEBs or RPMs you can download from [latest release](https://github.com/woodpecker-ci/woodpecker/releases/latest)
|
||||||
|
|
||||||
|
## Authentication
|
||||||
|
|
||||||
|
Authentication is done using OAuth and is delegated to your forge which is configured using environment variables.
|
||||||
|
|
||||||
|
See the complete reference for all supported forges [here](../11-forges/10-overview.md).
|
||||||
|
|
||||||
|
## Database
|
||||||
|
|
||||||
|
By default Woodpecker uses a SQLite database which requires zero installation or configuration. See the [database settings](../30-database.md) page to further configure it or use MySQL or Postgres.
|
||||||
|
|
||||||
|
## SSL
|
||||||
|
|
||||||
|
Woodpecker supports SSL configuration by using Let's encrypt or by using own certificates. See the [SSL guide](../60-ssl.md). You can also put it behind a [reverse proxy](#behind-a-proxy)
|
||||||
|
|
||||||
|
## Metrics
|
||||||
|
|
||||||
|
A [Prometheus endpoint](../90-prometheus.md) is exposed.
|
||||||
|
|
||||||
|
## Behind a proxy
|
||||||
|
|
||||||
|
See the [proxy guide](../70-proxy.md) if you want to see a setup behind Apache, Nginx, Caddy or ngrok.
|
||||||
|
|
||||||
|
In the case you need to use Woodpecker with a URL path prefix (like: <https://example.org/woodpecker/>), add the root path to [`WOODPECKER_HOST`](../10-server-config.md#woodpecker_host).
|
||||||
|
|
||||||
|
## Third-party installation methods
|
||||||
|
|
||||||
|
:::info
|
||||||
|
These installation methods are not officially supported. If you experience issues with them, please open issues in the specific repositories.
|
||||||
|
:::
|
||||||
|
|
||||||
|
- Using [NixOS](./30-nixos.md) via the [NixOS module](https://search.nixos.org/options?channel=unstable&size=200&sort=relevance&query=woodpecker)
|
||||||
|
- [Using YunoHost](https://apps.yunohost.org/app/woodpecker)
|
||||||
|
- [On Cloudron](https://www.cloudron.io/store/org.woodpecker_ci.cloudronapp.html)
|
|
@ -0,0 +1,147 @@
|
||||||
|
# docker-compose
|
||||||
|
|
||||||
|
The below [docker-compose](https://docs.docker.com/compose/) configuration can be used to start a Woodpecker server with a single agent.
|
||||||
|
|
||||||
|
It relies on a number of environment variables that you must set before running `docker-compose up`. The variables are described below.
|
||||||
|
|
||||||
|
```yaml title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
image: woodpeckerci/woodpecker-server:latest
|
||||||
|
ports:
|
||||||
|
- 8000:8000
|
||||||
|
volumes:
|
||||||
|
- woodpecker-server-data:/var/lib/woodpecker/
|
||||||
|
environment:
|
||||||
|
- WOODPECKER_OPEN=true
|
||||||
|
- WOODPECKER_HOST=${WOODPECKER_HOST}
|
||||||
|
- WOODPECKER_GITHUB=true
|
||||||
|
- WOODPECKER_GITHUB_CLIENT=${WOODPECKER_GITHUB_CLIENT}
|
||||||
|
- WOODPECKER_GITHUB_SECRET=${WOODPECKER_GITHUB_SECRET}
|
||||||
|
- WOODPECKER_AGENT_SECRET=${WOODPECKER_AGENT_SECRET}
|
||||||
|
|
||||||
|
woodpecker-agent:
|
||||||
|
image: woodpeckerci/woodpecker-agent:latest
|
||||||
|
command: agent
|
||||||
|
restart: always
|
||||||
|
depends_on:
|
||||||
|
- woodpecker-server
|
||||||
|
volumes:
|
||||||
|
- woodpecker-agent-config:/etc/woodpecker
|
||||||
|
- /var/run/docker.sock:/var/run/docker.sock
|
||||||
|
environment:
|
||||||
|
- WOODPECKER_SERVER=woodpecker-server:9000
|
||||||
|
- WOODPECKER_AGENT_SECRET=${WOODPECKER_AGENT_SECRET}
|
||||||
|
|
||||||
|
volumes:
|
||||||
|
woodpecker-server-data:
|
||||||
|
woodpecker-agent-config:
|
||||||
|
```
|
||||||
|
|
||||||
|
Woodpecker needs to know its own address. You must therefore provide the public address of it in `<scheme>://<hostname>` format. Please omit trailing slashes:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_HOST=${WOODPECKER_HOST}
|
||||||
|
```
|
||||||
|
|
||||||
|
Woodpecker can also have its port's configured. It uses a separate port for gRPC and for HTTP. The agent performs gRPC calls and connects to the gRPC port.
|
||||||
|
They can be configured with `*_ADDR` variables:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_GRPC_ADDR=${WOODPECKER_GRPC_ADDR}
|
||||||
|
+ - WOODPECKER_SERVER_ADDR=${WOODPECKER_HTTP_ADDR}
|
||||||
|
```
|
||||||
|
|
||||||
|
Reverse proxying can also be [configured for gRPC](../70-proxy.md#caddy). If the agents are connecting over the internet, it should also be SSL encrypted. The agent then needs to be configured to be secure:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_GRPC_SECURE=true # defaults to false
|
||||||
|
+ - WOODPECKER_GRPC_VERIFY=true # default
|
||||||
|
```
|
||||||
|
|
||||||
|
As agents run pipeline steps as docker containers they require access to the host machine's Docker daemon:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
[...]
|
||||||
|
woodpecker-agent:
|
||||||
|
[...]
|
||||||
|
+ volumes:
|
||||||
|
+ - /var/run/docker.sock:/var/run/docker.sock
|
||||||
|
```
|
||||||
|
|
||||||
|
Agents require the server address for agent-to-server communication. The agent connects to the server's gRPC port:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-agent:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
+ - WOODPECKER_SERVER=woodpecker-server:9000
|
||||||
|
```
|
||||||
|
|
||||||
|
The server and agents use a shared secret to authenticate communication. This should be a random string of your choosing and should be kept private. You can generate such string with `openssl rand -hex 32`:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_AGENT_SECRET=${WOODPECKER_AGENT_SECRET}
|
||||||
|
woodpecker-agent:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_AGENT_SECRET=${WOODPECKER_AGENT_SECRET}
|
||||||
|
```
|
||||||
|
|
||||||
|
## Docker images
|
||||||
|
|
||||||
|
Image variants:
|
||||||
|
|
||||||
|
- The `latest` image is the latest stable release
|
||||||
|
- The `vX.X.X` images are stable releases
|
||||||
|
- The `vX.X` images are based on the current release branch (e.g. `release/v1.0`) and can be used to get bugfixes asap
|
||||||
|
- The `next` images are based on the current `main` branch
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# server
|
||||||
|
docker pull woodpeckerci/woodpecker-server:latest
|
||||||
|
docker pull woodpeckerci/woodpecker-server:latest-alpine
|
||||||
|
|
||||||
|
# agent
|
||||||
|
docker pull woodpeckerci/woodpecker-agent:latest
|
||||||
|
docker pull woodpeckerci/woodpecker-agent:latest-alpine
|
||||||
|
|
||||||
|
# cli
|
||||||
|
docker pull woodpeckerci/woodpecker-cli:latest
|
||||||
|
docker pull woodpeckerci/woodpecker-cli:latest-alpine
|
||||||
|
```
|
|
@ -0,0 +1,9 @@
|
||||||
|
# Kubernetes
|
||||||
|
|
||||||
|
We recommended to deploy Woodpecker using the [Woodpecker helm chart](https://github.com/woodpecker-ci/helm).
|
||||||
|
Have a look at the [`values.yaml`](https://github.com/woodpecker-ci/helm/blob/main/charts/woodpecker/values.yaml) config files for all available settings.
|
||||||
|
|
||||||
|
The chart contains two subcharts, `server` and `agent` which are automatically configured as needed.
|
||||||
|
The chart started off with two independent charts but was merged into one to simplify the deployment at start of 2023.
|
||||||
|
|
||||||
|
A couple of backend-specific config env vars exists which are described in the [kubernetes backend docs](../22-backends/40-kubernetes.md).
|
|
@ -0,0 +1,88 @@
|
||||||
|
# NixOS
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Note that this module is not maintained by the woodpecker-developers.
|
||||||
|
If you experience issues please open a bug report in the [nixpkgs repo](https://github.com/NixOS/nixpkgs/issues/new/choose) where the module is maintained.
|
||||||
|
:::
|
||||||
|
|
||||||
|
The NixOS install is in theory quite similar to the binary install and supports multiple backends.
|
||||||
|
In practice, the settings are specified declaratively in the NixOS configuration and no manual steps need to be taken.
|
||||||
|
|
||||||
|
## General Configuration
|
||||||
|
|
||||||
|
```nix
|
||||||
|
{ config
|
||||||
|
, ...
|
||||||
|
}:
|
||||||
|
let
|
||||||
|
domain = "woodpecker.example.org";
|
||||||
|
in
|
||||||
|
{
|
||||||
|
# This automatically sets up certificates via let's encrypt
|
||||||
|
security.acme.defaults.email = "acme@example.com";
|
||||||
|
security.acme.acceptTerms = true;
|
||||||
|
security.acme.certs."${domain}" = { };
|
||||||
|
|
||||||
|
# Setting up a nginx proxy that handles tls for us
|
||||||
|
networking.firewall.allowedTCPPorts = [ 80 443 ];
|
||||||
|
services.nginx = {
|
||||||
|
enable = true;
|
||||||
|
recommendedTlsSettings = true;
|
||||||
|
recommendedOptimisation = true;
|
||||||
|
recommendedProxySettings = true;
|
||||||
|
virtualHosts."${domain}" = {
|
||||||
|
enableACME = true;
|
||||||
|
forceSSL = true;
|
||||||
|
locations."/" = {
|
||||||
|
proxyPass = "http://localhost:3007";
|
||||||
|
};
|
||||||
|
};
|
||||||
|
};
|
||||||
|
|
||||||
|
services.woodpecker-server = {
|
||||||
|
enable = true;
|
||||||
|
environment = {
|
||||||
|
WOODPECKER_HOST = "https://${domain}";
|
||||||
|
WOODPECKER_SERVER_ADDR = ":3007";
|
||||||
|
WOODPECKER_OPEN = "true";
|
||||||
|
};
|
||||||
|
# You can pass a file with env vars to the system it could look like:
|
||||||
|
# WOODPECKER_AGENT_SECRET=XXXXXXXXXXXXXXXXXXXXXX
|
||||||
|
environmentFile = "/path/to/my/secrets/file";
|
||||||
|
};
|
||||||
|
|
||||||
|
# This sets up a woodpecker agent
|
||||||
|
services.woodpecker-agents.agents."docker" = {
|
||||||
|
enable = true;
|
||||||
|
# We need this to talk to the podman socket
|
||||||
|
extraGroups = [ "podman" ];
|
||||||
|
environment = {
|
||||||
|
WOODPECKER_SERVER = "localhost:9000";
|
||||||
|
WOODPECKER_MAX_WORKFLOWS = "4";
|
||||||
|
DOCKER_HOST = "unix:///run/podman/podman.sock";
|
||||||
|
WOODPECKER_BACKEND = "docker";
|
||||||
|
};
|
||||||
|
# Same as with woodpecker-server
|
||||||
|
environmentFile = [ "/var/lib/secrets/woodpecker.env" ];
|
||||||
|
};
|
||||||
|
|
||||||
|
# Here we setup podman and enable dns
|
||||||
|
virtualisation.podman = {
|
||||||
|
enable = true;
|
||||||
|
defaultNetwork.settings = {
|
||||||
|
dns_enabled = true;
|
||||||
|
};
|
||||||
|
};
|
||||||
|
# This is needed for podman to be able to talk over dns
|
||||||
|
networking.firewall.interfaces."podman0" = {
|
||||||
|
allowedUDPPorts = [ 53 ];
|
||||||
|
allowedTCPPorts = [ 53 ];
|
||||||
|
};
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
All configuration options can be found via [NixOS Search](https://search.nixos.org/options?channel=unstable&size=200&sort=relevance&query=woodpecker)
|
||||||
|
|
||||||
|
## Tips and tricks
|
||||||
|
|
||||||
|
There are some resources on how to utilize Woodpecker more effectively with NixOS on the [Awesome Woodpecker](../../92-awesome.md) page, like using the runners nix-store in the pipeline
|
|
@ -0,0 +1,6 @@
|
||||||
|
label: 'Deployment'
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
||||||
|
link:
|
||||||
|
type: 'doc'
|
||||||
|
id: 'overview'
|
|
@ -0,0 +1,562 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Server configuration
|
||||||
|
|
||||||
|
## User registration
|
||||||
|
|
||||||
|
Woodpecker does not have its own user registry; users are provided from your [forge](./11-forges/10-overview.md) (using OAuth2).
|
||||||
|
|
||||||
|
Registration is closed by default (`WOODPECKER_OPEN=false`). If registration is open (`WOODPECKER_OPEN=true`) then every user with an account at the configured forge can login to Woodpecker.
|
||||||
|
|
||||||
|
To open registration:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_OPEN=true
|
||||||
|
```
|
||||||
|
|
||||||
|
You can **also restrict** registration, by keep registration closed and:
|
||||||
|
|
||||||
|
- **adding** new **users manually** via the CLI: `woodpecker-cli user add`
|
||||||
|
- allowing specific **admin users** via the `WOODPECKER_ADMIN` setting
|
||||||
|
- by open registration and **filter by organization** membership through the `WOODPECKER_ORGS` setting
|
||||||
|
|
||||||
|
### Close registration, but allow specific admin users
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_OPEN=false
|
||||||
|
WOODPECKER_ADMIN=johnsmith,janedoe
|
||||||
|
```
|
||||||
|
|
||||||
|
### Only allow registration of users, who are members of approved organizations
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_OPEN=true
|
||||||
|
WOODPECKER_ORGS=dolores,dogpatch
|
||||||
|
```
|
||||||
|
|
||||||
|
## Administrators
|
||||||
|
|
||||||
|
Administrators should also be enumerated in your configuration.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_ADMIN=johnsmith,janedoe
|
||||||
|
```
|
||||||
|
|
||||||
|
## Filtering repositories
|
||||||
|
|
||||||
|
Woodpecker operates with the user's OAuth permission. Due to the coarse permission handling of GitHub, you may end up syncing more repos into Woodpecker than preferred.
|
||||||
|
|
||||||
|
Use the `WOODPECKER_REPO_OWNERS` variable to filter which GitHub user's repos should be synced only. You typically want to put here your company's GitHub name.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_REPO_OWNERS=mycompany,mycompanyossgithubuser
|
||||||
|
```
|
||||||
|
|
||||||
|
## Global registry setting
|
||||||
|
|
||||||
|
If you want to make available a specific private registry to all pipelines, use the `WOODPECKER_DOCKER_CONFIG` server configuration.
|
||||||
|
Point it to your server's docker config.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_DOCKER_CONFIG=/root/.docker/config.json
|
||||||
|
```
|
||||||
|
|
||||||
|
## Handling sensitive data in docker-compose and docker-swarm
|
||||||
|
|
||||||
|
To handle sensitive data in docker-compose or docker-swarm configurations there are several options:
|
||||||
|
|
||||||
|
For docker-compose you can use a `.env` file next to your compose configuration to store the secrets outside of the compose file. While this separates configuration from secrets it is still not very secure.
|
||||||
|
|
||||||
|
Alternatively use docker-secrets. As it may be difficult to use docker secrets for environment variables woodpecker allows to read sensible data from files by providing a `*_FILE` option of all sensible configuration variables. Woodpecker will try to read the value directly from this file. Keep in mind that when the original environment variable gets specified at the same time it will override the value read from the file.
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_AGENT_SECRET_FILE=/run/secrets/woodpecker-agent-secret
|
||||||
|
+ secrets:
|
||||||
|
+ - woodpecker-agent-secret
|
||||||
|
+
|
||||||
|
+ secrets:
|
||||||
|
+ woodpecker-agent-secret:
|
||||||
|
+ external: true
|
||||||
|
```
|
||||||
|
|
||||||
|
Store a value to a docker secret like this:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
echo "my_agent_secret_key" | docker secret create woodpecker-agent-secret -
|
||||||
|
```
|
||||||
|
|
||||||
|
or generate a random one like this:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
openssl rand -hex 32 | docker secret create woodpecker-agent-secret -
|
||||||
|
```
|
||||||
|
|
||||||
|
## Custom JavaScript and CSS
|
||||||
|
|
||||||
|
Woodpecker supports custom JS and CSS files.
|
||||||
|
These files must be present in the server's filesystem.
|
||||||
|
They can be backed in a Docker image or mounted from a ConfigMap inside a Kubernetes environment.
|
||||||
|
The configuration variables are independent of each other, which means it can be just one file present, or both.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_CUSTOM_CSS_FILE=/usr/local/www/woodpecker.css
|
||||||
|
WOODPECKER_CUSTOM_JS_FILE=/usr/local/www/woodpecker.js
|
||||||
|
```
|
||||||
|
|
||||||
|
The examples below show how to place a banner message in the top navigation bar of Woodpecker.
|
||||||
|
|
||||||
|
### `woodpecker.css`
|
||||||
|
|
||||||
|
```css
|
||||||
|
.banner-message {
|
||||||
|
position: absolute;
|
||||||
|
width: 280px;
|
||||||
|
height: 40px;
|
||||||
|
margin-left: 240px;
|
||||||
|
margin-top: 5px;
|
||||||
|
padding-top: 5px;
|
||||||
|
font-weight: bold;
|
||||||
|
background: red no-repeat;
|
||||||
|
text-align: center;
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
### `woodpecker.js`
|
||||||
|
|
||||||
|
```javascript
|
||||||
|
// place/copy a minified version of jQuery or ZeptoJS here ...
|
||||||
|
!(function () {
|
||||||
|
'use strict';
|
||||||
|
function e() {} /*...*/
|
||||||
|
})();
|
||||||
|
|
||||||
|
$().ready(function () {
|
||||||
|
$('.app nav img').first().htmlAfter("<div class='banner-message'>This is a demo banner message :)</div>");
|
||||||
|
});
|
||||||
|
```
|
||||||
|
|
||||||
|
## All server configuration options
|
||||||
|
|
||||||
|
The following list describes all available server configuration options.
|
||||||
|
|
||||||
|
### `WOODPECKER_LOG_LEVEL`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the logging level. Possible values are `trace`, `debug`, `info`, `warn`, `error`, `fatal`, `panic`, `disabled` and empty.
|
||||||
|
|
||||||
|
### `WOODPECKER_LOG_FILE`
|
||||||
|
|
||||||
|
> Default: `stderr`
|
||||||
|
|
||||||
|
Output destination for logs.
|
||||||
|
'stdout' and 'stderr' can be used as special keywords.
|
||||||
|
|
||||||
|
### `WOODPECKER_LOG_XORM`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable XORM logs.
|
||||||
|
|
||||||
|
### `WOODPECKER_LOG_XORM_SQL`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable XORM SQL command logs.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEBUG_PRETTY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable pretty-printed debug output.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEBUG_NOCOLOR`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
Disable colored debug output.
|
||||||
|
|
||||||
|
### `WOODPECKER_HOST`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Server fully qualified URL of the user-facing hostname, port (if not default for HTTP/HTTPS) and path prefix.
|
||||||
|
|
||||||
|
Examples:
|
||||||
|
|
||||||
|
- `WOODPECKER_HOST=http://woodpecker.example.org`
|
||||||
|
- `WOODPECKER_HOST=http://example.org/woodpecker`
|
||||||
|
- `WOODPECKER_HOST=http://example.org:1234/woodpecker`
|
||||||
|
|
||||||
|
### `WOODPECKER_WEBHOOK_HOST`
|
||||||
|
|
||||||
|
> Default: value from `WOODPECKER_HOST` config env
|
||||||
|
|
||||||
|
Server fully qualified URL of the Webhook-facing hostname and path prefix.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_WEBHOOK_HOST=http://woodpecker-server.cicd.svc.cluster.local:8000`
|
||||||
|
|
||||||
|
### `WOODPECKER_SERVER_ADDR`
|
||||||
|
|
||||||
|
> Default: `:8000`
|
||||||
|
|
||||||
|
Configures the HTTP listener port.
|
||||||
|
|
||||||
|
### `WOODPECKER_SERVER_ADDR_TLS`
|
||||||
|
|
||||||
|
> Default: `:443`
|
||||||
|
|
||||||
|
Configures the HTTPS listener port when SSL is enabled.
|
||||||
|
|
||||||
|
### `WOODPECKER_SERVER_CERT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Path to an SSL certificate used by the server to accept HTTPS requests.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_SERVER_CERT=/path/to/cert.pem`
|
||||||
|
|
||||||
|
### `WOODPECKER_SERVER_KEY`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Path to an SSL certificate key used by the server to accept HTTPS requests.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_SERVER_KEY=/path/to/key.pem`
|
||||||
|
|
||||||
|
### `WOODPECKER_CUSTOM_CSS_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
File path for the server to serve a custom .CSS file, used for customizing the UI.
|
||||||
|
Can be used for showing banner messages, logos, or environment-specific hints (a.k.a. white-labeling).
|
||||||
|
The file must be UTF-8 encoded, to ensure all special characters are preserved.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_CUSTOM_CSS_FILE=/usr/local/www/woodpecker.css`
|
||||||
|
|
||||||
|
### `WOODPECKER_CUSTOM_JS_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
File path for the server to serve a custom .JS file, used for customizing the UI.
|
||||||
|
Can be used for showing banner messages, logos, or environment-specific hints (a.k.a. white-labeling).
|
||||||
|
The file must be UTF-8 encoded, to ensure all special characters are preserved.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_CUSTOM_JS_FILE=/usr/local/www/woodpecker.js`
|
||||||
|
|
||||||
|
### `WOODPECKER_LETS_ENCRYPT`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Automatically generates an SSL certificate using Let's Encrypt, and configures the server to accept HTTPS requests.
|
||||||
|
|
||||||
|
### `WOODPECKER_GRPC_ADDR`
|
||||||
|
|
||||||
|
> Default: `:9000`
|
||||||
|
|
||||||
|
Configures the gRPC listener port.
|
||||||
|
|
||||||
|
### `WOODPECKER_GRPC_SECRET`
|
||||||
|
|
||||||
|
> Default: `secret`
|
||||||
|
|
||||||
|
Configures the gRPC JWT secret.
|
||||||
|
|
||||||
|
### `WOODPECKER_GRPC_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GRPC_SECRET` from the specified filepath.
|
||||||
|
|
||||||
|
### `WOODPECKER_METRICS_SERVER_ADDR`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures an unprotected metrics endpoint. An empty value disables the metrics endpoint completely.
|
||||||
|
|
||||||
|
Example: `:9001`
|
||||||
|
|
||||||
|
### `WOODPECKER_ADMIN`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list of admin accounts.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_ADMIN=user1,user2`
|
||||||
|
|
||||||
|
### `WOODPECKER_ORGS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list of approved organizations.
|
||||||
|
|
||||||
|
Example: `org1,org2`
|
||||||
|
|
||||||
|
### `WOODPECKER_REPO_OWNERS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list of syncable repo owners. ???
|
||||||
|
|
||||||
|
Example: `user1,user2`
|
||||||
|
|
||||||
|
### `WOODPECKER_OPEN`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable to allow user registration.
|
||||||
|
|
||||||
|
### `WOODPECKER_AUTHENTICATE_PUBLIC_REPOS`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Always use authentication to clone repositories even if they are public. Needed if the forge requires to always authenticate as used by many companies.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEFAULT_CANCEL_PREVIOUS_PIPELINE_EVENTS`
|
||||||
|
|
||||||
|
> Default: `pull_request, push`
|
||||||
|
|
||||||
|
List of event names that will be canceled when a new pipeline for the same context (tag, branch) is created.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEFAULT_CLONE_IMAGE`
|
||||||
|
|
||||||
|
> Default is defined in [shared/constant/constant.go](https://github.com/woodpecker-ci/woodpecker/blob/main/shared/constant/constant.go)
|
||||||
|
|
||||||
|
The default docker image to be used when cloning the repo
|
||||||
|
|
||||||
|
### `WOODPECKER_DEFAULT_PIPELINE_TIMEOUT`
|
||||||
|
|
||||||
|
> 60 (minutes)
|
||||||
|
|
||||||
|
The default time for a repo in minutes before a pipeline gets killed
|
||||||
|
|
||||||
|
### `WOODPECKER_MAX_PIPELINE_TIMEOUT`
|
||||||
|
|
||||||
|
> 120 (minutes)
|
||||||
|
|
||||||
|
The maximum time in minutes you can set in the repo settings before a pipeline gets killed
|
||||||
|
|
||||||
|
### `WOODPECKER_SESSION_EXPIRES`
|
||||||
|
|
||||||
|
> Default: `72h`
|
||||||
|
|
||||||
|
Configures the session expiration time.
|
||||||
|
Context: when someone does log into Woodpecker, a temporary session token is created.
|
||||||
|
As long as the session is valid (until it expires or log-out),
|
||||||
|
a user can log into Woodpecker, without re-authentication.
|
||||||
|
|
||||||
|
### `WOODPECKER_ESCALATE`
|
||||||
|
|
||||||
|
> Defaults are defined in [shared/constant/constant.go](https://github.com/woodpecker-ci/woodpecker/blob/main/shared/constant/constant.go)
|
||||||
|
|
||||||
|
Docker images to run in privileged mode. Only change if you are sure what you do!
|
||||||
|
|
||||||
|
<!--
|
||||||
|
### `WOODPECKER_VOLUME`
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list of Docker volumes that are mounted into every pipeline step.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_VOLUME=/path/on/host:/path/in/container:rw`|
|
||||||
|
-->
|
||||||
|
|
||||||
|
### `WOODPECKER_DOCKER_CONFIG`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures a specific private registry config for all pipelines.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_DOCKER_CONFIG=/home/user/.docker/config.json`
|
||||||
|
|
||||||
|
<!--
|
||||||
|
### `WOODPECKER_ENVIRONMENT`
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
TODO
|
||||||
|
|
||||||
|
### `WOODPECKER_NETWORK`
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list of Docker networks that are attached to every pipeline step.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_NETWORK=network1,network2`
|
||||||
|
-->
|
||||||
|
|
||||||
|
### `WOODPECKER_AGENT_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
A shared secret used by server and agents to authenticate communication. A secret can be generated by `openssl rand -hex 32`.
|
||||||
|
|
||||||
|
### `WOODPECKER_AGENT_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_AGENT_SECRET` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_KEEPALIVE_MIN_TIME`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Server-side enforcement policy on the minimum amount of time a client should wait before sending a keepalive ping.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_KEEPALIVE_MIN_TIME=10s`
|
||||||
|
|
||||||
|
### `WOODPECKER_DATABASE_DRIVER`
|
||||||
|
|
||||||
|
> Default: `sqlite3`
|
||||||
|
|
||||||
|
The database driver name. Possible values are `sqlite3`, `mysql` or `postgres`.
|
||||||
|
|
||||||
|
### `WOODPECKER_DATABASE_DATASOURCE`
|
||||||
|
|
||||||
|
> Default: `woodpecker.sqlite` if not running inside a container, `/var/lib/woodpecker/woodpecker.sqlite` if running inside a container
|
||||||
|
|
||||||
|
The database connection string. The default value is the path of the embedded SQLite database file.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# MySQL
|
||||||
|
# https://github.com/go-sql-driver/mysql#dsn-data-source-name
|
||||||
|
WOODPECKER_DATABASE_DATASOURCE=root:password@tcp(1.2.3.4:3306)/woodpecker?parseTime=true
|
||||||
|
|
||||||
|
# PostgreSQL
|
||||||
|
# https://www.postgresql.org/docs/current/static/libpq-connect.html#LIBPQ-CONNSTRING
|
||||||
|
WOODPECKER_DATABASE_DATASOURCE=postgres://root:password@1.2.3.4:5432/woodpecker?sslmode=disable
|
||||||
|
```
|
||||||
|
|
||||||
|
### `WOODPECKER_DATABASE_DATASOURCE_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_DATABASE_DATASOURCE` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_PROMETHEUS_AUTH_TOKEN`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Token to secure the Prometheus metrics endpoint.
|
||||||
|
Must be set to enable the endpoint.
|
||||||
|
|
||||||
|
### `WOODPECKER_PROMETHEUS_AUTH_TOKEN_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_PROMETHEUS_AUTH_TOKEN` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_STATUS_CONTEXT`
|
||||||
|
|
||||||
|
> Default: `ci/woodpecker`
|
||||||
|
|
||||||
|
Context prefix Woodpecker will use to publish status messages to SCM. You probably will only need to change it if you run multiple Woodpecker instances for a single repository.
|
||||||
|
|
||||||
|
### `WOODPECKER_STATUS_CONTEXT_FORMAT`
|
||||||
|
|
||||||
|
> Default: `{{ .context }}/{{ .event }}/{{ .workflow }}{{if not (eq .axis_id 0)}}/{{.axis_id}}{{end}}`
|
||||||
|
|
||||||
|
Template for the status messages published to forges, uses [Go templates](https://pkg.go.dev/text/template) as template language.
|
||||||
|
Supported variables:
|
||||||
|
|
||||||
|
- `context`: Woodpecker's context (see `WOODPECKER_STATUS_CONTEXT`)
|
||||||
|
- `event`: the event which started the pipeline
|
||||||
|
- `workflow`: the workflow's name
|
||||||
|
- `owner`: the repo's owner
|
||||||
|
- `repo`: the repo's name
|
||||||
|
|
||||||
|
### `WOODPECKER_ADDONS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
List of addon files. See [addons](./75-addons/00-overview.md).
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_MEM_SWAP`
|
||||||
|
|
||||||
|
> Default: `0`
|
||||||
|
|
||||||
|
The maximum amount of memory a single pipeline container is allowed to swap to disk, configured in bytes. There is no limit if `0`.
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_MEM`
|
||||||
|
|
||||||
|
> Default: `0`
|
||||||
|
|
||||||
|
The maximum amount of memory a single pipeline container can use, configured in bytes. There is no limit if `0`.
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_SHM_SIZE`
|
||||||
|
|
||||||
|
> Default: `0`
|
||||||
|
|
||||||
|
The maximum amount of memory of `/dev/shm` allowed in bytes. There is no limit if `0`.
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_CPU_QUOTA`
|
||||||
|
|
||||||
|
> Default: `0`
|
||||||
|
|
||||||
|
The number of microseconds per CPU period that the container is limited to before throttled. There is no limit if `0`.
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_CPU_SHARES`
|
||||||
|
|
||||||
|
> Default: `0`
|
||||||
|
|
||||||
|
The relative weight vs. other containers.
|
||||||
|
|
||||||
|
### `WOODPECKER_LIMIT_CPU_SET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Comma-separated list to limit the specific CPUs or cores a pipeline container can use.
|
||||||
|
|
||||||
|
Example: `WOODPECKER_LIMIT_CPU_SET=1,2`
|
||||||
|
|
||||||
|
### `WOODPECKER_CONFIG_SERVICE_ENDPOINT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Specify a configuration service endpoint, see [Configuration Extension](./100-external-configuration-api.md)
|
||||||
|
|
||||||
|
### `WOODPECKER_FORGE_TIMEOUT`
|
||||||
|
|
||||||
|
> Default: 3s
|
||||||
|
|
||||||
|
Specify timeout when fetching the Woodpecker configuration from forge. See <https://pkg.go.dev/time#ParseDuration> for syntax reference.
|
||||||
|
|
||||||
|
### `WOODPECKER_ENABLE_SWAGGER`
|
||||||
|
|
||||||
|
> Default: true
|
||||||
|
|
||||||
|
Enable the Swagger UI for API documentation.
|
||||||
|
|
||||||
|
### `WOODPECKER_DISABLE_VERSION_CHECK`
|
||||||
|
|
||||||
|
> Default: false
|
||||||
|
|
||||||
|
Disable version check in admin web UI.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_...`
|
||||||
|
|
||||||
|
See [GitHub configuration](./11-forges/20-github.md#configuration)
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_...`
|
||||||
|
|
||||||
|
See [Gitea configuration](./11-forges/30-gitea.md#configuration)
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_...`
|
||||||
|
|
||||||
|
See [Bitbucket configuration](./11-forges/50-bitbucket.md#configuration)
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_...`
|
||||||
|
|
||||||
|
See [Gitlab configuration](./11-forges/40-gitlab.md#configuration)
|
|
@ -0,0 +1,104 @@
|
||||||
|
# External Configuration API
|
||||||
|
|
||||||
|
To provide additional management and preprocessing capabilities for pipeline configurations Woodpecker supports an HTTP API which can be enabled to call an external config service.
|
||||||
|
Before the run or restart of any pipeline Woodpecker will make a POST request to an external HTTP API sending the current repository, build information and all current config files retrieved from the repository. The external API can then send back new pipeline configurations that will be used immediately or respond with `HTTP 204` to tell the system to use the existing configuration.
|
||||||
|
|
||||||
|
Every request sent by Woodpecker is signed using a [http-signature](https://datatracker.ietf.org/doc/html/draft-cavage-http-signatures) by a private key (ed25519) generated on the first start of the Woodpecker server. You can get the public key for the verification of the http-signature from `http(s)://your-woodpecker-server/api/signature/public-key`.
|
||||||
|
|
||||||
|
A simplistic example configuration service can be found here: [https://github.com/woodpecker-ci/example-config-service](https://github.com/woodpecker-ci/example-config-service)
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
You need to trust the external config service as it is getting secret information about the repository and pipeline and has the ability to change pipeline configs that could run malicious tasks.
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Config
|
||||||
|
|
||||||
|
```ini title="Server"
|
||||||
|
WOODPECKER_CONFIG_SERVICE_ENDPOINT=https://example.com/ciconfig
|
||||||
|
```
|
||||||
|
|
||||||
|
### Example request made by Woodpecker
|
||||||
|
|
||||||
|
```json
|
||||||
|
{
|
||||||
|
"repo": {
|
||||||
|
"id": 100,
|
||||||
|
"uid": "",
|
||||||
|
"user_id": 0,
|
||||||
|
"namespace": "",
|
||||||
|
"name": "woodpecker-testpipe",
|
||||||
|
"slug": "",
|
||||||
|
"scm": "git",
|
||||||
|
"git_http_url": "",
|
||||||
|
"git_ssh_url": "",
|
||||||
|
"link": "",
|
||||||
|
"default_branch": "",
|
||||||
|
"private": true,
|
||||||
|
"visibility": "private",
|
||||||
|
"active": true,
|
||||||
|
"config": "",
|
||||||
|
"trusted": false,
|
||||||
|
"protected": false,
|
||||||
|
"ignore_forks": false,
|
||||||
|
"ignore_pulls": false,
|
||||||
|
"cancel_pulls": false,
|
||||||
|
"timeout": 60,
|
||||||
|
"counter": 0,
|
||||||
|
"synced": 0,
|
||||||
|
"created": 0,
|
||||||
|
"updated": 0,
|
||||||
|
"version": 0
|
||||||
|
},
|
||||||
|
"pipeline": {
|
||||||
|
"author": "myUser",
|
||||||
|
"author_avatar": "https://myforge.com/avatars/d6b3f7787a685fcdf2a44e2c685c7e03",
|
||||||
|
"author_email": "my@email.com",
|
||||||
|
"branch": "main",
|
||||||
|
"changed_files": ["somefilename.txt"],
|
||||||
|
"commit": "2fff90f8d288a4640e90f05049fe30e61a14fd50",
|
||||||
|
"created_at": 0,
|
||||||
|
"deploy_to": "",
|
||||||
|
"enqueued_at": 0,
|
||||||
|
"error": "",
|
||||||
|
"event": "push",
|
||||||
|
"finished_at": 0,
|
||||||
|
"id": 0,
|
||||||
|
"link_url": "https://myforge.com/myUser/woodpecker-testpipe/commit/2fff90f8d288a4640e90f05049fe30e61a14fd50",
|
||||||
|
"message": "test old config\n",
|
||||||
|
"number": 0,
|
||||||
|
"parent": 0,
|
||||||
|
"ref": "refs/heads/main",
|
||||||
|
"refspec": "",
|
||||||
|
"clone_url": "",
|
||||||
|
"reviewed_at": 0,
|
||||||
|
"reviewed_by": "",
|
||||||
|
"sender": "myUser",
|
||||||
|
"signed": false,
|
||||||
|
"started_at": 0,
|
||||||
|
"status": "",
|
||||||
|
"timestamp": 1645962783,
|
||||||
|
"title": "",
|
||||||
|
"updated_at": 0,
|
||||||
|
"verified": false
|
||||||
|
},
|
||||||
|
"configs": [
|
||||||
|
{
|
||||||
|
"name": ".woodpecker.yaml",
|
||||||
|
"data": "steps:\n - name: backend\n image: alpine\n commands:\n - echo \"Hello there from Repo (.woodpecker.yaml)\"\n"
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
### Example response structure
|
||||||
|
|
||||||
|
```json
|
||||||
|
{
|
||||||
|
"configs": [
|
||||||
|
{
|
||||||
|
"name": "central-override",
|
||||||
|
"data": "steps:\n - name: backend\n image: alpine\n commands:\n - echo \"Hello there from ConfigAPI\"\n"
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
||||||
|
```
|
|
@ -0,0 +1,13 @@
|
||||||
|
# Forges
|
||||||
|
|
||||||
|
## Supported features
|
||||||
|
|
||||||
|
| Feature | [GitHub](20-github.md) | [Gitea / Forgejo](30-gitea.md) | [Gitlab](40-gitlab.md) | [Bitbucket](50-bitbucket.md) | [Bitbucket Datacenter](60-bitbucket_datacenter.md) |
|
||||||
|
| ------------------------------------------------------------- | :--------------------: | :----------------------------: | :--------------------: | :--------------------------: | :------------------------------------------------: |
|
||||||
|
| Event: Push | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: |
|
||||||
|
| Event: Tag | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: |
|
||||||
|
| Event: Pull-Request | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: |
|
||||||
|
| Event: Release | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x: |
|
||||||
|
| Event: Deploy | :white_check_mark: | :x: | :x: | :x: | :x: |
|
||||||
|
| [Multiple workflows](../../20-usage/25-workflows.md) | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: | :white_check_mark: |
|
||||||
|
| [when.path filter](../../20-usage/20-workflow-syntax.md#path) | :white_check_mark: | :white_check_mark: | :white_check_mark: | :x: | :x: |
|
|
@ -0,0 +1,83 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# GitHub
|
||||||
|
|
||||||
|
Woodpecker comes with built-in support for GitHub and GitHub Enterprise.
|
||||||
|
To use Woodpecker with GitHub the following environment variables should be set for the server component:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_GITHUB=true
|
||||||
|
WOODPECKER_GITHUB_CLIENT=YOUR_GITHUB_CLIENT_ID
|
||||||
|
WOODPECKER_GITHUB_SECRET=YOUR_GITHUB_CLIENT_SECRET
|
||||||
|
```
|
||||||
|
|
||||||
|
You will get these values from GitHub when you register your OAuth application.
|
||||||
|
To do so, go to Settings -> Developer Settings -> GitHub Apps -> New Oauth2 App.
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Do not use a "GitHub App" instead of an Oauth2 app as the former will not work correctly with Woodpecker right now (because user access tokens are not being refreshed automatically)
|
||||||
|
:::
|
||||||
|
|
||||||
|
## App Settings
|
||||||
|
|
||||||
|
- Name: An arbitrary name for your App
|
||||||
|
- Homepage URL: The URL of your Woodpecker instance
|
||||||
|
- Callback URL: `https://<your-woodpecker-instance>/authorize`
|
||||||
|
- (optional) Upload the Woodpecker Logo: <https://avatars.githubusercontent.com/u/84780935?s=200&v=4>
|
||||||
|
|
||||||
|
## Client Secret Creation
|
||||||
|
|
||||||
|
After your App has been created, you can generate a client secret.
|
||||||
|
Use this one for the `WOODPECKER_GITHUB_SECRET` environment variable.
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
This is a full list of configuration options. Please note that many of these options use default configuration values that should work for the majority of installations.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enables the GitHub driver.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_URL`
|
||||||
|
|
||||||
|
> Default: `https://github.com`
|
||||||
|
|
||||||
|
Configures the GitHub server address.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_CLIENT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the GitHub OAuth client id to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_CLIENT_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITHUB_CLIENT` from the specified filepath.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the GitHub OAuth client secret. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITHUB_SECRET` from the specified filepath.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_MERGE_REF`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
### `WOODPECKER_GITHUB_SKIP_VERIFY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Configure if SSL verification should be skipped.
|
|
@ -0,0 +1,95 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Gitea / Forgejo
|
||||||
|
|
||||||
|
Woodpecker comes with built-in support for Gitea and the "soft" fork Forgejo. To enable Gitea you should configure the Woodpecker container using the following environment variables:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_GITEA=true
|
||||||
|
WOODPECKER_GITEA_URL=YOUR_GITEA_URL
|
||||||
|
WOODPECKER_GITEA_CLIENT=YOUR_GITEA_CLIENT
|
||||||
|
WOODPECKER_GITEA_SECRET=YOUR_GITEA_CLIENT_SECRET
|
||||||
|
```
|
||||||
|
|
||||||
|
## Gitea on the same host with containers
|
||||||
|
|
||||||
|
If you have Gitea also running on the same host within a container, make sure the agent does have access to it.
|
||||||
|
The agent tries to clone using the URL which Gitea reports through its API. For simplified connectivity, you should add the woodpecker agent to the same docker network as Gitea is in.
|
||||||
|
Otherwise, the communication should go via the `docker0` gateway (usually 172.17.0.1).
|
||||||
|
|
||||||
|
To configure the Docker network if the network's name is `gitea`, configure it like this:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
[...]
|
||||||
|
woodpecker-agent:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_BACKEND_DOCKER_NETWORK=gitea
|
||||||
|
```
|
||||||
|
|
||||||
|
## Registration
|
||||||
|
|
||||||
|
Register your application with Gitea to create your client id and secret. You can find the OAuth applications settings of Gitea at `https://gitea.<host>/user/settings/`. It is very import the authorization callback URL matches your http(s) scheme and hostname exactly with `https://<host>/authorize` as the path.
|
||||||
|
|
||||||
|
If you run the Woodpecker CI server on the same host as the Gitea instance, you might also need to allow local connections in Gitea, since version `v1.16`. Otherwise webhooks will fail. Add the following lines to your Gitea configuration (usually at `/etc/gitea/conf/app.ini`).
|
||||||
|
|
||||||
|
```ini
|
||||||
|
[webhook]
|
||||||
|
ALLOWED_HOST_LIST=external,loopback
|
||||||
|
```
|
||||||
|
|
||||||
|
For reference see [Configuration Cheat Sheet](https://docs.gitea.io/en-us/config-cheat-sheet/#webhook-webhook).
|
||||||
|
|
||||||
|
![gitea oauth setup](gitea_oauth.gif)
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
This is a full list of configuration options. Please note that many of these options use default configuration values that should work for the majority of installations.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enables the Gitea driver.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_URL`
|
||||||
|
|
||||||
|
> Default: `https://try.gitea.io`
|
||||||
|
|
||||||
|
Configures the Gitea server address.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_CLIENT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the Gitea OAuth client id. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_CLIENT_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITEA_CLIENT` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the Gitea OAuth client secret. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITEA_SECRET` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_GITEA_SKIP_VERIFY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Configure if SSL verification should be skipped.
|
|
@ -0,0 +1,68 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# GitLab
|
||||||
|
|
||||||
|
Woodpecker comes with built-in support for the GitLab version 8.2 and higher. To enable GitLab you should configure the Woodpecker container using the following environment variables:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_GITLAB=true
|
||||||
|
WOODPECKER_GITLAB_URL=http://gitlab.mycompany.com
|
||||||
|
WOODPECKER_GITLAB_CLIENT=95c0282573633eb25e82
|
||||||
|
WOODPECKER_GITLAB_SECRET=30f5064039e6b359e075
|
||||||
|
```
|
||||||
|
|
||||||
|
## Registration
|
||||||
|
|
||||||
|
You must register your application with GitLab in order to generate a Client and Secret. Navigate to your account settings and choose Applications from the menu, and click New Application.
|
||||||
|
|
||||||
|
Please use `http://woodpecker.mycompany.com/authorize` as the Authorization callback URL. Grant `api` scope to the application.
|
||||||
|
|
||||||
|
If you run the Woodpecker CI server on a private IP (RFC1918) or use a non standard TLD (e.g. `.local`, `.intern`) with your GitLab instance, you might also need to allow local connections in GitLab, otherwise API requests will fail. In GitLab, navigate to the Admin dashboard, then go to `Settings > Network > Outbound requests` and enable `Allow requests to the local network from web hooks and services`.
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
This is a full list of configuration options. Please note that many of these options use default configuration values that should work for the majority of installations.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enables the GitLab driver.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_URL`
|
||||||
|
|
||||||
|
> Default: `https://gitlab.com`
|
||||||
|
|
||||||
|
Configures the GitLab server address.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_CLIENT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the GitLab OAuth client id. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_CLIENT_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITLAB_CLIENT` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the GitLab OAuth client secret. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_GITLAB_SECRET` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_GITLAB_SKIP_VERIFY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Configure if SSL verification should be skipped.
|
|
@ -0,0 +1,75 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Bitbucket
|
||||||
|
|
||||||
|
Woodpecker comes with built-in support for Bitbucket Cloud. To enable Bitbucket Cloud you should configure the Woodpecker container using the following environment variables:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_BITBUCKET=true
|
||||||
|
WOODPECKER_BITBUCKET_CLIENT=... # called "Key" in Bitbucket
|
||||||
|
WOODPECKER_BITBUCKET_SECRET=...
|
||||||
|
```
|
||||||
|
|
||||||
|
## Registration
|
||||||
|
|
||||||
|
You must register an OAuth application at Bitbucket in order to get a key and secret combination for woodpecker. Navigate to your workspace settings and choose `OAuth consumers` from the menu, and finally click `Add Consumer` (the url should be like: `https://bitbucket.org/[your-project-name]/workspace/settings/api`).
|
||||||
|
|
||||||
|
Please set a name and set the `Callback URL` like this:
|
||||||
|
|
||||||
|
```uri
|
||||||
|
https://<your-woodpecker-address>/authorize
|
||||||
|
```
|
||||||
|
|
||||||
|
![bitbucket oauth setup](bitbucket_oauth.png)
|
||||||
|
|
||||||
|
Please also be sure to check the following permissions:
|
||||||
|
|
||||||
|
- Account: Email, Read
|
||||||
|
- Workspace membership: Read
|
||||||
|
- Projects: Read
|
||||||
|
- Repositories: Read
|
||||||
|
- Pull requests: Read
|
||||||
|
- Webhooks: Read and Write
|
||||||
|
|
||||||
|
![bitbucket permissions](bitbucket_permissions.png)
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
This is a full list of configuration options. Please note that many of these options use default configuration values that should work for the majority of installations.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enables the Bitbucket driver.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_CLIENT`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the Bitbucket OAuth client key. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_CLIENT_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_BITBUCKET_CLIENT` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the Bitbucket OAuth client secret. This is used to authorize access.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_BITBUCKET_SECRET` from the specified filepath
|
||||||
|
|
||||||
|
## Missing Features
|
||||||
|
|
||||||
|
Path filters for pull requests are not supported. We are interested in patches to include this functionality.
|
||||||
|
If you are interested in contributing to Woodpecker and submitting a patch please **contact us** via [Discord](https://discord.gg/fcMQqSMXJy) or [Matrix](https://matrix.to/#/#WoodpeckerCI-Develop:obermui.de).
|
|
@ -0,0 +1,99 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Bitbucket Datacenter / Server
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Woodpecker comes with experimental support for Bitbucket Datacenter / Server, formerly known as Atlassian Stash.
|
||||||
|
:::
|
||||||
|
|
||||||
|
To enable Bitbucket Server you should configure the Woodpecker container using the following environment variables:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
# docker-compose.yml
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
- [...]
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC=true
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC_GIT_USERNAME=foo
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC_GIT_PASSWORD=bar
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC_CLIENT_ID=xxx
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC_CLIENT_SECRET=yyy
|
||||||
|
+ - WOODPECKER_BITBUCKET_DC_URL=http://stash.mycompany.com
|
||||||
|
|
||||||
|
woodpecker-agent:
|
||||||
|
[...]
|
||||||
|
```
|
||||||
|
|
||||||
|
## Service Account
|
||||||
|
|
||||||
|
Woodpecker uses `git+https` to clone repositories, however, Bitbucket Server does not currently support cloning repositories with an OAuth token. To work around this limitation, you must create a service account and provide the username and password to Woodpecker. This service account will be used to authenticate and clone private repositories.
|
||||||
|
|
||||||
|
## Registration
|
||||||
|
|
||||||
|
Woodpecker must be registered with Bitbucket Datacenter / Server. In the administration section of Bitbucket choose "Application Links" and then "Create link". Woodpecker should be listed as "External Application" and the direction should be set to "Incomming". Note the client id and client secret of the registration to be used in the configuration of Woodpecker.
|
||||||
|
|
||||||
|
See also [Configure an incoming link](https://confluence.atlassian.com/bitbucketserver/configure-an-incoming-link-1108483657.html).
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
This is a full list of configuration options. Please note that many of these options use default configuration values that should work for the majority of installations.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enables the Bitbucket Server driver.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_URL`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the Bitbucket Server address.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_CLIENT_ID`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures your Bitbucket Server OAUth 2.0 client id.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_CLIENT_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures your Bitbucket Server OAUth 2.0 client secret.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_GIT_USERNAME`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
This username is used to authenticate and clone all private repositories.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_GIT_USERNAME_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_BITBUCKET_DC_GIT_USERNAME` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_GIT_PASSWORD`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
The password is used to authenticate and clone all private repositories.
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_GIT_PASSWORD_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_BITBUCKET_DC_GIT_PASSWORD` from the specified filepath
|
||||||
|
|
||||||
|
### `WOODPECKER_BITBUCKET_DC_SKIP_VERIFY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Configure if SSL verification should be skipped.
|
|
@ -0,0 +1,6 @@
|
||||||
|
label: 'Forges'
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
||||||
|
link:
|
||||||
|
type: 'doc'
|
||||||
|
id: 'overview'
|
After Width: | Height: | Size: 29 KiB |
After Width: | Height: | Size: 20 KiB |
After Width: | Height: | Size: 129 KiB |
After Width: | Height: | Size: 25 KiB |
|
@ -0,0 +1,199 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Agent configuration
|
||||||
|
|
||||||
|
Agents are configured by the command line or environment variables. At the minimum you need the following information:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_SERVER=localhost:9000
|
||||||
|
WOODPECKER_AGENT_SECRET="your-shared-secret-goes-here"
|
||||||
|
```
|
||||||
|
|
||||||
|
The following are automatically set and can be overridden:
|
||||||
|
|
||||||
|
- `WOODPECKER_HOSTNAME` if not set, becomes the OS' hostname
|
||||||
|
- `WOODPECKER_MAX_WORKFLOWS` if not set, defaults to 1
|
||||||
|
|
||||||
|
## Workflows per agent
|
||||||
|
|
||||||
|
By default, the maximum workflows that are executed in parallel on an agent is 1. If required, you can add `WOODPECKER_MAX_WORKFLOWS` to increase your parallel processing for an agent.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_SERVER=localhost:9000
|
||||||
|
WOODPECKER_AGENT_SECRET="your-shared-secret-goes-here"
|
||||||
|
WOODPECKER_MAX_WORKFLOWS=4
|
||||||
|
```
|
||||||
|
|
||||||
|
## Agent registration
|
||||||
|
|
||||||
|
When the agent starts it connects to the server using the token from `WOODPECKER_AGENT_SECRET`. The server identifies the agent and registers the agent in its database if it wasn't connected before.
|
||||||
|
|
||||||
|
There are two types of tokens to connect an agent to the server:
|
||||||
|
|
||||||
|
### Using system token
|
||||||
|
|
||||||
|
A _system token_ is a token that is used system-wide, e.g. when you set the same token in `WOODPECKER_AGENT_SECRET` on both the server and the agents.
|
||||||
|
|
||||||
|
In that case registration process would be as following:
|
||||||
|
|
||||||
|
1. The first time the agent communicates with the server, it is using the system token
|
||||||
|
1. The server registers the agent in its database if not done before and generates a unique ID which is then sent back to the agent
|
||||||
|
1. The agent stores the received ID in a file (configured by `WOODPECKER_AGENT_CONFIG_FILE`)
|
||||||
|
1. At the following startups, the agent uses the system token **and** its received ID to identify itself to the server
|
||||||
|
|
||||||
|
### Using agent token
|
||||||
|
|
||||||
|
An _agent token_ is a token that is used by only one particular agent. This unique token is applied to the agent by `WOODPECKER_AGENT_SECRET`.
|
||||||
|
|
||||||
|
To get an _agent token_ you have to register the agent manually in the server using the UI:
|
||||||
|
|
||||||
|
1. The administrator registers a new agent manually at `Settings -> Agents -> Add agent`
|
||||||
|
![Agent creation](./new-agent-registration.png)
|
||||||
|
![Agent created](./new-agent-created.png)
|
||||||
|
1. The generated token from the previous step has to be provided to the agent using `WOODPECKER_AGENT_SECRET`
|
||||||
|
1. The agent will connect to the server using the provided token and will update its status in the UI:
|
||||||
|
![Agent connected](./new-agent-connected.png)
|
||||||
|
|
||||||
|
## All agent configuration options
|
||||||
|
|
||||||
|
Here is the full list of configuration options and their default variables.
|
||||||
|
|
||||||
|
### `WOODPECKER_SERVER`
|
||||||
|
|
||||||
|
> Default: `localhost:9000`
|
||||||
|
|
||||||
|
Configures gRPC address of the server.
|
||||||
|
|
||||||
|
### `WOODPECKER_USERNAME`
|
||||||
|
|
||||||
|
> Default: `x-oauth-basic`
|
||||||
|
|
||||||
|
The gRPC username.
|
||||||
|
|
||||||
|
### `WOODPECKER_AGENT_SECRET`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
A shared secret used by server and agents to authenticate communication. A secret can be generated by `openssl rand -hex 32`.
|
||||||
|
|
||||||
|
### `WOODPECKER_AGENT_SECRET_FILE`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Read the value for `WOODPECKER_AGENT_SECRET` from the specified filepath, e.g. `/etc/woodpecker/agent-secret.conf`
|
||||||
|
|
||||||
|
### `WOODPECKER_LOG_LEVEL`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the logging level. Possible values are `trace`, `debug`, `info`, `warn`, `error`, `fatal`, `panic`, `disabled` and empty.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEBUG_PRETTY`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable pretty-printed debug output.
|
||||||
|
|
||||||
|
### `WOODPECKER_DEBUG_NOCOLOR`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
Disable colored debug output.
|
||||||
|
|
||||||
|
### `WOODPECKER_HOSTNAME`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures the agent hostname.
|
||||||
|
|
||||||
|
### `WOODPECKER_AGENT_CONFIG_FILE`
|
||||||
|
|
||||||
|
> Default: `/etc/woodpecker/agent.conf`
|
||||||
|
|
||||||
|
Configures the path of the agent config file.
|
||||||
|
|
||||||
|
### `WOODPECKER_MAX_WORKFLOWS`
|
||||||
|
|
||||||
|
> Default: `1`
|
||||||
|
|
||||||
|
Configures the number of parallel workflows.
|
||||||
|
|
||||||
|
### `WOODPECKER_FILTER_LABELS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Configures labels to filter pipeline pick up. Use a list of key-value pairs like `key=value,second-key=*`. `*` can be used as a wildcard. By default, agents provide three additional labels `platform=os/arch`, `hostname=my-agent` and `repo=*` which can be overwritten if needed. To learn how labels work, check out the [pipeline syntax page](../20-usage/20-workflow-syntax.md#labels).
|
||||||
|
|
||||||
|
### `WOODPECKER_HEALTHCHECK`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
Enable healthcheck endpoint.
|
||||||
|
|
||||||
|
### `WOODPECKER_HEALTHCHECK_ADDR`
|
||||||
|
|
||||||
|
> Default: `:3000`
|
||||||
|
|
||||||
|
Configures healthcheck endpoint address.
|
||||||
|
|
||||||
|
### `WOODPECKER_KEEPALIVE_TIME`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
After a duration of this time of no activity, the agent pings the server to check if the transport is still alive.
|
||||||
|
|
||||||
|
### `WOODPECKER_KEEPALIVE_TIMEOUT`
|
||||||
|
|
||||||
|
> Default: `20s`
|
||||||
|
|
||||||
|
After pinging for a keepalive check, the agent waits for a duration of this time before closing the connection if no activity.
|
||||||
|
|
||||||
|
### `WOODPECKER_GRPC_SECURE`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Configures if the connection to `WOODPECKER_SERVER` should be made using a secure transport.
|
||||||
|
|
||||||
|
### `WOODPECKER_GRPC_VERIFY`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
Configures if the gRPC server certificate should be verified, only valid when `WOODPECKER_GRPC_SECURE` is `true`.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND`
|
||||||
|
|
||||||
|
> Default: `auto-detect`
|
||||||
|
|
||||||
|
Configures the backend engine to run pipelines on. Possible values are `auto-detect`, `docker`, `local` or `kubernetes`.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_DOCKER_*`
|
||||||
|
|
||||||
|
See [Docker backend configuration](./22-backends/10-docker.md#configuration)
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_*`
|
||||||
|
|
||||||
|
See [Kubernetes backend configuration](./22-backends/40-kubernetes.md#configuration)
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_LOCAL_*`
|
||||||
|
|
||||||
|
See [Local backend configuration](./22-backends/20-local.md#options)
|
||||||
|
|
||||||
|
## Advanced Settings
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Only change these If you know what you do.
|
||||||
|
:::
|
||||||
|
|
||||||
|
### `WOODPECKER_CONNECT_RETRY_COUNT`
|
||||||
|
|
||||||
|
> Default: `5`
|
||||||
|
|
||||||
|
Configures number of times agent retries to connect to the server.
|
||||||
|
|
||||||
|
### `WOODPECKER_CONNECT_RETRY_DELAY`
|
||||||
|
|
||||||
|
> Default: `2s`
|
||||||
|
|
||||||
|
Configures delay between agent connection retries to the server.
|
|
@ -0,0 +1,64 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Docker backend
|
||||||
|
|
||||||
|
This is the original backend used with Woodpecker. The docker backend executes each step inside a separate container started on the agent.
|
||||||
|
|
||||||
|
## Docker credentials
|
||||||
|
|
||||||
|
Woodpecker supports [Docker credentials](https://github.com/docker/docker-credential-helpers) to securely store registry credentials. Install your corresponding credential helper and configure it in your Docker config file passed via [`WOODPECKER_DOCKER_CONFIG`](../10-server-config.md#woodpecker_docker_config).
|
||||||
|
|
||||||
|
To add your credential helper to the Woodpecker server container you could use the following code to build a custom image:
|
||||||
|
|
||||||
|
```dockerfile
|
||||||
|
FROM woodpeckerci/woodpecker-server:latest-alpine
|
||||||
|
|
||||||
|
RUN apk add -U --no-cache docker-credential-ecr-login
|
||||||
|
```
|
||||||
|
|
||||||
|
## Podman support
|
||||||
|
|
||||||
|
While the agent was developed with Docker/Moby, Podman can also be used by setting the environment variable `DOCKER_HOST` to point to the Podman socket. In order to work without workarounds, Podman 4.0 (or above) is required.
|
||||||
|
|
||||||
|
## Image cleanup
|
||||||
|
|
||||||
|
The agent **will not** automatically remove images from the host. This task should be managed by the host system. For example, you can use a cron job to periodically do clean-up tasks for the CI runner.
|
||||||
|
|
||||||
|
:::danger
|
||||||
|
The following commands **are destructive** and **irreversible** it is highly recommended that you test these commands on your system before running them in production via a cron job or other automation.
|
||||||
|
:::
|
||||||
|
|
||||||
|
### Remove all unused images
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker image rm $(docker images --filter "dangling=true" -q --no-trunc)
|
||||||
|
```
|
||||||
|
|
||||||
|
### Remove Woodpecker volumes
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker volume rm $(docker volume ls --filter name=^wp_* --filter dangling=true -q)
|
||||||
|
```
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_DOCKER_NETWORK`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Set to the name of an existing network which will be attached to all your pipeline containers (steps). Please be careful as this allows the containers of different pipelines to access each other!
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_DOCKER_ENABLE_IPV6`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Enable IPv6 for the networks used by pipeline containers (steps). Make sure you configured your docker daemon to support IPv6.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_DOCKER_VOLUMES`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
List of default volumes separated by comma to be mounted to all pipeline containers (steps). For example to use custom CA
|
||||||
|
certificates installed on host and host timezone use `/etc/ssl/certs:/etc/ssl/certs:ro,/etc/timezone:/etc/timezone`.
|
|
@ -0,0 +1,71 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 3
|
||||||
|
---
|
||||||
|
|
||||||
|
# Local backend
|
||||||
|
|
||||||
|
:::danger
|
||||||
|
The local backend will execute the pipelines on the local system without any isolation of any kind.
|
||||||
|
:::
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Currently we do not support services for this backend.
|
||||||
|
[Read more here](https://github.com/woodpecker-ci/woodpecker/issues/3095).
|
||||||
|
:::
|
||||||
|
|
||||||
|
Since the code runs directly in the same context as the agent (same user, same
|
||||||
|
filesystem), a malicious pipeline could be used to access the agent
|
||||||
|
configuration especially the `WOODPECKER_AGENT_SECRET` variable.
|
||||||
|
|
||||||
|
It is recommended to use this backend only for private setup where the code and
|
||||||
|
pipeline can be trusted. You shouldn't use it for a public facing CI where
|
||||||
|
anyone can submit code or add new repositories. You shouldn't execute the agent
|
||||||
|
as a privileged user (root).
|
||||||
|
|
||||||
|
The local backend will use a random directory in `$TMPDIR` to store the cloned
|
||||||
|
code and execute commands.
|
||||||
|
|
||||||
|
In order to use this backend, you need to download (or build) the
|
||||||
|
[binary](https://github.com/woodpecker-ci/woodpecker/releases/latest) of the
|
||||||
|
agent, configure it and run it on the host machine.
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
To enable the local backend, add this to your configuration:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_BACKEND=local
|
||||||
|
```
|
||||||
|
|
||||||
|
### Shell
|
||||||
|
|
||||||
|
The `image` entry is used to specify the shell, such as Bash or Fish, that is
|
||||||
|
used to run the commands.
|
||||||
|
|
||||||
|
```yaml title=".woodpecker.yaml"
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: bash
|
||||||
|
commands: [...]
|
||||||
|
```
|
||||||
|
|
||||||
|
### Plugins
|
||||||
|
|
||||||
|
Plugins are just executable binaries:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: /usr/bin/tree
|
||||||
|
```
|
||||||
|
|
||||||
|
If no commands are provided, we treat them as plugins in the usual manner.
|
||||||
|
In the context of the local backend, plugins are simply executable binaries, which can be located using their name if they are listed in `$PATH`, or through an absolute path.
|
||||||
|
|
||||||
|
### Options
|
||||||
|
|
||||||
|
#### `WOODPECKER_BACKEND_LOCAL_TEMP_DIR`
|
||||||
|
|
||||||
|
> Default: default temp directory
|
||||||
|
|
||||||
|
Directory to create folders for workflows.
|
|
@ -0,0 +1,257 @@
|
||||||
|
---
|
||||||
|
toc_max_heading_level: 2
|
||||||
|
---
|
||||||
|
|
||||||
|
# Kubernetes backend
|
||||||
|
|
||||||
|
The kubernetes backend executes steps inside standalone pods. A temporary PVC is created for the lifetime of the pipeline to transfer files between steps.
|
||||||
|
|
||||||
|
## Images from private registries
|
||||||
|
|
||||||
|
In order to pull private container images defined in your pipeline YAML you must provide [registry credentials in Kubernetes secret](https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/).
|
||||||
|
As the secret is Agent-wide, it has to be placed in namespace defined by `WOODPECKER_BACKEND_K8S_NAMESPACE`.
|
||||||
|
Besides, you need to provide the secret name to Agent via `WOODPECKER_BACKEND_K8S_PULL_SECRET_NAMES`.
|
||||||
|
|
||||||
|
## Job specific configuration
|
||||||
|
|
||||||
|
### Resources
|
||||||
|
|
||||||
|
The kubernetes backend also allows for specifying requests and limits on a per-step basic, most commonly for CPU and memory.
|
||||||
|
We recommend to add a `resources` definition to all steps to ensure efficient scheduling.
|
||||||
|
|
||||||
|
Here is an example definition with an arbitrary `resources` definition below the `backend_options` section:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: 'My kubernetes step'
|
||||||
|
image: alpine
|
||||||
|
commands:
|
||||||
|
- echo "Hello world"
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
memory: 200Mi
|
||||||
|
cpu: 100m
|
||||||
|
limits:
|
||||||
|
memory: 400Mi
|
||||||
|
cpu: 1000m
|
||||||
|
```
|
||||||
|
|
||||||
|
You can use [Limit Ranges](https://kubernetes.io/docs/concepts/policy/limit-range/) if you want to set the limits by per-namespace basis.
|
||||||
|
|
||||||
|
### Service account
|
||||||
|
|
||||||
|
`serviceAccountName` specifies the name of the ServiceAccount which the pod will mount. This service account must be created externally.
|
||||||
|
See the [kubernetes documentation](https://kubernetes.io/docs/concepts/security/service-accounts/) for more information on using service accounts.
|
||||||
|
|
||||||
|
### Node selector
|
||||||
|
|
||||||
|
`nodeSelector` specifies the labels which are used to select the node on which the job will be executed.
|
||||||
|
|
||||||
|
Labels defined here will be appended to a list which already contains `"kubernetes.io/arch"`.
|
||||||
|
By default `"kubernetes.io/arch"` is inferred from the agents' platform. One can override it by setting that label in the `nodeSelector` section of the `backend_options`.
|
||||||
|
Without a manual overwrite, builds will be randomly assigned to the runners and inherit their respective architectures.
|
||||||
|
|
||||||
|
To overwrite this, one needs to set the label in the `nodeSelector` section of the `backend_options`.
|
||||||
|
A practical example for this is when running a matrix-build and delegating specific elements of the matrix to run on a specific architecture.
|
||||||
|
In this case, one must define an arbitrary key in the matrix section of the respective matrix element:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
matrix:
|
||||||
|
include:
|
||||||
|
- NAME: runner1
|
||||||
|
ARCH: arm64
|
||||||
|
```
|
||||||
|
|
||||||
|
And then overwrite the `nodeSelector` in the `backend_options` section of the step(s) using the name of the respective env var:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
[...]
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
nodeSelector:
|
||||||
|
kubernetes.io/arch: "${ARCH}"
|
||||||
|
```
|
||||||
|
|
||||||
|
You can use [PodNodeSelector](https://kubernetes.io/docs/reference/access-authn-authz/admission-controllers/#podnodeselector) admission controller if you want to set the node selector by per-namespace basis.
|
||||||
|
|
||||||
|
### Tolerations
|
||||||
|
|
||||||
|
When you use `nodeSelector` and the node pool is configured with Taints, you need to specify the Tolerations. Tolerations allow the scheduler to schedule pods with matching taints.
|
||||||
|
See the [kubernetes documentation](https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/) for more information on using tolerations.
|
||||||
|
|
||||||
|
Example pipeline configuration:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: build
|
||||||
|
image: golang
|
||||||
|
commands:
|
||||||
|
- go get
|
||||||
|
- go build
|
||||||
|
- go test
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
serviceAccountName: 'my-service-account'
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
memory: 128Mi
|
||||||
|
cpu: 1000m
|
||||||
|
limits:
|
||||||
|
memory: 256Mi
|
||||||
|
nodeSelector:
|
||||||
|
beta.kubernetes.io/instance-type: p3.8xlarge
|
||||||
|
tolerations:
|
||||||
|
- key: 'key1'
|
||||||
|
operator: 'Equal'
|
||||||
|
value: 'value1'
|
||||||
|
effect: 'NoSchedule'
|
||||||
|
tolerationSeconds: 3600
|
||||||
|
```
|
||||||
|
|
||||||
|
### Volumes
|
||||||
|
|
||||||
|
To mount volumes a persistent volume (PV) and persistent volume claim (PVC) are needed on the cluster which can be referenced in steps via the `volumes` option.
|
||||||
|
Assuming a PVC named `woodpecker-cache` exists, it can be referenced as follows in a step:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: "Restore Cache"
|
||||||
|
image: meltwater/drone-cache
|
||||||
|
volumes:
|
||||||
|
- woodpecker-cache:/woodpecker/src/cache
|
||||||
|
settings:
|
||||||
|
mount:
|
||||||
|
- "woodpecker-cache"
|
||||||
|
[...]
|
||||||
|
```
|
||||||
|
|
||||||
|
### Security context
|
||||||
|
|
||||||
|
Use the following configuration to set the [Security Context](https://kubernetes.io/docs/tasks/configure-pod-container/security-context/) for the pod/container running a given pipeline step:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
steps:
|
||||||
|
- name: test
|
||||||
|
image: alpine
|
||||||
|
commands:
|
||||||
|
- echo Hello world
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
securityContext:
|
||||||
|
runAsUser: 999
|
||||||
|
runAsGroup: 999
|
||||||
|
privileged: true
|
||||||
|
[...]
|
||||||
|
```
|
||||||
|
|
||||||
|
Note that the `backend_options.kubernetes.securityContext` object allows you to set both pod and container level security context options in one object.
|
||||||
|
By default, the properties will be set at the pod level. Properties that are only supported on the container level will be set there instead. So, the
|
||||||
|
configuration shown above will result in something like the following pod spec:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
kind: Pod
|
||||||
|
spec:
|
||||||
|
securityContext:
|
||||||
|
runAsUser: 999
|
||||||
|
runAsGroup: 999
|
||||||
|
containers:
|
||||||
|
- name: wp-01hcd83q7be5ymh89k5accn3k6-0-step-0
|
||||||
|
image: alpine
|
||||||
|
securityContext:
|
||||||
|
privileged: true
|
||||||
|
[...]
|
||||||
|
```
|
||||||
|
|
||||||
|
You can also restrict a container's syscalls with [seccomp](https://kubernetes.io/docs/tutorials/security/seccomp/) profile
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
securityContext:
|
||||||
|
seccompProfile:
|
||||||
|
type: Localhost
|
||||||
|
localhostProfile: profiles/audit.json
|
||||||
|
```
|
||||||
|
|
||||||
|
or restrict a container's access to resources by specifying [AppArmor](https://kubernetes.io/docs/tutorials/security/apparmor/) profile
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
backend_options:
|
||||||
|
kubernetes:
|
||||||
|
securityContext:
|
||||||
|
apparmorProfile:
|
||||||
|
type: Localhost
|
||||||
|
localhostProfile: k8s-apparmor-example-deny-write
|
||||||
|
```
|
||||||
|
|
||||||
|
:::note
|
||||||
|
AppArmor syntax follows [KEP-24](https://github.com/kubernetes/enhancements/blob/fddcbb9cbf3df39ded03bad71228265ac6e5215f/keps/sig-node/24-apparmor/README.md).
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Tips and tricks
|
||||||
|
|
||||||
|
### CRI-O
|
||||||
|
|
||||||
|
CRI-O users currently need to configure the workspace for all workflows in order for them to run correctly. Add the following at the beginning of your configuration:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
workspace:
|
||||||
|
base: '/woodpecker'
|
||||||
|
path: '/'
|
||||||
|
```
|
||||||
|
|
||||||
|
See [this issue](https://github.com/woodpecker-ci/woodpecker/issues/2510) for more details.
|
||||||
|
|
||||||
|
## Configuration
|
||||||
|
|
||||||
|
These env vars can be set in the `env:` sections of the agent.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_NAMESPACE`
|
||||||
|
|
||||||
|
> Default: `woodpecker`
|
||||||
|
|
||||||
|
The namespace to create worker pods in.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_VOLUME_SIZE`
|
||||||
|
|
||||||
|
> Default: `10G`
|
||||||
|
|
||||||
|
The volume size of the pipeline volume.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_STORAGE_CLASS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
The storage class to use for the pipeline volume.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_STORAGE_RWX`
|
||||||
|
|
||||||
|
> Default: `true`
|
||||||
|
|
||||||
|
Determines if `RWX` should be used for the pipeline volume's [access mode](https://kubernetes.io/docs/concepts/storage/persistent-volumes/#access-modes). If false, `RWO` is used instead.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_POD_LABELS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Additional labels to apply to worker pods. Must be a YAML object, e.g. `{"example.com/test-label":"test-value"}`.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_POD_ANNOTATIONS`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Additional annotations to apply to worker pods. Must be a YAML object, e.g. `{"example.com/test-annotation":"test-value"}`.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_SECCTX_NONROOT`
|
||||||
|
|
||||||
|
> Default: `false`
|
||||||
|
|
||||||
|
Determines if containers must be required to run as non-root users.
|
||||||
|
|
||||||
|
### `WOODPECKER_BACKEND_K8S_PULL_SECRET_NAMES`
|
||||||
|
|
||||||
|
> Default: empty
|
||||||
|
|
||||||
|
Secret names to pull images from private repositories. See, how to [Pull an Image from a Private Registry](https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/).
|
|
@ -0,0 +1,23 @@
|
||||||
|
# Custom backends
|
||||||
|
|
||||||
|
If none of our backends fits your usecases, you can write your own.
|
||||||
|
|
||||||
|
Therefore, implement the interface `"go.woodpecker-ci.org/woodpecker/woodpecker/v2/pipeline/backend/types".Backend` and
|
||||||
|
build a custom agent using your backend with this `main.go`:
|
||||||
|
|
||||||
|
```go
|
||||||
|
package main
|
||||||
|
|
||||||
|
import (
|
||||||
|
"go.woodpecker-ci.org/woodpecker/v2/cmd/agent/core"
|
||||||
|
backendTypes "go.woodpecker-ci.org/woodpecker/v2/pipeline/backend/types"
|
||||||
|
)
|
||||||
|
|
||||||
|
func main() {
|
||||||
|
core.RunAgent([]backendTypes.Backend{
|
||||||
|
yourBackend,
|
||||||
|
})
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
It is also possible to use multiple backends, you can select with [`WOODPECKER_BACKEND`](../15-agent-config.md#woodpecker_backend) between them.
|
|
@ -0,0 +1,4 @@
|
||||||
|
label: 'Backends'
|
||||||
|
# position: 3
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
|
@ -0,0 +1,53 @@
|
||||||
|
# Databases
|
||||||
|
|
||||||
|
The default database engine of Woodpecker is an embedded SQLite database which requires zero installation or configuration. But you can replace it with a MySQL/MariaDB or Postgres database.
|
||||||
|
|
||||||
|
## Configure SQLite
|
||||||
|
|
||||||
|
By default Woodpecker uses a SQLite database stored under `/var/lib/woodpecker/`. If using containers, you can mount a [data volume](https://docs.docker.com/storage/volumes/#create-and-manage-volumes) to persist the SQLite database.
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
+ volumes:
|
||||||
|
+ - woodpecker-server-data:/var/lib/woodpecker/
|
||||||
|
```
|
||||||
|
|
||||||
|
## Configure MySQL/MariaDB
|
||||||
|
|
||||||
|
The below example demonstrates MySQL database configuration. See the official driver [documentation](https://github.com/go-sql-driver/mysql#dsn-data-source-name) for configuration options and examples.
|
||||||
|
The minimum version of MySQL/MariaDB required is determined by the `go-sql-driver/mysql` - see [it's README](https://github.com/go-sql-driver/mysql#requirements) for more information.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_DATABASE_DRIVER=mysql
|
||||||
|
WOODPECKER_DATABASE_DATASOURCE=root:password@tcp(1.2.3.4:3306)/woodpecker?parseTime=true
|
||||||
|
```
|
||||||
|
|
||||||
|
## Configure Postgres
|
||||||
|
|
||||||
|
The below example demonstrates Postgres database configuration. See the official driver [documentation](https://www.postgresql.org/docs/current/static/libpq-connect.html#LIBPQ-CONNSTRING) for configuration options and examples.
|
||||||
|
Please use Postgres versions equal or higher than **11**.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_DATABASE_DRIVER=postgres
|
||||||
|
WOODPECKER_DATABASE_DATASOURCE=postgres://root:password@1.2.3.4:5432/postgres?sslmode=disable
|
||||||
|
```
|
||||||
|
|
||||||
|
## Database Creation
|
||||||
|
|
||||||
|
Woodpecker does not create your database automatically. If you are using the MySQL or Postgres driver you will need to manually create your database using `CREATE DATABASE`.
|
||||||
|
|
||||||
|
## Database Migration
|
||||||
|
|
||||||
|
Woodpecker automatically handles database migration, including the initial creation of tables and indexes. New versions of Woodpecker will automatically upgrade the database unless otherwise specified in the release notes.
|
||||||
|
|
||||||
|
## Database Backups
|
||||||
|
|
||||||
|
Woodpecker does not perform database backups. This should be handled by separate third party tools provided by your database vendor of choice.
|
||||||
|
|
||||||
|
## Database Archiving
|
||||||
|
|
||||||
|
Woodpecker does not perform data archival; it considered out-of-scope for the project. Woodpecker is rather conservative with the amount of data it stores, however, you should expect the database logs to grow the size of your database considerably.
|
90
docs/versioned_docs/version-2.4/30-administration/60-ssl.md
Normal file
|
@ -0,0 +1,90 @@
|
||||||
|
# SSL
|
||||||
|
|
||||||
|
Woodpecker supports two ways of enabling SSL communication. You can either use Let's Encrypt to get automated SSL support with
|
||||||
|
renewal or provide your own SSL certificates.
|
||||||
|
|
||||||
|
## Let's Encrypt
|
||||||
|
|
||||||
|
Woodpecker supports automated SSL configuration and updates using Let's Encrypt.
|
||||||
|
|
||||||
|
You can enable Let's Encrypt by making the following modifications to your server configuration:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_LETS_ENCRYPT=true
|
||||||
|
WOODPECKER_LETS_ENCRYPT_EMAIL=ssl-admin@example.tld
|
||||||
|
```
|
||||||
|
|
||||||
|
Note that Woodpecker uses the hostname from the `WOODPECKER_HOST` environment variable when requesting certificates. For example, if `WOODPECKER_HOST=https://example.com` is set the certificate is requested for `example.com`. To receive emails before certificates expire Let's Encrypt requires an email address. You can set it with `WOODPECKER_LETS_ENCRYPT_EMAIL=ssl-admin@example.tld`.
|
||||||
|
|
||||||
|
The SSL certificates are stored in `$HOME/.local/share/certmagic` for binary versions of Woodpecker and in `/var/lib/woodpecker` for the Container versions of it. You can set a custom path by setting `XDG_DATA_HOME` if required.
|
||||||
|
|
||||||
|
> Once enabled you can visit the Woodpecker UI with http and the HTTPS address. HTTP will be redirected to HTTPS.
|
||||||
|
|
||||||
|
### Certificate Cache
|
||||||
|
|
||||||
|
Woodpecker writes the certificates to `/var/lib/woodpecker/certmagic/`.
|
||||||
|
|
||||||
|
### Certificate Updates
|
||||||
|
|
||||||
|
Woodpecker uses the official Go acme library which will handle certificate upgrades. There should be no addition configuration or management required.
|
||||||
|
|
||||||
|
## SSL with own certificates
|
||||||
|
|
||||||
|
Woodpecker supports SSL configuration by mounting certificates into your container.
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_SERVER_CERT=/etc/certs/woodpecker.example.com/server.crt
|
||||||
|
WOODPECKER_SERVER_KEY=/etc/certs/woodpecker.example.com/server.key
|
||||||
|
```
|
||||||
|
|
||||||
|
### Certificate Chain
|
||||||
|
|
||||||
|
The most common problem encountered is providing a certificate file without the intermediate chain.
|
||||||
|
|
||||||
|
> LoadX509KeyPair reads and parses a public/private key pair from a pair of files. The files must contain PEM encoded data. The certificate file may contain intermediate certificates following the leaf certificate to form a certificate chain.
|
||||||
|
|
||||||
|
### Certificate Errors
|
||||||
|
|
||||||
|
SSL support is provided using the [ListenAndServeTLS](https://golang.org/pkg/net/http/#ListenAndServeTLS) function from the Go standard library. If you receive certificate errors or warnings please examine your configuration more closely.
|
||||||
|
|
||||||
|
### Running in containers
|
||||||
|
|
||||||
|
Update your configuration to expose the following ports:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
ports:
|
||||||
|
+ - 80:80
|
||||||
|
+ - 443:443
|
||||||
|
- 9000:9000
|
||||||
|
```
|
||||||
|
|
||||||
|
Update your configuration to mount your certificate and key:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
volumes:
|
||||||
|
+ - /etc/certs/woodpecker.example.com/server.crt:/etc/certs/woodpecker.example.com/server.crt
|
||||||
|
+ - /etc/certs/woodpecker.example.com/server.key:/etc/certs/woodpecker.example.com/server.key
|
||||||
|
```
|
||||||
|
|
||||||
|
Update your configuration to provide the paths of your certificate and key:
|
||||||
|
|
||||||
|
```diff title="docker-compose.yaml"
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
[...]
|
||||||
|
environment:
|
||||||
|
+ - WOODPECKER_SERVER_CERT=/etc/certs/woodpecker.example.com/server.crt
|
||||||
|
+ - WOODPECKER_SERVER_KEY=/etc/certs/woodpecker.example.com/server.key
|
||||||
|
```
|
199
docs/versioned_docs/version-2.4/30-administration/70-proxy.md
Normal file
|
@ -0,0 +1,199 @@
|
||||||
|
# Proxy
|
||||||
|
|
||||||
|
## Apache
|
||||||
|
|
||||||
|
This guide provides a brief overview for installing Woodpecker server behind the Apache2 web-server. This is an example configuration:
|
||||||
|
|
||||||
|
```apacheconf
|
||||||
|
ProxyPreserveHost On
|
||||||
|
|
||||||
|
RequestHeader set X-Forwarded-Proto "https"
|
||||||
|
|
||||||
|
ProxyPass / http://127.0.0.1:8000/
|
||||||
|
ProxyPassReverse / http://127.0.0.1:8000/
|
||||||
|
```
|
||||||
|
|
||||||
|
You must have these Apache modules installed:
|
||||||
|
|
||||||
|
- `proxy`
|
||||||
|
- `proxy_http`
|
||||||
|
|
||||||
|
You must configure Apache to set `X-Forwarded-Proto` when using https.
|
||||||
|
|
||||||
|
```diff
|
||||||
|
ProxyPreserveHost On
|
||||||
|
|
||||||
|
+RequestHeader set X-Forwarded-Proto "https"
|
||||||
|
|
||||||
|
ProxyPass / http://127.0.0.1:8000/
|
||||||
|
ProxyPassReverse / http://127.0.0.1:8000/
|
||||||
|
```
|
||||||
|
|
||||||
|
## Nginx
|
||||||
|
|
||||||
|
This guide provides a basic overview for installing Woodpecker server behind the Nginx web-server. For more advanced configuration options please consult the official Nginx [documentation](https://www.nginx.com/resources/admin-guide/).
|
||||||
|
|
||||||
|
Example configuration:
|
||||||
|
|
||||||
|
```nginx
|
||||||
|
server {
|
||||||
|
listen 80;
|
||||||
|
server_name woodpecker.example.com;
|
||||||
|
|
||||||
|
location / {
|
||||||
|
proxy_set_header X-Forwarded-For $remote_addr;
|
||||||
|
proxy_set_header X-Forwarded-Proto $scheme;
|
||||||
|
proxy_set_header Host $http_host;
|
||||||
|
|
||||||
|
proxy_pass http://127.0.0.1:8000;
|
||||||
|
proxy_redirect off;
|
||||||
|
proxy_http_version 1.1;
|
||||||
|
proxy_buffering off;
|
||||||
|
|
||||||
|
chunked_transfer_encoding off;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
You must configure the proxy to set `X-Forwarded` proxy headers:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
server {
|
||||||
|
listen 80;
|
||||||
|
server_name woodpecker.example.com;
|
||||||
|
|
||||||
|
location / {
|
||||||
|
+ proxy_set_header X-Forwarded-For $remote_addr;
|
||||||
|
+ proxy_set_header X-Forwarded-Proto $scheme;
|
||||||
|
|
||||||
|
proxy_pass http://127.0.0.1:8000;
|
||||||
|
proxy_redirect off;
|
||||||
|
proxy_http_version 1.1;
|
||||||
|
proxy_buffering off;
|
||||||
|
|
||||||
|
chunked_transfer_encoding off;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
## Caddy
|
||||||
|
|
||||||
|
This guide provides a brief overview for installing Woodpecker server behind the [Caddy web-server](https://caddyserver.com/). This is an example caddyfile proxy configuration:
|
||||||
|
|
||||||
|
```caddy
|
||||||
|
# expose WebUI and API
|
||||||
|
woodpecker.example.com {
|
||||||
|
reverse_proxy woodpecker-server:8000
|
||||||
|
}
|
||||||
|
|
||||||
|
# expose gRPC
|
||||||
|
woodpeckeragent.example.com {
|
||||||
|
reverse_proxy h2c://woodpecker-server:9000
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
:::note
|
||||||
|
Above configuration shows how to create reverse-proxies for web and agent communication. If your agent uses SSL do not forget to enable [`WOODPECKER_GRPC_SECURE`](./15-agent-config.md#woodpecker_grpc_secure).
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Tunnelmole
|
||||||
|
|
||||||
|
[Tunnelmole](https://github.com/robbie-cahill/tunnelmole-client) is an open source tunneling tool.
|
||||||
|
|
||||||
|
Start by [installing tunnelmole](https://github.com/robbie-cahill/tunnelmole-client#installation).
|
||||||
|
|
||||||
|
After the installation, run the following command to start tunnelmole:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
tmole 8000
|
||||||
|
```
|
||||||
|
|
||||||
|
It will start a tunnel and will give a response like this:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
➜ ~ tmole 8000
|
||||||
|
http://bvdo5f-ip-49-183-170-144.tunnelmole.net is forwarding to localhost:8000
|
||||||
|
https://bvdo5f-ip-49-183-170-144.tunnelmole.net is forwarding to localhost:8000
|
||||||
|
```
|
||||||
|
|
||||||
|
Set `WOODPECKER_HOST` to the Tunnelmole URL (`xxx.tunnelmole.net`) and start the server.
|
||||||
|
|
||||||
|
## Ngrok
|
||||||
|
|
||||||
|
[Ngrok](https://ngrok.com/) is a popular closed source tunnelling tool. After installing ngrok, open a new console and run the following command:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
ngrok http 8000
|
||||||
|
```
|
||||||
|
|
||||||
|
Set `WOODPECKER_HOST` to the ngrok URL (usually xxx.ngrok.io) and start the server.
|
||||||
|
|
||||||
|
## Traefik
|
||||||
|
|
||||||
|
To install the Woodpecker server behind a [Traefik](https://traefik.io/) load balancer, you must expose both the `http` and the `gRPC` ports. Here is a comprehensive example, considering you are running Traefik with docker swarm and want to do TLS termination and automatic redirection from http to https.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
version: '3.8'
|
||||||
|
|
||||||
|
services:
|
||||||
|
server:
|
||||||
|
image: woodpeckerci/woodpecker-server:latest
|
||||||
|
environment:
|
||||||
|
- WOODPECKER_OPEN=true
|
||||||
|
- WOODPECKER_ADMIN=your_admin_user
|
||||||
|
# other settings ...
|
||||||
|
|
||||||
|
networks:
|
||||||
|
- dmz # externally defined network, so that traefik can connect to the server
|
||||||
|
volumes:
|
||||||
|
- woodpecker-server-data:/var/lib/woodpecker/
|
||||||
|
|
||||||
|
deploy:
|
||||||
|
labels:
|
||||||
|
- traefik.enable=true
|
||||||
|
|
||||||
|
# web server
|
||||||
|
- traefik.http.services.woodpecker-service.loadbalancer.server.port=8000
|
||||||
|
|
||||||
|
- traefik.http.routers.woodpecker-secure.rule=Host(`cd.yourdomain.com`)
|
||||||
|
- traefik.http.routers.woodpecker-secure.tls=true
|
||||||
|
- traefik.http.routers.woodpecker-secure.tls.certresolver=letsencrypt
|
||||||
|
- traefik.http.routers.woodpecker-secure.entrypoints=websecure
|
||||||
|
- traefik.http.routers.woodpecker-secure.service=woodpecker-service
|
||||||
|
|
||||||
|
- traefik.http.routers.woodpecker.rule=Host(`cd.yourdomain.com`)
|
||||||
|
- traefik.http.routers.woodpecker.entrypoints=web
|
||||||
|
- traefik.http.routers.woodpecker.service=woodpecker-service
|
||||||
|
|
||||||
|
- traefik.http.middlewares.woodpecker-redirect.redirectscheme.scheme=https
|
||||||
|
- traefik.http.middlewares.woodpecker-redirect.redirectscheme.permanent=true
|
||||||
|
- traefik.http.routers.woodpecker.middlewares=woodpecker-redirect@docker
|
||||||
|
|
||||||
|
# gRPC service
|
||||||
|
- traefik.http.services.woodpecker-grpc.loadbalancer.server.port=9000
|
||||||
|
- traefik.http.services.woodpecker-grpc.loadbalancer.server.scheme=h2c
|
||||||
|
|
||||||
|
- traefik.http.routers.woodpecker-grpc-secure.rule=Host(`woodpecker-grpc.yourdomain.com`)
|
||||||
|
- traefik.http.routers.woodpecker-grpc-secure.tls=true
|
||||||
|
- traefik.http.routers.woodpecker-grpc-secure.tls.certresolver=letsencrypt
|
||||||
|
- traefik.http.routers.woodpecker-grpc-secure.entrypoints=websecure
|
||||||
|
- traefik.http.routers.woodpecker-grpc-secure.service=woodpecker-grpc
|
||||||
|
|
||||||
|
- traefik.http.routers.woodpecker-grpc.rule=Host(`woodpecker-grpc.yourdomain.com`)
|
||||||
|
- traefik.http.routers.woodpecker-grpc.entrypoints=web
|
||||||
|
- traefik.http.routers.woodpecker-grpc.service=woodpecker-grpc
|
||||||
|
|
||||||
|
- traefik.http.middlewares.woodpecker-grpc-redirect.redirectscheme.scheme=https
|
||||||
|
- traefik.http.middlewares.woodpecker-grpc-redirect.redirectscheme.permanent=true
|
||||||
|
- traefik.http.routers.woodpecker-grpc.middlewares=woodpecker-grpc-redirect@docker
|
||||||
|
|
||||||
|
volumes:
|
||||||
|
woodpecker-server-data:
|
||||||
|
driver: local
|
||||||
|
|
||||||
|
networks:
|
||||||
|
dmz:
|
||||||
|
external: true
|
||||||
|
```
|
||||||
|
|
||||||
|
You should pass `WOODPECKER_GRPC_SECURE=true` and `WOODPECKER_GRPC_VERIFY=true` to your agent when using this configuration.
|
|
@ -0,0 +1,40 @@
|
||||||
|
# Addons
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Addons are still experimental. Their implementation can change and break at any time.
|
||||||
|
:::
|
||||||
|
|
||||||
|
:::danger
|
||||||
|
You need to trust the author of the addons you use. Depending on their type, addons can access forge authentication codes, your secrets or other sensitive information.
|
||||||
|
:::
|
||||||
|
|
||||||
|
To adapt Woodpecker to your needs beyond the [configuration](../10-server-config.md), Woodpecker has its own **addon** system, built ontop of [Go's internal plugin system](https://go.dev/pkg/plugin).
|
||||||
|
|
||||||
|
Addons can be used for:
|
||||||
|
|
||||||
|
- Forges
|
||||||
|
|
||||||
|
## Restrictions
|
||||||
|
|
||||||
|
Addons are restricted by how Go plugins work. This includes the following restrictions:
|
||||||
|
|
||||||
|
- only supported on Linux, FreeBSD, and macOS
|
||||||
|
- addons must have been built for the correct Woodpecker version. If an addon is not provided specifically for this version, you likely won't be able to use it.
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
To use an addon, download the addon version built for your Woodpecker version. Then, you can add the following to your configuration:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_ADDONS=/path/to/your/addon/file.so
|
||||||
|
```
|
||||||
|
|
||||||
|
In case you run Woodpecker as container, you probably want to mount the addon binaries to `/opt/addons/`.
|
||||||
|
|
||||||
|
You can list multiple addons, Woodpecker will automatically determine their type. If you specify multiple addons with the same type, only the first one will be used.
|
||||||
|
|
||||||
|
Using an addon always overwrites Woodpecker's internal setup. This means, that a forge addon will be used if specified, no matter what's configured for the forges natively supported by Woodpecker.
|
||||||
|
|
||||||
|
### Bug reports
|
||||||
|
|
||||||
|
If you experience bugs, please check which component has the issue. If it's the addon, **do not raise an issue in the main repository**, but rather use the separate addon repositories. To check which component is responsible for the bug, look at the logs. Logs from addons are marked with a special field `addon` containing their addon file name.
|
|
@ -0,0 +1,97 @@
|
||||||
|
# Creating addons
|
||||||
|
|
||||||
|
Addons are written in Go.
|
||||||
|
|
||||||
|
## Writing your code
|
||||||
|
|
||||||
|
An addon consists of two variables/functions in Go.
|
||||||
|
|
||||||
|
1. The `Type` variable. Specifies the type of the addon and must be directly accessed from `shared/addons/types/types.go`.
|
||||||
|
2. The `Addon` function which is the main point of your addon.
|
||||||
|
This function takes the `zerolog` logger you should use to log errors, warnings, etc. as argument.
|
||||||
|
|
||||||
|
It returns two values:
|
||||||
|
|
||||||
|
1. The actual addon. For type reference see [table below](#return-types).
|
||||||
|
2. An error. If this error is not `nil`, Woodpecker exits.
|
||||||
|
|
||||||
|
Directly import Woodpecker's Go package (`go.woodpecker-ci.org/woodpecker/woodpecker/v2`) and use the interfaces and types defined there.
|
||||||
|
|
||||||
|
### Return types
|
||||||
|
|
||||||
|
| Addon type | Return type |
|
||||||
|
| ---------- | -------------------------------------------------------------------- |
|
||||||
|
| `Forge` | `"go.woodpecker-ci.org/woodpecker/woodpecker/v2/server/forge".Forge` |
|
||||||
|
|
||||||
|
### Using configurations
|
||||||
|
|
||||||
|
If you write a plugin for the server (`Forge` and the services), you can access the server config.
|
||||||
|
|
||||||
|
Therefore, use the `"go.woodpecker-ci.org/woodpecker/v2/server".Config` variable.
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
The config is not available when your addon is initialized, i.e., the `Addon` function is called.
|
||||||
|
Only use the config in the interface methods.
|
||||||
|
:::
|
||||||
|
|
||||||
|
## Compiling
|
||||||
|
|
||||||
|
After you write your addon code, compile your addon:
|
||||||
|
|
||||||
|
```sh
|
||||||
|
go build -buildmode plugin
|
||||||
|
```
|
||||||
|
|
||||||
|
The output file is your addon that is now ready to be used.
|
||||||
|
|
||||||
|
## Restrictions
|
||||||
|
|
||||||
|
Addons must directly depend on Woodpecker's core (`go.woodpecker-ci.org/woodpecker/woodpecker/v2`).
|
||||||
|
The addon must have been built with **exactly the same code** as the Woodpecker instance you'd like to use it on. This means: If you build your addon with a specific commit from Woodpecker `next`, you can likely only use it with the Woodpecker version compiled from this commit.
|
||||||
|
Also, if you change something inside Woodpecker without committing, it might fail because you need to recompile your addon with this code first.
|
||||||
|
|
||||||
|
In addition to this, addons are only supported on Linux, FreeBSD, and macOS.
|
||||||
|
|
||||||
|
:::info
|
||||||
|
It is recommended to at least support the latest version of Woodpecker.
|
||||||
|
:::
|
||||||
|
|
||||||
|
### Compile for different versions
|
||||||
|
|
||||||
|
As long as there are no changes to Woodpecker's interfaces,
|
||||||
|
or they are backwards-compatible, you can compile the addon for multiple versions
|
||||||
|
by changing the version of `go.woodpecker-ci.org/woodpecker/woodpecker/v2` using `go get` before compiling.
|
||||||
|
|
||||||
|
## Logging
|
||||||
|
|
||||||
|
The entrypoint receives a `zerolog.Logger` as input. **Do not use any other logging solution.** This logger follows the configuration of the Woodpecker instance and adds a special field `addon` to the log entries which allows users to find out which component is writing the log messages.
|
||||||
|
|
||||||
|
## Example structure
|
||||||
|
|
||||||
|
```go
|
||||||
|
package main
|
||||||
|
|
||||||
|
import (
|
||||||
|
"context"
|
||||||
|
"net/http"
|
||||||
|
|
||||||
|
"github.com/rs/zerolog"
|
||||||
|
"go.woodpecker-ci.org/woodpecker/v2/server/forge"
|
||||||
|
forge_types "go.woodpecker-ci.org/woodpecker/v2/server/forge/types"
|
||||||
|
"go.woodpecker-ci.org/woodpecker/v2/server/model"
|
||||||
|
addon_types "go.woodpecker-ci.org/woodpecker/v2/shared/addon/types"
|
||||||
|
)
|
||||||
|
|
||||||
|
var Type = addon_types.TypeForge
|
||||||
|
|
||||||
|
func Addon(logger zerolog.Logger) (forge.Forge, error) {
|
||||||
|
logger.Info().Msg("hello world from addon")
|
||||||
|
return &config{l: logger}, nil
|
||||||
|
}
|
||||||
|
|
||||||
|
type config struct {
|
||||||
|
l zerolog.Logger
|
||||||
|
}
|
||||||
|
|
||||||
|
// In this case, `config` must implement `forge.Forge`. You must directly use Woodpecker's packages - see imports above.
|
||||||
|
```
|
|
@ -0,0 +1,6 @@
|
||||||
|
label: 'Addons'
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
||||||
|
link:
|
||||||
|
type: 'doc'
|
||||||
|
id: 'overview'
|
|
@ -0,0 +1,37 @@
|
||||||
|
# Autoscaler
|
||||||
|
|
||||||
|
If your would like dynamically scale your agents with the load, you can use [our autoscaler](https://github.com/woodpecker-ci/autoscaler).
|
||||||
|
|
||||||
|
Please note that the autoscaler is not feature-complete yet. You can follow the progress [here](https://github.com/woodpecker-ci/autoscaler#roadmap).
|
||||||
|
|
||||||
|
## Setup
|
||||||
|
|
||||||
|
### docker-compose
|
||||||
|
|
||||||
|
If you are using docker-compose you can add the following to your `docker-compose.yaml` file:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
version: '3'
|
||||||
|
|
||||||
|
services:
|
||||||
|
woodpecker-server:
|
||||||
|
image: woodpeckerci/woodpecker-server:next
|
||||||
|
[...]
|
||||||
|
|
||||||
|
woodpecker-autoscaler:
|
||||||
|
image: woodpeckerci/autoscaler:next
|
||||||
|
restart: always
|
||||||
|
depends_on:
|
||||||
|
- woodpecker-server
|
||||||
|
environment:
|
||||||
|
- WOODPECKER_SERVER=https://your-woodpecker-server.tld # the url of your woodpecker server / could also be a public url
|
||||||
|
- WOODPECKER_TOKEN=${WOODPECKER_TOKEN} # the api token you can get from the UI https://your-woodpecker-server.tld/user
|
||||||
|
- WOODPECKER_MIN_AGENTS=0
|
||||||
|
- WOODPECKER_MAX_AGENTS=3
|
||||||
|
- WOODPECKER_WORKFLOWS_PER_AGENT=2 # the number of workflows each agent can run at the same time
|
||||||
|
- WOODEPCKER_GRPC_ADDR=https://grpc.your-woodpecker-server.tld # the grpc address of your woodpecker server, publicly accessible from the agents
|
||||||
|
- WOODEPCKER_GRPC_SECURE=true
|
||||||
|
- WOODPECKER_AGENT_ENV= # optional environment variables to pass to the agents
|
||||||
|
- WOODPECKER_PROVIDER=hetznercloud # set the provider, you can find all the available ones down below
|
||||||
|
- WOODPECKER_HETZNERCLOUD_API_TOKEN=${WOODPECKER_HETZNERCLOUD_API_TOKEN} # your api token for the Hetzner cloud
|
||||||
|
```
|
|
@ -0,0 +1,81 @@
|
||||||
|
# Prometheus
|
||||||
|
|
||||||
|
Woodpecker is compatible with Prometheus and exposes a `/metrics` endpoint if the environment variable `WOODPECKER_PROMETHEUS_AUTH_TOKEN` is set. Please note that access to the metrics endpoint is restricted and requires the authorization token from the environment variable mentioned above.
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
global:
|
||||||
|
scrape_interval: 60s
|
||||||
|
|
||||||
|
scrape_configs:
|
||||||
|
- job_name: 'woodpecker'
|
||||||
|
bearer_token: dummyToken...
|
||||||
|
|
||||||
|
static_configs:
|
||||||
|
- targets: ['woodpecker.domain.com']
|
||||||
|
```
|
||||||
|
|
||||||
|
## Authorization
|
||||||
|
|
||||||
|
An administrator will need to generate a user API token and configure in the Prometheus configuration file as a bearer token. Please see the following example:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
global:
|
||||||
|
scrape_interval: 60s
|
||||||
|
|
||||||
|
scrape_configs:
|
||||||
|
- job_name: 'woodpecker'
|
||||||
|
+ bearer_token: dummyToken...
|
||||||
|
|
||||||
|
static_configs:
|
||||||
|
- targets: ['woodpecker.domain.com']
|
||||||
|
```
|
||||||
|
|
||||||
|
As an alternative, the token can also be read from a file:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
global:
|
||||||
|
scrape_interval: 60s
|
||||||
|
|
||||||
|
scrape_configs:
|
||||||
|
- job_name: 'woodpecker'
|
||||||
|
+ bearer_token_file: /etc/secrets/woodpecker-monitoring-token
|
||||||
|
|
||||||
|
static_configs:
|
||||||
|
- targets: ['woodpecker.domain.com']
|
||||||
|
```
|
||||||
|
|
||||||
|
## Metric Reference
|
||||||
|
|
||||||
|
List of Prometheus metrics specific to Woodpecker:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
# HELP woodpecker_pipeline_count Pipeline count.
|
||||||
|
# TYPE woodpecker_pipeline_count counter
|
||||||
|
woodpecker_pipeline_count{branch="main",pipeline="total",repo="woodpecker-ci/woodpecker",status="success"} 3
|
||||||
|
woodpecker_pipeline_count{branch="mkdocs",pipeline="total",repo="woodpecker-ci/woodpecker",status="success"} 3
|
||||||
|
# HELP woodpecker_pipeline_time Build time.
|
||||||
|
# TYPE woodpecker_pipeline_time gauge
|
||||||
|
woodpecker_pipeline_time{branch="main",pipeline="total",repo="woodpecker-ci/woodpecker",status="success"} 116
|
||||||
|
woodpecker_pipeline_time{branch="mkdocs",pipeline="total",repo="woodpecker-ci/woodpecker",status="success"} 155
|
||||||
|
# HELP woodpecker_pipeline_total_count Total number of builds.
|
||||||
|
# TYPE woodpecker_pipeline_total_count gauge
|
||||||
|
woodpecker_pipeline_total_count 1025
|
||||||
|
# HELP woodpecker_pending_steps Total number of pending pipeline steps.
|
||||||
|
# TYPE woodpecker_pending_steps gauge
|
||||||
|
woodpecker_pending_steps 0
|
||||||
|
# HELP woodpecker_repo_count Total number of repos.
|
||||||
|
# TYPE woodpecker_repo_count gauge
|
||||||
|
woodpecker_repo_count 9
|
||||||
|
# HELP woodpecker_running_steps Total number of running pipeline steps.
|
||||||
|
# TYPE woodpecker_running_steps gauge
|
||||||
|
woodpecker_running_steps 0
|
||||||
|
# HELP woodpecker_user_count Total number of users.
|
||||||
|
# TYPE woodpecker_user_count gauge
|
||||||
|
woodpecker_user_count 1
|
||||||
|
# HELP woodpecker_waiting_steps Total number of pipeline waiting on deps.
|
||||||
|
# TYPE woodpecker_waiting_steps gauge
|
||||||
|
woodpecker_waiting_steps 0
|
||||||
|
# HELP woodpecker_worker_count Total number of workers.
|
||||||
|
# TYPE woodpecker_worker_count gauge
|
||||||
|
woodpecker_worker_count 4
|
||||||
|
```
|
|
@ -0,0 +1,4 @@
|
||||||
|
label: 'Administration'
|
||||||
|
# position: 3
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
After Width: | Height: | Size: 5.3 KiB |
After Width: | Height: | Size: 4.4 KiB |
After Width: | Height: | Size: 25 KiB |
593
docs/versioned_docs/version-2.4/40-cli.md
Normal file
|
@ -0,0 +1,593 @@
|
||||||
|
# CLI
|
||||||
|
|
||||||
|
# NAME
|
||||||
|
|
||||||
|
woodpecker-cli - A new cli application
|
||||||
|
|
||||||
|
# SYNOPSIS
|
||||||
|
|
||||||
|
woodpecker-cli
|
||||||
|
|
||||||
|
```
|
||||||
|
[--config|-c]=[value]
|
||||||
|
[--disable-update-check]
|
||||||
|
[--log-file]=[value]
|
||||||
|
[--log-level]=[value]
|
||||||
|
[--nocolor]
|
||||||
|
[--pretty]
|
||||||
|
[--server|-s]=[value]
|
||||||
|
[--token|-t]=[value]
|
||||||
|
```
|
||||||
|
|
||||||
|
# DESCRIPTION
|
||||||
|
|
||||||
|
Woodpecker command line utility
|
||||||
|
|
||||||
|
**Usage**:
|
||||||
|
|
||||||
|
```
|
||||||
|
woodpecker-cli [GLOBAL OPTIONS] command [COMMAND OPTIONS] [ARGUMENTS...]
|
||||||
|
```
|
||||||
|
|
||||||
|
# GLOBAL OPTIONS
|
||||||
|
|
||||||
|
**--config, -c**="": path to config file
|
||||||
|
|
||||||
|
**--disable-update-check**: disable update check
|
||||||
|
|
||||||
|
**--log-file**="": Output destination for logs. 'stdout' and 'stderr' can be used as special keywords. (default: "stderr")
|
||||||
|
|
||||||
|
**--log-level**="": set logging level (default: "info")
|
||||||
|
|
||||||
|
**--nocolor**: disable colored debug output, only has effect if pretty output is set too
|
||||||
|
|
||||||
|
**--pretty**: enable pretty-printed debug output
|
||||||
|
|
||||||
|
**--server, -s**="": server address
|
||||||
|
|
||||||
|
**--token, -t**="": server auth token
|
||||||
|
|
||||||
|
|
||||||
|
# COMMANDS
|
||||||
|
|
||||||
|
## pipeline
|
||||||
|
|
||||||
|
manage pipelines
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
show pipeline history
|
||||||
|
|
||||||
|
**--branch**="": branch filter
|
||||||
|
|
||||||
|
**--event**="": event filter
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33mPipeline #{{ .Number }} \x1b[0m\nStatus: {{ .Status }}\nEvent: {{ .Event }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nAuthor: {{ .Author }} {{ if .Email }}<{{.Email}}>{{ end }}\nMessage: {{ .Message }}\n")
|
||||||
|
|
||||||
|
**--limit**="": limit the list size (default: 25)
|
||||||
|
|
||||||
|
**--status**="": status filter
|
||||||
|
|
||||||
|
### last
|
||||||
|
|
||||||
|
show latest pipeline details
|
||||||
|
|
||||||
|
**--branch**="": branch name (default: "main")
|
||||||
|
|
||||||
|
**--format**="": format output (default: "Number: {{ .Number }}\nStatus: {{ .Status }}\nEvent: {{ .Event }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nMessage: {{ .Message }}\nAuthor: {{ .Author }}\n")
|
||||||
|
|
||||||
|
### logs
|
||||||
|
|
||||||
|
show pipeline logs
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
show pipeline details
|
||||||
|
|
||||||
|
**--format**="": format output (default: "Number: {{ .Number }}\nStatus: {{ .Status }}\nEvent: {{ .Event }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nMessage: {{ .Message }}\nAuthor: {{ .Author }}\n")
|
||||||
|
|
||||||
|
### stop
|
||||||
|
|
||||||
|
stop a pipeline
|
||||||
|
|
||||||
|
### start
|
||||||
|
|
||||||
|
start a pipeline
|
||||||
|
|
||||||
|
**--param, -p**="": custom parameters to be injected into the step environment. Format: KEY=value
|
||||||
|
|
||||||
|
### approve
|
||||||
|
|
||||||
|
approve a pipeline
|
||||||
|
|
||||||
|
### decline
|
||||||
|
|
||||||
|
decline a pipeline
|
||||||
|
|
||||||
|
### queue
|
||||||
|
|
||||||
|
show pipeline queue
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33m{{ .FullName }} #{{ .Number }} \x1b[0m\nStatus: {{ .Status }}\nEvent: {{ .Event }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nAuthor: {{ .Author }} {{ if .Email }}<{{.Email}}>{{ end }}\nMessage: {{ .Message }}\n")
|
||||||
|
|
||||||
|
### ps
|
||||||
|
|
||||||
|
show pipeline steps
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33mStep #{{ .PID }} \x1b[0m\nStep: {{ .Name }}\nState: {{ .State }}\n")
|
||||||
|
|
||||||
|
### create
|
||||||
|
|
||||||
|
create new pipeline
|
||||||
|
|
||||||
|
**--branch**="": branch to create pipeline from
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33mPipeline #{{ .Number }} \x1b[0m\nStatus: {{ .Status }}\nEvent: {{ .Event }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nAuthor: {{ .Author }} {{ if .Email }}<{{.Email}}>{{ end }}\nMessage: {{ .Message }}\n")
|
||||||
|
|
||||||
|
**--var**="": key=value
|
||||||
|
|
||||||
|
## log
|
||||||
|
|
||||||
|
manage logs
|
||||||
|
|
||||||
|
### purge
|
||||||
|
|
||||||
|
purge a log
|
||||||
|
|
||||||
|
## deploy
|
||||||
|
|
||||||
|
deploy code
|
||||||
|
|
||||||
|
**--branch**="": branch filter (default: "main")
|
||||||
|
|
||||||
|
**--event**="": event filter (default: "push")
|
||||||
|
|
||||||
|
**--format**="": format output (default: "Number: {{ .Number }}\nStatus: {{ .Status }}\nCommit: {{ .Commit }}\nBranch: {{ .Branch }}\nRef: {{ .Ref }}\nMessage: {{ .Message }}\nAuthor: {{ .Author }}\nTarget: {{ .Deploy }}\n")
|
||||||
|
|
||||||
|
**--param, -p**="": custom parameters to be injected into the step environment. Format: KEY=value
|
||||||
|
|
||||||
|
**--status**="": status filter (default: "success")
|
||||||
|
|
||||||
|
## exec
|
||||||
|
|
||||||
|
execute a local pipeline
|
||||||
|
|
||||||
|
**--backend-docker-api-version**="": the version of the API to reach, leave empty for latest.
|
||||||
|
|
||||||
|
**--backend-docker-cert**="": path to load the TLS certificates for connecting to docker server
|
||||||
|
|
||||||
|
**--backend-docker-host**="": path to docker socket or url to the docker server
|
||||||
|
|
||||||
|
**--backend-docker-ipv6**: backend docker enable IPV6
|
||||||
|
|
||||||
|
**--backend-docker-network**="": backend docker network
|
||||||
|
|
||||||
|
**--backend-docker-tls-verify**: enable or disable TLS verification for connecting to docker server
|
||||||
|
|
||||||
|
**--backend-docker-volumes**="": backend docker volumes (comma separated)
|
||||||
|
|
||||||
|
**--backend-engine**="": backend engine to run pipelines on (default: "auto-detect")
|
||||||
|
|
||||||
|
**--backend-http-proxy**="": if set, pass the environment variable down as "HTTP_PROXY" to steps
|
||||||
|
|
||||||
|
**--backend-https-proxy**="": if set, pass the environment variable down as "HTTPS_PROXY" to steps
|
||||||
|
|
||||||
|
**--backend-k8s-namespace**="": backend k8s namespace (default: "woodpecker")
|
||||||
|
|
||||||
|
**--backend-k8s-pod-annotations**="": backend k8s additional worker pod annotations
|
||||||
|
|
||||||
|
**--backend-k8s-pod-image-pull-secret-names**="": backend k8s pull secret names for private registries (default: "regcred")
|
||||||
|
|
||||||
|
**--backend-k8s-pod-labels**="": backend k8s additional worker pod labels
|
||||||
|
|
||||||
|
**--backend-k8s-secctx-nonroot**: `run as non root` Kubernetes security context option
|
||||||
|
|
||||||
|
**--backend-k8s-storage-class**="": backend k8s storage class
|
||||||
|
|
||||||
|
**--backend-k8s-storage-rwx**: backend k8s storage access mode, should ReadWriteMany (RWX) instead of ReadWriteOnce (RWO) be used? (default: true)
|
||||||
|
|
||||||
|
**--backend-k8s-volume-size**="": backend k8s volume size (default 10G) (default: "10G")
|
||||||
|
|
||||||
|
**--backend-local-temp-dir**="": set a different temp dir to clone workflows into (default: "/tmp")
|
||||||
|
|
||||||
|
**--backend-no-proxy**="": if set, pass the environment variable down as "NO_PROXY" to steps
|
||||||
|
|
||||||
|
**--commit-author-avatar**="":
|
||||||
|
|
||||||
|
**--commit-author-email**="":
|
||||||
|
|
||||||
|
**--commit-author-name**="":
|
||||||
|
|
||||||
|
**--commit-branch**="":
|
||||||
|
|
||||||
|
**--commit-message**="":
|
||||||
|
|
||||||
|
**--commit-ref**="":
|
||||||
|
|
||||||
|
**--commit-refspec**="":
|
||||||
|
|
||||||
|
**--commit-sha**="":
|
||||||
|
|
||||||
|
**--env**="":
|
||||||
|
|
||||||
|
**--forge-type**="":
|
||||||
|
|
||||||
|
**--forge-url**="":
|
||||||
|
|
||||||
|
**--local**: run from local directory
|
||||||
|
|
||||||
|
**--netrc-machine**="":
|
||||||
|
|
||||||
|
**--netrc-password**="":
|
||||||
|
|
||||||
|
**--netrc-username**="":
|
||||||
|
|
||||||
|
**--network**="": external networks
|
||||||
|
|
||||||
|
**--pipeline-created**="": (default: 0)
|
||||||
|
|
||||||
|
**--pipeline-event**="": (default: "manual")
|
||||||
|
|
||||||
|
**--pipeline-finished**="": (default: 0)
|
||||||
|
|
||||||
|
**--pipeline-number**="": (default: 0)
|
||||||
|
|
||||||
|
**--pipeline-parent**="": (default: 0)
|
||||||
|
|
||||||
|
**--pipeline-started**="": (default: 0)
|
||||||
|
|
||||||
|
**--pipeline-status**="":
|
||||||
|
|
||||||
|
**--pipeline-target**="":
|
||||||
|
|
||||||
|
**--pipeline-url**="":
|
||||||
|
|
||||||
|
**--prev-commit-author-avatar**="":
|
||||||
|
|
||||||
|
**--prev-commit-author-email**="":
|
||||||
|
|
||||||
|
**--prev-commit-author-name**="":
|
||||||
|
|
||||||
|
**--prev-commit-branch**="":
|
||||||
|
|
||||||
|
**--prev-commit-message**="":
|
||||||
|
|
||||||
|
**--prev-commit-ref**="":
|
||||||
|
|
||||||
|
**--prev-commit-refspec**="":
|
||||||
|
|
||||||
|
**--prev-commit-sha**="":
|
||||||
|
|
||||||
|
**--prev-pipeline-created**="": (default: 0)
|
||||||
|
|
||||||
|
**--prev-pipeline-event**="":
|
||||||
|
|
||||||
|
**--prev-pipeline-finished**="": (default: 0)
|
||||||
|
|
||||||
|
**--prev-pipeline-number**="": (default: 0)
|
||||||
|
|
||||||
|
**--prev-pipeline-started**="": (default: 0)
|
||||||
|
|
||||||
|
**--prev-pipeline-status**="":
|
||||||
|
|
||||||
|
**--prev-pipeline-url**="":
|
||||||
|
|
||||||
|
**--privileged**="": privileged plugins (default: "plugins/docker", "plugins/gcr", "plugins/ecr", "woodpeckerci/plugin-docker-buildx", "codeberg.org/woodpecker-plugins/docker-buildx")
|
||||||
|
|
||||||
|
**--repo**="": full repo name
|
||||||
|
|
||||||
|
**--repo-clone-ssh-url**="":
|
||||||
|
|
||||||
|
**--repo-clone-url**="":
|
||||||
|
|
||||||
|
**--repo-private**="":
|
||||||
|
|
||||||
|
**--repo-remote-id**="":
|
||||||
|
|
||||||
|
**--repo-trusted**:
|
||||||
|
|
||||||
|
**--repo-url**="":
|
||||||
|
|
||||||
|
**--step-name**="": (default: 0)
|
||||||
|
|
||||||
|
**--system-name**="": (default: "woodpecker")
|
||||||
|
|
||||||
|
**--system-platform**="":
|
||||||
|
|
||||||
|
**--system-url**="": (default: "https://github.com/woodpecker-ci/woodpecker")
|
||||||
|
|
||||||
|
**--timeout**="": pipeline timeout (default: 1h0m0s)
|
||||||
|
|
||||||
|
**--volumes**="": pipeline volumes
|
||||||
|
|
||||||
|
**--workflow-name**="": (default: 0)
|
||||||
|
|
||||||
|
**--workflow-number**="": (default: 0)
|
||||||
|
|
||||||
|
**--workspace-base**="": (default: "/woodpecker")
|
||||||
|
|
||||||
|
**--workspace-path**="": (default: "src")
|
||||||
|
|
||||||
|
## info
|
||||||
|
|
||||||
|
show information about the current user
|
||||||
|
|
||||||
|
## registry
|
||||||
|
|
||||||
|
manage registries
|
||||||
|
|
||||||
|
### add
|
||||||
|
|
||||||
|
adds a registry
|
||||||
|
|
||||||
|
**--hostname**="": registry hostname (default: "docker.io")
|
||||||
|
|
||||||
|
**--password**="": registry password
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--username**="": registry username
|
||||||
|
|
||||||
|
### rm
|
||||||
|
|
||||||
|
remove a registry
|
||||||
|
|
||||||
|
**--hostname**="": registry hostname (default: "docker.io")
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### update
|
||||||
|
|
||||||
|
update a registry
|
||||||
|
|
||||||
|
**--hostname**="": registry hostname (default: "docker.io")
|
||||||
|
|
||||||
|
**--password**="": registry password
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--username**="": registry username
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
display registry info
|
||||||
|
|
||||||
|
**--hostname**="": registry hostname (default: "docker.io")
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
list registries
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
## secret
|
||||||
|
|
||||||
|
manage secrets
|
||||||
|
|
||||||
|
### add
|
||||||
|
|
||||||
|
adds a secret
|
||||||
|
|
||||||
|
**--event**="": secret limited to these events
|
||||||
|
|
||||||
|
**--global**: global secret
|
||||||
|
|
||||||
|
**--image**="": secret limited to these images
|
||||||
|
|
||||||
|
**--name**="": secret name
|
||||||
|
|
||||||
|
**--organization, --org**="": organization id or full-name (e.g. 123 or octocat)
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--value**="": secret value
|
||||||
|
|
||||||
|
### rm
|
||||||
|
|
||||||
|
remove a secret
|
||||||
|
|
||||||
|
**--global**: global secret
|
||||||
|
|
||||||
|
**--name**="": secret name
|
||||||
|
|
||||||
|
**--organization, --org**="": organization id or full-name (e.g. 123 or octocat)
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### update
|
||||||
|
|
||||||
|
update a secret
|
||||||
|
|
||||||
|
**--event**="": secret limited to these events
|
||||||
|
|
||||||
|
**--global**: global secret
|
||||||
|
|
||||||
|
**--image**="": secret limited to these images
|
||||||
|
|
||||||
|
**--name**="": secret name
|
||||||
|
|
||||||
|
**--organization, --org**="": organization id or full-name (e.g. 123 or octocat)
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--value**="": secret value
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
display secret info
|
||||||
|
|
||||||
|
**--global**: global secret
|
||||||
|
|
||||||
|
**--name**="": secret name
|
||||||
|
|
||||||
|
**--organization, --org**="": organization id or full-name (e.g. 123 or octocat)
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
list secrets
|
||||||
|
|
||||||
|
**--global**: global secret
|
||||||
|
|
||||||
|
**--organization, --org**="": organization id or full-name (e.g. 123 or octocat)
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
## repo
|
||||||
|
|
||||||
|
manage repositories
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
list all repos
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33m{{ .FullName }}\x1b[0m (id: {{ .ID }}, forgeRemoteID: {{ .ForgeRemoteID }})")
|
||||||
|
|
||||||
|
**--org**="": filter by organization
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
show repository details
|
||||||
|
|
||||||
|
**--format**="": format output (default: "Owner: {{ .Owner }}\nRepo: {{ .Name }}\nURL: {{ .ForgeURL }}\nConfig path: {{ .Config }}\nVisibility: {{ .Visibility }}\nPrivate: {{ .IsSCMPrivate }}\nTrusted: {{ .IsTrusted }}\nGated: {{ .IsGated }}\nClone url: {{ .Clone }}\nAllow pull-requests: {{ .AllowPullRequests }}\n")
|
||||||
|
|
||||||
|
### add
|
||||||
|
|
||||||
|
add a repository
|
||||||
|
|
||||||
|
### update
|
||||||
|
|
||||||
|
update a repository
|
||||||
|
|
||||||
|
**--config**="": repository configuration path (e.g. .woodpecker.yml)
|
||||||
|
|
||||||
|
**--gated**: repository is gated
|
||||||
|
|
||||||
|
**--pipeline-counter**="": repository starting pipeline number (default: 0)
|
||||||
|
|
||||||
|
**--timeout**="": repository timeout (default: 0s)
|
||||||
|
|
||||||
|
**--trusted**: repository is trusted
|
||||||
|
|
||||||
|
**--unsafe**: validate updating the pipeline-counter is unsafe
|
||||||
|
|
||||||
|
**--visibility**="": repository visibility
|
||||||
|
|
||||||
|
### rm
|
||||||
|
|
||||||
|
remove a repository
|
||||||
|
|
||||||
|
### repair
|
||||||
|
|
||||||
|
repair repository webhooks
|
||||||
|
|
||||||
|
### chown
|
||||||
|
|
||||||
|
assume ownership of a repository
|
||||||
|
|
||||||
|
### sync
|
||||||
|
|
||||||
|
synchronize the repository list
|
||||||
|
|
||||||
|
**--format**="": format output (default: "\x1b[33m{{ .FullName }}\x1b[0m (id: {{ .ID }}, forgeRemoteID: {{ .ForgeRemoteID }})")
|
||||||
|
|
||||||
|
## user
|
||||||
|
|
||||||
|
manage users
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
list all users
|
||||||
|
|
||||||
|
**--format**="": format output (default: "{{ .Login }}")
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
show user details
|
||||||
|
|
||||||
|
**--format**="": format output (default: "User: {{ .Login }}\nEmail: {{ .Email }}")
|
||||||
|
|
||||||
|
### add
|
||||||
|
|
||||||
|
adds a user
|
||||||
|
|
||||||
|
### rm
|
||||||
|
|
||||||
|
remove a user
|
||||||
|
|
||||||
|
## lint
|
||||||
|
|
||||||
|
lint a pipeline configuration file
|
||||||
|
|
||||||
|
## log-level
|
||||||
|
|
||||||
|
get the logging level of the server, or set it with [level]
|
||||||
|
|
||||||
|
## cron
|
||||||
|
|
||||||
|
manage cron jobs
|
||||||
|
|
||||||
|
### add
|
||||||
|
|
||||||
|
add a cron job
|
||||||
|
|
||||||
|
**--branch**="": cron branch
|
||||||
|
|
||||||
|
**--name**="": cron name
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--schedule**="": cron schedule
|
||||||
|
|
||||||
|
### rm
|
||||||
|
|
||||||
|
remove a cron job
|
||||||
|
|
||||||
|
**--id**="": cron id
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### update
|
||||||
|
|
||||||
|
update a cron job
|
||||||
|
|
||||||
|
**--branch**="": cron branch
|
||||||
|
|
||||||
|
**--id**="": cron id
|
||||||
|
|
||||||
|
**--name**="": cron name
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
**--schedule**="": cron schedule
|
||||||
|
|
||||||
|
### info
|
||||||
|
|
||||||
|
display info about a cron job
|
||||||
|
|
||||||
|
**--id**="": cron id
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
### ls
|
||||||
|
|
||||||
|
list cron jobs
|
||||||
|
|
||||||
|
**--repository, --repo**="": repository id or full-name (e.g. 134 or octocat/hello-world)
|
||||||
|
|
||||||
|
## setup
|
||||||
|
|
||||||
|
setup the woodpecker-cli for the first time
|
||||||
|
|
||||||
|
**--server-url**="": The URL of the woodpecker server
|
||||||
|
|
||||||
|
**--token**="": The token to authenticate with the woodpecker server
|
||||||
|
|
||||||
|
## update
|
||||||
|
|
||||||
|
update the woodpecker-cli to the latest version
|
||||||
|
|
||||||
|
**--force**: force update even if the latest version is already installed
|
150
docs/versioned_docs/version-2.4/91-migrations.md
Normal file
|
@ -0,0 +1,150 @@
|
||||||
|
# Migrations
|
||||||
|
|
||||||
|
Some versions need some changes to the server configuration or the pipeline configuration files.
|
||||||
|
|
||||||
|
## `next`
|
||||||
|
|
||||||
|
- Deprecated `steps.[name].group` in favor of `steps.[name].depends_on` (see [workflow syntax](./20-usage/20-workflow-syntax.md#depends_on) to learn how to set dependencies)
|
||||||
|
- Removed `WOODPECKER_ROOT_PATH` and `WOODPECKER_ROOT_URL` config variables. Use `WOODPECKER_HOST` with a path instead
|
||||||
|
- Pipelines without a config file will now be skipped instead of failing
|
||||||
|
- Deprecated `includes` and `excludes` support from **event** filter
|
||||||
|
- Deprecated uppercasing all secret env vars, instead, the value of the `secrets` property is used. [Read more](./20-usage/40-secrets.md#use-secrets-in-commands)
|
||||||
|
- Deprecated alternative names for secrets, use `environment` with `from_secret`
|
||||||
|
- Deprecated slice definition for env vars
|
||||||
|
|
||||||
|
## 2.0.0
|
||||||
|
|
||||||
|
- Dropped deprecated `CI_BUILD_*`, `CI_PREV_BUILD_*`, `CI_JOB_*`, `*_LINK`, `CI_SYSTEM_ARCH`, `CI_REPO_REMOTE` built-in environment variables
|
||||||
|
- Deprecated `platform:` filter in favor of `labels:`, [read more](./20-usage/20-workflow-syntax.md#filter-by-platform)
|
||||||
|
- Secrets `event` property was renamed to `events` and `image` to `images` as both are lists. The new property `events` / `images` has to be used in the api. The old properties `event` and `image` were removed.
|
||||||
|
- The secrets `plugin_only` option was removed. Secrets with images are now always only available for plugins using listed by the `images` property. Existing secrets with a list of `images` will now only be available to the listed images if they are used as a plugin.
|
||||||
|
- Removed `build` alias for `pipeline` command in CLI
|
||||||
|
- Removed `ssh` backend. Use an agent directly on the SSH machine using the `local` backend.
|
||||||
|
- Removed `/hook` and `/stream` API paths in favor of `/api/(hook|stream)`. You may need to use the "Repair repository" button in the repo settings or "Repair all" in the admin settings to recreate the forge hook.
|
||||||
|
- Removed `WOODPECKER_DOCS` config variable
|
||||||
|
- Renamed `link` to `url` (including all API fields)
|
||||||
|
- Deprecated `CI_COMMIT_URL` env var, use `CI_PIPELINE_FORGE_URL`
|
||||||
|
|
||||||
|
## 1.0.0
|
||||||
|
|
||||||
|
- The signature used to verify extension calls (like those used for the [config-extension](./30-administration/100-external-configuration-api.md)) done by the Woodpecker server switched from using a shared-secret HMac to an ed25519 key-pair. Read more about it at the [config-extensions](./30-administration/100-external-configuration-api.md) documentation.
|
||||||
|
- Refactored support for old agent filter labels and expressions. Learn how to use the new [filter](./20-usage/20-workflow-syntax.md#labels)
|
||||||
|
- Renamed step environment variable `CI_SYSTEM_ARCH` to `CI_SYSTEM_PLATFORM`. Same applies for the cli exec variable.
|
||||||
|
- Renamed environment variables `CI_BUILD_*` and `CI_PREV_BUILD_*` to `CI_PIPELINE_*` and `CI_PREV_PIPELINE_*`, old ones are still available but deprecated
|
||||||
|
- Renamed environment variables `CI_JOB_*` to `CI_STEP_*`, old ones are still available but deprecated
|
||||||
|
- Renamed environment variable `CI_REPO_REMOTE` to `CI_REPO_CLONE_URL`, old is still available but deprecated
|
||||||
|
- Renamed environment variable `*_LINK` to `*_URL`, old ones are still available but deprecated
|
||||||
|
- Renamed API endpoints for pipelines (`<owner>/<repo>/builds/<buildId>` -> `<owner>/<repo>/pipelines/<pipelineId>`), old ones are still available but deprecated
|
||||||
|
- Updated Prometheus gauge `build_*` to `pipeline_*`
|
||||||
|
- Updated Prometheus gauge `*_job_*` to `*_step_*`
|
||||||
|
- Renamed config env `WOODPECKER_MAX_PROCS` to `WOODPECKER_MAX_WORKFLOWS` (still available as fallback)
|
||||||
|
- The pipelines are now also read from `.yaml` files, the new default order is `.woodpecker/*.yml` and `.woodpecker/*.yaml` (without any prioritization) -> `.woodpecker.yml` -> `.woodpecker.yaml`
|
||||||
|
- Dropped support for [Coding](https://coding.net/), [Gogs](https://gogs.io) and Bitbucket Server (Stash).
|
||||||
|
- `/api/queue/resume` & `/api/queue/pause` endpoint methods were changed from `GET` to `POST`
|
||||||
|
- rename `pipeline:` key in your workflow config to `steps:`
|
||||||
|
- If you want to migrate old logs to the new format, watch the error messages on start. If there are none we are good to go, else you have to plan a migration that can take hours. Set `WOODPECKER_MIGRATIONS_ALLOW_LONG` to true and let it run.
|
||||||
|
- Using `repo-id` in favor of `owner/repo` combination
|
||||||
|
- :warning: The api endpoints `/api/repos/{owner}/{repo}/...` were replaced by new endpoints using the repos id `/api/repos/{repo-id}`
|
||||||
|
- To find the id of a repo use the `/api/repos/lookup/{repo-full-name-with-slashes}` endpoint.
|
||||||
|
- The existing badge endpoint `/api/badges/{owner}/{repo}` will still work, but whenever possible try to use the new endpoint using the `repo-id`: `/api/badges/{repo-id}`.
|
||||||
|
- The UI urls for a repository changed from `/repos/{owner}/{repo}/...` to `/repos/{repo-id}/...`. You will be redirected automatically when using the old url.
|
||||||
|
- The woodpecker-go api-client is now using the `repo-id` instead of `owner/repo` for all functions
|
||||||
|
- Using `org-id` in favour of `owner` name
|
||||||
|
- :warning: The api endpoints `/api/orgs/{owner}/...` were replaced by new endpoints using the orgs id `/api/repos/{org-id}`
|
||||||
|
- To find the id of orgs use the `/api/orgs/lookup/{org_full_name}` endpoint.
|
||||||
|
- The UI urls for a organization changed from `/org/{owner}/...` to `/orgs/{org-id}/...`. You will be redirected automatically when using the old url.
|
||||||
|
- The woodpecker-go api-client is now using the `org-id` instead of `org name` for all functions
|
||||||
|
- The `command:` field has been removed from steps. If you were using it, please check if the entrypoint of the image you used is a shell.
|
||||||
|
- If it is a shell, simply rename `command:` to `commands:`.
|
||||||
|
- If it's not, you need to prepend the entrypoint before and also rename it (e.g., `commands: <entrypoint> <cmd>`).
|
||||||
|
|
||||||
|
## 0.15.0
|
||||||
|
|
||||||
|
- Default value for custom pipeline path is now empty / un-set which results in following resolution:
|
||||||
|
|
||||||
|
`.woodpecker/*.yml` -> `.woodpecker.yml` -> `.drone.yml`
|
||||||
|
|
||||||
|
Only projects created after updating will have an empty value by default. Existing projects will stick to the current pipeline path which is `.drone.yml` in most cases.
|
||||||
|
|
||||||
|
Read more about it at the [Project Settings](./20-usage/71-project-settings.md#pipeline-path)
|
||||||
|
|
||||||
|
- From version `0.15.0` ongoing there will be three types of docker images: `latest`, `next` and `x.x.x` with an alpine variant for each type like `latest-alpine`.
|
||||||
|
If you used `latest` before to try pre-release features you should switch to `next` after this release.
|
||||||
|
|
||||||
|
- Dropped support for `DRONE_*` environment variables. The according `WOODPECKER_*` variables must be used instead.
|
||||||
|
Additionally some alternative namings have been removed to simplify maintenance:
|
||||||
|
|
||||||
|
- `WOODPECKER_AGENT_SECRET` replaces `WOODPECKER_SECRET`, `DRONE_SECRET`, `WOODPECKER_PASSWORD`, `DRONE_PASSWORD` and `DRONE_AGENT_SECRET`.
|
||||||
|
- `WOODPECKER_HOST` replaces `DRONE_HOST` and `DRONE_SERVER_HOST`.
|
||||||
|
- `WOODPECKER_DATABASE_DRIVER` replaces `DRONE_DATABASE_DRIVER` and `DATABASE_DRIVER`.
|
||||||
|
- `WOODPECKER_DATABASE_DATASOURCE` replaces `DRONE_DATABASE_DATASOURCE` and `DATABASE_CONFIG`.
|
||||||
|
|
||||||
|
- Dropped support for `DRONE_*` environment variables in pipeline steps. Pipeline meta-data can be accessed with `CI_*` variables.
|
||||||
|
|
||||||
|
- `CI_*` prefix replaces `DRONE_*`
|
||||||
|
- `CI` value is now `woodpecker`
|
||||||
|
- `DRONE=true` has been removed
|
||||||
|
- Some variables got deprecated and will be removed in future versions. Please migrate to the new names. Same applies for `DRONE_` of them.
|
||||||
|
- CI_ARCH => use CI_SYSTEM_ARCH
|
||||||
|
- CI_COMMIT => CI_COMMIT_SHA
|
||||||
|
- CI_TAG => CI_COMMIT_TAG
|
||||||
|
- CI_PULL_REQUEST => CI_COMMIT_PULL_REQUEST
|
||||||
|
- CI_REMOTE_URL => use CI_REPO_REMOTE
|
||||||
|
- CI_REPO_BRANCH => use CI_REPO_DEFAULT_BRANCH
|
||||||
|
- CI_PARENT_BUILD_NUMBER => use CI_BUILD_PARENT
|
||||||
|
- CI_BUILD_TARGET => use CI_BUILD_DEPLOY_TARGET
|
||||||
|
- CI_DEPLOY_TO => use CI_BUILD_DEPLOY_TARGET
|
||||||
|
- CI_COMMIT_AUTHOR_NAME => use CI_COMMIT_AUTHOR
|
||||||
|
- CI_PREV_COMMIT_AUTHOR_NAME => use CI_PREV_COMMIT_AUTHOR
|
||||||
|
- CI_SYSTEM => use CI_SYSTEM_NAME
|
||||||
|
- CI_BRANCH => use CI_COMMIT_BRANCH
|
||||||
|
- CI_SOURCE_BRANCH => use CI_COMMIT_SOURCE_BRANCH
|
||||||
|
- CI_TARGET_BRANCH => use CI_COMMIT_TARGET_BRANCH
|
||||||
|
|
||||||
|
For all available variables and their descriptions have a look at [built-in-environment-variables](./20-usage/50-environment.md#built-in-environment-variables).
|
||||||
|
|
||||||
|
- Prometheus metrics have been changed from `drone_*` to `woodpecker_*`
|
||||||
|
|
||||||
|
- Base path has moved from `/var/lib/drone` to `/var/lib/woodpecker`
|
||||||
|
|
||||||
|
- Default workspace base path has moved from `/drone` to `/woodpecker`
|
||||||
|
|
||||||
|
- Default SQLite database location has changed:
|
||||||
|
|
||||||
|
- `/var/lib/drone/drone.sqlite` -> `/var/lib/woodpecker/woodpecker.sqlite`
|
||||||
|
- `drone.sqlite` -> `woodpecker.sqlite`
|
||||||
|
|
||||||
|
- Plugin Settings moved into `settings` section:
|
||||||
|
|
||||||
|
```diff
|
||||||
|
steps:
|
||||||
|
something:
|
||||||
|
image: my/plugin
|
||||||
|
- setting1: foo
|
||||||
|
- setting2: bar
|
||||||
|
+ settings:
|
||||||
|
+ setting1: foo
|
||||||
|
+ setting2: bar
|
||||||
|
```
|
||||||
|
|
||||||
|
- `WOODPECKER_DEBUG` option for server and agent got removed in favor of `WOODPECKER_LOG_LEVEL=debug`
|
||||||
|
|
||||||
|
- Remove unused server flags which can safely be removed from your server config: `WOODPECKER_QUIC`, `WOODPECKER_GITHUB_SCOPE`, `WOODPECKER_GITHUB_GIT_USERNAME`, `WOODPECKER_GITHUB_GIT_PASSWORD`, `WOODPECKER_GITHUB_PRIVATE_MODE`, `WOODPECKER_GITEA_GIT_USERNAME`, `WOODPECKER_GITEA_GIT_PASSWORD`, `WOODPECKER_GITEA_PRIVATE_MODE`, `WOODPECKER_GITLAB_GIT_USERNAME`, `WOODPECKER_GITLAB_GIT_PASSWORD`, `WOODPECKER_GITLAB_PRIVATE_MODE`
|
||||||
|
|
||||||
|
- Dropped support for manually setting the agents platform with `WOODPECKER_PLATFORM`. The platform is now automatically detected.
|
||||||
|
|
||||||
|
- Use `WOODPECKER_STATUS_CONTEXT` instead of the deprecated options `WOODPECKER_GITHUB_CONTEXT` and `WOODPECKER_GITEA_CONTEXT`.
|
||||||
|
|
||||||
|
## 0.14.0
|
||||||
|
|
||||||
|
No breaking changes
|
||||||
|
|
||||||
|
## From Drone
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
Migration from Drone is only possible if you were running Drone <= v0.8.
|
||||||
|
:::
|
||||||
|
|
||||||
|
1. Make sure you are already running Drone v0.8
|
||||||
|
2. Upgrade to Woodpecker v0.14.4, migration will be done during startup
|
||||||
|
3. Upgrade to the latest Woodpecker version. Pay attention to the breaking changes listed above.
|
64
docs/versioned_docs/version-2.4/92-awesome.md
Normal file
|
@ -0,0 +1,64 @@
|
||||||
|
# Awesome Woodpecker
|
||||||
|
|
||||||
|
A curated list of awesome things related to Woodpecker-CI.
|
||||||
|
|
||||||
|
If you have some missing resources, please feel free to [open a pull-request](https://github.com/woodpecker-ci/woodpecker/edit/main/docs/docs/92-awesome.md) and add them.
|
||||||
|
|
||||||
|
## Official Resources
|
||||||
|
|
||||||
|
- [Woodpecker CI pipeline configs](https://github.com/woodpecker-ci/woodpecker/tree/main/.woodpecker) - Complex setup containing different kind of pipelines
|
||||||
|
- [Golang tests](https://github.com/woodpecker-ci/woodpecker/blob/main/.woodpecker/test.yaml)
|
||||||
|
- [Typescript, eslint & Vue](https://github.com/woodpecker-ci/woodpecker/blob/main/.woodpecker/web.yaml)
|
||||||
|
- [Docusaurus & publishing to GitHub Pages](https://github.com/woodpecker-ci/woodpecker/blob/main/.woodpecker/docs.yaml)
|
||||||
|
- [Docker container building](https://github.com/woodpecker-ci/woodpecker/blob/main/.woodpecker/docker.yaml)
|
||||||
|
|
||||||
|
## Projects using Woodpecker
|
||||||
|
|
||||||
|
- [Woodpecker-CI](https://github.com/woodpecker-ci/woodpecker/tree/main/.woodpecker) itself
|
||||||
|
- [All official plugins](https://github.com/woodpecker-ci?q=plugin&type=all)
|
||||||
|
- [dessalines/thumb-key](https://github.com/dessalines/thumb-key/blob/main/.woodpecker.yml) - Android Jetpack compose linting and building
|
||||||
|
- [Vieter](https://git.rustybever.be/vieter-v/vieter) - Archlinux/Pacman repository server & automated package build system
|
||||||
|
- [Rieter](https://git.rustybever.be/Chewing_Bever/rieter) - Rewrite of the Vieter project in Rust
|
||||||
|
- [Alex](https://git.rustybever.be/Chewing_Bever/alex) - Minecraft server wrapper designed to automate backups & complement Docker installations
|
||||||
|
|
||||||
|
## Tools
|
||||||
|
|
||||||
|
- [Convert Drone CI pipelines to Woodpecker CI](https://codeberg.org/lafriks/woodpecker-pipeline-transform)
|
||||||
|
- [Ansible NAS](https://github.com/davestephens/ansible-nas/) - a homelab Ansible playbook that can set up Woodpecker-CI and Gitea
|
||||||
|
- [picus](https://github.com/windsource/picus) - Picus connects to a Woodpecker CI server and creates an agent in the cloud when there are pending workflows.
|
||||||
|
- [Hetzner cloud](https://www.hetzner.com/cloud) based [Woodpecker compatible autoscaler](https://git.ljoonal.xyz/ljoonal/hetzner-ci-autoscaler) - Creates and destroys VPS instances based on the count of pending & running jobs.
|
||||||
|
- [woodpecker-lint](https://git.schmidl.dev/schtobia/woodpecker-lint) - A repository for linting a woodpecker config file via pre-commit hook
|
||||||
|
- [Grafana Dashboard](https://github.com/Janik-Haag/woodpecker-grafana-dashboard) - A dashboard visualizing information exposed by the woodpecker prometheus endpoint.
|
||||||
|
- [woodpecker-autoscaler](https://github.com/Lerentis/woodpecker-autoscaler) - Yet another woodpecker autoscaler currently targeting [Hetzner cloud](https://www.hetzner.com/cloud) that works in parallel to other autoscaler implementations.
|
||||||
|
|
||||||
|
## Configuration Services
|
||||||
|
|
||||||
|
- [Dynamic Pipelines for Nix Flakes](https://github.com/pinpox/woodpecker-flake-pipeliner) - Define pipelines as Nix Flake outputs
|
||||||
|
|
||||||
|
## Pipelines
|
||||||
|
|
||||||
|
- [Collection of pipeline examples](https://codeberg.org/Codeberg-CI/examples)
|
||||||
|
|
||||||
|
## Posts & tutorials
|
||||||
|
|
||||||
|
- [Setup Gitea with Woodpecker CI](https://containers.fan/posts/setup-gitea-with-woodpecker-ci/)
|
||||||
|
- [Step-by-step guide to modern, secure and Open-source CI setup](https://devforth.io/blog/step-by-step-guide-to-modern-secure-ci-setup/)
|
||||||
|
- [Using Woodpecker CI for my static sites](https://jan.wildeboer.net/2022/07/Woodpecker-CI-Jekyll/)
|
||||||
|
- [Woodpecker CI @ Codeberg](https://www.sarkasti.eu/articles/post/woodpecker/)
|
||||||
|
- [Deploy Docker/Compose using Woodpecker CI](https://hinty.io/vverenko/deploy-docker-compose-using-woodpecker-ci/)
|
||||||
|
- [Installing Woodpecker CI in your personal homelab](https://pwa.io/articles/installing-woodpecker-in-your-homelab/)
|
||||||
|
- [Locally Cached Nix CI with Woodpecker](https://blog.kotatsu.dev/posts/2023-04-21-woodpecker-nix-caching/)
|
||||||
|
- [How to run Cypress auto-tests on Woodpecker CI and report results to Slack](https://devforth.io/blog/how-to-run-cypress-auto-tests-on-woodpecker-ci-and-report-results-to-slack/)
|
||||||
|
- [Quest For CICD - WoodpeckerCI](https://omaramin.me/posts/woodpecker/)
|
||||||
|
- [Getting started with Woodpecker CI](https://blog.lutra-it.eu/getting-started-with-woodpecker-ci.html)
|
||||||
|
- [Installing gitea and woodpecker using binary packages](https://neelex.com/2023/03/26/Installing-gitea-using-binary-packages/)
|
||||||
|
|
||||||
|
## Videos
|
||||||
|
|
||||||
|
- [Replace Ansible Semaphore with Woodpecker CI](https://www.youtube.com/watch?v=d610YPvCB0E)
|
||||||
|
- ["unexpected EOF" error when trying to pair Woodpecker CI served through the Caddy with Gitea](https://www.youtube.com/watch?v=n7Hyvt71Np0)
|
||||||
|
- [CICD Environment in Docker Swarm behind Caddy Server - Part 2 Woodpeckerci](https://www.youtube.com/watch?v=rkbw_k7JvS0)
|
||||||
|
|
||||||
|
## Plugins
|
||||||
|
|
||||||
|
We have a separate [index](/plugins) for plugins.
|
|
@ -0,0 +1,153 @@
|
||||||
|
# Getting started
|
||||||
|
|
||||||
|
You can develop on your local computer by following the [steps below](#preparation-for-local-development) or you can start with a fully prepared online setup using [Gitpod](https://github.com/gitpod-io/gitpod) and [Gitea](https://github.com/go-gitea/gitea).
|
||||||
|
|
||||||
|
## Gitpod
|
||||||
|
|
||||||
|
If you want to start development or updating docs as easy as possible, you can use our preconfigured setup for Woodpecker using [Gitpod](https://github.com/gitpod-io/gitpod). Gitpod starts a complete development setup in the cloud containing:
|
||||||
|
|
||||||
|
- An IDE in the browser or bridged to your local VS-Code or Jetbrains
|
||||||
|
- A preconfigured [Gitea](https://github.com/go-gitea/gitea) instance as forge
|
||||||
|
- A preconfigured Woodpecker server
|
||||||
|
- A single preconfigured Woodpecker agent node
|
||||||
|
- Our docs preview server
|
||||||
|
|
||||||
|
Start Woodpecker in Gitpod by clicking on the following badge. You can log in with `woodpecker` and `password`.
|
||||||
|
|
||||||
|
[![Open in Gitpod](https://gitpod.io/button/open-in-gitpod.svg)](https://gitpod.io/#https://github.com/woodpecker-ci/woodpecker)
|
||||||
|
|
||||||
|
## Preparation for local development
|
||||||
|
|
||||||
|
### Install Go
|
||||||
|
|
||||||
|
Install Golang (>=1.20) as described by [this guide](https://go.dev/doc/install).
|
||||||
|
|
||||||
|
### Install make
|
||||||
|
|
||||||
|
> GNU Make is a tool which controls the generation of executables and other non-source files of a program from the program's source files (<https://www.gnu.org/software/make/>).
|
||||||
|
|
||||||
|
Install make on:
|
||||||
|
|
||||||
|
- Ubuntu: `apt install make` - [Docs](https://wiki.ubuntuusers.de/Makefile/)
|
||||||
|
- [Windows](https://stackoverflow.com/a/32127632/8461267)
|
||||||
|
- Mac OS: `brew install make`
|
||||||
|
|
||||||
|
### Install Node.js & `pnpm`
|
||||||
|
|
||||||
|
Install [Node.js (>=14)](https://nodejs.org/en/download/) if you want to build Woodpecker's UI or documentation.
|
||||||
|
|
||||||
|
For dependency installation (`node_modules`) of UI and documentation of Woodpecker the package manager pnpm is used.
|
||||||
|
[This guide](https://pnpm.io/installation) describes the installation of `pnpm`.
|
||||||
|
|
||||||
|
### Install `pre-commit` (optional)
|
||||||
|
|
||||||
|
Woodpecker uses [`pre-commit`](https://pre-commit.com/) to allow you to easily autofix your code.
|
||||||
|
To apply it during local development, take a look at [`pre-commit`s documentation](https://pre-commit.com/#usage).
|
||||||
|
|
||||||
|
### Create a `.env` file with your development configuration
|
||||||
|
|
||||||
|
Similar to the environment variables you can set for your production setup of Woodpecker, you can create a `.env` in the root of the Woodpecker project and add any need config to it.
|
||||||
|
|
||||||
|
A common config for debugging would look like this:
|
||||||
|
|
||||||
|
```ini
|
||||||
|
WOODPECKER_OPEN=true
|
||||||
|
WOODPECKER_ADMIN=your-username
|
||||||
|
|
||||||
|
# if you want to test webhooks with an online forge like GitHub this address needs to be accessible from public server
|
||||||
|
WOODPECKER_HOST=http://your-dev-address.com
|
||||||
|
|
||||||
|
# github (sample for a forge config - see /docs/administration/forge/overview for other forges)
|
||||||
|
WOODPECKER_GITHUB=true
|
||||||
|
WOODPECKER_GITHUB_CLIENT=<redacted>
|
||||||
|
WOODPECKER_GITHUB_SECRET=<redacted>
|
||||||
|
|
||||||
|
# agent
|
||||||
|
WOODPECKER_SERVER=localhost:9000
|
||||||
|
WOODPECKER_AGENT_SECRET=a-long-and-secure-password-used-for-the-local-development-system
|
||||||
|
WOODPECKER_MAX_WORKFLOWS=1
|
||||||
|
|
||||||
|
# enable if you want to develop the UI
|
||||||
|
# WOODPECKER_DEV_WWW_PROXY=http://localhost:8010
|
||||||
|
|
||||||
|
# used so you can login without using a public address
|
||||||
|
WOODPECKER_DEV_OAUTH_HOST=http://localhost:8000
|
||||||
|
|
||||||
|
# disable health-checks while debugging (normally not needed while developing)
|
||||||
|
WOODPECKER_HEALTHCHECK=false
|
||||||
|
|
||||||
|
# WOODPECKER_LOG_LEVEL=debug
|
||||||
|
# WOODPECKER_LOG_LEVEL=trace
|
||||||
|
```
|
||||||
|
|
||||||
|
### Setup OAuth
|
||||||
|
|
||||||
|
Create an OAuth app for your forge as described in the [forges documentation](../30-administration/11-forges/10-overview.md). If you set `WOODPECKER_DEV_OAUTH_HOST=http://localhost:8000` you can use that address with the path as explained for the specific forge to login without the need for a public address. For example for GitHub you would use `http://localhost:8000/authorize` as authorization callback URL.
|
||||||
|
|
||||||
|
## Developing with VS Code
|
||||||
|
|
||||||
|
You can use different methods for debugging the Woodpecker applications. One of the currently recommended ways to debug and test the Woodpecker application is using [VS-Code](https://code.visualstudio.com/) or [VS-Codium](https://vscodium.com/) (Open-Source binaries of VS-Code) as most maintainers are using it and Woodpecker already includes the needed debug configurations for it.
|
||||||
|
|
||||||
|
To launch all needed services for local development, you can use "Woodpecker CI" debugging configuration that will launch UI, server and agent in debugging mode. Then open `http://localhost:8000` to access it.
|
||||||
|
|
||||||
|
As a starting guide for programming Go with VS Code, you can use this video guide:
|
||||||
|
[![Getting started with Go in VS Code](https://img.youtube.com/vi/1MXIGYrMk80/0.jpg)](https://www.youtube.com/watch?v=1MXIGYrMk80)
|
||||||
|
|
||||||
|
### Debugging Woodpecker
|
||||||
|
|
||||||
|
The Woodpecker source code already includes launch configurations for the Woodpecker server and agent. To start debugging you can click on the debug icon in the navigation bar of VS-Code (ctrl-shift-d). On that page you will see the existing launch jobs at the top. Simply select the agent or server and click on the play button. You can set breakpoints in the source files to stop at specific points.
|
||||||
|
|
||||||
|
![Woodpecker debugging with VS Code](./vscode-debug.png)
|
||||||
|
|
||||||
|
## Testing & linting code
|
||||||
|
|
||||||
|
To test or lint parts of Woodpecker, you can run one of the following commands:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# test server code
|
||||||
|
make test-server
|
||||||
|
|
||||||
|
# test agent code
|
||||||
|
make test-agent
|
||||||
|
|
||||||
|
# test cli code
|
||||||
|
make test-cli
|
||||||
|
|
||||||
|
# test datastore / database related code like migrations of the server
|
||||||
|
make test-server-datastore
|
||||||
|
|
||||||
|
# lint go code
|
||||||
|
make lint
|
||||||
|
|
||||||
|
# lint UI code
|
||||||
|
make lint-frontend
|
||||||
|
|
||||||
|
# test UI code
|
||||||
|
make test-frontend
|
||||||
|
```
|
||||||
|
|
||||||
|
If you want to test a specific Go file, you can also use:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
go test -race -timeout 30s go.woodpecker-ci.org/woodpecker/v2/<path-to-the-package-or-file-to-test>
|
||||||
|
```
|
||||||
|
|
||||||
|
Or you can open the test-file inside [VS-Code](#developing-with-vs-code) and run or debug the test by clicking on the inline commands:
|
||||||
|
|
||||||
|
![Run test via VS-Code](./vscode-run-test.png)
|
||||||
|
|
||||||
|
## Run applications from terminal
|
||||||
|
|
||||||
|
If you want to run a Woodpecker applications from your terminal, you can use one of the following commands from the base of the Woodpecker project. They will execute Woodpecker in a similar way as described in [debugging Woodpecker](#debugging-woodpecker) without the ability to really debug it in your editor.
|
||||||
|
|
||||||
|
```bash title="start server"
|
||||||
|
go run ./cmd/server
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash title="start agent"
|
||||||
|
go run ./cmd/agent
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash title="execute cli command"
|
||||||
|
go run ./cmd/cli [command]
|
||||||
|
```
|
|
@ -0,0 +1,26 @@
|
||||||
|
# Core ideas
|
||||||
|
|
||||||
|
- A configuration (e.g. of a pipeline) should never be [turing complete](https://en.wikipedia.org/wiki/Turing_completeness) (We have agents to exec things 🙂).
|
||||||
|
- If possible, follow the [KISS principle](https://en.wikipedia.org/wiki/KISS_principle).
|
||||||
|
- What is used most often should be default.
|
||||||
|
- Keep different topics separated, so you can write plugins, port new ideas ... more easily, see [Architecture](./05-architecture.md).
|
||||||
|
|
||||||
|
## Addons and extensions
|
||||||
|
|
||||||
|
If you are wondering whether your contribution will be accepted to be merged in the Woodpecker core, or whether it's better to write an
|
||||||
|
[addon](../30-administration/75-addons/00-overview.md), [extension](../30-administration/100-external-configuration-api.md) or an
|
||||||
|
[external custom backend](../30-administration/22-backends/50-custom-backends.md), please check these points:
|
||||||
|
|
||||||
|
- Is your change very specific to your setup and unlikely to be used by anyone else?
|
||||||
|
- Does your change violate the [guidelines](#guidelines)?
|
||||||
|
|
||||||
|
Both should be false when you open a pull request to get your change into the core repository.
|
||||||
|
|
||||||
|
### Guidelines
|
||||||
|
|
||||||
|
#### Forges
|
||||||
|
|
||||||
|
A new forge must support these features:
|
||||||
|
|
||||||
|
- OAuth2
|
||||||
|
- Webhooks
|
39
docs/versioned_docs/version-2.4/92-development/03-ui.md
Normal file
|
@ -0,0 +1,39 @@
|
||||||
|
# UI Development
|
||||||
|
|
||||||
|
To develop the UI you need to install [Node.js and pnpm](./01-getting-started.md#install-nodejs--pnpm). In addition it is recommended to use VS-Code with the recommended plugin selection to get features like auto-formatting, linting and typechecking. The UI is written with [Vue 3](https://v3.vuejs.org/) as Single-Page-Application accessing the Woodpecker REST api.
|
||||||
|
|
||||||
|
## Setup
|
||||||
|
|
||||||
|
The UI code is placed in `web/`. Change to that folder in your terminal with `cd web/` and install all dependencies by running `pnpm install`. For production builds the generated UI code is integrated into the Woodpecker server by using [go-embed](https://pkg.go.dev/embed).
|
||||||
|
|
||||||
|
Testing UI changes would require us to rebuild the UI after each adjustment to the code by running `pnpm build` and restarting the Woodpecker server. To avoid this you can make use of the dev-proxy integrated into the Woodpecker server. This integrated dev-proxy will forward all none api request to a separate http-server which will only serve the UI files.
|
||||||
|
|
||||||
|
![UI Proxy architecture](./ui-proxy.svg)
|
||||||
|
|
||||||
|
Start the UI server locally with [hot-reloading](https://stackoverflow.com/a/41429055/8461267) by running: `pnpm start`. To enable the forwarding of requests to the UI server you have to enable the dev-proxy inside the Woodpecker server by adding `WOODPECKER_DEV_WWW_PROXY=http://localhost:8010` to your `.env` file.
|
||||||
|
After starting the Woodpecker server as explained in the [debugging](./01-getting-started.md#debugging-woodpecker) section, you should now be able to access the UI under [http://localhost:8000](http://localhost:8000).
|
||||||
|
|
||||||
|
## Tools and frameworks
|
||||||
|
|
||||||
|
The following list contains some tools and frameworks used by the Woodpecker UI. For some points we added some guidelines / hints to help you developing.
|
||||||
|
|
||||||
|
- [Vue 3](https://v3.vuejs.org/)
|
||||||
|
- use `setup` and composition api
|
||||||
|
- place (re-usable) components in `web/src/components/`
|
||||||
|
- views should have a route in `web/src/router.ts` and are located in `web/src/views/`
|
||||||
|
- [Windicss](https://windicss.org/) (similar to Tailwind)
|
||||||
|
- use Windicss classes where possible
|
||||||
|
- if needed extend the Windicss config to use new classes
|
||||||
|
- [Vite](https://vitejs.dev/) (similar to Webpack)
|
||||||
|
- [Typescript](https://www.typescriptlang.org/)
|
||||||
|
- avoid using `any` and `unknown` (the linter will prevent you from doing so anyways :wink:)
|
||||||
|
- [eslint](https://eslint.org/)
|
||||||
|
- [Volar & vue-tsc](https://github.com/johnsoncodehk/volar/) for type-checking in .vue file
|
||||||
|
- use the take-over mode of Volar as described by [this guide](https://github.com/johnsoncodehk/volar/discussions/471)
|
||||||
|
|
||||||
|
## Messages and Translations
|
||||||
|
|
||||||
|
Woodpecker uses [Vue I18n](https://vue-i18n.intlify.dev/) as translation library. New translations have to be added to `web/src/assets/locales/en.json`. The English source file will be automatically imported into [Weblate](https://translate.woodpecker-ci.org/) (the translation system used by Woodpecker) where all other languages will be translated by the community based on the English source.
|
||||||
|
You must not provide translations except English in PRs, otherwise weblate could put git into conflicts (when someone has translated in that language file and changes are not into main branch yet)
|
||||||
|
|
||||||
|
For more information about translations see [Translations](./07-translations.md).
|
20
docs/versioned_docs/version-2.4/92-development/04-docs.md
Normal file
|
@ -0,0 +1,20 @@
|
||||||
|
# Documentation
|
||||||
|
|
||||||
|
The documentation is using docusaurus as framework. You can learn more about it from its [official documentation](https://docusaurus.io/docs/).
|
||||||
|
|
||||||
|
If you only want to change some text it probably is enough if you just search for the corresponding [Markdown](https://www.markdownguide.org/basic-syntax/) file inside the `docs/docs/` folder and adjust it. If you want to change larger parts and test the rendered documentation you can run docusaurus locally. Similarly to the UI you need to install [Node.js and pnpm](./01-getting-started.md#install-nodejs--pnpm). After that you can run and build docusaurus locally by using the following commands:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
cd docs/
|
||||||
|
|
||||||
|
pnpm install
|
||||||
|
|
||||||
|
# build plugins used by the docs
|
||||||
|
pnpm build:woodpecker-plugins
|
||||||
|
|
||||||
|
# start docs with hot-reloading, so you can change the docs and directly see the changes in the browser without reloading it manually
|
||||||
|
pnpm start
|
||||||
|
|
||||||
|
# or build the docs to deploy it to some static page hosting
|
||||||
|
pnpm build
|
||||||
|
```
|
|
@ -0,0 +1,48 @@
|
||||||
|
# Architecture
|
||||||
|
|
||||||
|
## Package architecture
|
||||||
|
|
||||||
|
![Woodpecker architecture](./woodpecker-architecture.png)
|
||||||
|
|
||||||
|
## System architecture
|
||||||
|
|
||||||
|
### main package hierarchy
|
||||||
|
|
||||||
|
| package | meaning | imports |
|
||||||
|
| ------------------ | -------------------------------------------------------------- | ------------------------------------- |
|
||||||
|
| `cmd/**` | parse command-line args & environment to stat server/cli/agent | all other |
|
||||||
|
| `agent/**` | code only agent (remote worker) will need | `pipeline`, `shared` |
|
||||||
|
| `cli/**` | code only cli tool does need | `pipeline`, `shared`, `woodpecker-go` |
|
||||||
|
| `server/**` | code only server will need | `pipeline`, `shared` |
|
||||||
|
| `shared/**` | code shared for all three main tools (go help utils) | only std and external libs |
|
||||||
|
| `woodpecker-go/**` | go client for server rest api | std |
|
||||||
|
|
||||||
|
### Server
|
||||||
|
|
||||||
|
| package | meaning | imports |
|
||||||
|
| -------------------- | ----------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||||||
|
| `server/api/**` | handle web requests from `server/router` | `pipeline`, `../badges`, `../ccmenue`, `../logging`, `../model`, `../pubsub`, `../queue`, `../forge`, `../shared`, `../store`, `shared`, (TODO: mv `server/router/middleware/session`) |
|
||||||
|
| `server/badges/**` | generate svg badges for pipelines | `../model` |
|
||||||
|
| `server/ccmenu/**` | generate xml ccmenu for pipelines | `../model` |
|
||||||
|
| `server/grpc/**` | gRPC server agents can connect to | `pipeline/rpc/**`, `../logging`, `../model`, `../pubsub`, `../queue`, `../forge`, `../pipeline`, `../store` |
|
||||||
|
| `server/logging/**` | logging lib for gPRC server to stream logs while running | std |
|
||||||
|
| `server/model/**` | structs for store (db) and api (json) | std |
|
||||||
|
| `server/plugins/**` | plugins for server | `../model`, `../forge` |
|
||||||
|
| `server/pipeline/**` | orchestrate pipelines | `pipeline`, `../model`, `../pubsub`, `../queue`, `../forge`, `../store`, `../plugins` |
|
||||||
|
| `server/pubsub/**` | pubsub lib for server to push changes to the WebUI | std |
|
||||||
|
| `server/queue/**` | queue lib for server where agents pull new pipelines from via gRPC | `server/model` |
|
||||||
|
| `server/forge/**` | forge lib for server to connect and handle forge specific stuff | `shared`, `server/model` |
|
||||||
|
| `server/router/**` | handle requests to REST API (and all middleware) and serve UI and WebUI config | `shared`, `../api`, `../model`, `../forge`, `../store`, `../web` |
|
||||||
|
| `server/store/**` | handle database | `server/model` |
|
||||||
|
| `server/shared/**` | TODO: move and split [#974](https://github.com/woodpecker-ci/woodpecker/issues/974) | |
|
||||||
|
| `server/web/**` | server SPA | |
|
||||||
|
|
||||||
|
- `../` = `server/`
|
||||||
|
|
||||||
|
### Agent
|
||||||
|
|
||||||
|
TODO
|
||||||
|
|
||||||
|
### CLI
|
||||||
|
|
||||||
|
TODO
|
24
docs/versioned_docs/version-2.4/92-development/06-guides.md
Normal file
|
@ -0,0 +1,24 @@
|
||||||
|
# Guides
|
||||||
|
|
||||||
|
## ORM
|
||||||
|
|
||||||
|
Woodpecker uses [Xorm](https://xorm.io/) as ORM for the database connection.
|
||||||
|
You can find its documentation at [gobook.io/read/gitea.com/xorm](https://gobook.io/read/gitea.com/xorm/manual-en-US/).
|
||||||
|
|
||||||
|
## Add a new migration
|
||||||
|
|
||||||
|
Woodpecker uses migrations to change the database schema if a database model has been changed. Add the new migration task into `server/store/datastore/migration/`.
|
||||||
|
|
||||||
|
:::info
|
||||||
|
Adding new properties to models will be handled automatically by the underlying [ORM](#orm) based on the [struct field tags](https://stackoverflow.com/questions/10858787/what-are-the-uses-for-tags-in-go) of the model. If you add a completely new model, you have to add it to the `allBeans` variable at `server/store/datastore/migration/migration.go` to get a new table created.
|
||||||
|
:::
|
||||||
|
|
||||||
|
:::warning
|
||||||
|
You should not use `sess.Begin()`, `sess.Commit()` or `sess.Close()` inside a migration. Session / transaction handling will be done by the underlying migration manager.
|
||||||
|
:::
|
||||||
|
|
||||||
|
To automatically execute the migration after the start of the server, the new migration needs to be added to the end of `migrationTasks` in `server/store/datastore/migration/migration.go`. After a successful execution of that transaction the server will automatically add the migration to a list, so it won't be executed again on the next start.
|
||||||
|
|
||||||
|
## Constants of official images
|
||||||
|
|
||||||
|
All official default images, are saved in [shared/constant/constant.go](https://github.com/woodpecker-ci/woodpecker/blob/main/shared/constant/constant.go) and must be pinned by an exact tag.
|
|
@ -0,0 +1,9 @@
|
||||||
|
# Translations
|
||||||
|
|
||||||
|
To translate the web UI into your language, we have [our own Weblate instance](https://translate.woodpecker-ci.org/). Please register there and translate Woodpecker into your language. **We won't accept PRs changing any language except English.**
|
||||||
|
|
||||||
|
<a href="https://translate.woodpecker-ci.org/engage/woodpecker-ci/">
|
||||||
|
<img src="https://translate.woodpecker-ci.org/widgets/woodpecker-ci/-/ui/multi-blue.svg" alt="Translation status" />
|
||||||
|
</a>
|
||||||
|
|
||||||
|
Woodpecker uses [Vue I18n](https://vue-i18n.intlify.dev/) as translation library.
|
63
docs/versioned_docs/version-2.4/92-development/08-swagger.md
Normal file
|
@ -0,0 +1,63 @@
|
||||||
|
# Swagger, API Spec and Code Generation
|
||||||
|
|
||||||
|
Woodpecker uses [gin-swagger](https://github.com/swaggo/gin-swagger) middleware to automatically
|
||||||
|
generate Swagger v2 API specifications and a nice looking Web UI from the source code.
|
||||||
|
Also, the generated spec will be transformed into Markdown, using [go-swagger](https://github.com/go-swagger/go-swagger)
|
||||||
|
and then being using on the community's website documentation.
|
||||||
|
|
||||||
|
It's paramount important to keep the gin handler function's godoc documentation up-to-date,
|
||||||
|
to always have accurate API documentation.
|
||||||
|
Whenever you change, add or enhance an API endpoint, please update the godocs.
|
||||||
|
|
||||||
|
You don't require any extra tools on your machine, all Swagger tooling is automatically fetched by standard Go tools.
|
||||||
|
|
||||||
|
## Gin-Handler API documentation guideline
|
||||||
|
|
||||||
|
Here's a typical example of how annotations for Swagger documentation look like...
|
||||||
|
|
||||||
|
```go title="server/api/user.go"
|
||||||
|
// @Summary Get a user
|
||||||
|
// @Description Returns a user with the specified login name. Requires admin rights.
|
||||||
|
// @Router /users/{login} [get]
|
||||||
|
// @Produce json
|
||||||
|
// @Success 200 {object} User
|
||||||
|
// @Tags Users
|
||||||
|
// @Param Authorization header string true "Insert your personal access token" default(Bearer <personal access token>)
|
||||||
|
// @Param login path string true "the user's login name"
|
||||||
|
// @Param foobar query string false "optional foobar parameter"
|
||||||
|
// @Param page query int false "for response pagination, page offset number" default(1)
|
||||||
|
// @Param perPage query int false "for response pagination, max items per page" default(50)
|
||||||
|
```
|
||||||
|
|
||||||
|
```go title="server/model/user.go"
|
||||||
|
type User struct {
|
||||||
|
ID int64 `json:"id" xorm:"pk autoincr 'user_id'"`
|
||||||
|
// ...
|
||||||
|
} // @name User
|
||||||
|
```
|
||||||
|
|
||||||
|
These guidelines aim to have consistent wording in the swagger doc:
|
||||||
|
|
||||||
|
- first word after `@Summary` and `@Summary` are always uppercase
|
||||||
|
- `@Summary` has no `.` (dot) at the end of the line
|
||||||
|
- model structs shall use custom short names, to ease life for API consumers, using `@name`
|
||||||
|
- `@Success` object or array declarations shall be short, this means the actual `model.User` struct must have a `@name` annotation, so that the model can be renderend in Swagger
|
||||||
|
- when pagination is used, `@Parame page` and `@Parame perPage` must be added manually
|
||||||
|
- `@Param Authorization` is almost always present, there are just a few un-protected endpoints
|
||||||
|
|
||||||
|
There are many examples in the `server/api` package, which you can use a blueprint.
|
||||||
|
More enhanced information you can find here <https://github.com/swaggo/swag/blob/master/README.md#declarative-comments-format>
|
||||||
|
|
||||||
|
### Manual code generation
|
||||||
|
|
||||||
|
```bash title="generate the server's Go code containing the Swagger"
|
||||||
|
make generate-swagger
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash title="update the Markdown in the ./docs folder"
|
||||||
|
make docs
|
||||||
|
```
|
||||||
|
|
||||||
|
```bash title="auto-format swagger related godoc"
|
||||||
|
go run github.com/swaggo/swag/cmd/swag@latest fmt -g server/api/z.go
|
||||||
|
```
|
|
@ -0,0 +1,4 @@
|
||||||
|
label: 'Development'
|
||||||
|
# position: 3
|
||||||
|
collapsible: true
|
||||||
|
collapsed: true
|
16
docs/versioned_docs/version-2.4/92-development/ui-proxy.svg
Normal file
After Width: | Height: | Size: 7.5 KiB |
BIN
docs/versioned_docs/version-2.4/92-development/vscode-debug.png
Normal file
After Width: | Height: | Size: 17 KiB |
After Width: | Height: | Size: 11 KiB |
After Width: | Height: | Size: 61 KiB |
BIN
docs/versioned_docs/version-2.4/woodpecker.png
Normal file
After Width: | Height: | Size: 70 KiB |
8
docs/versioned_sidebars/version-2.4-sidebars.json
Normal file
|
@ -0,0 +1,8 @@
|
||||||
|
{
|
||||||
|
"tutorialSidebar": [
|
||||||
|
{
|
||||||
|
"type": "autogenerated",
|
||||||
|
"dirName": "."
|
||||||
|
}
|
||||||
|
]
|
||||||
|
}
|
|
@ -1 +1 @@
|
||||||
["2.3", "2.2", "2.1", "2.0", "1.0", "0.15"]
|
["2.4", "2.3", "2.2", "2.1", "2.0", "1.0", "0.15"]
|
||||||
|
|