Skip to content

Commit 762d9df

Browse files
address reviews
Signed-off-by: prashant-gurung899 <prasantgrg777@gmail.com>
1 parent 1a66dea commit 762d9df

File tree

3 files changed

+33
-23
lines changed

3 files changed

+33
-23
lines changed

oauth.png

60.5 KB
Loading
60.5 KB
Loading

src/assets/woodpeckerCI/woodpeckerCI.md

Lines changed: 33 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -4,14 +4,14 @@ authorName: Prashant Gurung
44
authorAvatar: https://avatars.githubusercontent.com/u/53248463?v=4
55
authorLink: https://github.com/prashant-gurung899
66
createdAt: July 3, 2025
7-
tags: CI/CD
7+
tags: CI/CD, Woodpecker, starlark, docker-compose, Traefik, WCCS
88
banner: https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/cover.png
99
---
1010

1111
## Background
12-
Continuous Integration (CI) tools are vital for automating the testing and deployment of modern software. One such open-source tool is Woodpecker CI, a lightweight CI/CD system. Woodpecker CI is an open-source continuous integration and delivery platform that helps developers automate building, testing, and deploying their code. It is a community-driven fork and successor of the popular Drone CI project, sharing many design principles and compatibility with Drone pipelines. Traditionally, Woodpecker pipelines are written in YAML. But with the rise of programmable pipelines, we now have the flexibility to define our CI configuration using Starlark — a Python-like configuration language.
12+
Continuous Integration tools are essential to build and test modern software automatically and regularly. Woodpecker CI is one such open-source tool, a lightweight CI/CD system. Woodpecker CI is an open-source continuous integration and delivery system that help developers in automating deployment, builds, and testing of code. It's an open-source fork and alternative to the popular Drone CI project with numerous design similarities and Drone pipeline compatibility. Traditionally, Woodpecker pipelines are YAML, but now that programmable pipelines are in vogue, we can finally have the liberty of defining our CI configuration through Starlark — a Python-ish config language.
1313

14-
In this blog, I’ll walk you through setting up Woodpecker CI with Traefik as a reverse proxy and integrating it with WCCS (Woodpecker CI Config Service) to convert Starlark configurations into YAML files, enabling us to write pipelines in .woodpecker.star files. Here's a high-level view of what we'll cover:
14+
In this article, I will walk you through setting up Woodpecker CI with Traefik as a reverse proxy and [WCCS](https://github.com/opencloud-eu/woodpecker-ci-config-service/) (Woodpecker CI Config Service) to convert Starlark configurations into YAML files so that we can write pipelines in `.star` files. Here is a high-level overview of what we are going through:
1515

1616
- Spinning up a Woodpecker server with Traefik
1717

@@ -24,12 +24,14 @@ In this blog, I’ll walk you through setting up Woodpecker CI with Traefik as a
2424
By the end, you’ll be able to write CI pipelines in Starlark and dynamically convert them to YAML during runtime.
2525

2626
## Prepare Woodpecker secrets via .env
27+
Create a `.env` file to store your environment variables.
28+
2729
```console
2830
#Your woodpecker host
2931
WOODPECKER_HOST=https://<your-ci-server>
3032

3133

32-
# GitHub OAuth Secrets
34+
# GitHub OAuth app Secrets - We'll create OAuth app later
3335
WOODPECKER_GITHUB_CLIENT=XXXXXXXXXXXXXXXX
3436
WOODPECKER_GITHUB_SECRET=XXXXXXXXXXXXXXXXXXXXXXXX
3537

@@ -38,12 +40,13 @@ WOODPECKER_GITHUB_SECRET=XXXXXXXXXXXXXXXXXXXXXXXX
3840
WOODPECKER_AGENT_SECRET=<generated-secret>
3941

4042

41-
# Let’s Encrypt contact email (Traefik will use this)
43+
# letsEncrypt contact email (Traefik will use this)
4244
ACME_EMAIL=admin@example.com
4345
```
4446

4547
## Traefik Configuration
46-
Traefik plays a crucial role in this architecture by handling all the networking complexities - SSL termination, routing, and load balancing
48+
Traefik plays a crucial role in this architecture by handling all the networking complexities - SSL termination, routing, and load balancing.
49+
Create a `docker-compose.yml` file and add the following Traefik service configuration:
4750

4851
```yml
4952
version: "3.9"
@@ -75,12 +78,12 @@ services:
7578
This configuration:
7679
7780
- Sets up Traefik to listen on ports 80 and 443
78-
- Configures Let's Encrypt for automatic SSL certificate management
81+
- Configures automatic SSL certificate management via [letsEncrypt](https://letsencrypt.org/)
7982
- Enables Docker provider to automatically detect new services
8083
- Mounts necessary volumes for certificate storage and Docker socket access
8184
8285
## Setting Up Woodpecker Server and Agent
83-
Now that we have Traefik running, let's set up the Woodpecker server and agent services. Here's the essential setup:
86+
Now that we have Traefik running, let's set up the Woodpecker server and agent services in the same `docker-compose.yml` file:
8487

8588
```yml
8689
woodpecker-server:
@@ -133,11 +136,15 @@ Now that we have Traefik running, let's set up the Woodpecker server and agent s
133136
134137
## Authenticating with GitHub
135138
139+
Woodpecker cannot do anything by itself, it needs a forge (the service where the repositories are hosted). Woodpecker supports [various forges](https://woodpecker-ci.org/docs/administration/configuration/forges/overview), for this blog we will focus on GitHub.
140+
136141
To connect GitHub with Woodpecker:
137142
138-
1. Register a new OAuth application in your GitHub developer settings.
143+
1. Register a new OAuth application in your GitHub developer [settings](https://github.com/settings/applications/new).
144+
145+
2. In your GitHub OAuth App, set the authorization callback URL to `https://<your-ci-server>/authorize`
139146

140-
2. Set the callback URL to `https://<your-ci-server>/authorize`
147+
![Callback URL](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/oauth.png)
141148

142149
3. Copy the generated Client ID and Secret.
143150

@@ -161,26 +168,19 @@ From the Woodpecker UI:
161168
Woodpecker will automatically add the necessary webhooks to the repo.
162169

163170

164-
After enabling your desired repository, there's one more thing that you need to do i.e. to set pipeline config path.
165-
166-
- From the settings of your Woodpecker Server, go to repositories and click on the enabled repo's settings icon as shown below:
167-
168-
![Settings](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/settings.png)
169-
170-
- Then, add `.woodpecker.star` as pipeline config path and save it:
171-
172-
![Pipeline Config](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/path.png)
173-
174171
## Generating the Public Key
172+
Before running any pipeline, woodpecker server sends a POST request to an external config service (in our case WCCS) with all current config file and build information of the current repository. The external service takes the information and sends back the pipeline configurations. In our case, this is how a starlark file is being converted into yaml configurations.
173+
175174
Every request sent by Woodpecker is signed using a http-signature by a private key (ed25519) generated on the first start of the Woodpecker server. You can get the public key for the verification of the http-signature from:
176175
```console
177-
http(s)://your-ci-server/api/signature/public-key
176+
https://<your-ci-server>/api/signature/public-key
178177
```
179178
Store that public key into `keys/public.pem` in the same directory level as your docker compose, it will be needed for signature verification.
180179

181180
## Setting Up WCCS-Woodpecker CI Config Service (Starlark Conversion Service)
182181
The Woodpecker Config Conversion Service (WCCS) is a lightweight web service created and maintained by [Opencloud-eu](https://opencloud.eu/en). It enables Woodpecker CI to convert pipeline definitions written in Starlark into standard YAML on the fly by receiving a signed POST request from Woodpecker.
183182
You can easily deploy WCCS using their official Docker image available on Docker Hub: [opencloudeu/wccs](https://hub.docker.com/r/opencloudeu/wccs).
183+
Update your `docker-compose.yml` to include the WCCS service:
184184
```yml
185185
wccs:
186186
image: opencloudeu/wccs:latest
@@ -215,7 +215,17 @@ To allow Woodpecker to fetch pipeline configs from WCCS, we added this to the se
215215
```console
216216
WOODPECKER_CONFIG_SERVICE_ENDPOINT=http://wccs:8080/ciconfig
217217
```
218-
Woodpecker now sends a signed JSON payload to WCCS whenever a build is triggered. WCCS verifies the signature using the public key and responds with a YAML pipeline based on your .woodpecker.star file.
218+
Woodpecker now sends a signed JSON payload to WCCS whenever a build is triggered. WCCS verifies the signature using the public key and responds with a YAML pipeline based on your `.woodpecker.star` file.
219+
220+
After conneting WCCS with the woodpecker server, there's one more thing that you need to do i.e. to set pipeline config path, because by default Woodpecker will take `.woodpecker.yaml` as it's pipeline configuration.
221+
222+
- From the settings of your Woodpecker server, go to `Repositories` and click on the enabled repo's settings icon as shown below:
223+
224+
![Settings](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/settings.png)
225+
226+
- Then, add `.woodpecker.star` as pipeline config path and save it:
227+
228+
![Pipeline Config](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/path.png)
219229

220230
## Add a Simple Starlark Pipeline
221231
Here's a simple `.woodpecker.star` example that you can add in your project's root and you're all set:
@@ -241,7 +251,7 @@ def main(ctx):
241251

242252
## Triggering Your First CI Run
243253
Now that you have your `.woodpecker.star` file ready, commit and push it to your GitHub repository and then, open a Pull Request from your branch <your-branch-name> to master.
244-
Once the PR is created, Woodpecker will automatically send the build request to WCCS, fetch the pipeline config, and start your first CI run. You can head over to the Woodpecker UI to watch the build logs in real time.
254+
Once the PR is created, Woodpecker will automatically send a build request to WCCS, fetch the pipeline configuration, and start your first CI run. You can then head over to the Woodpecker UI to watch the build logs in real time.
245255

246256
![Converted Yaml](https://raw.githubusercontent.com/JankariTech/blog/woodpecker-ci-starlark/src/assets/woodpeckerCI/images/converted.png)
247257

0 commit comments

Comments
 (0)