[chore] Add Docker test pipeline (open-telemetry#837)

mowies · web-flow · commit ce900446e8df · 2025-03-05T10:15:39.000Z
* initial testing Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try to build images again Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> ignore darwin ppc64le build Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try with conditional Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix expression Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try again Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> debugging Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> and again Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> disable windows/ppc64le Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> remove ppc64le from darwin and windows builds Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more debugging Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try agian Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> again Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try using tojson and not fromjson Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> extract data from files directly Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> finally getting somewhere Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more jq changes Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more variables Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> remove newlines Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> remove quotes Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try removing quotes in jq commands Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> extract goos and goarch from tar.gz artifacts Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> use correct path Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try with different conditional Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> adjust paths again Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try adding quotes Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> try different conditional Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> dfebugging Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> sanity check Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix conditional, try to fix quotes Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> copy binary before building image Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add first docker test steps Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix matrix reference Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> reduce pipeline debugging demand Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> exclude darwin and windows docker tests Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> remove darwin for now Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> debugging of paths Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix path Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> change from docker ps to docker logs Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> set entrypoint manually Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> change from import to load Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> almost there Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix version Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> set name explicitely Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more output Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> redirect stderr to stdout Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> better output Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> more debug output Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> fix newlines Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> use special test config file Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> forgot backslash... Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add pwd Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> do loopback Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> Revert "reduce pipeline debugging demand" This reverts commit b858523. remove maybe unneeded steps Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add back download step Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add back qemu action Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add back checkout step Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> add back qemu step Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> revert removal of windows/ppc64le variant Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> revert matrix configs Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> * remove darwin/ppc64le variant from CI since no artifacts are built there Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> * only run docker test steps on linux Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com> --------- Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com>
diff --git a/.github/workflows/base-ci-goreleaser.yaml b/.github/workflows/base-ci-goreleaser.yaml
@@ -46,6 +46,8 @@ jobs:
           - GOOS: windows
             GOARCH: ppc64le
     runs-on: ubuntu-24.04
+    outputs:
+      version: ${{ steps.prep.outputs.version }}
 
     steps:
       - name: Checkout
@@ -165,6 +167,9 @@ jobs:
       - name: Print built artifacts
         run: cat ./distributions/${{ inputs.distribution }}/dist/**/artifacts.json
 
+      - name: Print metadata
+        run: cat ./distributions/${{ inputs.distribution }}/dist/**/metadata.json
+
       - name: Print dist folder contents
         if: always()
         run: ls -laR ./distributions/${{ inputs.distribution }}/dist
@@ -184,3 +189,109 @@ jobs:
           name: msi-packages
           path: distributions/${{ inputs.distribution }}/dist/windows_amd64_v1/**/*.msi
           if-no-files-found: error
+
+      - name: Prepare variables
+        if: matrix.GOOS == 'linux'
+        id: prep
+        run: |
+          # Find version number and types of built artifacts
+          echo "version=$(cat ./distributions/${{ inputs.distribution }}/dist/**/metadata.json | jq -r '.version')" >> "$GITHUB_OUTPUT"
+          echo "types=$(cat ./distributions/${{ inputs.distribution }}/dist/**/artifacts.json | jq '[.[].type]' | tr -d '\n' )" >> "$GITHUB_OUTPUT"
+          
+          # Find GOOS and GOARCH
+          os=$(cat ./distributions/${{ inputs.distribution }}/dist/**/artifacts.json | jq -r '.[] | select(.name | contains(".tar.gz")) | .goos')
+          arch=$(cat ./distributions/${{ inputs.distribution }}/dist/**/artifacts.json | jq -r '.[] | select(.name | contains(".tar.gz")) | .goarch')
+          echo "arch=$os-$arch" >> "$GITHUB_OUTPUT"
+          
+          # Find binary path
+          echo "binary-path=$(cat ./distributions/${{ inputs.distribution }}/dist/**/artifacts.json | jq -r 'map(select(any(.type; contains("Binary")))) | .[].path' )" >> "$GITHUB_OUTPUT"
+
+      - name: Print version and target
+        if: matrix.GOOS == 'linux'
+        run: |
+          echo 'Version: ${{ steps.prep.outputs.version }}'
+          echo 'Types: ${{ steps.prep.outputs.types }}'
+          echo 'Arch: ${{ steps.prep.outputs.arch }}'
+          echo 'Images?: ${{ steps.prep.outputs.container-images }}'
+
+      - name: Copy binary to distro root folder
+        if: matrix.GOOS == 'linux'
+        run: cp ./distributions/${{ inputs.distribution }}/${{ steps.prep.outputs.binary-path }} ./distributions/${{ inputs.distribution }}
+
+      - name: Build container images locally
+        if: matrix.GOOS == 'linux' && contains(steps.prep.outputs.types, 'Docker Image')
+        uses: docker/build-push-action@0adf9959216b96bec444f325f1e493d4aa344497 # v6.14.0
+        with:
+          context: ./distributions/${{ inputs.distribution }}
+          push: false
+          load: true
+          tags: ${{ inputs.distribution }}:${{ steps.prep.outputs.version }}-${{ steps.prep.outputs.arch }}
+
+      - name: Export container image to tarball
+        if: matrix.GOOS == 'linux' && contains(steps.prep.outputs.types, 'Docker Image')
+        run: |
+          docker save ${{ inputs.distribution }}:${{ steps.prep.outputs.version }}-${{ steps.prep.outputs.arch }} > /tmp/${{ inputs.distribution }}.tar
+
+      - name: Upload container image artifact
+        if: matrix.GOOS == 'linux' && contains(steps.prep.outputs.types, 'Docker Image')
+        uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0
+        with:
+          name: ${{ inputs.distribution }}-image-${{ steps.prep.outputs.version }}-${{ steps.prep.outputs.arch }}
+          path: /tmp/${{ inputs.distribution }}.tar
+          retention-days: 7
+
+  docker-tests:
+    needs:
+      - check-goreleaser
+    strategy:
+      matrix:
+        GOOS: ${{ fromJSON( inputs.goos) }}
+        GOARCH: ${{ fromJSON( inputs.goarch) }}
+        exclude:
+          - GOOS: darwin
+          - GOOS: windows
+    runs-on: ubuntu-24.04
+    steps:
+      - name: Checkout
+        uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
+
+      - name: Setup QEMU
+        uses: docker/setup-qemu-action@4574d27a4764455b42196d70a065bc6853246a25 # v3.4.0
+        with:
+          platforms: arm64,ppc64le,linux/arm/v7,s390x
+
+      - name: Download container image artifact
+        uses: actions/download-artifact@cc203385981b70ca67e1cc392babf9cc229d5806 #v4.1.9
+        with:
+          name: ${{ inputs.distribution }}-image-${{ needs.check-goreleaser.outputs.version }}-${{ matrix.GOOS }}-${{ matrix.GOARCH }}
+
+      - name: Load image into docker
+        run: |
+          docker image load --input ./${{ inputs.distribution }}.tar
+          docker image ls
+          docker image inspect ${{ inputs.distribution }}:${{ needs.check-goreleaser.outputs.version }}-${{ matrix.GOOS }}-${{ matrix.GOARCH }}
+
+      - name: Run container image
+        run: |
+          echo "Running container..."
+          docker run --name ${{ inputs.distribution }} \
+            -d \
+            -v ${PWD}/tests/docker-tests/default-config.yaml:/config.yaml \
+            ${{ inputs.distribution }}:${{ needs.check-goreleaser.outputs.version }}-${{ matrix.GOOS }}-${{ matrix.GOARCH }} \
+            --config /config.yaml
+          echo "docker ps:"
+          echo ""
+          docker ps
+          echo "Sleeping for a bit..."
+          sleep 10
+          echo "Checking logs for correct startup..."
+          docker logs ${{ inputs.distribution }} >& docker-logs-${{ inputs.distribution }}.log
+          if cat docker-logs-${{ inputs.distribution }}.log | grep "Everything is ready."; then
+            echo "${{ inputs.distribution }} started up correctly"
+          else
+            echo "${{ inputs.distribution }} failed to start"
+            echo "Printing container logs below..."
+            echo ""
+            cat docker-logs-${{ inputs.distribution }}.log
+            exit 1
+          fi
diff --git a/tests/docker-tests/default-config.yaml b/tests/docker-tests/default-config.yaml
@@ -0,0 +1,17 @@
+
+receivers:
+  otlp:
+    protocols:
+      grpc:
+        endpoint: 0.0.0.0:4317
+
+exporters:
+  otlphttp:
+    endpoint: "http://0.0.0.0:4317"
+
+service:
+  pipelines:
+    metrics:
+      receivers: [otlp]
+      processors: []
+      exporters: [otlphttp]
