Setup test automation for github org tests (#678)

Signed-off-by: Andrea Lamparelli <a.lamparelli95@gmail.com>

Author: lampajr

.github/ISSUE_TEMPLATE/join_org.md

@@ -31,4 +31,4 @@ Please read the [guidelines](https://www.kubeflow.org/docs/about/contributing/#j
 ## Additional Instructions
 - After your PR is merged please wait at least 1 hour for changes to propagate.
 - You will receive an email invite (to your GitHub associated email address) to join Kubeflow on GitHub. Follow the instructions on the email to accept your invitation.
-- If after an hour you haven't received an invite to join the GitHub org (or your invite has expired) please open an issue with an [owner](../../OWNERS) tagged to request follow-up.
+- If after an hour you haven't received an invite to join the GitHub org (or your invite has expired) please open an issue with an [owner](../../OWNERS) tagged to request follow-up.

.github/requirements.txt

@@ -0,0 +1,2 @@
+pytest==8.2.0
+PyYAML==6.0.1

.github/workflows/github_org_test.yaml

@@ -0,0 +1,30 @@
+name: Github Org Tests
+on:
+  pull_request:
+    paths:
+      - github-orgs/kubeflow/org.yaml
+      - .github/workflows/github_org_test.yaml
+jobs:
+  tests:
+    runs-on: ubuntu-latest
+    env:
+      PYTHON_VERSION: "3.10"
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v4
+
+    - name: Set up Python ${{ env.PYTHON_VERSION }}
+      uses: actions/setup-python@v5
+      with:
+        python-version: ${{ env.PYTHON_VERSION }}
+        cache: "pip"
+
+    - name: Install PyTest
+      run: |
+        pip install -r .github/requirements.txt
+        pytest --version
+
+    - name: Run tests
+      working-directory: ./github-orgs
+      run: |
+        pytest test_org_yaml.py

README.md

@@ -4,8 +4,8 @@ Repository used to maintain group ACLs used by the Kubeflow community.
 
 For Google Groups in kubeflow.org, refer to `google_groups` subfolder.
 
-Run `pytest` after modifying `org.yaml`. Currently, this must be run
-manually. This test run automatically in a future change.
+To check if everything is fine after modifying `org.yaml`, you can run
+`pytest` locally from `github-orgs` directory.
 
 ## Joining the Kubeflow GitHub organization