-
Notifications
You must be signed in to change notification settings - Fork 815
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feature: Metaflow end-to-end testing GHA (#2336)
uses the newly introduced `metaflow-dev` to spin up a complete stack for end-to-end testing inside GHA
- Loading branch information
Showing
1 changed file
with
43 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,43 @@ | ||
name: Test Metaflow with complete Kubernetes stack | ||
|
||
on: | ||
push: | ||
branches: | ||
- master | ||
pull_request: | ||
branches: | ||
- master | ||
|
||
jobs: | ||
test: | ||
runs-on: ubuntu-latest | ||
|
||
steps: | ||
- name: Check out source | ||
uses: actions/checkout@v4 | ||
|
||
- name: Install Metaflow | ||
run: | | ||
python -m pip install --upgrade pip | ||
pip install . kubernetes | ||
- name: Bring up the environment | ||
run: | | ||
echo "Starting environment in the background..." | ||
MINIKUBE_CPUS=2 metaflow-dev all-up & | ||
# Give time to spin up. Adjust as needed: | ||
sleep 150 | ||
- name: Wait & run flow | ||
run: | | ||
# When the environment is up, metaflow-dev shell will wait for readiness | ||
# and then drop into a shell. We feed commands via a heredoc: | ||
cat <<EOF | metaflow-dev shell | ||
echo "Environment is ready; running flow now..." | ||
python metaflow/tutorials/00-helloworld/helloworld.py run --with kubernetes | ||
EOF | ||
- name: Tear down environment | ||
run: | | ||
metaflow-dev down |