Skip to content

docs: add devbox-based local development guide#7294

Merged
pingsutw merged 7 commits intomainfrom
docs/devbox-local-setup
Apr 29, 2026
Merged

docs: add devbox-based local development guide#7294
pingsutw merged 7 commits intomainfrom
docs/devbox-local-setup

Conversation

@pingsutw
Copy link
Copy Markdown
Member

@pingsutw pingsutw commented Apr 28, 2026

Why are the changes needed?

New contributors had no documented path for running a full Flyte stack locally. The existing manager/README.md was also stale: it referenced a Queue Service and State Service that no longer exist, claimed SQLite as the backend, and listed an outdated set of services.

What changes were proposed in this pull request?

  • Add a Running Flyte Locally section to CONTRIBUTING.md covering make devbox-build, make devbox-run FLYTE_DEV=true, make devbox-stop, and make -C manager run, plus a manager/config.yaml snippet and a pointer to manager/README.md.
  • Refresh manager/README.md to match the current code:
    • Replace the make build / "bring your own cluster" instructions with the devbox flow.
    • Drop the non-existent Queue Service and State Service; document the actual services (Runs, Executor/Operator, Actions, DataProxy, Events, Cache, Secret, App + Internal App Proxy).
    • Switch the database story from SQLite to PostgreSQL (config snippet, psql usage, Docker example, architecture diagram).
    • Rewrite the architecture diagram and "How It Works" flow so the Actions Service correctly watches TaskAction CRs and forwards updates to the SDK controller via WatchForUpdates.
    • Update the API Endpoints section to list the Connect handlers actually mounted in runs/setup.go and actions/setup.go.

How was this patch tested?

Documentation-only change. Verified by running the documented flow locally:

  • make devbox-build
  • make devbox-run FLYTE_DEV=true
  • make -C manager run

Labels

  • changed

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Comment thread CONTRIBUTING.md Outdated
Comment thread manager/README.md Outdated
@pingsutw pingsutw changed the base branch from v2 to main April 28, 2026 18:53
Copilot AI review requested due to automatic review settings April 28, 2026 19:01
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR aims to improve contributor documentation for running a full Flyte stack locally (devbox + locally running flyte-manager) and refreshes the manager docs to match the current Flyte 2 service layout.

Changes:

  • Added a “Running Flyte Locally” section to CONTRIBUTING.md describing the devbox workflow and manager configuration.
  • Updated manager/README.md to reflect current services/endpoints and Postgres usage.
  • Added several new top-level docs/config/scripts (including a tarball artifact) that appear duplicative or out-of-scope for a docs-only PR.

Reviewed changes

Copilot reviewed 7 out of 8 changed files in this pull request and generated 9 comments.

Show a summary per file
File Description
CONTRIBUTING.md Adds devbox-based local development instructions and a sample manager/config.yaml snippet.
manager/README.md Refreshes manager service list, endpoints, and “How it works” narrative.
start-rustfs.sh Adds a RustFS startup script (but duplicates existing scripts/start-rustfs.sh).
config/k3d/cluster.yaml Adds a k3d cluster config file (currently appears unused/unreferenced).
BACKEND_README.md Adds a backend overview doc (duplicates docs/BACKEND_README.md and appears outdated).
DOCKER_QUICK_START.md Adds a Docker quick-start doc (duplicates docs/DOCKER_QUICK_START.md).
IMPLEMENTATION_SPEC.md Adds an implementation spec (duplicates docs/IMPLEMENTATION_SPEC.md and references non-existent packages).
fast.tar.gz Adds an unreferenced binary tarball artifact.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread start-rustfs.sh
Comment thread config/k3d/cluster.yaml Outdated
Comment thread CONTRIBUTING.md Outdated
Comment thread BACKEND_README.md Outdated
Comment thread IMPLEMENTATION_SPEC.md
Comment thread start-rustfs.sh
Comment thread BACKEND_README.md Outdated
Comment thread DOCKER_QUICK_START.md
Comment thread manager/README.md Outdated
@pingsutw pingsutw changed the base branch from main to v2 April 28, 2026 19:15
@pingsutw pingsutw force-pushed the docs/devbox-local-setup branch from ddf8b5f to 5a8c796 Compare April 28, 2026 19:15
Document how to run a full Flyte stack locally using `make devbox-build`,
`make devbox-run FLYTE_DEV=true`, and `make -C manager run`. Update
manager/README.md to reflect the current service set (no Queue/State
service), the PostgreSQL backend, and the actual API surface, and add a
matching "Running Flyte Locally" section to CONTRIBUTING.md.

Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Kevin Su <pingsutw@apache.org>
@pingsutw pingsutw changed the base branch from v2 to main April 28, 2026 19:20
Copilot AI review requested due to automatic review settings April 28, 2026 19:20
@pingsutw pingsutw force-pushed the docs/devbox-local-setup branch from 5a8c796 to b4ecf96 Compare April 28, 2026 19:20
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread manager/README.md Outdated
Comment thread manager/README.md Outdated
Comment thread CONTRIBUTING.md
Comment thread CONTRIBUTING.md Outdated
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Kevin Su <pingsutw@gmail.com>
Copilot AI review requested due to automatic review settings April 28, 2026 19:39
pingsutw and others added 2 commits April 28, 2026 12:39
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Kevin Su <pingsutw@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Kevin Su <pingsutw@gmail.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 5 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread manager/README.md
Comment thread manager/README.md
Comment thread CONTRIBUTING.md
Comment thread CONTRIBUTING.md
Comment thread CONTRIBUTING.md
Signed-off-by: Kevin Su <pingsutw@apache.org>
@pingsutw pingsutw added this pull request to the merge queue Apr 29, 2026
Merged via the queue into main with commit a5546a6 Apr 29, 2026
18 checks passed
@pingsutw pingsutw deleted the docs/devbox-local-setup branch April 29, 2026 21:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants