Skip to content

Add rank-affine managed image reward processes - #2

Open
nussejzz wants to merge 4 commits into
feat/diffusion-residency-lifecyclefrom
feat/managed-image-reward
Open

Add rank-affine managed image reward processes#2
nussejzz wants to merge 4 commits into
feat/diffusion-residency-lifecyclefrom
feat/managed-image-reward

Conversation

@nussejzz

Copy link
Copy Markdown
Owner

Summary

  • launch one bounded scorer child per reward rank in an explicit Python environment without extra Ray GPU allocation
  • add image/image-edit wire decoding, stable request chunking, identity/version checks, and deterministic idempotency
  • expose resident, per-call, offload/onload, drain, and graceful shutdown lifecycles
  • make EditReward support explicit model, dtype, head, batching, and device lifecycle configuration

This is PR 2 of a 3-PR stack and is based on PR 1.

Test plan

  • 25 managed reward and wire contract tests
  • inherited-socket real child-process smoke
  • Hydra config resolution and 2,286 recipe target checks
  • pre-commit checks
  • top-of-stack rank-affine EditReward DP8 smoke

Made with Cursor

Launch bounded single-scorer children in explicit Python environments, preserve rank-local GPU affinity, and harden the HTTP protocol with chunking, identity, lifecycle, and idempotent retries.

Co-authored-by: Cursor <cursoragent@cursor.com>
nussejzz and others added 3 commits August 2, 2026 14:05
Keep the managed reward pull request focused on production code by dropping its standalone tests and inherited design artifacts.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant