Add sleep/wake support for diffusion engine#22659

Open

MikukuOvO wants to merge 73 commits intosgl-project:mainfrom

MikukuOvO:dev/pr-19152-sleep-wake-rebased

Commits on Apr 12, 2026

add release and resume handle in scheduler

klhhhhh
authored and
MikukuOvO
committed
implement release and resume memory in gpu worker

klhhhhh
authored and
MikukuOvO
committed
update release and resume api in http server

klhhhhh
authored and
MikukuOvO
committed
pre-commit lint

klhhhhh
authored and
MikukuOvO
committed
remove tags for diffusion models and update io_struct in post training

klhhhhh
authored and
MikukuOvO
committed
adjust tags in function call

klhhhhh
authored and
MikukuOvO
committed
implement new wake sleep func directly use get updated module in pipeline

klhhhhh
authored and
MikukuOvO
committed
run lint

klhhhhh
authored and
MikukuOvO
committed
Implement new wake and sleep also add sanitize moving part for modules

klhhhhh
authored and
MikukuOvO
committed
refactor weight api

klhhhhh
authored and
MikukuOvO
committed
Retrun correct status code call generation when sleeping

klhhhhh
authored and
MikukuOvO
committed
update comment

klhhhhh
authored and
MikukuOvO
committed
update lint

klhhhhh
authored and
MikukuOvO
committed
refactor all the code

klhhhhh
authored and
MikukuOvO
committed
refactor all the code

klhhhhh
authored and
MikukuOvO
committed
refactor gpu_worker and utils in openai entrypoint

klhhhhh
authored and
MikukuOvO
committed
fix bugs in utils

klhhhhh
authored and
MikukuOvO
committed
fix bugs in utils

klhhhhh
authored and
MikukuOvO
committed
fix bugs in weight api

klhhhhh
authored and
MikukuOvO
committed
fix comment in wake func

klhhhhh
authored and
MikukuOvO
committed
refactor wake func

klhhhhh
authored and
MikukuOvO
committed
add test wake sleep in ci

klhhhhh
authored and
MikukuOvO
committed
adds pytest entry

zhaochenyang20
authored and
MikukuOvO
committed
fix race condition

zhaochenyang20
authored and
MikukuOvO
committed
refactor process generation batch

klhhhhh
authored and
MikukuOvO
committed
fix bugs:access output using details

klhhhhh
authored and
MikukuOvO
committed
change test name

klhhhhh
authored and
MikukuOvO
committed
avoid worker exectution failed and keep consistent self._sleeping

klhhhhh
authored and
MikukuOvO
committed
refactor gpu worker

klhhhhh
authored and
MikukuOvO
committed
add roll out function

klhhhhh
authored and
MikukuOvO
committed
update scheduler

klhhhhh
authored and
MikukuOvO
committed
refactor weight api

klhhhhh
authored and
MikukuOvO
committed
move modules and rollback

zhaochenyang20
authored and
MikukuOvO
committed
refactor: unit test

zhaochenyang20
authored and
MikukuOvO
committed
refactor: unit test, assert generate correct

zhaochenyang20
authored and
MikukuOvO
committed
refactor: _get_module_device

zhaochenyang20
authored and
MikukuOvO
committed
refactor: logging control

zhaochenyang20
authored and
MikukuOvO
committed
refactor: _handle_memory_occupation

zhaochenyang20
authored and
MikukuOvO
committed
refactor: resume_memory_occupation

zhaochenyang20
authored and
MikukuOvO
committed
update docs

zhaochenyang20
authored and
MikukuOvO
committed
change docs string

zhaochenyang20
authored and
MikukuOvO
committed
fix rocm ci

zhaochenyang20
authored and
MikukuOvO
committed
minor refactor

alphabetc1
authored and
MikukuOvO
committed
add todo for rollback expection

zhaochenyang20
authored and
MikukuOvO
committed
self fixing comments

zhaochenyang20
authored and
MikukuOvO
committed
refactor: pass the request instance instead of class type

alphabetc1
authored and
MikukuOvO
committed
move RL related tests to post-training dir

zhaochenyang20
authored and
MikukuOvO
committed
fix untoched unit test in CI

zhaochenyang20
authored and
MikukuOvO
committed
extract _get_module_device into utility helper & add TODO for io_struct.py

authored and
MikukuOvO
committed
remove unit redunct tests

zhaochenyang20
authored and
MikukuOvO
committed
move test

alphabetc1
authored and
MikukuOvO
committed

Commits on Apr 13, 2026

Commits on Apr 14, 2026

refactor: raise sleeping request errors in scheduler
MikukuOvO
committed

Commits on Apr 15, 2026

fix: guard sleep wake with fsdp inference
MikukuOvO
committed