[tinker][megatron] Multi-LoRA Megatron + Tinker API#1617

Merged

erictang000 merged 24 commits into

NovaSky-AI:mainfrom

erictang000:multi_lora

May 8, 2026

Commits on May 4, 2026

[docs] Add Multi-LoRA Megatron Tinker design doc (v1)

erictang000
and
claude
committed
[multi-lora] Add AdapterStore for per-worker LoRA slot bookkeeping

erictang000
and
claude
committed
[multi-lora] Wire AdapterStore into MegatronPolicyWorkerBase

erictang000
and
claude
committed
[multi-lora] Add ensure_active_adapter + model_id threading to dispatch

erictang000
and
claude
committed
[multi-lora] Allow multiple LoRA policy adapters in SkyRLTrainBackend

erictang000
and
claude
committed
[multi-lora] Add GPU-gated multi-LoRA integration test for Megatron

erictang000
and
claude
committed
[multi-lora] Add two-client smoke runbook

erictang000
and
claude
committed
[multi-lora] Fix _lora_signature_from to not read non-existent target_modules

erictang000
and
claude
committed
x
erictang000
committed
[multi-lora] Swap grad buffers along with params + optimizer state

erictang000
and
claude
committed

Commits on May 8, 2026