Skip to content

add: async scheduler, async scheduling todos#244

Open
huijjj wants to merge 1 commit intodev-0.12from
async-scheduling-initial
Open

add: async scheduler, async scheduling todos#244
huijjj wants to merge 1 commit intodev-0.12from
async-scheduling-initial

Conversation

@huijjj
Copy link
Copy Markdown
Collaborator

@huijjj huijjj commented Dec 30, 2025

🚀 Summary of Changes

Added async scheduler and TODOs for async scheduling.

At the moment, there's probably no real benefit since we can’t run anything asynchronously between the host and the device yet. However, I’ve added an async scheduler as a placeholder so that once this capability is brought up, we can build on it immediately. I also left detailed comments in the code outlining what needs to be done next. See the comments starting with TODO(RBLN) in rbln_model_runner.py for details.

About async scheduling, please refer to upstream PR.


📌 Related Issues / Tickets

  • Resolves #
  • Related to #

✅ Type of Change

  • ✨ Feature (feature)
  • 🧠 Model support (model)
  • 🧬 Core engine changes (core)
  • 🛠 Bug fix (bug-fix)
  • ⚙️ Performance improvement (perf)
  • 🔁 Refactor or code cleanup (refactor)
  • 📄 Documentation (docs)
  • ❓ Other (other): please describe

🧪 How to Test

  1. Run ...
  2. Verify output: ...
  3. Edge case tested: ...

📸 Screenshots / Logs (if applicable)


📋 Checklist

  • PR title follows Conventional Commits format
  • This PR is linked to an existing issue
  • The test method is described, and the expected result is clearly stated
  • Relevant documentation has been updated (if applicable)

💬 Notes


@huijjj huijjj self-assigned this Dec 30, 2025
@rebel-jiwoopark rebel-jiwoopark added the torch.compile torch.compile based implementation label Jan 5, 2026
@huijjj huijjj force-pushed the async-scheduling-initial branch from 4539940 to e12d230 Compare January 13, 2026 04:11
@huijjj huijjj changed the base branch from dev to dev-0.12 January 13, 2026 04:11
@huijjj huijjj force-pushed the async-scheduling-initial branch 3 times, most recently from ad002d1 to 86bd004 Compare January 14, 2026 00:29
@huijjj huijjj force-pushed the async-scheduling-initial branch from 86bd004 to c6fad74 Compare January 15, 2026 06:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

torch.compile torch.compile based implementation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants