Skip to content

Add EdgeRunner#1926

Merged
vpeschenkov merged 1 commit into
matteocrippa:masterfrom
christopherkarani:add-edgerunner
Apr 10, 2026
Merged

Add EdgeRunner#1926
vpeschenkov merged 1 commit into
matteocrippa:masterfrom
christopherkarani:add-edgerunner

Conversation

@christopherkarani
Copy link
Copy Markdown
Contributor

Summary

  • Add EdgeRunner to the AI section
  • Fast, local LLM inference for Apple Silicon built in Swift and Metal from the ground up
  • Supports GGUF models (Qwen3, etc.) with Metal-optimized kernels delivering ~230+ tok/s decode on M3 Max
  • Placed right after Espresso (same author, complementary project — EdgeRunner does inference, Espresso compiles for ANE)

Checklist

  • Entry added to contents.json only (no README.md changes)
  • Short, plain description starting with capital and ending with period
  • Fits AI category (LLM inference engine)
  • MIT license (allowed)
  • Swift 6.2+
  • 15+ GitHub stars
  • English README

Fast, local LLM inference for Apple Silicon built in Swift/Metal.
Supports GGUF models (Qwen3, etc.) with Metal-optimized kernels
and ~230+ tok/s decode on M3 Max.
@vpeschenkov vpeschenkov merged commit ac1e5c7 into matteocrippa:master Apr 10, 2026
1 check failed
@vpeschenkov vpeschenkov changed the title Add EdgeRunner to AI category Add EdgeRunner Apr 10, 2026
@vpeschenkov
Copy link
Copy Markdown
Collaborator

@christopherkarani thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants