Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
vllm-project
/
vllm-project.github.io
Public
Notifications
You must be signed in to change notification settings
Fork
139
Star
68
Code
Issues
4
Pull requests
15
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Security and quality
Insights
[WIP] Blog: announcing vllm-metal
- #314
#314
Draft
WindChimeRan
wants to merge 16 commits into
vllm-project:main
vllm-project/vllm-project.github.io:main
from
WindChimeRan:vllm-metal-v0.4.0-blog
WindChimeRan/vllm-project.github.io:vllm-metal-v0.4.0-blog
Copy head branch name to clipboard
Conversation
Commits
16
(16)
Checks
Files changed
Draft
[WIP] Blog: announcing vllm-metal
#314
WindChimeRan
wants to merge 16 commits into
vllm-project:main
vllm-project/vllm-project.github.io:main
from
WindChimeRan:vllm-metal-v0.4.0-blog
WindChimeRan/vllm-project.github.io:vllm-metal-v0.4.0-blog
Copy head branch name to clipboard
Commits
Commits on Aug 30, 2026
Add vllm-metal v0.4.0 announcement
Show description for 2d9a70b
WindChimeRan
committed
2d9a70b
View commit details
Copy full SHA for 2d9a70b
Browse repository at this point
Commits on Sep 1, 2026
Move the DGX Spark comparison out of the announcement
Show description for b58c01c
WindChimeRan
committed
b58c01c
View commit details
Copy full SHA for b58c01c
Browse repository at this point
Draft the M1 Pro vs M5 Pro generational table
Show description for b814232
WindChimeRan
committed
b814232
View commit details
Copy full SHA for b814232
Browse repository at this point
Rename the announcement to v0.28.0
Show description for e0a65f6
WindChimeRan
committed
e0a65f6
View commit details
Copy full SHA for e0a65f6
Browse repository at this point
Commits on Sep 2, 2026
Update the results to the 4-bit re-run
Show description for 4fa6951
WindChimeRan
committed
4fa6951
View commit details
Copy full SHA for 4fa6951
Browse repository at this point
State the concurrency-1 result explicitly
Show description for 5bbb147
WindChimeRan
committed
5bbb147
View commit details
Copy full SHA for 5bbb147
Browse repository at this point
Sync the M1 Pro table's M5 Pro column to the 4-bit measurements
Show description for 6e99934
WindChimeRan
committed
6e99934
View commit details
Copy full SHA for 6e99934
Browse repository at this point
Add the Qwen3.6-35B-A3B results
Show description for 3610063
WindChimeRan
committed
3610063
View commit details
Copy full SHA for 3610063
Browse repository at this point
Commits on Sep 4, 2026
Give oMLX a memory prefix cache, not only a disk one
Show description for ebc0152
WindChimeRan
committed
ebc0152
View commit details
Copy full SHA for ebc0152
Browse repository at this point
Fix three claims the re-measured oMLX arms left behind
Show description for 06b1b78
WindChimeRan
committed
06b1b78
View commit details
Copy full SHA for 06b1b78
Browse repository at this point
Name the two oMLX arms up front, and give the real serve commands
Show description for 66c48f6
WindChimeRan
committed
66c48f6
View commit details
Copy full SHA for 66c48f6
Browse repository at this point
Correct the MLX checkpoint's weight footprint
Show description for 494eb46
WindChimeRan
committed
494eb46
View commit details
Copy full SHA for 494eb46
Browse repository at this point
Say which model the llama.cpp slot sensitivity was measured on
Show description for 2c84f8a
WindChimeRan
committed
2c84f8a
View commit details
Copy full SHA for 2c84f8a
Browse repository at this point
Back the MTP draft-depth numbers with measurements that exist
Show description for b53c49f
WindChimeRan
committed
b53c49f
View commit details
Copy full SHA for b53c49f
Browse repository at this point
Measure what padding costs, and correct oMLX's row
Show description for 3159304
WindChimeRan
committed
3159304
View commit details
Copy full SHA for 3159304
Browse repository at this point
Widen the padding measurement to eight requests, and add lily
Show description for 8be4b98
WindChimeRan
committed
8be4b98
View commit details
Copy full SHA for 8be4b98
Browse repository at this point
You can’t perform that action at this time.
