使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
-
Updated
Nov 2, 2026 - C++
使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install
RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.
Run Qwen3.8-Flash-Next (125B) on an RTX 3060 12 GB with 30 GB of RAM, streaming experts from the SSD. 50-70 tok/s, 262K context. A fork of Strata.
Type a prompt or drop up to 10 photos: Qwen-Image-2.1 renders it on your 12 GB GPU in ~35 s. Desktop app + CLI, honest benchmark vs gpt-image-2.
Unofficial FreeToken fork: Flash-Next 125B at 38 tok/s on two RTX 3060s with 2-bit experts, gpt-oss-120b on one; a benchmark tunes your settings. Qwen3.8-Flash-Next, 12 GB, MTP, 250k context, image input, WSL2. Runs on Turing: RTX 2060, RTX 20 series, sm_75.
Windows UEFI GPU unlock for RTX 30-series: a guided, self-service installer (text and graphical) with roll back, update-in-place and a full test suite. Fork of impacifist/Windows-GPU-UNLOCK.
Run AI on your own hardware, never deal with the cloud and create AI that can handle sensitive data. This repo showcases how to run AI on your own computer, and how to build specialised tools for it to use. I showcase a real setup where I developed tools in Deepseek Harness, that solved real automation engineering problems
华硕 ROG 幻16 GU603ZM 黑苹果 EFI:OpenCore 1.0.8 + macOS Sequoia 15 + nullmoth NVIDIA 驱动(RTX 3060 Laptop)
Pinned, hash-verified Comfy-Org MiniMax H3 ComfyUI workflows for T2V, I2V and R2V, with RTX 3060 benchmark evidence.
Getting LTX-2.5 and MiniMax-H3 running reliably on a 12GB card in ComfyUI — real bugs found and fixed, not just a config dump
DeepSeek-R1 7B INT4 at 69.3 tok/s on a $300 RTX 3060. Faster than llama.cpp, vLLM, and NVIDIA TensorRT-LLM. Is one developer + Ai really better than the entire industry?
Measured local AI inference recipes for Ryzen 5 5600X + RTX 3060: FreeToken and llama.cpp profiles, DFlash, context/output budgets, benchmark logs, and agent integrations.
Exact file sizes, official VRAM statements and measured 12GB runs for Wan, LTX, HunyuanVideo, Mochi and CogVideoX in ComfyUI
Rent GPUs by the hour on Lium to top LocalMaxxing leaderboards with verified, high-speed inference for under $10 total.
Experimental open RTX 3060 driver research for macOS Tahoe — safe probe first
Reproducible single-system evaluation of Qwen3.8-27B on an RTX 3060 12 GB: long-context inference, KV-cache optimization, Windows/WSL2, and Codex integration.
To associate your repository with the rtx-3060 topic, visit your repo's landing page and select "manage topics."