|
1 | 1 | # Wingman LLM Models |
2 | 2 |
|
3 | | -## Architecture: Multi-Model Intelligence |
| 3 | +## Architecture: Curated Model Selection |
4 | 4 |
|
5 | | -Wingman supports a tiered model strategy to balance speed, intelligence, and privacy. |
| 5 | +Wingman uses a curated set of 5 high-quality models focused on: |
| 6 | +- **Good context windows** (32K-128K tokens) |
| 7 | +- **Multimodal capabilities** (vision, audio) |
| 8 | +- **Function calling / tools** support |
6 | 9 |
|
7 | | -### The Intelligence Tiers |
| 10 | +### Model Summary |
8 | 11 |
|
9 | | -| Tier | Size (Params) | Best For | Recommended Model | |
10 | | -|------|---------------|----------|-------------------| |
11 | | -| **Featherweight** | 270M - 0.5B | Speed & Tools | **FunctionGemma 270M** ⭐ | |
12 | | -| **Middleweight** | 1B - 1.5B | Chat & Reasoning | **Gemma 3 1B** 💎 | |
13 | | -| **Heavyweight** | 3B - 4B | Advanced Logic | **Phi-4 Mini** 🔬 | |
| 12 | +| Model | Params | Size | RAM | Context | Capabilities | |
| 13 | +|-------|--------|------|-----|---------|--------------| |
| 14 | +| **Gemma 3n E2B** 📷 | 2B eff | 3.6GB | 4GB | 32K | Text + Vision + Audio + Tools | |
| 15 | +| **DeepSeek R1** 🧠 | 1.5B | 1.2GB | 4GB | 32K | Text + Thinking + Tools | |
| 16 | +| **Phi-4 Mini** 🔬 | 3.8B | 2.8GB | 6GB | 128K | Text + Tools (Best context!) | |
| 17 | +| **Gemma 3 1B** 💎 | 1B | 689MB | 4GB | 32K | Text (Recommended for chat) | |
| 18 | +| **Qwen 2.5 1.5B** 🌍 | 1.5B | 1.1GB | 4GB | 32K | Text + Tools (Multilingual) | |
14 | 19 |
|
15 | 20 | --- |
16 | 21 |
|
17 | | -## Model Roster (Verified Official List) |
| 22 | +## Model Details |
18 | 23 |
|
19 | | -All models are official LiteRT builds from the **`litert-community`** organization on HuggingFace. |
| 24 | +### Multimodal |
| 25 | +* **Gemma 3n E2B** 📷🎤: Full multimodal - text, image, video, audio input. Best for vision tasks. Requires Gemma license acceptance on HuggingFace. |
20 | 26 |
|
21 | | -| Model | Class | Size | RAM | Context | Category | |
22 | | -|-------|-------|------|-----|---------|----------| |
23 | | -| **DeepSeek R1** | 1.5B | 1.2GB | 4GB | 32K | Reasoning/Agent | |
24 | | -| **Phi-4 Mini** | 3.8B | 2.8GB | 6GB | 128K | Logic/Reasoning | |
25 | | -| **Gemma 3 1B** 💎 | 1B | 689MB | 4GB | 32K | General Chat | |
26 | | -| **Gemma 3 270M** | 270M | 276MB | 2GB | 32K | Fast Chat | |
27 | | -| **Qwen 2.5 1.5B** | 1.5B | 1.1GB | 4GB | 32K | Multilingual | |
28 | | -| **Qwen 2.5 0.5B** | 0.5B | 400MB | 2GB | 32K | Fast Actions | |
29 | | -| **Gemma 2 2B IT** | 2B | 1.6GB | 4GB | 8K | High Quality Text | |
30 | | -| **FunctionGemma** ⭐ | 270M | 150MB | 2GB | 8K | Specialized Agent | |
31 | | -| **TinyLlama 1.1B** | 1.1B | 650MB | 2GB | 2K | Legacy Support | |
32 | | -| **SmolLM 135M** | 135M | 270MB | 1GB | 2K | Ultra-Lightweight | |
| 27 | +### Agent & Reasoning |
| 28 | +* **DeepSeek R1 1.5B** 🧠: Thinking mode + function calling. Best for complex reasoning and tool chaining. |
| 29 | +* **Phi-4 Mini** 🔬: Advanced logic with 128K context - the largest context window available. Best for long conversations. |
| 30 | +* **Qwen 2.5 1.5B** 🌍: Strong multilingual support + tools. Best for non-English users. |
33 | 31 |
|
34 | | ---- |
35 | | - |
36 | | -## Model Tiers |
37 | | - |
38 | | -### Tier 1: Agent & Tools (The "Brain") |
39 | | -* **DeepSeek R1 1.5B**: Best for complex reasoning and tool chaining. |
40 | | -* **Phi-4 Mini**: Advanced logic for deeper strategy analysis. |
41 | | -* **FunctionGemma 270M**: The core model for simple on-device actions. |
42 | | -* **Qwen 2.5 (1.5B/0.5B)**: Exceptional for multilingual tool requests. |
43 | | - |
44 | | -### Tier 2: General Chat (The "Vibe") |
45 | | -* **Gemma 3 1B** 💎: **Recommended.** Best balance of wit, speed, and persona. |
46 | | -* **Gemma 2 2B IT**: High-precision text for nuanced advice. |
47 | | -* **Gemma 3 270M**: Whisper-fast chat for quick check-ins. |
48 | | - |
49 | | -### Tier 3: Support Models (The "Safety Net") |
50 | | -* **TinyLlama 1.1B**: Reliable chat for older hardware. |
51 | | -* **SmolLM 135M**: Runs on almost anything; perfect for emergency advice. |
| 32 | +### General Chat |
| 33 | +* **Gemma 3 1B** 💎: **Recommended.** Best balance of quality, speed, and size. Requires Gemma license. |
52 | 34 |
|
53 | 35 | --- |
54 | 36 |
|
55 | | -## Technical Setup |
56 | | - |
57 | | -### RAM Recommendations |
58 | | -- **Old Devices (2GB)**: Use FunctionGemma 270M. |
59 | | -- **Standard (4GB)**: Gemma 3 1B or DeepSeek R1. |
60 | | -- **Pro Devices (6GB+)**: Phi-4 Mini or Gemma 3n E4B. |
| 37 | +## RAM Recommendations |
61 | 38 |
|
62 | | -### Context Management |
63 | | -Wingman uses a dynamic sliding-window context. Older messages are summarized once they exceed the model's `contextWindowK` (listed above), ensuring you nunca pierdas el hilo de la conversacion. |
| 39 | +- **Standard (4GB)**: Gemma 3 1B (chat) or DeepSeek R1 (reasoning) |
| 40 | +- **Pro Devices (6GB+)**: Phi-4 Mini (128K context) or Gemma 3n E2B (multimodal) |
64 | 41 |
|
65 | 42 | --- |
66 | 43 |
|
67 | 44 | ## Official Sources & Repositories |
68 | 45 |
|
69 | | -Wingman uses strictly verified `.task` models to ensure compatibility with MediaPipe/LiteRT. |
| 46 | +All models are verified `.task` or `.litertlm` formats for MediaPipe/LiteRT compatibility. |
70 | 47 |
|
71 | | -### Primary Source: LiteRT Community |
72 | | -Most models are sourced from the [LiteRT Community HuggingFace Organization](https://huggingface.co/litert-community). |
73 | | -- **DeepSeek R1 1.5B**: [Link](https://huggingface.co/litert-community/DeepSeek-R1-Distill-Qwen-1.5B) |
74 | | -- **Phi-4 Mini**: [Link](https://huggingface.co/litert-community/Phi-4-mini-instruct) |
75 | | -- **Gemma 3 Family**: [Link](https://huggingface.co/litert-community/Gemma3-1B-IT) |
76 | | -- **Qwen 2.5 Family**: [Link](https://huggingface.co/litert-community/Qwen2.5-1.5B-Instruct) |
| 48 | +### LiteRT Community (Public - No login required) |
| 49 | +- **DeepSeek R1 1.5B**: [litert-community/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/litert-community/DeepSeek-R1-Distill-Qwen-1.5B) |
| 50 | +- **Phi-4 Mini**: [litert-community/Phi-4-mini-instruct](https://huggingface.co/litert-community/Phi-4-mini-instruct) |
| 51 | +- **Qwen 2.5 1.5B**: [litert-community/Qwen2.5-1.5B-Instruct](https://huggingface.co/litert-community/Qwen2.5-1.5B-Instruct) |
77 | 52 |
|
78 | | -### Specialized Agent Models |
79 | | -- **FunctionGemma 270M**: Sourced from [sasha-denisov/function-gemma-270M-it](https://huggingface.co/sasha-denisov/function-gemma-270M-it). This model is specifically fine-tuned for on-device tool calling and low-latency interaction. |
| 53 | +### Google (Gated - Requires Gemma license acceptance) |
| 54 | +- **Gemma 3n E2B**: [google/gemma-3n-E2B-it-litert-lm](https://huggingface.co/google/gemma-3n-E2B-it-litert-lm) |
| 55 | +- **Gemma 3 1B**: [litert-community/Gemma3-1B-IT](https://huggingface.co/litert-community/Gemma3-1B-IT) |
80 | 56 |
|
81 | 57 | --- |
82 | 58 |
|
83 | | -## Technical Specifications (Summary) |
| 59 | +## Technical Specifications |
84 | 60 |
|
85 | 61 | | Metric | Minimum | Recommended | |
86 | 62 | |--------|---------|-------------| |
87 | | -| **Device RAM** | 2GB | 4GB - 6GB | |
| 63 | +| **Device RAM** | 4GB | 6GB+ | |
88 | 64 | | **Storage** | 1GB | 5GB+ (for multiple models) | |
89 | 65 | | **OS** | iOS 16.0+ / Android 11+ | Latest | |
90 | 66 |
|
91 | 67 | --- |
92 | 68 |
|
93 | 69 | ## Credits |
94 | 70 | - **Google AI**: For the Gemma architecture and MediaPipe SDK. |
95 | | -- **DeepSeek / Microsoft / Alibaba**: For the weights used in distilled LiteRT models. |
96 | | -- **Sasha Denisov**: For the FunctionGemma fine-tune optimized for mobile agents. |
| 71 | +- **DeepSeek / Microsoft / Alibaba**: For model weights used in LiteRT conversions. |
| 72 | +- **LiteRT Community**: For maintaining verified on-device model conversions. |
0 commit comments