Skip to content

Commit d97b499

Browse files
feat: Enhance LLM model support with an updated roster, documentation, and flutter_markdown_plus integration.
1 parent dc1f101 commit d97b499

9 files changed

Lines changed: 558 additions & 693 deletions

File tree

docs/MODELS.md

Lines changed: 52 additions & 53 deletions
Original file line numberDiff line numberDiff line change
@@ -14,84 +14,83 @@ Wingman supports a tiered model strategy to balance speed, intelligence, and pri
1414

1515
---
1616

17-
## Model Roster (Verified Specs)
17+
## Model Roster (Verified Official List)
1818

19-
All models are optimized for **LiteRT (MediaPipe)** and verified for on-device performance.
19+
All models are official LiteRT builds from the **`litert-community`** organization on HuggingFace.
2020

2121
| Model | Class | Size | RAM | Context | Category |
2222
|-------|-------|------|-----|---------|----------|
23-
| **FunctionGemma**| 270M | 150MB | 2GB | 8K | Agent (Tools) |
24-
| **Gemma 3 1B** 💎 | 1B | 555MB | 4GB | 32K | General Chat |
25-
| **DeepSeek R1** | 1.5B | 1.2GB | 4GB | 32K | Reasoning |
23+
| **DeepSeek R1** | 1.5B | 1.2GB | 4GB | 32K | Reasoning/Agent |
2624
| **Phi-4 Mini** | 3.8B | 2.8GB | 6GB | 128K | Logic/Reasoning |
27-
| **Hammer 2.1** | 0.5B | 480MB | 2GB | 8K | Actions |
28-
| **Qwen 2.5** | 1.5B | 1.1GB | 4GB | 32K | Multilingual |
29-
| **Gemma 3n E4B** | 4B | 3.1GB | 3GB* | 32K | Multimodal |
30-
| **Gemma 3n E2B** | 2B | 1.6GB | 2GB* | 32K | Multimodal |
31-
32-
*\*Note: Gemma 3n models use effective parameter counting for lower VRAM footprints.*
25+
| **Gemma 3 1B** 💎 | 1B | 689MB | 4GB | 32K | General Chat |
26+
| **Gemma 3 270M** | 270M | 276MB | 2GB | 32K | Fast Chat |
27+
| **Qwen 2.5 1.5B** | 1.5B | 1.1GB | 4GB | 32K | Multilingual |
28+
| **Qwen 2.5 0.5B** | 0.5B | 400MB | 2GB | 32K | Fast Actions |
29+
| **Gemma 2 2B IT** | 2B | 1.6GB | 4GB | 8K | High Quality Text |
30+
| **FunctionGemma**| 270M | 150MB | 2GB | 8K | Specialized Agent |
31+
| **TinyLlama 1.1B** | 1.1B | 650MB | 2GB | 2K | Legacy Support |
32+
| **SmolLM 135M** | 135M | 270MB | 1GB | 2K | Ultra-Lightweight |
3333

3434
---
3535

36-
## Tier 1: Agent & Tools (The "Brain")
36+
## Model Tiers
37+
38+
### Tier 1: Agent & Tools (The "Brain")
39+
* **DeepSeek R1 1.5B**: Best for complex reasoning and tool chaining.
40+
* **Phi-4 Mini**: Advanced logic for deeper strategy analysis.
41+
* **FunctionGemma 270M**: The core model for simple on-device actions.
42+
* **Qwen 2.5 (1.5B/0.5B)**: Exceptional for multilingual tool requests.
3743

38-
### FunctionGemma 270M ⭐
39-
**Recommended for Wingman's tool-calling features.**
40-
- **Capabilities**: Clipboard, Reminders, Dossier Updates.
41-
- **Vibe**: Fast, structured, reliable.
44+
### Tier 2: General Chat (The "Vibe")
45+
* **Gemma 3 1B** 💎: **Recommended.** Best balance of wit, speed, and persona.
46+
* **Gemma 2 2B IT**: High-precision text for nuanced advice.
47+
* **Gemma 3 270M**: Whisper-fast chat for quick check-ins.
4248

43-
### Hammer 2.1 0.5B
44-
- **Capabilities**: Multi-turn tool use, action planning.
45-
- **Vibe**: High-speed task execution.
49+
### Tier 3: Support Models (The "Safety Net")
50+
* **TinyLlama 1.1B**: Reliable chat for older hardware.
51+
* **SmolLM 135M**: Runs on almost anything; perfect for emergency advice.
4652

4753
---
4854

49-
## Tier 2: General Chat (The "Vibe")
55+
## Technical Setup
5056

51-
### Gemma 3 1B 💎
52-
**The gold standard for natural "WINGMAN" persona.**
53-
- **Capabilities**: High-quality chat, cultural nuance, humor.
54-
- **Vibe**: Authentic, witty, helpful.
57+
### RAM Recommendations
58+
- **Old Devices (2GB)**: Use FunctionGemma 270M.
59+
- **Standard (4GB)**: Gemma 3 1B or DeepSeek R1.
60+
- **Pro Devices (6GB+)**: Phi-4 Mini or Gemma 3n E4B.
5561

56-
### Qwen 2.5 1.5B
57-
- **Capabilities**: Superior multilingual support (Spanish/Latino slang).
58-
- **Vibe**: Culturally sophisticated, versatile.
62+
### Context Management
63+
Wingman uses a dynamic sliding-window context. Older messages are summarized once they exceed the model's `contextWindowK` (listed above), ensuring you nunca pierdas el hilo de la conversacion.
5964

6065
---
6166

62-
## Tier 3: Reasoning & Logic (The "Strategist")
63-
64-
### Phi-4 Mini 3.8B 🔬
65-
- **Capabilities**: Complex pattern matching, relationship strategy.
66-
- **Vibe**: Analytical, deep-thinking, logical.
67+
## Official Sources & Repositories
6768

68-
### DeepSeek R1 1.5B
69-
- **Capabilities**: Logical chain-of-thought, problem solving.
70-
- **Vibe**: Methodical, clarifying, reasoning.
69+
Wingman uses strictly verified `.task` models to ensure compatibility with MediaPipe/LiteRT.
7170

72-
---
73-
74-
## Tier 4: Multimodal (The "Eyes")
71+
### Primary Source: LiteRT Community
72+
Most models are sourced from the [LiteRT Community HuggingFace Organization](https://huggingface.co/litert-community).
73+
- **DeepSeek R1 1.5B**: [Link](https://huggingface.co/litert-community/DeepSeek-R1-Distill-Qwen-1.5B)
74+
- **Phi-4 Mini**: [Link](https://huggingface.co/litert-community/Phi-4-mini-instruct)
75+
- **Gemma 3 Family**: [Link](https://huggingface.co/litert-community/Gemma3-1B-IT)
76+
- **Qwen 2.5 Family**: [Link](https://huggingface.co/litert-community/Qwen2.5-1.5B-Instruct)
7577

76-
### Gemma 3n E4B / E2B
77-
- **Capabilities**: Screenshot transcriptions, photo analysis.
78-
- **Vibe**: Visual, observant.
78+
### Specialized Agent Models
79+
- **FunctionGemma 270M**: Sourced from [sasha-denisov/function-gemma-270M-it](https://huggingface.co/sasha-denisov/function-gemma-270M-it). This model is specifically fine-tuned for on-device tool calling and low-latency interaction.
7980

8081
---
8182

82-
## Technical Setup
83-
84-
### RAM Recommendations
85-
- **Old Devices (2GB)**: Use FunctionGemma 270M.
86-
- **Standard (4GB)**: Gemma 3 1B or DeepSeek R1.
87-
- **Pro Devices (6GB+)**: Phi-4 Mini or Gemma 3n E4B.
83+
## Technical Specifications (Summary)
8884

89-
### Context Management
90-
Wingman uses a dynamic sliding-window context. Older messages are summarized once they exceed the model's `contextWindowK` (listed above), ensuring you nunca pierdas el hilo de la conversacion.
85+
| Metric | Minimum | Recommended |
86+
|--------|---------|-------------|
87+
| **Device RAM** | 2GB | 4GB - 6GB |
88+
| **Storage** | 1GB | 5GB+ (for multiple models) |
89+
| **OS** | iOS 16.0+ / Android 11+ | Latest |
9190

9291
---
9392

94-
## Sources & Credits
95-
- **Google AI**: Native Gemma family support.
96-
- **LiteRT Community**: For optimized `.task` conversions of DeepSeek, Qwen, and Phi models.
97-
- **MediaPipe**: The underlying inference engine.
93+
## Credits
94+
- **Google AI**: For the Gemma architecture and MediaPipe SDK.
95+
- **DeepSeek / Microsoft / Alibaba**: For the weights used in distilled LiteRT models.
96+
- **Sasha Denisov**: For the FunctionGemma fine-tune optimized for mobile agents.

lib/main.dart

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ final _router = GoRouter(
6464
routes: [
6565
// Home screen (profiles list) - accessible via drawer/button
6666
GoRoute(
67-
path: '/profiles',
67+
path: '/radar',
6868
builder: (context, state) => const HomeScreen(),
6969
),
7070
// Main chat route

0 commit comments

Comments
 (0)