Commit 74c4f22
fix(core): support LanguageModelV3 in MastraModelGateway.resolveLanguageModel (#11489)
## Summary
This PR enables custom gateways to return either `LanguageModelV2` (AI
SDK v5) or `LanguageModelV3` (AI SDK v6) from the `resolveLanguageModel`
method.
## Changes
- **`packages/core/src/llm/model/gateways/base.ts`**
- Added `GatewayLanguageModel` union type (`LanguageModelV2 |
LanguageModelV3`)
- Updated `MastraModelGateway.resolveLanguageModel` abstract method to
return `GatewayLanguageModel`
- **`packages/core/src/llm/model/router.ts`**
- Added `isLanguageModelV3` type guard function
- Updated `doGenerate` and `doStream` methods to detect V3 models and
wrap them with `AISDKV6LanguageModel`
- Updated internal `resolveLanguageModel` return type and
`modelInstances` Map to use `GatewayLanguageModel`
- **`packages/core/src/llm/model/gateways/index.ts`** &
**`packages/core/src/llm/index.ts`**
- Exported `GatewayLanguageModel` type for external use
## Example Usage
```typescript
import { MastraModelGateway, type GatewayLanguageModel } from '@mastra/core/llm';
import { createOpenAICompatible } from '@ai-sdk/openai-compatible'; // v6
class CustomGateway extends MastraModelGateway {
async resolveLanguageModel({ modelId, providerId, apiKey }): Promise<GatewayLanguageModel> {
// Now works with both V2 and V3!
return createOpenAICompatible({
name: providerId,
apiKey,
baseURL: 'https://...',
}).chatModel(modelId);
}
}
```
## Testing
- All 115 gateway and router tests pass ✅
- Type check passes ✅
Fixes #11443
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **New Features**
* Added support for AI SDK v6 language models in the core runtime.
* Routing and model resolution updated to handle mixed v5/v6 models
while preserving full backward compatibility with existing v5 workflows.
<sub>✏️ Tip: You can customize this high-level summary in your review
settings.</sub>
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: Abhi Aiyer <abhiaiyer91@gmail.com>1 parent 4f0b3c6 commit 74c4f22
File tree
5 files changed
+43
-6
lines changed- .changeset
- packages/core/src/llm
- model
- gateways
5 files changed
+43
-6
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
148 | 148 | | |
149 | 149 | | |
150 | 150 | | |
151 | | - | |
| 151 | + | |
152 | 152 | | |
153 | 153 | | |
154 | 154 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
15 | 16 | | |
16 | 17 | | |
17 | 18 | | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
18 | 25 | | |
19 | 26 | | |
20 | 27 | | |
| |||
51 | 58 | | |
52 | 59 | | |
53 | 60 | | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
54 | 65 | | |
55 | 66 | | |
56 | 67 | | |
57 | 68 | | |
58 | 69 | | |
59 | | - | |
| 70 | + | |
60 | 71 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
4 | 5 | | |
| 6 | + | |
5 | 7 | | |
6 | | - | |
| 8 | + | |
7 | 9 | | |
8 | 10 | | |
9 | 11 | | |
| |||
12 | 14 | | |
13 | 15 | | |
14 | 16 | | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
15 | 24 | | |
16 | 25 | | |
17 | 26 | | |
| |||
127 | 136 | | |
128 | 137 | | |
129 | 138 | | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
130 | 145 | | |
131 | 146 | | |
132 | 147 | | |
| |||
164 | 179 | | |
165 | 180 | | |
166 | 181 | | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
167 | 188 | | |
168 | 189 | | |
169 | 190 | | |
| |||
178 | 199 | | |
179 | 200 | | |
180 | 201 | | |
181 | | - | |
| 202 | + | |
182 | 203 | | |
183 | 204 | | |
184 | 205 | | |
| |||
208 | 229 | | |
209 | 230 | | |
210 | 231 | | |
211 | | - | |
| 232 | + | |
212 | 233 | | |
0 commit comments