-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathmodels_list.json
More file actions
2133 lines (2133 loc) · 101 KB
/
Copy pathmodels_list.json
File metadata and controls
2133 lines (2133 loc) · 101 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
{
"data": [
{
"created": 1768823553,
"id": "zai-org/glm-4.7-flash",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 700,
"output_token_price_per_m": 4000,
"title": "zai-org/glm-4.7-flash",
"description": "GLM-4.7-Flash, a state-of-the-art model in the 30B class, delivers a compelling balance of high performance and efficiency. Tailored for Agentic Coding, it strengthens coding proficiency, long-horizon planning, and tool synergy, securing top-tier results on public benchmarks among similarly sized open-source models. It excels in complex agent tasks with superior instruction following for tool use, while significantly elevating the frontend aesthetics and completion efficiency of long-range workflows in Artifacts and Agentic Coding.",
"tags": [],
"context_size": 200000,
"status": 1,
"display_name": "GLM-4.7-Flash",
"model_type": "chat",
"max_output_tokens": 131100,
"features": ["serverless", "function-calling", "structured-outputs", "reasoning"],
"endpoints": ["chat/completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1764588967,
"id": "deepseek/deepseek-v3.2",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2690,
"output_token_price_per_m": 4000,
"title": "deepseek/deepseek-v3.2",
"description": "We introduce DeepSeek-V3.2, a next-generation foundation model designed to unify high computational efficiency with state-of-the-art reasoning and agentic performance. DeepSeek-V3.2 is built upon three core technical breakthroughs:\n\n• DeepSeek Sparse Attention (DSA):\nA new highly efficient attention mechanism that significantly reduces computational overhead while preserving model quality, purpose-built for long-context reasoning and high-throughput workloads.\n\n• Scalable Reinforcement Learning Framework:\nDeepSeek-V3.2 leverages a robust RL training protocol and expanded post-training compute to reach GPT-5-level performance. Its high-compute variant, DeepSeek-V3.2-Speciale, surpasses GPT-5 and demonstrates reasoning capabilities comparable to Gemini-3.0-Pro.\n\n• Large-Scale Agentic Task Synthesis Pipeline:\nTo enable reliable tool-use and multi-step decision-making, we develop a novel agentic data synthesis pipeline that generates high-quality interactive reasoning tasks at scale, greatly enhancing the model’s",
"tags": [],
"context_size": 163840,
"status": 1,
"display_name": "Deepseek V3.2",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1766485136,
"id": "minimax/minimax-m2.1",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 12000,
"title": "minimax/minimax-m2.1",
"description": "MiniMax M2.1 is a cutting-edge AI model designed to revolutionize how developers build software. With enhanced multi-language programming support, it excels in generating high-quality code across popular languages like Rust, Java, Golang, C++, Kotlin, Objective-C, TypeScript, and JavaScript.\n\nKey improvements include:\n\n22% faster response times and 30% lower token consumption for efficient workflows.\nSeamless integration with leading development frameworks (Claude Code, Droid Factory AI, BlackBox, etc.).\nFull-stack development capabilities, from mobile (Android/iOS) to web and 3D interactive prototyping.\nOptimized performance-to-cost ratio, making AI-assisted development more accessible.\nWhether you're a software engineer, app developer, or tech innovator, M2.1 empowers smarter coding with industry-leading AI.",
"tags": [],
"context_size": 204800,
"status": 1,
"display_name": "Minimax M2.1",
"model_type": "chat",
"max_output_tokens": 131072,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1766422299,
"id": "zai-org/glm-4.7",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6000,
"output_token_price_per_m": 22000,
"title": "zai-org/glm-4.7",
"description": "GLM-4.7 is Z.AI's latest flagship model, with major upgrades focused on advanced coding capabilities and more reliable multi-step reasoning and execution. It shows clear gains in complex agent workflows, while delivering a more natural conversational experience and stronger front-end design sensibility.",
"tags": [],
"context_size": 204800,
"status": 1,
"display_name": "GLM-4.7",
"model_type": "chat",
"max_output_tokens": 131072,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "anthropic", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1766140400,
"id": "xiaomimimo/mimo-v2-flash",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 1000,
"output_token_price_per_m": 3000,
"title": "xiaomimimo/mimo-v2-flash",
"description": "Xiaomi MiMo-V2-Flash is a proprietary MoE model developed by Xiaomi, designed for extreme inference efficiency with 309B total parameters (15B active). By incorporating an innovative Hybrid attention architecture and multi-layer MTP inference acceleration, it ranks among the top 2 global open-source models across multiple Agent benchmarks. Its coding capabilities surpass all open-source models and rival the industry-leading closed-source model, Claude 4.5 Sonnet—yet at only 2.5% of the inference cost and with 2x the generation speed, successfully pushing the limits of both model performance and efficiency.",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "XiaomiMiMo/MiMo-V2-Flash",
"model_type": "chat",
"max_output_tokens": 32000,
"features": ["serverless", "function-calling", "structured-outputs", "reasoning"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1765370191,
"id": "zai-org/autoglm-phone-9b-multilingual",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 350,
"output_token_price_per_m": 1380,
"title": "zai-org/autoglm-phone-9b-multilingual",
"description": "Phone Agent is a mobile intelligent assistant framework built on AutoGLM, capable of understanding smartphone screens through multimodal perception and executing automated operations to complete tasks.\nThe system controls devices via ADB (Android Debug Bridge), uses a vision-language model for screen understanding, and leverages intelligent planning to generate and execute action sequences.\n\nUsers can simply describe tasks in natural language—for example, “Open Xiaohongshu and search for food recommendations.”\nPhone Agent will automatically parse the intent, understand the current UI, plan the next steps, and carry out the entire workflow.\n\nThe system also includes:\n\nSensitive action confirmation mechanisms\nHuman-in-the-loop fallback for login or verification code scenarios\nRemote ADB debugging, allowing device connection via WiFi or network for flexible remote control and development",
"tags": [],
"context_size": 65536,
"status": 1,
"display_name": "AutoGLM-Phone-9B-Multilingual",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1762480786,
"id": "moonshotai/kimi-k2-thinking",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6000,
"output_token_price_per_m": 25000,
"title": "moonshotai/kimi-k2-thinking",
"description": "The kimi-k2-thinking model is a general-purpose agentic reasoning model developed by Moonshot AI. ",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "Kimi K2 Thinking",
"model_type": "chat",
"max_output_tokens": 262144,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1761536024,
"id": "minimax/minimax-m2",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 12000,
"title": "minimax/minimax-m2",
"description": "MiniMax-M2 is a compact, high-efficiency large language model optimized for end-to-end coding and agentic workflows. With 10 billion activated parameters (230 billion total), it delivers near-frontier intelligence across general reasoning, tool use, and multi-step task execution while maintaining low latency and deployment efficiency.\n\nThe model excels in code generation, multi-file editing, compile-run-fix loops, and test-validated repair, showing strong results on SWE-Bench Verified, Multi-SWE-Bench, and Terminal-Bench. It also performs competitively in agentic evaluations such as BrowseComp and GAIA, effectively handling long-horizon planning, retrieval, and recovery from execution errors.\n\nBenchmarked by Artificial Analysis, MiniMax-M2 ranks among the top open-source models for composite intelligence, spanning mathematics, science, and instruction-following. Its small activation footprint enables fast inference, high concurrency, and improved unit economics, making it well-suited for large-scale agents, d",
"tags": [],
"context_size": 204800,
"status": 1,
"display_name": "MiniMax-M2",
"model_type": "chat",
"max_output_tokens": 131072,
"features": ["function-calling", "reasoning", "serverless"],
"endpoints": ["chat/completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1761138629,
"id": "paddlepaddle/paddleocr-vl",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 200,
"output_token_price_per_m": 200,
"title": "paddlepaddle/paddleocr-vl",
"description": "",
"tags": [],
"context_size": 16384,
"status": 1,
"display_name": "PaddleOCR-VL",
"model_type": "chat",
"max_output_tokens": 16384,
"endpoints": ["chat/completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1759142233,
"id": "deepseek/deepseek-v3.2-exp",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2700,
"output_token_price_per_m": 4100,
"title": "deepseek/deepseek-v3.2-exp",
"description": "DeepSeek-V3.2-Exp is an experimental model introducing the groundbreaking DeepSeek Sparse Attention (DSA) mechanism for enhanced long-context processing efficiency.\n\nBuilt on V3.1-Terminus, DSA achieves fine-grained sparse attention while maintaining identical output quality. This delivers substantial computational efficiency improvements without compromising accuracy.\n\nComprehensive benchmarks confirm V3.2-Exp matches V3.1-Terminus performance, proving efficiency gains don't sacrifice capability. As both a powerful tool and research platform, it establishes new paradigms for efficient long-context AI processing.\n\n",
"tags": [],
"context_size": 163840,
"status": 1,
"display_name": "Deepseek V3.2 Exp",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1758695177,
"id": "qwen/qwen3-vl-235b-a22b-thinking",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 9800,
"output_token_price_per_m": 39500,
"title": "qwen/qwen3-vl-235b-a22b-thinking",
"description": "",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 VL 235B A22B Thinking",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["reasoning", "serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text", "image", "video"],
"output_modalities": ["text"]
},
{
"created": 1765204180,
"id": "zai-org/glm-4.6v",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 9000,
"title": "zai-org/glm-4.6v",
"description": "GLM-4.6V represents a significant multimodal advancement in the GLM series, featuring a 128k-token training context window and achieving state-of-the-art visual understanding accuracy for models of its parameter scale. Notably, it's the first visual model to natively integrate Function Call capabilities directly into its architecture, creating a seamless pathway from visual perception to executable actions. This breakthrough establishes a unified technical foundation for deploying multimodal agents in real-world business applications.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "GLM 4.6V",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "anthropic", "completions"],
"input_modalities": ["text", "video", "image"],
"output_modalities": ["text"]
},
{
"created": 1759220284,
"id": "zai-org/glm-4.6",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 5500,
"output_token_price_per_m": 22000,
"title": "zai-org/glm-4.6",
"description": "As the latest iteration in the GLM series, GLM-4.6 achieves comprehensive enhancements across multiple domains, including real-world coding, long-context processing, reasoning, searching, writing, and agentic applications. ",
"tags": [],
"context_size": 204800,
"status": 1,
"display_name": "GLM 4.6",
"model_type": "chat",
"max_output_tokens": 131072,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "anthropic", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1767593645,
"id": "kwaipilot/kat-coder-pro",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 12000,
"title": "kwaipilot/kat-coder-pro",
"description": "KAT-Coder-Pro V1 by KwaiKAT is a non-reasoning model optimized for agentic coding. It delivers strong performance on reasoning-style tasks while requiring significantly fewer output tokens than peer models. With the 1210 release, it achieved a score of 64 on the Artificial Analysis Intelligence Index, placing it in the global Top 10 and ranking first among all non-reasoning models.",
"tags": [],
"context_size": 256000,
"status": 1,
"display_name": "Kat Coder Pro",
"model_type": "chat",
"max_output_tokens": 128000,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1757534155,
"id": "qwen/qwen3-next-80b-a3b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 1500,
"output_token_price_per_m": 15000,
"title": "qwen/qwen3-next-80b-a3b-instruct",
"description": "Qwen3-Next uses a highly sparse MoE design: 80B total parameters, but only ~3B activated per inference step. Experiments show that, with global load balancing, increasing total expert parameters while keeping activated experts fixed steadily reduces training loss.Compared to Qwen3’s MoE (128 total experts, 8 routed), Qwen3-Next expands to 512 total experts, combining 10 routed experts + 1 shared expert — maximizing resource usage without hurting performance.\nThe Qwen3-Next-80B-A3B-Instruct performs comparably to our flagship model Qwen3-235B-A22B-Instruct-2507, and shows clear advantages in tasks requiring ultra-long context (up to 256K tokens).\n",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 Next 80B A3B Instruct",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1757533943,
"id": "qwen/qwen3-next-80b-a3b-thinking",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 1500,
"output_token_price_per_m": 15000,
"title": "qwen/qwen3-next-80b-a3b-thinking",
"description": "Qwen3-Next uses a highly sparse MoE design: 80B total parameters, but only ~3B activated per inference step. Experiments show that, with global load balancing, increasing total expert parameters while keeping activated experts fixed steadily reduces training loss.Compared to Qwen3’s MoE (128 total experts, 8 routed), Qwen3-Next expands to 512 total experts, combining 10 routed experts + 1 shared expert — maximizing resource usage without hurting performance.\nThe Qwen3-Next-80B-A3B-Thinking excels at complex reasoning tasks — outperforming higher-cost models like Qwen3-30B-A3B-Thinking-2507 and Qwen3-32B-Thinking, outpeforming the closed-source Gemini-2.5-Flash-Thinking on multiple benchmarks, and approaching the performance of our top-tier model Qwen3-235B-A22B-Thinking-2507.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 Next 80B A3B Thinking",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1761290363,
"id": "deepseek/deepseek-ocr",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 300,
"output_token_price_per_m": 300,
"title": "deepseek/deepseek-ocr",
"description": "",
"tags": [],
"context_size": 8192,
"status": 1,
"display_name": "DeepSeek-OCR",
"model_type": "chat",
"max_output_tokens": 8192,
"endpoints": ["chat/completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1758549812,
"id": "deepseek/deepseek-v3.1-terminus",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2700,
"output_token_price_per_m": 10000,
"title": "deepseek/deepseek-v3.1-terminus",
"description": "DeepSeek-V3.1-Terminus preserves all original model capabilities while resolving key user-reported issues, including:\n- Language consistency: Significantly reducing mixed Chinese-English output and eliminating abnormal character occurrences\n- Agent performance: Enhanced optimization of both Code Agent and Search Agent functionality",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Deepseek V3.1 Terminus",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1758695214,
"id": "qwen/qwen3-vl-235b-a22b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 15000,
"title": "qwen/qwen3-vl-235b-a22b-instruct",
"description": "",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 VL 235B A22B Instruct",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "batch-api"],
"input_modalities": ["text", "image", "video"],
"output_modalities": ["text"]
},
{
"created": 1758682246,
"id": "qwen/qwen3-max",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 21100,
"output_token_price_per_m": 84500,
"title": "qwen/qwen3-max",
"description": "Qwen/qwen3-max, Enhanced with specialized upgrades in agent programming and tool calling. This official release achieves domain SOTA performance, supporting more complex agent scenarios.",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "Qwen3 Max",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1763437112,
"id": "skywork/r1v4-lite",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2000,
"output_token_price_per_m": 6000,
"title": "skywork/r1v4-lite",
"description": "Advanced multimodal large language model supporting both text and image inputs. Features powerful visual understanding and deep reasoning capabilities, suitable for complex task planning and in-depth research scenarios.\n\n",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "Skywork R1V4-Lite",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1755759094,
"id": "deepseek/deepseek-v3.1",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2700,
"output_token_price_per_m": 10000,
"title": "deepseek/deepseek-v3.1",
"description": "DeepSeek-V3.1 is a hybrid model that supports both thinking mode and non-thinking mode.DeepSeek-V3.1 is post-trained on the top of DeepSeek-V3.1-Base, which is built upon the original V3 base checkpoint through a two-phase long context extension approach, following the methodology outlined in the original DeepSeek-V3 report. We have expanded our dataset by collecting additional long documents and substantially extending both training phases. The 32K extension phase has been increased 10-fold to 630B tokens, while the 128K extension phase has been extended by 3.3x to 209B tokens.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "DeepSeek V3.1",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1757052991,
"id": "moonshotai/kimi-k2-0905",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6000,
"output_token_price_per_m": 25000,
"title": "moonshotai/kimi-k2-0905",
"description": "Kimi K2 0905 is the September update of Kimi K2 0711. It is a large-scale Mixture-of-Experts (MoE) language model developed by Moonshot AI, featuring 1 trillion total parameters with 32 billion active per forward pass. It supports long-context inference up to 256k tokens, extended from the previous 128k.\nThis update improves agentic coding with higher accuracy and better generalization across scaffolds, and enhances frontend coding with more aesthetic and functional outputs for web, 3D, and related tasks. Kimi K2 is optimized for agentic capabilities, including advanced tool use, reasoning, and code synthesis. It excels across coding (LiveCodeBench, SWE-bench), reasoning (ZebraLogic, GPQA), and tool-use (Tau2, AceBench) benchmarks. The model is trained with a novel stack incorporating the MuonClip optimizer for stable large-scale MoE training.",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "Kimi K2 0905",
"model_type": "chat",
"max_output_tokens": 262144,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1753233789,
"id": "qwen/qwen3-coder-480b-a35b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 13000,
"title": "qwen/qwen3-coder-480b-a35b-instruct",
"description": "Qwen3-Coder-480B-A35B-Instruct is a cutting-edge open coding model from Qwen, matching Claude Sonnet’s performance in agentic programming, browser automation, and core development tasks. With native 256K context (extendable to 1M tokens via YaRN), it excels at repository-scale analysis and features specialized function-call support for platforms like Qwen Code and CLINE—making it ideal for complex, real-world development workflows.",
"tags": [],
"context_size": 262144,
"status": 1,
"display_name": "Qwen3 Coder 480B A35B Instruct",
"model_type": "chat",
"max_output_tokens": 65536,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1759991077,
"id": "qwen/qwen3-coder-30b-a3b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 700,
"output_token_price_per_m": 2700,
"title": "qwen/qwen3-coder-30b-a3b-instruct",
"description": "Qwen3-Coder-30B-A3B-Instruct is a 30.5B parameter Mixture-of-Experts (MoE) model with 128 experts (8 active per forward pass), designed for advanced code generation, repository-scale understanding, and agentic tool use. Built on the Qwen3 architecture, it supports a native context length of 256K tokens (extendable to 1M with Yarn) and performs strongly in tasks involving function calls, browser use, and structured code completion.\n\nThis model is optimized for instruction-following without “thinking mode”, and integrates well with OpenAI-compatible tool-use formats.",
"tags": [],
"context_size": 160000,
"status": 1,
"display_name": "Qwen3 Coder 30b A3B Instruct",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1754438873,
"id": "openai/gpt-oss-120b",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 500,
"output_token_price_per_m": 2500,
"title": "openai/gpt-oss-120b",
"description": "gpt-oss-120b is an open-weight, 117B-parameter Mixture-of-Experts (MoE) language model from OpenAI designed for high-reasoning, agentic, and general-purpose production use cases. It activates 5.1B parameters per forward pass and is optimized to run on a single H100 GPU with native MXFP4 quantization. The model supports configurable reasoning depth, full chain-of-thought access, and native tool use, including function calling, browsing, and structured output generation.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "OpenAI GPT OSS 120B",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "batch-api"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1752263515,
"id": "moonshotai/kimi-k2-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 5700,
"output_token_price_per_m": 23000,
"title": "moonshotai/kimi-k2-instruct",
"description": "Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model with 32 billion activated parameters and 1 trillion total parameters. Trained with the Muon optimizer, Kimi K2 achieves exceptional performance across frontier knowledge, reasoning, and coding tasks while being meticulously optimized for agentic capabilities.Specifically designed for tool use, reasoning, and autonomous problem-solving.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Kimi K2 Instruct",
"model_type": "chat",
"max_output_tokens": 131072,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1742909352,
"id": "deepseek/deepseek-v3-0324",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 2700,
"output_token_price_per_m": 11200,
"title": "deepseek/deepseek-v3-0324",
"description": "DeepSeek V3, a 685B-parameter, mixture-of-experts model, is the latest iteration of the flagship chat model family from the DeepSeek team.",
"tags": [],
"context_size": 163840,
"status": 1,
"display_name": "DeepSeek V3 0324",
"model_type": "chat",
"max_output_tokens": 163840,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1753709673,
"id": "zai-org/glm-4.5",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6000,
"output_token_price_per_m": 22000,
"title": "zai-org/glm-4.5",
"description": "GLM-4.5 Series Models are foundation models specifically engineered for intelligent agents. The flagship GLM-4.5 integrates 355 billion total parameters (32 billion active), unifying reasoning, coding, and agent capabilities to address complex application demands.\nAs a hybrid reasoning system, it offers dual operational modes:\n- Thinking Mode: Enables complex reasoning, tool invocation, and strategic planning\n- Non-Thinking Mode: Delivers low-latency responses for real-time interactions\nThis architecture bridges high-performance AI with adaptive functionality for dynamic agent environments.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "GLM-4.5",
"model_type": "chat",
"max_output_tokens": 98304,
"features": ["function-calling", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1753443150,
"id": "qwen/qwen3-235b-a22b-thinking-2507",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 30000,
"title": "qwen/qwen3-235b-a22b-thinking-2507",
"description": "The Qwen3-235B-A22B-Thinking-2507 represents the newest thinking-enabled model in the Qwen3 series, delivering groundbreaking improvements in reasoning capabilities. This advanced AI demonstrates significantly enhanced performance across logical reasoning, mathematics, scientific analysis, coding tasks, and academic benchmarks - matching or even surpassing human-expert level performance to achieve state-of-the-art results among open-source thinking models. Beyond its exceptional reasoning skills, the model shows markedly better general capabilities including more precise instruction following, sophisticated tool usage, highly natural text generation, and improved alignment with human preferences. It also features enhanced 256K long-context understanding, allowing it to maintain coherence and depth across extended documents and complex discussions.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 235B A22b Thinking 2507",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "anthropic"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1721801867,
"id": "meta-llama/llama-3.1-8b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 200,
"output_token_price_per_m": 500,
"title": "meta-llama/llama-3.1-8b-instruct",
"description": "Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations. The 8B instruct-tuned version is particularly fast and efficient. It has demonstrated strong performance in human evaluations, outperforming several leading closed-source models.",
"tags": [],
"context_size": 16384,
"status": 1,
"display_name": "Llama 3.1 8B Instruct",
"model_type": "chat",
"max_output_tokens": 16384,
"features": ["serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1756965597,
"id": "google/gemma-3-12b-it",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 500,
"output_token_price_per_m": 1000,
"title": "google/gemma-3-12b-it",
"description": "",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Gemma3 12B",
"model_type": "chat",
"max_output_tokens": 8192,
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1754914926,
"id": "zai-org/glm-4.5v",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6000,
"output_token_price_per_m": 18000,
"title": "zai-org/glm-4.5v",
"description": "Z.ai's GLM-4.5V sets a new standard in visual reasoning, achieving SOTA performance across 42 benchmarks among open-source models. Beyond benchmarks, it excels in real-world applications through hybrid training, enabling comprehensive visual understanding—from image/video analysis and GUI interaction to complex document processing and precise visual grounding.\n\nIn China's GeoGuessr challenge, GLM-4.5V surpassed 99% of 21,000 human players within 16 hours, reaching 66th place in a week. Built on the GLM-4.5-Air foundation and inheriting GLM-4.1V-Thinking's approach, it leverages a 106B-parameter MoE architecture for scalable, efficient performance. This model bridges advanced AI research with practical deployment, delivering unmatched visual intelligence",
"tags": [],
"context_size": 65536,
"status": 1,
"display_name": "GLM 4.5V",
"model_type": "chat",
"max_output_tokens": 16384,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text", "video", "image"],
"output_modalities": ["text"]
},
{
"created": 1754438961,
"id": "openai/gpt-oss-20b",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 400,
"output_token_price_per_m": 1500,
"title": "openai/gpt-oss-20b",
"description": "gpt-oss-20b is an open-weight 21B parameter model released by OpenAI under the Apache 2.0 license. It uses a Mixture-of-Experts (MoE) architecture with 3.6B active parameters per forward pass, optimized for lower-latency inference and deployability on consumer or single-GPU hardware. The model is trained in OpenAI’s Harmony response format and supports reasoning level configuration, fine-tuning, and agentic capabilities including function calling, tool use, and structured outputs.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "OpenAI: GPT OSS 20B",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text", "image"],
"output_modalities": ["text"]
},
{
"created": 1753176794,
"id": "qwen/qwen3-235b-a22b-instruct-2507",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 900,
"output_token_price_per_m": 5800,
"title": "qwen/qwen3-235b-a22b-instruct-2507",
"description": "Qwen3-235B-A22B-Instruct-2507 is a multilingual, instruction-tuned mixture-of-experts language model based on the Qwen3-235B architecture, with 22B active parameters per forward pass. It is optimized for general-purpose text generation, including instruction following, logical reasoning, math, code, and tool usage. The model supports a native 262K context length and does not implement \"thinking mode\" (\u003cthink\u003e blocks).\nCompared to its base variant, this version delivers significant gains in knowledge coverage, long-context reasoning, coding benchmarks, and alignment with open-ended tasks. It is particularly strong on multilingual understanding, math reasoning (e.g., AIME, HMMT), and alignment evaluations like Arena-Hard and WritingBench.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Qwen3 235B A22B Instruct 2507",
"model_type": "chat",
"max_output_tokens": 16384,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1738498371,
"id": "deepseek/deepseek-r1-distill-qwen-14b",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 1500,
"output_token_price_per_m": 1500,
"title": "deepseek/deepseek-r1-distill-qwen-14b",
"description": "DeepSeek R1 Distill Qwen 14B is a distilled large language model based on Qwen 2.5 14B, using outputs from DeepSeek R1. It outperforms OpenAI's o1-mini across various benchmarks, achieving new state-of-the-art results for dense models.\n\nOther benchmark results include:\n\nAIME 2024 pass@1: 69.7\nMATH-500 pass@1: 93.9\nCodeForces Rating: 1481\nThe model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models.",
"tags": [],
"context_size": 32768,
"status": 1,
"display_name": "DeepSeek R1 Distill Qwen 14B",
"model_type": "chat",
"max_output_tokens": 16384,
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1733560109,
"id": "meta-llama/llama-3.3-70b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 1350,
"output_token_price_per_m": 4000,
"title": "meta-llama/llama-3.3-70b-instruct",
"description": "The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.\n\nSupported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.",
"tags": [],
"context_size": 131072,
"status": 1,
"display_name": "Llama 3.3 70B Instruct",
"model_type": "chat",
"max_output_tokens": 120000,
"features": ["function-calling", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1728962258,
"id": "qwen/qwen-2.5-72b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3800,
"output_token_price_per_m": 4000,
"title": "qwen/qwen-2.5-72b-instruct",
"description": "Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters.",
"tags": [],
"context_size": 32000,
"status": 1,
"display_name": "Qwen 2.5 72B Instruct",
"model_type": "chat",
"max_output_tokens": 8192,
"features": ["function-calling", "structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1722337858,
"id": "mistralai/mistral-nemo",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 400,
"output_token_price_per_m": 1700,
"title": "mistralai/mistral-nemo",
"description": "A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi. It supports function calling and is released under the Apache 2.0 license.",
"tags": [],
"context_size": 60288,
"status": 1,
"display_name": "Mistral Nemo",
"model_type": "chat",
"max_output_tokens": 16000,
"features": ["structured-outputs", "serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1750139830,
"id": "minimaxai/minimax-m1-80k",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 5500,
"output_token_price_per_m": 22000,
"title": "minimaxai/minimax-m1-80k",
"description": "MiniMax-M1: The World's First Open-Weight, Large-Scale Hybrid Attention Inference Model\n\nMiniMax-M1 adopts a Mixture of Experts (MoE) architecture and integrates the Flash Attention mechanism. The model contains a total of 456 billion parameters, with 45.9 billion parameters activated per token.\n\nNatively, the M1 model supports a context length of 1 million tokens—8 times that of DeepSeek R1. Additionally, by combining the CISPO algorithm with an efficient hybrid attention design for reinforcement learning training, MiniMax-M1 achieves industry-leading performance in long-context reasoning and real-world software engineering scenarios.",
"tags": [],
"context_size": 1000000,
"status": 1,
"display_name": "MiniMax M1",
"model_type": "chat",
"max_output_tokens": 40000,
"features": ["function-calling", "reasoning", "serverless"],
"endpoints": ["chat/completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1748457624,
"id": "deepseek/deepseek-r1-0528",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 7000,
"output_token_price_per_m": 25000,
"title": "deepseek/deepseek-r1-0528",
"description": "DeepSeek R1 0528 is the latest open-source model released by the DeepSeek team, featuring impressive reasoning capabilities, particularly achieving performance comparable to OpenAI's o1 model in mathematics, coding, and reasoning tasks.",
"tags": [],
"context_size": 163840,
"status": 1,
"display_name": "DeepSeek R1 0528",
"model_type": "chat",
"max_output_tokens": 32768,
"features": ["function-calling", "structured-outputs", "reasoning", "serverless"],
"endpoints": ["chat/completions", "completions", "batch-api"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1738498293,
"id": "deepseek/deepseek-r1-distill-qwen-32b",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 3000,
"output_token_price_per_m": 3000,
"title": "deepseek/deepseek-r1-distill-qwen-32b",
"description": "DeepSeek R1 Distill Qwen 32B is a distilled large language model based on Qwen 2.5 32B, using outputs from DeepSeek R1. It outperforms OpenAI's o1-mini across various benchmarks, achieving new state-of-the-art results for dense models.\n\nOther benchmark results include:\nAIME 2024 pass@1: 72.6\nMATH-500 pass@1: 94.3\nCodeForces Rating: 1691\nThe model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models.",
"tags": [],
"context_size": 64000,
"status": 1,
"display_name": "DeepSeek R1 Distill Qwen 32B",
"model_type": "chat",
"max_output_tokens": 32000,
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1714024874,
"id": "meta-llama/llama-3-8b-instruct",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 400,
"output_token_price_per_m": 400,
"title": "meta-llama/llama-3-8b-instruct",
"description": "Meta's latest class of model (Llama 3) launched with a variety of sizes \u0026 flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations.",
"tags": [],
"context_size": 8192,
"status": 1,
"display_name": "Llama 3 8B Instruct",
"model_type": "chat",
"max_output_tokens": 8192,
"features": ["serverless"],
"endpoints": ["chat/completions", "completions"],
"input_modalities": ["text"],
"output_modalities": ["text"]
},
{
"created": 1713938472,
"id": "microsoft/wizardlm-2-8x22b",
"object": "model",
"owned_by": "unknown",
"permission": null,
"root": "",
"parent": "",
"input_token_price_per_m": 6200,
"output_token_price_per_m": 6200,
"title": "microsoft/wizardlm-2-8x22b",
"description": "WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.",
"tags": [],
"context_size": 65535,