Skip to content

[Feature]Support Ling2.5 Series #1027

@JamesBrianD

Description

@JamesBrianD

Checklist

Motivation

Supports the Ling 2.5 series models.

Goals

  1. Achieve an aime26 of ~73 with Ling-2.6-flash.

Task Breakdown

  1. Merged via the recurrent state memory pools system dependency. [Feature] Hybrid recurrent state management for KDA layers #946
  2. Integrated GLA Kernel + LightningAttnBackend [RFC] GLA Kernel + LightningAttnBackend Integration #1032
  3. Bailing moe 2.5 modeling
  4. Verify the accuracy of the Ling 2.6 flash model
  5. Support Ling 2.6-1T

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions