Support for Granite4 hybrid architecture #16208
Description
Checklist
- If this is not a feature request but a general question, please start a discussion at https://github.com/sgl-project/sglang/discussions. Otherwise, it will be closed.
- Please use English. Otherwise, it will be closed.
Motivation
Hello! Granite4 hybrid architecture (https://github.com/huggingface/transformers/blob/main/src/transformers/models/granitemoehybrid/modeling_granitemoehybrid.py#L1442) is yet not supported in Sglang.
Adding its support will be really helpful, are there plans to include it any soon?
Related resources
No response