-
Notifications
You must be signed in to change notification settings - Fork 283
Open
Description
I am trying to quantize AIDC-AI/Ovis2.5-2B (https://huggingface.co/AIDC-AI/Ovis2.5-2B) and im getting
File "/home/ubuntu/captioning/llm-awq/awq/quantize/pre_quant.py", line 53, in get_blocks
raise NotImplementedError(type(model))
NotImplementedError: <class 'transformers_modules.modeling_ovis2_5.Ovis2_5'>
Metadata
Metadata
Assignees
Labels
No labels