pretrain llm weight load issue

[poem2018]

Hi,

Thanks for the great work! I am trying to run the inference code according to the instruction, and met this error when loading the pretraining weight, is there any issue to resolve this?

llm = AutoModelForCausalLM.from_pretrained(model_name_or_path, config=llm_cfg, torch_dtype=eval(config.model_dtype), *args, **kwargs)

Error: safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

[zhuoyang20]

Hi @poem2018 ,

Could you provide more details about your intended purpose and usage? The pre-trained weights for VILA-U can be easily loaded using the following command:

import vila_u
vila_u.load("vila-u-7b-256") # pre-trained model path 

Best,
Zhuoyang