tinyllava/training_recipe/qlora_recipe.py设置矛盾 #198
Description
tinyllava/training_recipe/qlora_recipe.py这个设置是矛盾的吧8bit，4bit都为True
quantization_config = BitsAndBytesConfig(
load_in_8bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=llm_dtype
)