add filter_prefix and del_filter_prefix

[SongDI911]

It is hoped that to_diffuser exposes the parameter filter_prefix to avoid some models reporting errors during loading, for example
ValueError: Incompatible keys detected:
lora_unet_img_in.alpha, lora_unet_txt_in.alpha

[lmxyy]

any LoRA example for this?

[SongDI911]

any LoRA example for this?

Some lora trained using the Qinglong script
like thie
#265

[qiujunhan]

I also encountered this issue while using this model
https://civitai.com/models/1304167/flux1-drealistic-lesstouhou-projectgreater-cosplay-costume-collection-orprojectcos?modelVersionId=1660412

[qiujunhan]

I used this piece of code, copied it to /root/anaconda3/lib/python3.12/site-packages/nunchaku in the environment, but it still reported an error when running.
Used LoRA model: https://civitai.com/models/1304167/flux1-drealistic-lesstouhou-projectgreater-cosplay-costume-collection-orprojectcos?modelVersionId=1660412

File "/comfyui_vol/ComfyUI/execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/comfyui_vol/ComfyUI/execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/comfyui_vol/ComfyUI/execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "/comfyui_vol/ComfyUI/execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/comfyui_vol/ComfyUI/custom_nodes/ComfyUI-nunchaku/nodes/lora/flux.py", line 68, in load_lora
sd = to_diffusers(lora_path)
^^^^^^^^^^^^^^^^^^^^^^^
File "/root/anaconda3/lib/python3.12/site-packages/nunchaku/lora/flux/diffusers_converter.py", line 17, in to_diffusers
logger = logging.getLogger(name)
^^^^^^^^^^^
File "/root/anaconda3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 1706, in lora_state_dict
state_dict = _convert_kohya_flux_lora_to_diffusers(state_dict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 882, in _convert_kohya_flux_lora_to_diffusers
return _convert_sd_scripts_to_ai_toolkit(state_dict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 627, in _convert_sd_scripts_to_ai_toolkit
raise ValueError(f"Incompatible keys detected: \n\n {', '.join(remaining_keys)}")
ValueError: Incompatible keys detected:

lora_unet_img_in.alpha, lora_unet_txt_in.alpha

[SongDI911]

I used this piece of code, copied it to /root/anaconda3/lib/python3.12/site-packages/nunchaku in the environment, but it still reported an error when running. Used LoRA model: https://civitai.com/models/1304167/flux1-drealistic-lesstouhou-projectgreater-cosplay-costume-collection-orprojectcos?modelVersionId=1660412

File "/comfyui_vol/ComfyUI/execution.py", line 327, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/execution.py", line 202, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/execution.py", line 174, in _map_node_over_list process_inputs(input_dict, i) File "/comfyui_vol/ComfyUI/execution.py", line 163, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/custom_nodes/ComfyUI-nunchaku/nodes/lora/flux.py", line 68, in load_lora sd = to_diffusers(lora_path) ^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/nunchaku/lora/flux/diffusers_converter.py", line 17, in to_diffusers logger = logging.getLogger(name) ^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 1706, in lora_state_dict state_dict = _convert_kohya_flux_lora_to_diffusers(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 882, in _convert_kohya_flux_lora_to_diffusers return _convert_sd_scripts_to_ai_toolkit(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 627, in _convert_sd_scripts_to_ai_toolkit raise ValueError(f"Incompatible keys detected: \n\n {', '.join(remaining_keys)}") ValueError: Incompatible keys detected:

lora_unet_img_in.alpha, lora_unet_txt_in.alpha

https://github.com/SongDI911/ComfyUI-nunchakuhttps://github.com/SongDI911/ComfyUI-nunchaku
or
https://github.com/SongDI911/ComfyUI-nunchaku/tree/adaptation_qinglong

[qiujunhan]

I used this piece of code, copied it to /root/anaconda3/lib/python3.12/site-packages/nunchaku in the environment, but it still reported an error when running. Used LoRA model: https://civitai.com/models/1304167/flux1-drealistic-lesstouhou-projectgreater-cosplay-costume-collection-orprojectcos?modelVersionId=1660412我使用了这段代码，将其复制到环境中的 /root/anaconda3/lib/python3.12/site-packages/nunchaku，但在运行时仍然报错。使用的 LoRA 模型：https://civitai.com/models/1304167/flux1-drealistic-lesstouhou-projectgreater-cosplay-costume-collection-orprojectcos?modelVersionId=1660412
File "/comfyui_vol/ComfyUI/execution.py", line 327, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/execution.py", line 202, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/execution.py", line 174, in _map_node_over_list process_inputs(input_dict, i) File "/comfyui_vol/ComfyUI/execution.py", line 163, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/comfyui_vol/ComfyUI/custom_nodes/ComfyUI-nunchaku/nodes/lora/flux.py", line 68, in load_lora sd = to_diffusers(lora_path) ^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/nunchaku/lora/flux/diffusers_converter.py", line 17, in to_diffusers logger = logging.getLogger(name) ^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 1706, in lora_state_dict state_dict = _convert_kohya_flux_lora_to_diffusers(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 882, in _convert_kohya_flux_lora_to_diffusers return _convert_sd_scripts_to_ai_toolkit(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 627, in _convert_sd_scripts_to_ai_toolkit raise ValueError(f"Incompatible keys detected: \n\n {', '.join(remaining_keys)}") ValueError: Incompatible keys detected:文件 "/comfyui_vol/ComfyUI/execution.py" 第 327 行，在 execute 函数中输出数据，输出 UI，has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 文件 "/comfyui_vol/ComfyUI/execution.py" 第 202 行，在 get_output_data 函数中 return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 文件 "/comfyui_vol/ComfyUI/execution.py" 第 174 行，在 _map_node_over_list 函数中 process_inputs(input_dict, i) 文件 "/comfyui_vol/ComfyUI/execution.py" 第 163 行，在 process_inputs 函数中 results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^ 文件 "/comfyui_vol/ComfyUI/custom_nodes/ComfyUI-nunchaku/nodes/lora/flux.py" 第 68 行，在 load_lora 函数中 sd = to_diffusers(lora_path) ^^^^^^^^^^^^^^^^^^^^^^^ 文件 "/root/anaconda3/lib/python3.12/site-packages/nunchaku/lora/flux/diffusers_converter.py" 第 17, in to_diffusers logger = logging.getLogger(name) ^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 1706, in lora_state_dict state_dict = _convert_kohya_flux_lora_to_diffusers(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 882, in _convert_kohya_flux_lora_to_diffusers return _convert_sd_scripts_to_ai_toolkit(state_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/anaconda3/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 627, in _convert_sd_scripts_to_ai_toolkit raise ValueError(f"Incompatible keys detected: \n\n {', '.join(remaining_keys)}") ValueError: 检测到不兼容的键：
lora_unet_img_in.alpha, lora_unet_txt_in.alpha

https://github.com/SongDI911/ComfyUI-nunchakuhttps://github.com/SongDI911/ComfyUI-nunchaku or   或者 https://github.com/SongDI911/ComfyUI-nunchaku/tree/adaptation_qinglong

It ran successfully, thank you very much