[Bug] PuLID + LoRA

[windFFYL]

Requested to load Flux
loaded completely 3642.3314515075685 922.6993408203125 True
!!! Exception during processing !!! Error(s) in loading state_dict for NunchakuFluxTransformer2dModel:
Missing key(s) in state_dict: "transformer_blocks.0.pulid_ca.0.norm1.weight", "transformer_blocks.0.pulid_ca.0.norm1.bias", "transformer_blocks.0.pulid_ca.0.norm2.weight", "transformer_blocks.0.pulid_ca.0.norm2.bias", "transformer_blocks.0.pulid_ca.0.to_q.weight", "transformer_blocks.0.pulid_ca.0.to_kv.weight", "transformer_blocks.0.pulid_ca.0.to_out.weight", "transformer_blocks.0.pulid_ca.1.norm1.weight", "transformer_blocks.0.pulid_ca.1.norm1.bias", "transformer_blocks.0.pulid_ca.1.norm2.weight", "transformer_blocks.0.pulid_ca.1.norm2.bias", "transformer_blocks.0.pulid_ca.1.to_q.weight", "transformer_blocks.0.pulid_ca.1.to_kv.weight", "transformer_blocks.0.pulid_ca.1.to_out.weight", "transformer_blocks.0.pulid_ca.2.norm1.weight", "transformer_blocks.0.pulid_ca.2.norm1.bias", "transformer_blocks.0.pulid_ca.2.norm2.weight", "transformer_blocks.0.pulid_ca.2.norm2.bias", "transformer_blocks.0.pulid_ca.2.to_q.weight", "transformer_blocks.0.pulid_ca.2.to_kv.weight", "transformer_blocks.0.pulid_ca.2.to_out.weight", "transformer_blocks.0.pulid_ca.3.norm1.weight", "transformer_blocks.0.pulid_ca.3.norm1.bias", "transformer_blocks.0.pulid_ca.3.norm2.weight", "transformer_blocks.0.pulid_ca.3.norm2.bias", "transformer_blocks.0.pulid_ca.3.to_q.weight", "transformer_blocks.0.pulid_ca.3.to_kv.weight", "transformer_blocks.0.pulid_ca.3.to_out.weight", "transformer_blocks.0.pulid_ca.4.norm1.weight", "transformer_blocks.0.pulid_ca.4.norm1.bias", "transformer_blocks.0.pulid_ca.4.norm2.weight", "transformer_blocks.0.pulid_ca.4.norm2.bias", "transformer_blocks.0.pulid_ca.4.to_q.weight", "transformer_blocks.0.pulid_ca.4.to_kv.weight", "transformer_blocks.0.pulid_ca.4.to_out.weight", "transformer_blocks.0.pulid_ca.5.norm1.weight", "transformer_blocks.0.pulid_ca.5.norm1.bias", "transformer_blocks.0.pulid_ca.5.norm2.weight", "transformer_blocks.0.pulid_ca.5.norm2.bias", "transformer_blocks.0.pulid_ca.5.to_q.weight", "transformer_blocks.0.pulid_ca.5.to_kv.weight", "transformer_blocks.0.pulid_ca.5.to_out.weight", "transformer_blocks.0.pulid_ca.6.norm1.weight", "transformer_blocks.0.pulid_ca.6.norm1.bias", "transformer_blocks.0.pulid_ca.6.norm2.weight", "transformer_blocks.0.pulid_ca.6.norm2.bias", "transformer_blocks.0.pulid_ca.6.to_q.weight", "transformer_blocks.0.pulid_ca.6.to_kv.weight", "transformer_blocks.0.pulid_ca.6.to_out.weight", "transformer_blocks.0.pulid_ca.7.norm1.weight", "transformer_blocks.0.pulid_ca.7.norm1.bias", "transformer_blocks.0.pulid_ca.7.norm2.weight", "transformer_blocks.0.pulid_ca.7.norm2.bias", "transformer_blocks.0.pulid_ca.7.to_q.weight", "transformer_blocks.0.pulid_ca.7.to_kv.weight", "transformer_blocks.0.pulid_ca.7.to_out.weight", "transformer_blocks.0.pulid_ca.8.norm1.weight", "transformer_blocks.0.pulid_ca.8.norm1.bias", "transformer_blocks.0.pulid_ca.8.norm2.weight", "transformer_blocks.0.pulid_ca.8.norm2.bias", "transformer_blocks.0.pulid_ca.8.to_q.weight", "transformer_blocks.0.pulid_ca.8.to_kv.weight", "transformer_blocks.0.pulid_ca.8.to_out.weight", "transformer_blocks.0.pulid_ca.9.norm1.weight", "transformer_blocks.0.pulid_ca.9.norm1.bias", "transformer_blocks.0.pulid_ca.9.norm2.weight", "transformer_blocks.0.pulid_ca.9.norm2.bias", "transformer_blocks.0.pulid_ca.9.to_q.weight", "transformer_blocks.0.pulid_ca.9.to_kv.weight", "transformer_blocks.0.pulid_ca.9.to_out.weight", "transformer_blocks.0.pulid_ca.10.norm1.weight", "transformer_blocks.0.pulid_ca.10.norm1.bias", "transformer_blocks.0.pulid_ca.10.norm2.weight", "transformer_blocks.0.pulid_ca.10.norm2.bias", "transformer_blocks.0.pulid_ca.10.to_q.weight", "transformer_blocks.0.pulid_ca.10.to_kv.weight", "transformer_blocks.0.pulid_ca.10.to_out.weight", "transformer_blocks.0.pulid_ca.11.norm1.weight", "transformer_blocks.0.pulid_ca.11.norm1.bias", "transformer_blocks.0.pulid_ca.11.norm2.weight", "transformer_blocks.0.pulid_ca.11.norm2.bias", "transformer_blocks.0.pulid_ca.11.to_q.weight", "transformer_blocks.0.pulid_ca.11.to_kv.weight", "transformer_blocks.0.pulid_ca.11.to_out.weight", "transformer_blocks.0.pulid_ca.12.norm1.weight", "transformer_blocks.0.pulid_ca.12.norm1.bias", "transformer_blocks.0.pulid_ca.12.norm2.weight", "transformer_blocks.0.pulid_ca.12.norm2.bias", "transformer_blocks.0.pulid_ca.12.to_q.weight", "transformer_blocks.0.pulid_ca.12.to_kv.weight", "transformer_blocks.0.pulid_ca.12.to_out.weight", "transformer_blocks.0.pulid_ca.13.norm1.weight", "transformer_blocks.0.pulid_ca.13.norm1.bias", "transformer_blocks.0.pulid_ca.13.norm2.weight", "transformer_blocks.0.pulid_ca.13.norm2.bias", "transformer_blocks.0.pulid_ca.13.to_q.weight", "transformer_blocks.0.pulid_ca.13.to_kv.weight", "transformer_blocks.0.pulid_ca.13.to_out.weight", "transformer_blocks.0.pulid_ca.14.norm1.weight", "transformer_blocks.0.pulid_ca.14.norm1.bias", "transformer_blocks.0.pulid_ca.14.norm2.weight", "transformer_blocks.0.pulid_ca.14.norm2.bias", "transformer_blocks.0.pulid_ca.14.to_q.weight", "transformer_blocks.0.pulid_ca.14.to_kv.weight", "transformer_blocks.0.pulid_ca.14.to_out.weight", "transformer_blocks.0.pulid_ca.15.norm1.weight", "transformer_blocks.0.pulid_ca.15.norm1.bias", "transformer_blocks.0.pulid_ca.15.norm2.weight", "transformer_blocks.0.pulid_ca.15.norm2.bias", "transformer_blocks.0.pulid_ca.15.to_q.weight", "transformer_blocks.0.pulid_ca.15.to_kv.weight", "transformer_blocks.0.pulid_ca.15.to_out.weight", "transformer_blocks.0.pulid_ca.16.norm1.weight", "transformer_blocks.0.pulid_ca.16.norm1.bias", "transformer_blocks.0.pulid_ca.16.norm2.weight", "transformer_blocks.0.pulid_ca.16.norm2.bias", "transformer_blocks.0.pulid_ca.16.to_q.weight", "transformer_blocks.0.pulid_ca.16.to_kv.weight", "transformer_blocks.0.pulid_ca.16.to_out.weight", "transformer_blocks.0.pulid_ca.17.norm1.weight", "transformer_blocks.0.pulid_ca.17.norm1.bias", "transformer_blocks.0.pulid_ca.17.norm2.weight", "transformer_blocks.0.pulid_ca.17.norm2.bias", "transformer_blocks.0.pulid_ca.17.to_q.weight", "transformer_blocks.0.pulid_ca.17.to_kv.weight", "transformer_blocks.0.pulid_ca.17.to_out.weight", "transformer_blocks.0.pulid_ca.18.norm1.weight", "transformer_blocks.0.pulid_ca.18.norm1.bias", "transformer_blocks.0.pulid_ca.18.norm2.weight", "transformer_blocks.0.pulid_ca.18.norm2.bias", "transformer_blocks.0.pulid_ca.18.to_q.weight", "transformer_blocks.0.pulid_ca.18.to_kv.weight", "transformer_blocks.0.pulid_ca.18.to_out.weight", "transformer_blocks.0.pulid_ca.19.norm1.weight", "transformer_blocks.0.pulid_ca.19.norm1.bias", "transformer_blocks.0.pulid_ca.19.norm2.weight", "transformer_blocks.0.pulid_ca.19.norm2.bias", "transformer_blocks.0.pulid_ca.19.to_q.weight", "transformer_blocks.0.pulid_ca.19.to_kv.weight", "transformer_blocks.0.pulid_ca.19.to_out.weight".
Traceback (most recent call last):
File "L:\AIgongju\ComfyUI-aki-v1.1\execution.py", line 349, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\execution.py", line 224, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\execution.py", line 196, in _map_node_over_list
process_inputs(input_dict, i)
File "L:\AIgongju\ComfyUI-aki-v1.1\execution.py", line 185, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy_extras\nodes_custom_sampler.py", line 707, in sample
samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 1014, in sample
output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 982, in outer_sample
output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 965, in inner_sample
samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 744, in sample
samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\custom_nodes\ComfyUI-Detail-Daemon\detail_daemon_node.py", line 473, in lying_sigma_sampler
return lss_wrapped_sampler.sampler_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\k_diffusion\sampling.py", line 161, in sample_euler
denoised = model(x, sigma_hat * s_in, **extra_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\custom_nodes\ComfyUI-Detail-Daemon\detail_daemon_node.py", line 465, in model_wrapper
return model(x, sigma, **extra_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 396, in call
out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 945, in call
return self.predict_noise(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 948, in predict_noise
return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 376, in sampling_function
out = calc_cond_batch(model, conds, x, timestep, model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 206, in calc_cond_batch
return executor.execute(model, conds, x_in, timestep, model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\samplers.py", line 325, in calc_cond_batch
output = model.apply_model(input_x, timestep, **c).chunk(batch_chunks)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\model_base.py", line 148, in apply_model
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\comfy\model_base.py", line 186, in _apply_model
model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "L:\AIgongju\ComfyUI-aki-v1.1\custom_nodes\ComfyUI-nunchaku\nodes\models\flux.py", line 97, in forward
model.update_lora_params(composed_lora)
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\nunchaku\models\transformers\transformer_flux.py", line 528, in update_lora_params
self._update_unquantized_part_lora_params(1)
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\nunchaku\models\transformers\transformer_flux.py", line 505, in _update_unquantized_part_lora_params
self.load_state_dict(new_state_dict, strict=True)
File "L:\AIgongju\ComfyUI-aki-v1.1\python\Lib\site-packages\torch\nn\modules\module.py", line 2593, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for NunchakuFluxTransformer2dModel:
Missing key(s) in state_dict: "transformer_blocks.0.pulid_ca.0.norm1.weight", "transformer_blocks.0.pulid_ca.0.norm1.bias", "transformer_blocks.0.pulid_ca.0.norm2.weight", "transformer_blocks.0.pulid_ca.0.norm2.bias", "transformer_blocks.0.pulid_ca.0.to_q.weight", "transformer_blocks.0.pulid_ca.0.to_kv.weight", "transformer_blocks.0.pulid_ca.0.to_out.weight", "transformer_blocks.0.pulid_ca.1.norm1.weight", "transformer_blocks.0.pulid_ca.1.norm1.bias", "transformer_blocks.0.pulid_ca.1.norm2.weight", "transformer_blocks.0.pulid_ca.1.norm2.bias", "transformer_blocks.0.pulid_ca.1.to_q.weight", "transformer_blocks.0.pulid_ca.1.to_kv.weight", "transformer_blocks.0.pulid_ca.1.to_out.weight", "transformer_blocks.0.pulid_ca.2.norm1.weight", "transformer_blocks.0.pulid_ca.2.norm1.bias", "transformer_blocks.0.pulid_ca.2.norm2.weight", "transformer_blocks.0.pulid_ca.2.norm2.bias", "transformer_blocks.0.pulid_ca.2.to_q.weight", "transformer_blocks.0.pulid_ca.2.to_kv.weight", "transformer_blocks.0.pulid_ca.2.to_out.weight", "transformer_blocks.0.pulid_ca.3.norm1.weight", "transformer_blocks.0.pulid_ca.3.norm1.bias", "transformer_blocks.0.pulid_ca.3.norm2.weight", "transformer_blocks.0.pulid_ca.3.norm2.bias", "transformer_blocks.0.pulid_ca.3.to_q.weight", "transformer_blocks.0.pulid_ca.3.to_kv.weight", "transformer_blocks.0.pulid_ca.3.to_out.weight", "transformer_blocks.0.pulid_ca.4.norm1.weight", "transformer_blocks.0.pulid_ca.4.norm1.bias", "transformer_blocks.0.pulid_ca.4.norm2.weight", "transformer_blocks.0.pulid_ca.4.norm2.bias", "transformer_blocks.0.pulid_ca.4.to_q.weight", "transformer_blocks.0.pulid_ca.4.to_kv.weight", "transformer_blocks.0.pulid_ca.4.to_out.weight", "transformer_blocks.0.pulid_ca.5.norm1.weight", "transformer_blocks.0.pulid_ca.5.norm1.bias", "transformer_blocks.0.pulid_ca.5.norm2.weight", "transformer_blocks.0.pulid_ca.5.norm2.bias", "transformer_blocks.0.pulid_ca.5.to_q.weight", "transformer_blocks.0.pulid_ca.5.to_kv.weight", "transformer_blocks.0.pulid_ca.5.to_out.weight", "transformer_blocks.0.pulid_ca.6.norm1.weight", "transformer_blocks.0.pulid_ca.6.norm1.bias", "transformer_blocks.0.pulid_ca.6.norm2.weight", "transformer_blocks.0.pulid_ca.6.norm2.bias", "transformer_blocks.0.pulid_ca.6.to_q.weight", "transformer_blocks.0.pulid_ca.6.to_kv.weight", "transformer_blocks.0.pulid_ca.6.to_out.weight", "transformer_blocks.0.pulid_ca.7.norm1.weight", "transformer_blocks.0.pulid_ca.7.norm1.bias", "transformer_blocks.0.pulid_ca.7.norm2.weight", "transformer_blocks.0.pulid_ca.7.norm2.bias", "transformer_blocks.0.pulid_ca.7.to_q.weight", "transformer_blocks.0.pulid_ca.7.to_kv.weight", "transformer_blocks.0.pulid_ca.7.to_out.weight", "transformer_blocks.0.pulid_ca.8.norm1.weight", "transformer_blocks.0.pulid_ca.8.norm1.bias", "transformer_blocks.0.pulid_ca.8.norm2.weight", "transformer_blocks.0.pulid_ca.8.norm2.bias", "transformer_blocks.0.pulid_ca.8.to_q.weight", "transformer_blocks.0.pulid_ca.8.to_kv.weight", "transformer_blocks.0.pulid_ca.8.to_out.weight", "transformer_blocks.0.pulid_ca.9.norm1.weight", "transformer_blocks.0.pulid_ca.9.norm1.bias", "transformer_blocks.0.pulid_ca.9.norm2.weight", "transformer_blocks.0.pulid_ca.9.norm2.bias", "transformer_blocks.0.pulid_ca.9.to_q.weight", "transformer_blocks.0.pulid_ca.9.to_kv.weight", "transformer_blocks.0.pulid_ca.9.to_out.weight", "transformer_blocks.0.pulid_ca.10.norm1.weight", "transformer_blocks.0.pulid_ca.10.norm1.bias", "transformer_blocks.0.pulid_ca.10.norm2.weight", "transformer_blocks.0.pulid_ca.10.norm2.bias", "transformer_blocks.0.pulid_ca.10.to_q.weight", "transformer_blocks.0.pulid_ca.10.to_kv.weight", "transformer_blocks.0.pulid_ca.10.to_out.weight", "transformer_blocks.0.pulid_ca.11.norm1.weight", "transformer_blocks.0.pulid_ca.11.norm1.bias", "transformer_blocks.0.pulid_ca.11.norm2.weight", "transformer_blocks.0.pulid_ca.11.norm2.bias", "transformer_blocks.0.pulid_ca.11.to_q.weight", "transformer_blocks.0.pulid_ca.11.to_kv.weight", "transformer_blocks.0.pulid_ca.11.to_out.weight", "transformer_blocks.0.pulid_ca.12.norm1.weight", "transformer_blocks.0.pulid_ca.12.norm1.bias", "transformer_blocks.0.pulid_ca.12.norm2.weight", "transformer_blocks.0.pulid_ca.12.norm2.bias", "transformer_blocks.0.pulid_ca.12.to_q.weight", "transformer_blocks.0.pulid_ca.12.to_kv.weight", "transformer_blocks.0.pulid_ca.12.to_out.weight", "transformer_blocks.0.pulid_ca.13.norm1.weight", "transformer_blocks.0.pulid_ca.13.norm1.bias", "transformer_blocks.0.pulid_ca.13.norm2.weight", "transformer_blocks.0.pulid_ca.13.norm2.bias", "transformer_blocks.0.pulid_ca.13.to_q.weight", "transformer_blocks.0.pulid_ca.13.to_kv.weight", "transformer_blocks.0.pulid_ca.13.to_out.weight", "transformer_blocks.0.pulid_ca.14.norm1.weight", "transformer_blocks.0.pulid_ca.14.norm1.bias", "transformer_blocks.0.pulid_ca.14.norm2.weight", "transformer_blocks.0.pulid_ca.14.norm2.bias", "transformer_blocks.0.pulid_ca.14.to_q.weight", "transformer_blocks.0.pulid_ca.14.to_kv.weight", "transformer_blocks.0.pulid_ca.14.to_out.weight", "transformer_blocks.0.pulid_ca.15.norm1.weight", "transformer_blocks.0.pulid_ca.15.norm1.bias", "transformer_blocks.0.pulid_ca.15.norm2.weight", "transformer_blocks.0.pulid_ca.15.norm2.bias", "transformer_blocks.0.pulid_ca.15.to_q.weight", "transformer_blocks.0.pulid_ca.15.to_kv.weight", "transformer_blocks.0.pulid_ca.15.to_out.weight", "transformer_blocks.0.pulid_ca.16.norm1.weight", "transformer_blocks.0.pulid_ca.16.norm1.bias", "transformer_blocks.0.pulid_ca.16.norm2.weight", "transformer_blocks.0.pulid_ca.16.norm2.bias", "transformer_blocks.0.pulid_ca.16.to_q.weight", "transformer_blocks.0.pulid_ca.16.to_kv.weight", "transformer_blocks.0.pulid_ca.16.to_out.weight", "transformer_blocks.0.pulid_ca.17.norm1.weight", "transformer_blocks.0.pulid_ca.17.norm1.bias", "transformer_blocks.0.pulid_ca.17.norm2.weight", "transformer_blocks.0.pulid_ca.17.norm2.bias", "transformer_blocks.0.pulid_ca.17.to_q.weight", "transformer_blocks.0.pulid_ca.17.to_kv.weight", "transformer_blocks.0.pulid_ca.17.to_out.weight", "transformer_blocks.0.pulid_ca.18.norm1.weight", "transformer_blocks.0.pulid_ca.18.norm1.bias", "transformer_blocks.0.pulid_ca.18.norm2.weight", "transformer_blocks.0.pulid_ca.18.norm2.bias", "transformer_blocks.0.pulid_ca.18.to_q.weight", "transformer_blocks.0.pulid_ca.18.to_kv.weight", "transformer_blocks.0.pulid_ca.18.to_out.weight", "transformer_blocks.0.pulid_ca.19.norm1.weight", "transformer_blocks.0.pulid_ca.19.norm1.bias", "transformer_blocks.0.pulid_ca.19.norm2.weight", "transformer_blocks.0.pulid_ca.19.norm2.bias", "transformer_blocks.0.pulid_ca.19.to_q.weight", "transformer_blocks.0.pulid_ca.19.to_kv.weight", "transformer_blocks.0.pulid_ca.19.to_out.weight".

Prompt executed in 62.90 seconds

报错后继续点运行，第二次就能正常出图了，不知道是什么原因，大佬帮我看看，谢谢！

[windFFYL]

我找到原因了
这个和加速LORA不兼容，比如Hyper-FLUX.1-dev-8steps-lora和FLUX.1-Turbo-Alpha_lora8步加速

[j0eyhu]

really? i encountered this error today. i doubt it is caused by the long prompt.

below error message may help to troubleshoot:

CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
clip missing: ['text_projection.weight']
Token indices sequence length is longer than the specified maximum sequence length for this model (118 > 77). Running this sequence through the model will result in indexing errors

[CoiiChan]

Traceback (most recent call last):
File "S:\svn_project\ComfyUI_v344\ComfyUI\execution.py", line 361, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\execution.py", line 236, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\execution.py", line 208, in _map_node_over_list
process_inputs(input_dict, i)
File "S:\svn_project\ComfyUI_v344\ComfyUI\execution.py", line 197, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\nodes.py", line 1516, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\nodes.py", line 1483, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\sample.py", line 45, in sample
samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 1143, in sample
return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 1033, in sample
return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 1018, in sample
output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 986, in outer_sample
output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 969, in inner_sample
samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 748, in sample
samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\k_diffusion\sampling.py", line 632, in sample_dpmpp_2s_ancestral
return sample_dpmpp_2s_ancestral_RF(model, x, sigmas, extra_args, callback, disable, eta, s_noise, noise_sampler)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\k_diffusion\sampling.py", line 680, in sample_dpmpp_2s_ancestral_RF
denoised = model(x, sigmas[i] * s_in, **extra_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 400, in call
out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 949, in call
return self.predict_noise(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 952, in predict_noise
return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 380, in sampling_function
out = calc_cond_batch(model, conds, x, timestep, model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch
return executor.execute(model, conds, x_in, timestep, model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\samplers.py", line 325, in calc_cond_batch
output = model.apply_model(input_x, timestep, **c).chunk(batch_chunks)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\model_base.py", line 152, in apply_model
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\patcher_extension.py", line 111, in execute
return self.original(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\comfy\model_base.py", line 190, in _apply_model
model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "S:\svn_project\ComfyUI_v344\ComfyUI\custom_nodes\ComfyUI-nunchaku\wrappers\flux.py", line 138, in forward
model.update_lora_params(composed_lora)
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\nunchaku\models\transformers\transformer_flux.py", line 811, in update_lora_params
self._update_unquantized_part_lora_params(1)
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\nunchaku\models\transformers\transformer_flux.py", line 776, in _update_unquantized_part_lora_params
self.load_state_dict(new_state_dict, strict=True)
File "S:\svn_project\ComfyUI_v344\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 2593, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for NunchakuFluxTransformer2dModel:
Missing key(s) in state_dict: "transformer_blocks.0.pulid_ca.0.norm1.weight", "transformer_blocks.0.pulid_ca.0.norm1.bias", "transformer_blocks.0.pulid_ca.0.norm2.weight", "transformer_blocks.0.pulid_ca.0.norm2.bias", "transformer_blocks.0.pulid_ca.0.to_q.weight", "transformer_blocks.0.pulid_ca.0.to_kv.weight", "transformer_blocks.0.pulid_ca.0.to_out.weight", "transformer_blocks.0.pulid_ca.1.norm1.weight", "transformer_blocks.0.pulid_ca.1.norm1.bias", "transformer_blocks.0.pulid_ca.1.norm2.weight", "transformer_blocks.0.pulid_ca.1.norm2.bias", "transformer_blocks.0.pulid_ca.1.to_q.weight", "transformer_blocks.0.pulid_ca.1.to_kv.weight", "transformer_blocks.0.pulid_ca.1.to_out.weight", "transformer_blocks.0.pulid_ca.2.norm1.weight", "transformer_blocks.0.pulid_ca.2.norm1.bias", "transformer_blocks.0.pulid_ca.2.norm2.weight", "transformer_blocks.0.pulid_ca.2.norm2.bias", "transformer_blocks.0.pulid_ca.2.to_q.weight", "transformer_blocks.0.pulid_ca.2.to_kv.weight", "transformer_blocks.0.pulid_ca.2.to_out.weight", "transformer_blocks.0.pulid_ca.3.norm1.weight", "transformer_blocks.0.pulid_ca.3.norm1.bias", "transformer_blocks.0.pulid_ca.3.norm2.weight", "transformer_blocks.0.pulid_ca.3.norm2.bias", "transformer_blocks.0.pulid_ca.3.to_q.weight", "transformer_blocks.0.pulid_ca.3.to_kv.weight", "transformer_blocks.0.pulid_ca.3.to_out.weight", "transformer_blocks.0.pulid_ca.4.norm1.weight", "transformer_blocks.0.pulid_ca.4.norm1.bias", "transformer_blocks.0.pulid_ca.4.norm2.weight", "transformer_blocks.0.pulid_ca.4.norm2.bias", "transformer_blocks.0.pulid_ca.4.to_q.weight", "transformer_blocks.0.pulid_ca.4.to_kv.weight", "transformer_blocks.0.pulid_ca.4.to_out.weight", "transformer_blocks.0.pulid_ca.5.norm1.weight", "transformer_blocks.0.pulid_ca.5.norm1.bias", "transformer_blocks.0.pulid_ca.5.norm2.weight", "transformer_blocks.0.pulid_ca.5.norm2.bias", "transformer_blocks.0.pulid_ca.5.to_q.weight", "transformer_blocks.0.pulid_ca.5.to_kv.weight", "transformer_blocks.0.pulid_ca.5.to_out.weight", "transformer_blocks.0.pulid_ca.6.norm1.weight", "transformer_blocks.0.pulid_ca.6.norm1.bias", "transformer_blocks.0.pulid_ca.6.norm2.weight", "transformer_blocks.0.pulid_ca.6.norm2.bias", "transformer_blocks.0.pulid_ca.6.to_q.weight", "transformer_blocks.0.pulid_ca.6.to_kv.weight", "transformer_blocks.0.pulid_ca.6.to_out.weight", "transformer_blocks.0.pulid_ca.7.norm1.weight", "transformer_blocks.0.pulid_ca.7.norm1.bias", "transformer_blocks.0.pulid_ca.7.norm2.weight", "transformer_blocks.0.pulid_ca.7.norm2.bias", "transformer_blocks.0.pulid_ca.7.to_q.weight", "transformer_blocks.0.pulid_ca.7.to_kv.weight", "transformer_blocks.0.pulid_ca.7.to_out.weight", "transformer_blocks.0.pulid_ca.8.norm1.weight", "transformer_blocks.0.pulid_ca.8.norm1.bias", "transformer_blocks.0.pulid_ca.8.norm2.weight", "transformer_blocks.0.pulid_ca.8.norm2.bias", "transformer_blocks.0.pulid_ca.8.to_q.weight", "transformer_blocks.0.pulid_ca.8.to_kv.weight", "transformer_blocks.0.pulid_ca.8.to_out.weight", "transformer_blocks.0.pulid_ca.9.norm1.weight", "transformer_blocks.0.pulid_ca.9.norm1.bias", "transformer_blocks.0.pulid_ca.9.norm2.weight", "transformer_blocks.0.pulid_ca.9.norm2.bias", "transformer_blocks.0.pulid_ca.9.to_q.weight", "transformer_blocks.0.pulid_ca.9.to_kv.weight", "transformer_blocks.0.pulid_ca.9.to_out.weight", "transformer_blocks.0.pulid_ca.10.norm1.weight", "transformer_blocks.0.pulid_ca.10.norm1.bias", "transformer_blocks.0.pulid_ca.10.norm2.weight", "transformer_blocks.0.pulid_ca.10.norm2.bias", "transformer_blocks.0.pulid_ca.10.to_q.weight", "transformer_blocks.0.pulid_ca.10.to_kv.weight", "transformer_blocks.0.pulid_ca.10.to_out.weight", "transformer_blocks.0.pulid_ca.11.norm1.weight", "transformer_blocks.0.pulid_ca.11.norm1.bias", "transformer_blocks.0.pulid_ca.11.norm2.weight", "transformer_blocks.0.pulid_ca.11.norm2.bias", "transformer_blocks.0.pulid_ca.11.to_q.weight", "transformer_blocks.0.pulid_ca.11.to_kv.weight", "transformer_blocks.0.pulid_ca.11.to_out.weight", "transformer_blocks.0.pulid_ca.12.norm1.weight", "transformer_blocks.0.pulid_ca.12.norm1.bias", "transformer_blocks.0.pulid_ca.12.norm2.weight", "transformer_blocks.0.pulid_ca.12.norm2.bias", "transformer_blocks.0.pulid_ca.12.to_q.weight", "transformer_blocks.0.pulid_ca.12.to_kv.weight", "transformer_blocks.0.pulid_ca.12.to_out.weight", "transformer_blocks.0.pulid_ca.13.norm1.weight", "transformer_blocks.0.pulid_ca.13.norm1.bias", "transformer_blocks.0.pulid_ca.13.norm2.weight", "transformer_blocks.0.pulid_ca.13.norm2.bias", "transformer_blocks.0.pulid_ca.13.to_q.weight", "transformer_blocks.0.pulid_ca.13.to_kv.weight", "transformer_blocks.0.pulid_ca.13.to_out.weight", "transformer_blocks.0.pulid_ca.14.norm1.weight", "transformer_blocks.0.pulid_ca.14.norm1.bias", "transformer_blocks.0.pulid_ca.14.norm2.weight", "transformer_blocks.0.pulid_ca.14.norm2.bias", "transformer_blocks.0.pulid_ca.14.to_q.weight", "transformer_blocks.0.pulid_ca.14.to_kv.weight", "transformer_blocks.0.pulid_ca.14.to_out.weight", "transformer_blocks.0.pulid_ca.15.norm1.weight", "transformer_blocks.0.pulid_ca.15.norm1.bias", "transformer_blocks.0.pulid_ca.15.norm2.weight", "transformer_blocks.0.pulid_ca.15.norm2.bias", "transformer_blocks.0.pulid_ca.15.to_q.weight", "transformer_blocks.0.pulid_ca.15.to_kv.weight", "transformer_blocks.0.pulid_ca.15.to_out.weight", "transformer_blocks.0.pulid_ca.16.norm1.weight", "transformer_blocks.0.pulid_ca.16.norm1.bias", "transformer_blocks.0.pulid_ca.16.norm2.weight", "transformer_blocks.0.pulid_ca.16.norm2.bias", "transformer_blocks.0.pulid_ca.16.to_q.weight", "transformer_blocks.0.pulid_ca.16.to_kv.weight", "transformer_blocks.0.pulid_ca.16.to_out.weight", "transformer_blocks.0.pulid_ca.17.norm1.weight", "transformer_blocks.0.pulid_ca.17.norm1.bias", "transformer_blocks.0.pulid_ca.17.norm2.weight", "transformer_blocks.0.pulid_ca.17.norm2.bias", "transformer_blocks.0.pulid_ca.17.to_q.weight", "transformer_blocks.0.pulid_ca.17.to_kv.weight", "transformer_blocks.0.pulid_ca.17.to_out.weight", "transformer_blocks.0.pulid_ca.18.norm1.weight", "transformer_blocks.0.pulid_ca.18.norm1.bias", "transformer_blocks.0.pulid_ca.18.norm2.weight", "transformer_blocks.0.pulid_ca.18.norm2.bias", "transformer_blocks.0.pulid_ca.18.to_q.weight", "transformer_blocks.0.pulid_ca.18.to_kv.weight", "transformer_blocks.0.pulid_ca.18.to_out.weight", "transformer_blocks.0.pulid_ca.19.norm1.weight", "transformer_blocks.0.pulid_ca.19.norm1.bias", "transformer_blocks.0.pulid_ca.19.norm2.weight", "transformer_blocks.0.pulid_ca.19.norm2.bias", "transformer_blocks.0.pulid_ca.19.to_q.weight", "transformer_blocks.0.pulid_ca.19.to_kv.weight", "transformer_blocks.0.pulid_ca.19.to_out.weight".

I met the same Error .【nunchaku-flux.1-kontext-dev-turbo_lora.json】When adding Pulid, an error occurred， Bypass Nunchaku FLUX.1 LoRA Loader【 flux.1-turbo-alpha.safetensors】it will be OK

[InvictusGar]

I met the same error too. Any further update?

[CaiNiaoCYY]

same error

[pft-ChenKu]

The error in site-packages\nunchaku\models\transformers\transformer_flux.py, line 776, occurs in _update_unquantized_part_lora_params because strict is set to True, and our LoRA doesn't have the pulid weights.
As a temporary workaround, I added the missing keys back so the error no longer occurs. Or just set the strict to false?
There might be a more elegant way to handle this

def _update_unquantized_part_lora_params(self, strength: float = 1):
    ....

        full_sd = self.state_dict()
        missing_keys = set(full_sd.keys()) - set(new_state_dict.keys())

        for k in missing_keys:
            new_state_dict[k] = full_sd[k]
    
        self.load_state_dict(new_state_dict, strict=True)

[github-actions]

This issue has been automatically closed due to 30-day inactivity. Please feel free to reopen it with /reopen if needed.

[SECO16]

same error