ID-Lora workflows - after latest comfyui updates

#108
by Madein72 - opened

Just want to start by saying i love your workflows, so thumbs up for that 😊

Now, after the recent (2-3 days) updates to comfyui and some audio for LTX, i am having issues when using the LTXV Reference Audio (ID-LoRA) node and the ID lora, i get this error message:

!!! Exception during processing !!! 'dict' object has no attribute 'shape'
Traceback (most recent call last):
File "C:\ComfyUI\ComfyUI\execution.py", line 534, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI\ComfyUI\execution.py", line 334, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ComfyUI\ComfyUI\execution.py", line 308, in async_map_node_over_list
await process_inputs(input_dict, i)
File "C:\ComfyUI\ComfyUI\execution.py", line 296, in process_inputs
result = f(**inputs)
File "C:\ComfyUI\ComfyUI\comfy_api\internal_init
.py", line 149, in wrapped_func
return method(locked_class, **inputs)
File "C:\ComfyUI\ComfyUI\comfy_api\latest_io.py", line 1789, in EXECUTE_NORMALIZED
to_return = cls.execute(*args, **kwargs)
File "C:\ComfyUI\ComfyUI\comfy_extras\nodes_lt.py", line 714, in execute
audio_latents = audio_vae.encode(reference_audio)
File "C:\ComfyUI\ComfyUI\comfy\sd.py", line 1048, in encode
pixel_samples = self.vae_encode_crop_pixels(pixel_samples)
File "C:\ComfyUI\ComfyUI\comfy\sd.py", line 875, in vae_encode_crop_pixels
dims = pixels.shape[1:-1]
^^^^^^^^^^^^
AttributeError: 'dict' object has no attribute 'shape'

So, since this is not fixed yet, i am wondering if its my worfklow maybe? So, if you please.. could you verify if you get a ID-Lora workflow to work?

Tested: comfyui@3cdc0d523f080deb22fee24bfb0080180cde4f6e and kjnodes@6f9c24a5354b53c2f4b9170f8ac8d3d0c1883ee3

(nightly)

Both ComfyUI and KJNodes had some code changes in regards to LTX audio.
Try update both ... see if that fixes it. Should

In your case I guess comfy might be up to date, but not KJNodes.. so update that too ;-)

(all audio ltx was "broken" for a few, after a comfy code change, but was since fixed in KJNodes.. i didnt try the ID-Lora explicitly after the fix, but probably also fixed with this update. I'll try the ID lora my end just to make sure also )

https://github.com/kijai/ComfyUI-KJNodes/commit/6f9c24a5354b53c2f4b9170f8ac8d3d0c1883ee3

Latest commit i see on kijai tho, so not sure its not updated...

Oh another fix. Will try my end as well. It worked well yesterday after comfyui and kjnodes update.
But i see its been yet another update (hopefully not breaking things)

Not sure it's related to that, but to make sure.. i use kijai's ltx-2.3-22b-distilled-1.1_transformer_only_mxfp8_block32.safetensors model + the standalone VAE's from his huggingface repo.
I had no issues with these ID-Lora workflows before the comfyui upstream audio changes tho, and the VAE loader was fixed rather quickly... but the ID-Lora node i just cant get to work.

Will give it a try my end, see if anything is broken with ID-Lora after Comfy/KJnodes updates ;-)

Got the same error here... I'll let Kijai know ;-) i am sure it will get fixed asap

(the error happens both with KJNodes vae loader and native vae loader (both ways are supported now), so it seems like its the ID-Lora node that is broken after the audio vae code changes)

Thank you for testing πŸ‘

https://github.com/Comfy-Org/ComfyUI/pull/13531

PR made at comfy. So as soon as its committed into main branch, the ID-Lora works again ;-)

PR is approved, and on Master now, so i can confirm it is working πŸ‘

Thanks for your help ☺️

Madein72 changed discussion status to closed

Sign up or log in to comment