Unrecognized keys and unexpected types
#1
by SamuelTallet - opened
Hello, thanks for this model quantization.
Inference works but I have these warnings in the background:
Unrecognized keys in `rope_parameters` for 'rope_type'='yarn': {'llama_4_scaling_beta'}
Expected types for text_encoder: (<class 'transformers.models.auto.modeling_auto.AutoModel'>,), got <class 'transformers.models.mistral3.modeling_mistral3.Mistral3Model'>.
Expected types for pe: (<class 'transformers.models.auto.modeling_auto.AutoModelForCausalLM'>, <class 'NoneType'>), got <class 'transformers.models.ministral3.modeling_ministral3.Ministral3ForCausalLM'>.
The first one is a transformers warning, I use 5.3 and I don't have it, but it's safe either way, the other two are from diffusers and they are also safe, it's just that the pipeline was made using automodels which is not how we usually do it, but the models load correctly.
You can safely ignore those warnings.
Okay, thank you 😊
SamuelTallet changed discussion status to closed