base model issue

#1
by realrebelai - opened

EDIT: the issue is literally just the model. its not the quant, or settings.... the model just outputs noise, even on full weights. sorry for the confusion.

ERNIE_BASE_00011_

ERNIE_BASE_00010_

so i ran the turbo model with GREAT results buit the base model is giving me these results no matter the cfg i input. tried 1.0 - 5.0

something just feels off and theres a lot of noise going on

Screenshot (94)

ERNIE_BASE_00009_
ERNIE_BASE_00006_
ERNIE_BASE_00007_
ERNIE_BASE_00008_

realrebelai changed discussion status to closed

You're saying there's an issue with the bf16 gguf? or the safetensor?

You're saying there's an issue with the bf16 gguf? or the safetensor?

it was with the any version of the model, not just these

I think it may be the small vae for flux 2, im running a few gens to see if using the full flux 2 vae will fix it. I tried to save decoding process from stalling as i only have 8gb of vram and 16gb of ram so i have to work around that alot. Cant used tiled decode because it ruins images on alot of models so using condensed vaes like the small encoder is a great workaround. However i feel it may be affecting gens with this model. Ill update with images shortly to compare

Sign up or log in to comment