GGUF source model?
#8
by
smhf72
- opened
Were the GGUFs created using the BF16 base model or the FP8 base model (I'm assuming BF16)?
Were the GGUFs created using the BF16 base model or the FP8 base model (I'm assuming BF16)?
BF16 of course, without the VAE and other extra layers, so it's just the transformer model.
'VAE' object has no attribute 'latent_frequency_bins' error using GGUF
smhf72
changed discussion status to
closed