SearchingMan's picture
Initial release: pruned 5.1B text encoder for FLUX.2-klein-9B (bitwise-verified export, benchmarks, seed study)
300ccd6 verified
Raw
History Blame Contribute Delete
872 Bytes
This FLUX Model is licensed by Black Forest Labs Inc. under the FLUX Non-Commercial
License. Copyright Black Forest Labs Inc. IN NO EVENT SHALL BLACK FOREST LABS INC. BE
LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT
OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.
This repository contains a MODIFIED VERSION (a "Derivative" under the FLUX
Non-Commercial License) of the text encoder component of FLUX.2-klein-9B:
the encoder was structurally pruned (layer removal, layer merging, FFN width pruning,
GQA head-group pruning) and recovery-distilled against the original encoder,
reducing it from 8.19B to 5.10B parameters. The DiT and VAE are NOT included.
This Derivative is not an official product of Black Forest Labs Inc. and has not been
endorsed, approved, or validated by Black Forest Labs Inc.