README.md

metadata

license: apache-2.0
language:
  - en
base_model:
  - black-forest-labs/FLUX.2-klein-4B
tags:
  - art

Just some testing

Pin down what is needed between 50s,40s,30s cards

Translate info for use in TensorRT fp4 converting / onnx

Anyone that has made fp4 onnx before with NVIDIA’s Model Optimizer PTQ help in the Community tab is welcomed.

Currently working on correct Quantize/Dequantize nodes for onnx export to build fp4 RT engine for 50s cards.

Klein 4B NVFP4 Variants — txt_attn dtype notes

Klein4b-nvfp4.safetensors

• txt_attn weights: NVFP4

Klein4b-nvfp4_BF16.safetensors

• txt_attn weights: BF16

Klein4b-nvfp4_fp8e4m3fn_absmax.safetensors

• txt_attn weights: FP8 (float8_e4m3fn)
• txt_attn scaling: absmax

Klein4b-nvfp4_fp8e5m2_absmax.safetensors

• txt_attn weights: FP8 (float8_e5m2)
• txt_attn scaling: absmax