Combined NVFP4 Encoder

  • Qwen25VL7B_nvfp4_fixedBF16.safetensors - Replaced uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding with BF16 (152064, 3584). works in comfy

note: Havent done in depth testing

  • Qwen25VL7B_nvfp4_simple_raw.safetensors - has uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding. comfy wont load this

Split NVFP4 Encoders

  • has uint8 (152064, 1792) lm_head and nn.Embedding. comfy wont load these
  • split_files/text_encoders/qwen_2.5_vl_7b_text_nvfp4_simple.safetensors - Text encoder
  • split_files/vision_encoders/qwen_2.5_vl_7b_vision_nvfp4_simple.safetensors - Vision encoder

note: Still working on mixed layers but

Downloads last month
115
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Collection including ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4