base_model:
- huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated
base_model_relation: quantized
tags: - qwen
- qwen2.5
- vision-language
- split
- nvfp4
- fp16
- quantization
- art
license: apache-2.0
language: - en
Combined NVFP4 Encoder
Qwen25VL7B_nvfp4_fixedBF16.safetensors- Replaced uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding with BF16 (152064, 3584). works in comfy
note: Havent done in depth testing
Qwen25VL7B_nvfp4_simple_raw.safetensors- has uint8 (152064, 1792) (lm_head.weight)lm_head and (model.embed_tokens.weight)nn.Embedding. comfy wont load this
Split NVFP4 Encoders
- has uint8 (152064, 1792) lm_head and nn.Embedding. comfy wont load these
split_files/text_encoders/qwen_2.5_vl_7b_text_nvfp4_simple.safetensors- Text encodersplit_files/vision_encoders/qwen_2.5_vl_7b_vision_nvfp4_simple.safetensors- Vision encoder
note: Still working on mixed layers but