tags:
- qwen
- qwen2.5
- uncensored
- abliterated
- representation-engineering
- gguf
Qwen2.5-Coder-3B-Abliterated-GGUF
These are the GGUF format quantized files for the abliterated (uncensored) version of the Qwen/Qwen2.5-Coder-3B-Instruct model.
The original model's refusal mechanisms were mathematically projected out using orthogonalization techniques (representation engineering).
Available Quantizations
- FP16: Base format, highest quality, largest size.
- Q8_0: Very high quality, almost indistinguishable from FP16, but smaller.
- Q4_K_M: The recommended standard. Excellent balance between file size and generation quality.
Disclaimer
The creator of this model is NOT liable for any misuse, illegal activities, or harmful outputs generated by this model.
By using this model, you agree to take full responsibility for any consequences that arise from its application. This model is provided strictly for educational and research purposes.