license: apache-2.0
language:

• en
• ru
  base_model: huihui-ai/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated
  tags:
• gguf
• llama.cpp
• gemma4
• gemma
• abliterated
• uncensored
• coding
• code
• reasoning
• thinking
  pipeline_tag: text-generation

KakTakOne/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated-GGUF

GGUF quantizations of huihui-ai/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated — an uncensored (abliterated), coding-focused fine-tune of Google Gemma 4 12B.

# Создай Modelfile
echo 'FROM ./gemma4-12b-coder-abliterated-Q4_K_M.gguf' > Modelfile
ollama create gemma4-coder -f Modelfile
ollama run gemma4-coder

llama-cli -m gemma4-12b-coder-abliterated-Q4_K_M.gguf \
  -p "Write a Python function to find the longest palindromic substring" \
  -n 2048 --temp 0.6

About the Model

This model is created by abliterating (removing refusal mechanisms from) yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1, which is itself a coding-focused fine-tune of Google Gemma 4 12B, trained on high-quality, execution-verified Python coding data with Chain-of-Thought reasoning traces from Fable 5 and Composer 2.5 models.

Key Features

• 🧠 Reasoning-first coding: The model analyzes tasks (edge cases, complexity, architecture) before generating code, producing higher-quality outputs
• 🔓 Uncensored (abliterated): Refusal mechanisms have been removed — the model responds to all queries without artificial restrictions
• 💻 Coding optimized: Fine-tuned on execution-verified Python code with reasoning traces from frontier models
• 🏠 Local-first: 12B parameters — runs on GPUs with 8–16 GB VRAM depending on quantization
• 🌐 Multimodal base: Built on Gemma 4 architecture (text-only GGUF conversion; vision encoder is excluded)

Available Quantizations

Which Quantization to Choose?

Model Details

How to Use

These GGUF files can be loaded in LM Studio, Ollama, llama.cpp, or any other GGUF-compatible inference engine.

LM Studio

Search for KakTakOne/Huihui-gemma-4-12B in LM Studio search bar and download the desired quantization.

Ollama

# Create a Modelfile
echo 'FROM ./gemma4-12b-coder-abliterated-Q4_K_M.gguf' > Modelfile
ollama create gemma4-coder -f Modelfile
ollama run gemma4-coder

CLI (llama.cpp)

llama-cli -m gemma4-12b-coder-abliterated-Q4_K_M.gguf \
  -p "Write a Python function to find the longest palindromic substring" \
  -n 2048 --temp 0.6

Usage Warnings

⚠️ This is an uncensored (abliterated) model. Safety filtering has been significantly reduced. The model may generate sensitive, controversial, or inappropriate content. Users are solely responsible for ensuring compliance with local laws and ethical standards.

• Not suitable for all audiences — outputs may be inappropriate for public settings or underage users
• Research and experimental use recommended — avoid direct use in production or public-facing applications
• No default safety guarantees — unlike standard models, this model has not undergone safety optimization

Credits

• Original model: huihui-ai/Huihui-gemma-4-12B-coder-fable5-composer2.5-v1-abliterated
• Base fine-tune: yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1
• Foundation: Google Gemma 4
• Abliteration method: remove-refusals-with-transformers

Quantized by KakTakOne using llama-quantize from llama.cpp.