← back to catalog · registered 2026-11-18 18:04

ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF

ymarpro 32B GGUF second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/ymarpro%2FQwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF"
Response includes
  • classification m-uncensored
  • files 3
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
113
Likes
0
Model age
3d ago
created 2026-11-18
Downloads over time
Now 113 → from 0 ↑ 0%
04183124 0 on Nov 18 113 on Nov 22 Nov
Nov 18 → Nov 22 · 5 snapshots · spans 4 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Tags
transformers gguf llama-cpp gguf-my-repo base_model:thirdeyeai/Qwen2.5-Coder-32B-Instruct-Uncensored base_model:quantized:thirdeyeai/Qwen2.5-Coder-32B-Instruct-Uncensored endpoints_compatible region:us conversational

Related

Total size
32.4 GB
Files
3
Quantizations
1
Registered
2026-11-18 18:04
Last updated on HF
2026-11-18 17:30

Files by quantization

Auxiliary files 3 files 32.4 GB
qwen2.5-coder-32b-instruct-uncensored-q8_0.gguf 32.4 GB 9bee06af download
README.md 1.96 KB 6eb905ac download
.gitattributes 1.57 KB bec394cd download

README current version from Hugging Face


library_name: transformers
base_model: thirdeyeai/Qwen2.5-Coder-32B-Instruct-Uncensored
tags:

  • llama-cpp
  • gguf-my-repo

ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF

This model was converted to GGUF format from thirdeyeai/Qwen2.5-Coder-32B-Instruct-Uncensored using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.

Use with llama.cpp

Install llama.cpp through brew (works on Mac and Linux)

brew install llama.cpp

Invoke the llama.cpp server or the CLI.

CLI:

llama-cli --hf-repo ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF --hf-file qwen2.5-coder-32b-instruct-uncensored-q8_0.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF --hf-file qwen2.5-coder-32b-instruct-uncensored-q8_0.gguf -c 2048

Note: You can also use this checkpoint directly through the usage steps listed in the Llama.cpp repo as well.

Step 1: Clone llama.cpp from GitHub.

git clone https://github.com/ggerganov/llama.cpp

Step 2: Move into the llama.cpp folder and build it with LLAMA_CURL=1 flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).

cd llama.cpp && LLAMA_CURL=1 make

Step 3: Run inference through the main binary.

./llama-cli --hf-repo ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF --hf-file qwen2.5-coder-32b-instruct-uncensored-q8_0.gguf -p "The meaning to life and the universe is"

or

./llama-server --hf-repo ymarpro/Qwen2.5-Coder-32B-Instruct-Uncensored-Q8_0-GGUF --hf-file qwen2.5-coder-32b-instruct-uncensored-q8_0.gguf -c 2048

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-18 Upload README.md with huggingface_hub 88645fc 2 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration