← back to catalog · registered 2026-11-09 05:02

prithivMLmods/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-MTP-GGUF

prithivMLmods Deepseek 9B GGUF multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/prithivMLmods%2FDeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-MTP-GGUF"
Response includes
  • classification unknown
  • files 12
  • author_summary 110 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
1
Model age
today
created 2026-11-08

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en
Quantizations
BF16 Q3_K Q4_K Q5_K Q6_K Q8_0
Tags
transformers gguf mtp text-generation-inference llama-cpp unsloth qwen3_5 reasoning distillation deepseek sft rl

Related

Total size
65.1 GB
Files
12
Quantizations
7
Registered
2026-11-09 05:02
Last updated on HF
2026-11-09 04:55

Files by quantization

BF16 2 files 18.0 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.BF16.gguf 17.1 GB 51924af2 download
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.mmproj-bf16.gguf 879 MB 822aef59 download
Q8_0 1 file 9.11 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q8_0.gguf 9.11 GB 92bc0302 download
Q6_K 1 file 7.04 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q6_K.gguf 7.04 GB 70cd9cf4 download
Q5_K 2 files 12.2 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q5_K_M.gguf 6.19 GB 0e837840 download
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q5_K_S.gguf 6.03 GB 7ad4d2f6 download
Q4_K 2 files 10.5 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q4_K_M.gguf 5.38 GB b1b7985a download
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q4_K_S.gguf 5.11 GB 7b12afb9 download
Q3_K 2 files 9.11 GB
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q3_K_L.gguf 4.70 GB e5b675ad download
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q3_K_M.gguf 4.41 GB f3178485 download
Auxiliary files 2 files 8.32 KB
README.md 5.92 KB e455e7bb download
.gitattributes 2.40 KB 70451525 download

README current version from Hugging Face


base_model:

  • xtools-at/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic
    license: apache-2.0
    language:
  • en
    pipeline_tag: image-text-to-text
    tags:
  • mtp
  • text-generation-inference
  • llama-cpp
  • transformers
  • unsloth
  • qwen3_5
  • reasoning
  • distillation
  • deepseek
  • sft
  • rl
  • gspo
  • math
  • stem
  • tool-use
  • function-calling
  • heretic
  • uncensored
  • decensored
  • abliterated
  • speculative-decoding
  • nvidia-blackwell
  • rtx-pro-6000
  • SM120
  • GB202
  • B200
  • B300
  • FP4
  • blackwell
  • Qwen3.5
  • GPTQ
    library_name: transformers

DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-MTP-GGUF

DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic is xtools-at's decensored version of Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B, made with Heretic v2.0.0.dev0 using Arbitrary-Rank Ablation (layers 9–24). The card reports refusals falling from 100/100 to 3/100 at a KL divergence of 0.0422 from the original, and a 4B version also exists. The original is a 9B reasoning fine-tune of Qwen3.5-9B, distilled from DeepSeek-V4-Pro in Max Effect mode on about 250K math and STEM samples. Training was SFT followed by a light GSPO RL stage, with no coding data. The original's card reports 94.50% on GSM8K (four-run mean, NVFP4 on vLLM) and a 90.53% average on a 1,500-question MMLU-Pro Math/Physics/Chemistry sample, 0.93 points above Qwen3.5-9B, using 36% fewer reasoning tokens per correct answer. It also claims near-complete output-format compliance, with a single-letter answer 97.2% of the time against 37.3% for Qwen3.5-9B. All benchmarks were run on the original model, not on this decensored version, and the card calls the coding and tool-use gains small and preliminary. The base weights are marked Apache 2.0, and the card is a community model that says outputs need independent verification.

[!NOTE]
MTP — Speculative Decoding: Yes

[!NOTE]
Multi-Token Prediction (MTP) GGUF is a specialized GGUF model file format extension that integrates speculative decoding directly into the model weights to significantly accelerate local inference. Unlike traditional speculative decoding which requires a separate, smaller "draft" model, MTP GGUF files include additional output heads within the main model architecture that predict multiple future tokens in a single forward pass.

[!NOTE]
NVFP4-GPTQ Version: DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-NVFP4-GPTQ | NVFP4-GPTQ-GGUF Version: DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-NVFP4-GPTQ-GGUF

Model Files

File Name Quant Type File Size File Link Description
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.BF16.gguf BF16 18.4 GB Link Full BF16 weights. Highest quality, largest file size.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q3_K_L.gguf Q3_K_L 5.05 GB Link Lower quality but usable, good for low RAM availability.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q3_K_M.gguf Q3_K_M 4.74 GB Link Low quality.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q4_K_M.gguf Q4_K_M 5.78 GB Link Good quality, default size for most use cases, recommended.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q4_K_S.gguf Q4_K_S 5.49 GB Link Slightly lower quality with more space savings, recommended.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q5_K_M.gguf Q5_K_M 6.64 GB Link High quality, recommended.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q5_K_S.gguf Q5_K_S 6.47 GB Link High quality, recommended.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q6_K.gguf Q6_K 7.56 GB Link Very high quality, near perfect, recommended.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.Q8_0.gguf Q8_0 9.79 GB Link Extremely high quality, generally unneeded but max available quant.
DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic.mmproj-bf16.gguf mmproj-bf16 922 MB Link Multimodal projection file in BF16 format. Used for vision/language models.

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp

Quantized using llama.cpp by prithivMLmods.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration