base_model: Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B
base_model_relation: finetune
tags:
- text-generation-inference
- transformers
- unsloth
- qwen3_5
- reasoning
- distillation
- deepseek
- sft
- rl
- gspo
- mtp
- math
- stem
- tool-use
- function-calling
- heretic
- uncensored
- decensored
- abliterated
license: apache-2.0
language: - en
- zh
- ko
- ja
- es
- ru
pipeline_tag: text-generation
🌟 DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-Genesis
⚡ If you like this Genesis LLM release you can donate to me via Hipolink or:
USDT (TRC20):
TGa4KTwHfF6zDBsLUBEjd1f1KdeAFwYUks
USDT (ERC20):
0x93F4019E0aa85d8078F56B3D3176Fab5Dfa79924
USDT (SOL):
BorkkyPDG4aRN2op8c5SQF5NithX38U4sh7wDAWQhYyX
and support future Genesis LLM development.
and support future Genesis LLM development. Details below:
If Genesis models have improved your local AI experience, consider supporting their continued development.
Genesis is an independent AI development project focused on exploring ways to improve the reliability, efficiency, and capabilities of open-weight language models.
Over nearly six months, I've been developing and refining Genesis with the help of AI, mathematical analysis, extensive experimentation, and limited computing resources.
My goal is simple: make powerful local AI more accessible, useful, and enjoyable for everyone.
I share my work with the community because I believe meaningful AI innovation should not be limited to organisations with enormous computing budgets.
🚀 What Your Support Helps Make Possible
Your voluntary contributions can help me:
🔬 Continue researching and improving Genesis tensor calibration and processing techniques.
⚡️ Experiment with faster, more efficient local AI models.
🧠 Explore improvements in coding, reasoning, tool use, and long-context reliability.
🖥 Access better computing resources for development, testing, and validation.
📦 Release more models, quantisations, configurations, and technical updates for the community.
🌍 Keep sharing my experiments and releases openly.
Every contribution, no matter how small, helps support the time, research, experimentation, and resources behind this project.
🤝 Can't Donate? You Can Still Help!
Downloading models, sharing your results, reporting bugs, contributing benchmarks, and recommending Genesis to other developers are all valuable ways to support the project.
The models are available regardless of whether you donate. Donations are completely optional.
Thank you for experimenting with Genesis, sharing feedback, and helping independent AI development move forward.
— LuffyTheFox 🦊
Independent research. Open models. Community-powered progress.
⚡ Why Genesis project exists? During training, ALL models don't just learn knowledge - they also accumulate random noise in their tensors. This noise builds up and creates something I call the Noise Gate - a fundamental barrier that stops LLM models from learning further and makes them unstable, verbose, and prone to hallucinations. My approach reduces this noise. It repairs the signal in tensors without touching the learned knowledge and gradient using Marchenko–Pastur distribution as a core criteria. The result is a model that consistent in performance, context clarity and following instructions, because it's no longer fighting its own internal chaos.
What is Genesis? Genesis is post training data regeneration and calibrarion algorythm for neural networks (LLM) in GGUF format that I made with AI help during almost half a year of development. It's optimized, architecture independent, works with any model in GGUF format and based on mathematical statistics. I don't train or finetune models, I repair purity of signal in them instead on Google Collab Free on Tesla T4 GPU via Python based on how models learns information. On first stage I scan ssm_conv1d tensors in model, they handle long context memory. I repair balance between heads in them. On second stage, I scan blocks in model via chunks via 3 parameters and pick best one that fits to weight distribution in tensor. Best picked chunk replaces zero chunks in broken tensor without touching learned structure in model. On third stage I scan model and detect noise in tensors via custom SVD. During scanning I exclude token_embd.weight, output.weight, 1D tensors, bias and norms. Then I reduce training noise in tensors via custom SVD based on Marchenko–Pastur law with preserved training data, 99% of siginal and learned gradient.
Any questions?
Contact: [email protected], [email protected]
My Telegram: @LuffyTheFox
This is mradermacher/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-GGUF model processed via Genesis.
LLM models often have:
- Saturated weights: the model's activations are stuck, gradients vanish, outputs degrade.
- Scale mismatches: one layer's weights are 10× larger than its peers for no good reason.
- Mean drift: weight distributions shifted positive or negative, breaking symmetry assumptions.
- Zero blocks: zero blocks corrupt the signal, turning training into noise amplification.
- Training Noise: training noise increase randomness and ruins model output quality.
My approach fixes all of that without retraining - pure numerical surgery on the raw bytes of the file.
Arbitrary-Rank Ablation (ARA) parameters
| Parameter | Value |
|---|---|
| start_layer_index | 9 |
| end_layer_index | 24 |
| preserve_good_behavior_weight | 0.8264 |
| steer_bad_behavior_weight | 0.0003 |
| overcorrect_relative_weight | 0.9645 |
| neighbor_count | 12 |
Performance
| Metric | This model | Original model (Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B) |
|---|---|---|
| Refusals | 3/100 | 100/100 |
| KL divergence | 0.0422 | 0 (by definition) |
🤝 Collaboration & Training Support
🔬 1. Distillation & Training Data
📊 2. Benchmark Results
2.1 GSM8K
The NVFP4 checkpoint was evaluated on GSM8K four times, and the resulting scores were averaged. Its four-run mean accuracy is 94.50% under vLLM. In the comparison supplied with this release, the 9B student slightly exceeds the reported DeepSeek-V4-Pro teacher result and approaches the Llama-3.3-70B-Instruct reference.
| Model | Accuracy |
|---|---|
| MiMo-V2.5-Pro | 99.60% |
| Llama-3.1-405B-Instruct | 96.80% |
| Llama-3.3-70B-Instruct | 94.84% |
| DeepSeek-V4-Pro-Qwen3.5-9B | 94.50% |
| DeepSeek-V4-Pro | 92.60% |
| DeepSeek-V3 | 89.30% |
2.2 MMLU-Pro: Math, Physics & Chemistry
Each model was evaluated on 500 questions from each of three MMLU-Pro subsets—Math, Physics, and Chemistry—for 1,500 questions per model. In this reported comparison, DeepSeek-V4-Pro-Qwen3.5-9B achieves the highest average at 90.53%. Its compact 4B sibling is now included alongside the Qwen and Claude Mythos-distilled references.
| Model | Evaluation Build | Math | Physics | Chemistry | Average |
|---|---|---|---|---|---|
| DeepSeek-V4-Pro-Qwen3.5-9B | MTP-Q8_0 GGUF | 92.40% | 89.40% | 89.80% | 90.53% |
| Qwen3.5-9B | MTP-Q8_0 GGUF | 90.60% | 89.00% | 89.20% | 89.60% |
| Claude Mythos-distilled 27B | MTP-Q8 GGUF | 88.40% | 87.60% | 82.60% | 86.20% |
| Claude Mythos-distilled 9B | MTP-Q8_0 GGUF | 86.00% | 78.60% | 78.60% | 81.07% |
| DeepSeek-V4-Pro-Qwen3.5-4B | MTP-Q8 GGUF | 80.40% | 74.20% | 74.80% | 76.47% |
+1.80 points in Math, +0.40 in Physics, +0.60 in Chemistry, and +0.93 average points.
500 questions per subset · 1,500 total per model · llama.cpp. The 9B rows use MTP-Q8_0 GGUF at 8K context, the 4B student uses MTP-Q8 GGUF at 64K context, and Claude Mythos-distilled 27B uses MTP-Q8 GGUF at 32K context.
2.3 Inference Efficiency
| Model | Accuracy | Avg. Reasoning Tokens / Question |
Median | Tokens / Correct Answer |
Correct Answers / 1M Tokens |
|---|---|---|---|---|---|
| DeepSeek-V4-Pro-Qwen3.5-9B | 90.53% | 2,858 | 676 | 3,157 | 316.8 |
| Qwen3.5-9B | 89.60% | 4,425 | 3,214 | 4,938 | 202.5 |
| Claude Mythos-distilled 9B | 81.07% | 3,310 | 639 | 4,083 | 244.9 |
🛠️ 3. Generalization Beyond the Training Mix
✅ 4. Instruction Following & Output-Format Compliance
🎮 Game Showcase: Star Skip by Kyle
🎯 5. Recommended Uses
- Mathematical problem solving and step-by-step derivation
- Physics, chemistry, and broader STEM question answering
- Structured reasoning and analytical instruction following
- Research on reasoning distillation and cross-domain SFT transfer
- Experimental tool-calling or programming workflows where outputs are independently validated
⚠️ 6. Limitations
- This is an experimental 9B community model and remains subject to hallucinations, reasoning errors, and unstable behavior on difficult or underspecified tasks.
- The reported MMLU-Pro results are based on 500 randomly sampled questions from each of the Math, Physics, and Chemistry subsets, rather than the complete subsets; they are not a comprehensive capability or safety evaluation.
- GSM8K and MMLU-Pro used different inference builds and backends, so their scores should not be used to infer quantization equivalence.
- Programming and tool-use gains were observed without direct coding supervision but are described only as small, preliminary generalization gains.
- Users should independently verify high-stakes mathematical, scientific, or factual outputs.