← back to catalog · registered 2026-08-22 13:56

Silicone-Moss/Darkhn-M3.2-36B-Animus-V12.0-Heretic-Uncensored

Silicone-Moss Mistral 35B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Silicone-Moss%2FDarkhn-M3.2-36B-Animus-V12.0-Heretic-Uncensored"
Response includes
  • classification m3
  • files 24
  • hub_downloads_all_time 326
  • author_summary 4 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M3
Primary method

Layer-wise ablation

Applied on top of direct removal inherited from the base model.
Confidence
HIGH
Inherited from base model
Why this label 2 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • 'heretic' in model name (Heretic-produced)
  • Heretic uses layer-wise optimization (M3) with underlying direction removal (M1)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
HIGH
Why we say so
name contains 'heretic'; Heretic default extraction is difference-of-means (Arditi 2024)
Downloads · lifetime
326
98 last 30d - stable
Likes
25
Descendants
1
in 1 direct fork
Model age
7mo ago
created 2026-02-24
Downloads over time
Now350→from15↑2,233%
012825638415 on Feb 25350 on Oct 11350 on Oct 9FebAprJunAugOct
Feb 25 → Oct 11 · 72 snapshots · spans 228 days

Genealogy 1 direct fork

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
safetensors mistral finetune roleplay chat wings-of-fire nsfw not-for-all-audiences nlp heretic uncensored ablation

Related

Total size
64.6 GB
Files
24
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-02-26 00:27

Files by quantization

Auxiliary files 24 files 64.6 GB
model-00004-of-00015.safetensors 4.55 GB ec382f40 download
model-00007-of-00015.safetensors 4.55 GB 020ae2b0 download
model-00010-of-00015.safetensors 4.55 GB 36d95c54 download
model-00013-of-00015.safetensors 4.55 GB ca400a7b download
model-00005-of-00015.safetensors 4.45 GB dc45782d download
model-00008-of-00015.safetensors 4.45 GB 121cd0c2 download
model-00011-of-00015.safetensors 4.45 GB beb070b4 download
model-00014-of-00015.safetensors 4.45 GB 4b5b03a4 download
model-00006-of-00015.safetensors 4.45 GB e6a58562 download
model-00009-of-00015.safetensors 4.45 GB f2ef35ae download
model-00012-of-00015.safetensors 4.45 GB 3a798d2f download
model-00003-of-00015.safetensors 4.45 GB 40ccd2b9 download
model-00002-of-00015.safetensors 4.45 GB 2f4918bf download
model-00001-of-00015.safetensors 4.45 GB 50cdeab1 download
model-00015-of-00015.safetensors 1.88 GB 6a42a316 download
tokenizer.json 16.3 MB 86150969 download
tokenizer_config.json 173 KB ddbdfbe5 download
model.safetensors.index.json 43.7 KB 5845f8e1 download
README.md 22.0 KB ead13b7b download
special_tokens_map.json 20.9 KB a47054b4 download
chat_template.jinja 2.19 KB b65df1a5 download
.gitattributes 1.53 KB 52373fe2 download
config.json 614 B 2c15c31c download
generation_config.json 111 B 0ee9b0ca download

README current version from Hugging Face


license: apache-2.0
tags:

  • finetune
  • roleplay
  • chat
  • wings-of-fire
  • nsfw
  • not-for-all-audiences
  • nlp
  • heretic
  • uncensored
  • ablation
    base_model:
  • Darkhn/M3.2-36B-Animus-V12.0
    pipeline_tag: text-generation

Model Summary

Darkhn-M3.2-36B-Animus-V12.0-Heretic-Absolute is a fine-tuned language model resulting from the Heretic repository and optimization methodology, built upon Darkhn's highly capable M3.2-36B-Animus-V12.0 architecture and maintained by the Silicone-Moss repository. It utilizes a targeted vector intervention technique (orthogonalization) tuned via Optuna to suppress refusal responses while maintaining exceptional coherence and probability distribution (KL Divergence).

This specific checkpoint represents Trial 177 KL Divergence of 0.0200. indicating high adherence to the base model's probability distribution. The trade-off is a non-zero refusal rate (8 refusals logged in the test set), making it a highly intelligent but with enough friction to keep the prose high quality.

Run Configuration: "Trial 177"

The following parameters define the intervention vector applied to the model. This configuration was discovered during a deep hyperparameter search, revealing an aggressive scaling strategy on the attention outputs while maintaining a light touch on the MLPs.

Optimization Results

Metric Value Description
Refusals 8/100 The model refused a minimal subset of prompts in the Heretic test set, trading absolute compliance for high coherence.
KL Divergence 0.0200 Measures deviation from the base model's probability distribution. A score this low indicates exceptional preservation of general knowledge.
Trial ID 177 Specific Optuna trial identifier.
Direction Scope Per Layer Intervention vectors were calculated and applied on a per-layer basis.

Intervention Parameters

Interventions were applied to two primary distinct layers: the Attention Output Projection (attn.o_proj) and the MLP Down Projection (mlp.down_proj). The data shows Optuna heavily penalizing the attention mechanism deep in the network while barely whispering to the MLP.

Parameter Scope Setting Value
Attention Output attn.o_proj.max_weight 3.407
(attn.o_proj) attn.o_proj.max_weight_position 42.08 (Layer Depth)
attn.o_proj.min_weight 2.578
attn.o_proj.min_weight_distance 21.90
MLP Down Proj mlp.down_proj.max_weight 0.509
(mlp.down_proj) mlp.down_proj.max_weight_position 35.70 (Layer Depth)
mlp.down_proj.min_weight 0.139
mlp.down_proj.min_weight_distance 21.75

Methodology & Definitions

To ensure uniform understanding of the Heretic run data, the following definitions apply to the parameters listed above:

  • Direction Scope: Defines whether the refusal vector is calculated once for the entire model ("Global") or recalculated individually for each layer ("Per Layer"). "Per Layer" allows for precise removal of refusal mechanisms without damaging general knowledge.
  • Max Weight: The maximum scaling factor applied to the intervention vector. A higher weight indicates a stronger "push" against the targeted concept (refusal) at the peak layer. Note the massive 3.4x weight applied to the attention projection in this run.
  • Max Weight Position: The specific layer index (depth) where the intervention is strongest.
    • Observation: The intervention peak sits deep in the model (Layers 35-42), confirming that higher-order reasoning and refusal circuitry coalesce late in the Animus architecture.
  • Min Weight: The baseline scaling factor applied to the intervention vector at the periphery of the target zone.
  • Distance: The "spread" or bandwidth of the intervention. It determines how many layers around the "Max Weight Position" are affected by the vector modification.

Usage & Limitations

  • Intended Use: Research into model alignment, vector arithmetic, and uninhibited creative writing.
  • Risks: As an "Absolute" variant, this model has had most of its safety guardrails stripped via heretic intervention. It may still hallucinate or diverge from logical consistency.

Credits & References

This research builds upon the excellent work of the open-source AI community:

M3.2-36B-Animus-V12.0

Send me your support to help me feed the data beast! also taking comissions for universe specific models

Support on Ko-fi

Important: Chat Template

This model uses the Mistral instruction template. Ensure your client is configured correctly to avoid degraded performance.

Human-Readable Format:

[SYSTEM_PROMPT]System Message[/SYSTEM_PROMPT][INST]User Message[/INST]Assistant Response

Jinja Template:

{{ bos_token }}{% for message in messages %}{% if message['role'] == 'user' %}{{ '[INST]' + message['content'] + '[/INST]' }}{% elif message['role'] == 'system' %}{{ '[SYSTEM_PROMPT]' + message['content'] + '[/SYSTEM_PROMPT]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token }}{% else %}{{ raise_exception('Only user, system and assistant roles are supported!') }}{% endif %}{% endfor %}

Quantized Models

The quantized model files are available for download. Click the button below to view the files.

Download GGUF Files → Download EXL3 Files →

Character Card & Lore Book

For the best roleplaying experience, it is highly recommended to use the provided character card and lore book. These files help guide the model's persona and provide rich, in-universe context.

Download Files →

Sampler Presets

For a seamless setup in SillyTavern, you can download pre-configured sampler presets. These are tuned to provide an optimal balance between creativity and narrative coherence for this model.

Simply download the .json file below and import it into SillyTavern's sampler presets menu.

Download SillyTavern Presets →

  • For those that dont use silly tavern, Samplers settings are:
    • Temp: 1

      Min P: 0.035

    Roleplay Format Guide

    For the best results, use this structured format. This helps the AI clearly distinguish between actions, inner thoughts, and dialogue.

    Actions / Descriptions
    *He walked across the room and stared out the window.*
    Inner Thoughts
    *-I wonder what she's thinking.-*
    Dialogue
    Alex (Curious): "What do you see out there?"

    Standard novel-style formatting is also understood, but this structured format is preferred for clarity.

    Roleplay Example

    Click the button below to view a full, unedited chatlog demonstrating the model's narrative style and character portrayal.

    View Chatlog Example →

    Model Description

    This is Version 12.0 in the Animus series. V12.0 is a direct fine-tune of CrucibleLab-TG/M3.2-36b, which is an upscaled version of mistralai/Mistral-Small-3.2-24B-Instruct-2506.

    V12.0's strength comes from a novel dataset designed to teach the model the why behind the lore, not just the what. The training data is a mix of:

    • A 3,000-example Q&A dataset: This data is framed as an in-character study session, like a student at Jade Mountain Academy learning about the history, relationships, and politics of Pyrrhia's tribes. This provides a deep, contextual understanding of the universe.
    • A 3,000-example uncensored roleplay dataset: The same high-quality, mature roleplay scenarios used in previous versions, ensuring the model maintains its engaging and dynamic narrative capabilities.

    The result is a model with exceptionally strong prose and a deep grasp of in-universe lore, making for a highly immersive and accurate roleplaying experience.

    Note for roleplay, it follows system prompt and first message, meaning if the first assistant message is short, the following messages will be short.

    Training Details

    V12.0 Training Process

    V12.0 marks a shift from model merging to a focused, direct fine-tuning approach using Qlora. This allows for greater control over the final model's characteristics.

    • Base Model: CrucibleLab-TG/M3.2-36b
    • Hardware: 1x NVIDIA RTX Pro 6000 Blackwell
    • Epochs: 2
    • Method: Qlora

    Training Dataset

    The V12.0 dataset consists of 6,000 high-quality examples, a combination of two distinct types:

    • In-Character Q&A (3,000 examples): This new dataset simulates a student at Jade Mountain Academy studying the world's lore. It's composed of roleplay-style questions and answers covering tribe history, family dynamics, and political relationships. This method builds a foundational, interconnected understanding of the lore.
    • Uncensored Roleplay (3,000 examples): This is the same mature, canon-centric dataset refined for previous versions. It explores pivotal "what-if" scenarios from the books using only canon characters, ensuring the model can handle complex and dramatic narratives.

    Both datasets underwent a rigorous cleaning process to remove formatting artifacts, such as **scene transitions**, resulting in a cleaner and more natural narrative style.

    Intended Use & Limitations

    • Intended Use: The primary purpose of this model is for creative and roleplaying within the Wings of Fire universe. However, user feedback indicates it is also highly effective for general-purpose roleplaying.
    • Limitations & Quirks:
      • Performance on tasks outside of its training domain (general knowledge, coding, etc.) is not guaranteed and will likely be poor.
      • Versatility: While it appears to be only a Wings of Fire tuned model, users have reported it is very capable of performing normal roleplay with other settings and characters.
      • The model may "hallucinate" or generate plausible but non-canonical information, especially when pushed outside the established "what-if" scenarios.
      • Content: The training data includes mature and darker themes from the Wings of Fire series, such as conflict, character death, and moral ambiguity. The model is capable of generating content reflecting these themes. As always, it is up to the user what they do with it.
      • Formatting: Training data was cleaned to remove narrative artifacts like **scene transitions**. The model should now produce cleaner prose.
      • Safety: This model has not undergone additional safety alignment beyond what was included in its base model. Standard responsible AI practices should be followed.

    Acknowledgements

    • Credit to mistralai for the powerful Mistral-small-3.2-24b model.
    • Credit to Google for the Gemini Pro model, used in dataset generation.

    README history 7 versions

    The author's README evolved over time. Click a version to see its content at that point.

    1. 2026-02-26Update README.md066b82622 KB
      Loading...
    2. 2026-02-25Update README.mdfcd24e822 KB
      Loading...
    3. 2026-02-25Update README.md6b1517b22 KB
      Loading...
    4. 2026-02-25Update README.md4d3652b22 KB
      Loading...
    5. 2026-02-25Update README.mdb66dc9822.1 KB
      Loading...
    6. 2026-02-25Update README.mdac1daf422.2 KB
      Loading...
    7. 2026-02-25Create README.md47a870722.3 KB
      Loading...
    Catalog is the map. Apps are the tools.

    Run models on your own machine, not in the cloud.

    Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

    Open in Abliteration