← back to catalog · registered 2026-11-21 11:04

Ronin48LLC/Lamarck-Qwen3.8-27B-abliterated-v2

Ronin48LLC 27B GGUF second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Ronin48LLC%2FLamarck-Qwen3.8-27B-abliterated-v2"
Response includes
  • classification m8
  • files 5
  • author_summary 2 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-11-21
Downloads over time
Now 0 → from 0 ↑ 0%
0011 0 on Nov 21 0 on Nov 22 Nov
Nov 21 → Nov 22 · 2 snapshots · spans 1 day

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Tags
peft safetensors gguf lora qlora continued-pretraining text-generation base_model:huihui-ai/Huihui-Qwen3.8-27B-abliterated base_model:adapter:huihui-ai/Huihui-Qwen3.8-27B-abliterated region:us

Related

Total size
1.30 GB
Files
5
Quantizations
1
Registered
2026-11-21 11:04
Last updated on HF
2026-11-21 12:34

Files by quantization

Auxiliary files 5 files 1.30 GB
adapter_model.safetensors 891 MB dbbe51cc download
lamarck-qwen3.8-27b-abliterated-v2.gguf 445 MB d9674201 download
README.md 3.44 KB da3a8c5c download
.gitattributes 1.56 KB b9661d9b download
adapter_config.json 1.23 KB 3d95dedf download

README current version from Hugging Face


library_name: peft
base_model: huihui-ai/Huihui-Qwen3.8-27B-abliterated
tags:

  • lora
  • qlora
  • continued-pretraining
  • text-generation

Lamarck-Qwen3.8-27B-abliterated-v2

A LoRA adapter for
huihui-ai/Huihui-Qwen3.8-27B-abliterated,
produced by continued pretraining (QLoRA: 4-bit NF4 base, bf16 compute).
Rank 32, alpha 64, ~233M trainable parameters — double the rank of the
original Ronin48LLC/Lamarck-Qwen3.8-27B-abliterated
(r=16), which remains available unchanged. The adapter does not modify the base
weights.

This version was trained with validation-aware early stopping and
best-checkpoint selection
. The released adapter is the best checkpoint
(step 1000, eval loss 1.5875).

The adapter is base-specific — load it on the abliterated base above (the
upstream base has had refusal-related directions ablated), not on the pristine
Qwen/Qwen3.8-27B.

About the name

Named for Jean-Baptiste Lamarck and the inheritance of acquired characteristics.
The base model is the frozen germline; the adapter is the acquired trait layered
on top during fine-tuning, inherited by anyone who loads base + adapter.
Lamarckian inheritance, shipped as a small file.

Usage

Requires a recent transformers (the base is a Qwen3_5ForConditionalGeneration).

from transformers import Qwen3_5ForConditionalGeneration, AutoTokenizer
from peft import PeftModel

base = Qwen3_5ForConditionalGeneration.from_pretrained(
    "huihui-ai/Huihui-Qwen3.8-27B-abliterated", device_map="auto")
model = PeftModel.from_pretrained(base, "Ronin48LLC/Lamarck-Qwen3.8-27B-abliterated-v2")
tok = AutoTokenizer.from_pretrained("huihui-ai/Huihui-Qwen3.8-27B-abliterated")

Metrics

Four-way comparison under an identical harness (4-bit NF4 base, single L40S):
the unedited base, the original r=16 adapter, an r=32 fixed 3000-step run, and
this adapter (r=32 validation-aware, 1000 steps). Perplexity — lower is better.

Metric Base r=16 (v1) r=32 (3000 steps) v2 (this adapter)
Held-out security perplexity 6.13 5.77 4.77 4.88
OOD CyberMetric perplexity 22.25 17.73 18.70 17.76
OOD MMLU-security perplexity 8.58 7.91 7.85 7.75
OOD SecQA-v2 perplexity 4.91 4.45 4.37 4.19
OOD math-control perplexity 6.31 6.57 6.35 6.26
MMLU-security accuracy 0.820 0.815 0.820 0.815
SecQA-v2 accuracy 0.98 0.99 0.98 0.99
GSM8K accuracy 0.907 0.940 0.927 —*

* GSM8K generation for this adapter did not complete (benchmark runtime cap
during this secondary check); the math-control perplexity above already shows
it forgets the least of the four configurations.

Finding: this adapter matches the 3000-step run's in-distribution security
fit while winning every out-of-distribution generalization measure and the
math control, at one-third the training steps
. The fixed 3000-step run shows
the classic overfitting signature: extra steps improved in-distribution fit
marginally but degraded generalization across the board. Multiple-choice
accuracy is at ceiling (~0.82 / ~0.98) and cannot separate the adapters;
perplexity is the sensitive measure. These are research measurements, not a
capability claim.

Limitations

A research adapter. Verify outputs; no warranty of fitness for any particular
purpose.

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-21 Upload README.md with huggingface_hub 21d7996 3.7 KB
    Loading...
  2. 2026-11-21 Upload folder using huggingface_hub f705460 3.4 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration