← back to catalog · registered 2026-08-22 13:56

AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX

AITRADER Qwen 4.5B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/AITRADER%2FJackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX"
Response includes
  • classification m1
  • files 10
  • hub_downloads_all_time 834
  • author_summary 30 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
834
84 last 30d - stable
Likes
1
Model age
7mo ago
created 2026-03-08
Downloads over time
Now892→from280↑219%
249484719953280 on Mar 11892 on Oct 12MarAprMayJunJulAugSepOct
Mar 11 → Oct 12 · 71 snapshots · spans 215 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
mlx safetensors qwen3_5 abliterated uncensored qwen3.5 reasoning claude-distilled text-generation conversational en base_model:Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled

Related

Total size
8.46 GB
Files
10
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-03-13 21:34

Files by quantization

Auxiliary files 10 files 8.47 GB
model-00001-of-00002.safetensors 4.99 GB 75798251 download
model-00002-of-00002.safetensors 3.47 GB 3d387fba download
tokenizer.json 19.1 MB 87a7830d download
model.safetensors.index.json 67.5 KB 3db8e647 download
chat_template.jinja 3.95 KB 609532bf download
config.json 3.38 KB af7b4e0d download
README.md 2.22 KB 74acce44 download
.gitattributes 1.53 KB 52373fe2 download
tokenizer_config.json 1.17 KB d7920365 download
preprocessor_config.json 336 B 4ae180b4 download

README current version from Hugging Face


base_model: Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled
language: en
pipeline_tag: text-generation
library_name: mlx
tags:

  • mlx
  • abliterated
  • uncensored
  • qwen3.5
  • reasoning
  • claude-distilled
    license: apache-2.0

Jackrong Qwen3.5-4B Claude Reasoning - Abliterated (bf16 MLX)

This is an abliterated (uncensored) version of Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled, converted to MLX format for Apple Silicon.

What is this model?

The base model is Qwen3.5-4B fine-tuned on Claude 4.6 Opus reasoning data using Unsloth/LoRA, giving it strong chain-of-thought reasoning capabilities. This abliterated version removes safety refusal behaviors while preserving the model's reasoning abilities.

Abliteration Details

  • Method: lukey03 (1 direction, norm-preserving, 3 refinement passes, output-only projection)
  • Post-processing: LoRA compliance fine-tuning (rank=64, 80 iterations, 32 training examples)
  • Format: bf16 MLX (Apple Silicon native)
  • Refusal rate: ~12% on 100 adversarial prompts (85% compliance)
  • Tool: OBLITERATUS

Architecture

Qwen3.5 hybrid attention architecture:

  • 32 layers (8 full attention + 24 linear attention with GatedDeltaNet)
  • 2560 hidden size, 16 attention heads, 4 KV heads
  • ~4B parameters
  • 262K max context length

Usage

pip install mlx-lm

# Generate text
mlx_lm.generate --model AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX --prompt "Explain quantum computing"
from mlx_lm import load, generate

model, tokenizer = load("AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-fp16-MLX")
response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=512)

Quantized Version

A MXFP8 quantized version (~4.1 GB) is available at: AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-mxfp8-MLX

Disclaimer

This model is provided for research purposes. Users are responsible for ensuring their use complies with applicable laws and regulations.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-03-08Upload folder using huggingface_hub187a99a2.2 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration