← back to catalog · registered 2026-11-06 14:02

FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1-MLX-8bit

FrostWolfAI second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/FrostWolfAI%2FFrost-Cyber-Mini-Uncensored-v1.1-MLX-8bit"
Response includes
  • classification m1
  • files 9
  • author_summary 8 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-11-06

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Languages
en
Tags
mlx safetensors spark2_5 8-bit spark-x2.6 cybersecurity uncensored abliterated agentic tool-use reasoning on-device

Related

Total size
4.07 GB
Files
9
Quantizations
1
Registered
2026-11-06 14:02
Last updated on HF
2026-11-06 13:44

Files by quantization

Auxiliary files 9 files 4.08 GB
model.safetensors 4.07 GB 36c8fb6f download
tokenizer.json 9.65 MB 2591c719 download
model.safetensors.index.json 45.4 KB 1cc7b858 download
README.md 5.73 KB 109c843f download
chat_template.jinja 4.81 KB 22b787d7 download
config.json 2.52 KB 020c3ae2 download
.gitattributes 1.48 KB a6344aac download
tokenizer_config.json 524 B 8a8a4479 download
generation_config.json 281 B d47d1131 download

README current version from Hugging Face


license: apache-2.0
language:

  • en
    library_name: mlx
    pipeline_tag: text-generation
    base_model: FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1
    base_model_relation: quantized
    tags:
  • mlx
  • 8-bit
  • spark2_5
  • spark-x2.6
  • cybersecurity
  • uncensored
  • abliterated
  • agentic
  • tool-use
  • reasoning
  • on-device
  • local-llm

Frost Cyber Mini v1.1 — FrostWolf AI Labs

Frost Cyber Mini Uncensored v1.1 — MLX (8-bit)

Apple-silicon-native MLX conversion of
FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1,
the cybersecurity SFT + agentic tool-use fine-tune of
Spark-X2.6-4B-abliterated.

Part of the Frost Cyber Mini v1.1 model family.
For llama.cpp / Ollama / LM Studio's GGUF path, use
Frost-Cyber-Mini-Uncensored-v1.1-GGUF — MLX
cannot load GGUF files.

By Vatsal Bajpai (@xblack) at FrostWolfAI.

Buy me a coffee

Everything here is released openly. If it's useful to you and you'd like to support more open-source work on AI, a coffee goes a long way — entirely optional.

Which quant? This 8-bit release is near-lossless against the BF16 weights. On 16 GB machines, or when speed matters more, use Frost-Cyber-Mini-Uncensored-v1.1-MLX (4-bit, 2.32 GB).

Always run this model with thinking enabled. It was trained with a thinking channel and degrades
severely without it (it echoes JSON instead of answering). See Thinking.

Model details

Base FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1 (BF16)
Architecture spark2_5: 36 layers, 27 sliding-window (512) + 9 global attention (3:1)
Attention 16 heads / 4 KV heads, head dim 256, fused QKV, head-wise sigmoid output gate
Hidden / intermediate 2560 / 10240, GELU MLP, tied embeddings
Vocab / context 131,072 / 131,072 native (up to 232k via RoPE)
Quantization 8-bit affine, group size 64 — 8.503 bits/weight (g_proj gates and norms kept in BF16)
Size on disk 4.37 GB
Format MLX safetensors (model_type: spark2_5)

spark2_5 is supported natively by mlx-lm, so this repo loads on a stock install with no custom code and
no trust_remote_code. Sliding layers use a rotating 512-token KV cache, so memory grows only with the 9
global layers at long context.

Requirements

  • Apple silicon Mac, macOS 13.5+
  • mlx-lm >= 0.32
pip install -U mlx-lm

Usage

from mlx_lm import load, generate
from mlx_lm.sample_utils import make_sampler

model, tokenizer = load("FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1-MLX-8bit")

messages = [{"role": "user", "content": "Explain how a TLS 1.3 handshake works."}]

# thinking enabled (default) — REQUIRED for this model
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True, tokenize=False, enable_thinking=True
)
sampler = make_sampler(temp=0.3, top_p=0.95)
print(generate(model, tokenizer, prompt=prompt, max_tokens=2048, sampler=sampler))
# one-shot CLI
mlx_lm.generate --model FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1-MLX-8bit \
  --prompt "Write a Python port scanner using asyncio." --max-tokens 2048

# OpenAI-compatible server on :8080
mlx_lm.server --model FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1-MLX-8bit --port 8080

Also loadable directly in LM Studio (MLX engine).

Thinking

v1.1 adds an agentic tool-use fine-tuning phase on top of the cybersecurity SFT, trained whole-trace so the
model follows the full loop: read the task, inspect with tools, act, observe each tool result, recover from
errors, then answer. Thinking must be on — with it disabled the model degrades severely. Per request:

  • enable_thinking=True (default) — reasoning on; budget generous max_tokens or responses truncate mid-reasoning
  • reasoning_effort="low" (default) / "high" — on a 4B these behave similarly; treat it as on/off

With mlx_lm.server, pass them via "chat_template_kwargs", e.g. {"reasoning_effort": "high"}.

Notes carried over from v1.1

  • Do not use DRY or other repetition-penalty samplers for agentic coding. They mutate the verbatim
    strings (file paths, identifiers, edit targets) that tool calls must reproduce byte-for-byte. If the model
    loops, break it client-side (de-duplicate identical tool calls, cap steps) and/or use temperature ~0.3–0.4.
  • Do not rely on it for CVE details looked up by ID — verify CVE facts against a primary source or give
    the model a lookup tool.
  • This model has its refusals removed; you are responsible for how you use it and for following applicable
    law. Intended for authorized security testing, research, defense and education.

Benchmarks, training details and the full model card live on the
safetensors repo.


This model was converted to MLX format from FrostWolfAI/Frost-Cyber-Mini-Uncensored-v1.1
using mlx-lm version 0.32.2 (native spark2_5 support).

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration