← back to catalog · registered 2026-08-22 13:56

aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC

Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/aipster%2FPhi-4-mini-instruct-abliterated-q4f16_1-MLC"
Response includes
  • classification m1
  • files 75
  • hub_downloads_all_time 62
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
62
18 last 30d - stable
Likes
0
Model age
3mo ago
created 2026-06-17
Downloads over time
Now63→from9↑600%
62748689 on Jun 1763 on Oct 11JunJulAugSepOct
Jun 17 → Oct 11 · 56 snapshots · spans 116 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
mit
Languages
en ar de es fr it ja ko nl pl pt ru th uk vi zh
Tags
mlc-llm phi3 phi-4 mlc webllm webgpu q4f16_1 quantized abliterated uncensored conversational not-for-all-audiences

Related

Total size
2.01 GB
Files
75
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-06-17 19:01

Files by quantization

Auxiliary files 75 files 2.03 GB
params_shard_0.bin 293 MB 8df1ece3 download
params_shard_1.bin 36.6 MB b4638d16 download
params_shard_3.bin 30.0 MB 710933f6 download
params_shard_39.bin 30.0 MB 81830155 download
params_shard_11.bin 30.0 MB 657be8da download
params_shard_13.bin 30.0 MB bbede83f download
params_shard_15.bin 30.0 MB 27e28dd1 download
params_shard_17.bin 30.0 MB bf373a0b download
params_shard_19.bin 30.0 MB ac6408f1 download
params_shard_23.bin 30.0 MB 13392548 download
params_shard_25.bin 30.0 MB 2d9d1aac download
params_shard_27.bin 30.0 MB 842ec9a4 download
params_shard_29.bin 30.0 MB 261a5b56 download
params_shard_31.bin 30.0 MB 2dec39b5 download
params_shard_33.bin 30.0 MB b9bf34ee download
params_shard_35.bin 30.0 MB 1cdbcc96 download
params_shard_37.bin 30.0 MB 062c0efd download
params_shard_41.bin 30.0 MB fdf0e6b3 download
params_shard_43.bin 30.0 MB 1cdd73b2 download
params_shard_45.bin 30.0 MB 1620e7d6 download
params_shard_47.bin 30.0 MB 57c2867f download
params_shard_49.bin 30.0 MB 014516d0 download
params_shard_5.bin 30.0 MB aa7d4568 download
params_shard_51.bin 30.0 MB bf526304 download
params_shard_53.bin 30.0 MB bf6f5bd3 download
params_shard_55.bin 30.0 MB 16610583 download
params_shard_57.bin 30.0 MB 3f1d7ec7 download
params_shard_59.bin 30.0 MB 4a4afc6f download
params_shard_61.bin 30.0 MB a9eb6181 download
params_shard_63.bin 30.0 MB f243d28c download
params_shard_65.bin 30.0 MB 40425047 download
params_shard_7.bin 30.0 MB ec3d5e40 download
params_shard_9.bin 30.0 MB 0bfe3d17 download
params_shard_21.bin 30.0 MB a7118873 download
params_shard_10.bin 24.0 MB b1223ccd download
params_shard_12.bin 24.0 MB 2c4ac10d download
params_shard_14.bin 24.0 MB 457e626e download
params_shard_16.bin 24.0 MB c313b08f download
params_shard_18.bin 24.0 MB 6bfdd500 download
params_shard_2.bin 24.0 MB 8b99fa36 download
params_shard_20.bin 24.0 MB 78f083e7 download
params_shard_22.bin 24.0 MB 2792f95b download
params_shard_24.bin 24.0 MB 86656a7a download
params_shard_26.bin 24.0 MB 7260b19a download
params_shard_28.bin 24.0 MB e9c505eb download
params_shard_30.bin 24.0 MB 8c0b69f7 download
params_shard_32.bin 24.0 MB 6b761397 download
params_shard_34.bin 24.0 MB 0e9c24b0 download
params_shard_36.bin 24.0 MB 46b321c7 download
params_shard_38.bin 24.0 MB 2289898c download
params_shard_4.bin 24.0 MB e339226b download
params_shard_40.bin 24.0 MB 6caee62c download
params_shard_42.bin 24.0 MB 5d65f9ee download
params_shard_44.bin 24.0 MB 878ec4b2 download
params_shard_46.bin 24.0 MB b7cacb9d download
params_shard_48.bin 24.0 MB d07269bc download
params_shard_50.bin 24.0 MB 6af62974 download
params_shard_52.bin 24.0 MB 62b0ed6e download
params_shard_54.bin 24.0 MB a624e636 download
params_shard_56.bin 24.0 MB f6e2fd95 download
params_shard_58.bin 24.0 MB f96f5dfe download
params_shard_6.bin 24.0 MB 2f545611 download
params_shard_60.bin 24.0 MB ab109e8f download
params_shard_62.bin 24.0 MB 55ca1313 download
params_shard_64.bin 24.0 MB 476be629 download
params_shard_8.bin 24.0 MB 7958eabb download
tokenizer.json 14.8 MB 382cc235 download
vocab.json 3.73 MB ea953a43 download
merges.txt 2.31 MB dcecc452 download
tensor-cache.json 134 KB a01f9285 download
README.md 5.85 KB f53c364e download
mlc-chat-config.json 4.01 KB b29c92fb download
tokenizer_config.json 3.00 KB 288a9073 download
.gitattributes 1.53 KB 52373fe2 download
added_tokens.json 261 B 77e6ed40 download

README current version from Hugging Face


license: mit
base_model:

  • microsoft/Phi-4-mini-instruct
  • huihui-ai/Phi-4-mini-instruct-abliterated
    language:
  • en
  • ar
  • de
  • es
  • fr
  • it
  • ja
  • ko
  • nl
  • pl
  • pt
  • ru
  • th
  • uk
  • vi
  • zh
    pipeline_tag: text-generation
    library_name: mlc-llm
    tags:
  • phi3
  • phi-4
  • mlc
  • mlc-llm
  • webllm
  • webgpu
  • q4f16_1
  • quantized
  • abliterated
  • uncensored
  • conversational
  • not-for-all-audiences

Phi-4-mini-instruct abliterated · MLC q4f16_1

An uncensored Phi-4-mini, quantized to 4-bit MLC format for in-browser inference via WebGPU.

This is an MLC-ready build of huihui-ai/Phi-4-mini-instruct-abliterated, itself an abliterated (refusal-removed) variant of Microsoft's Phi-4-mini-instruct. The weights are quantized to q4f16_1 (4-bit weights, 16-bit activations) and packaged for use with MLC-LLM and WebLLM.

Everything runs on-device — no server, no API key, no data leaves your machine.

What abliteration means

Abliteration is a surgical edit to the model weights that removes the trained refusal behavior without retraining. The architecture and tokenizer are identical to the stock Phi-4-mini; only the weight values differ. This means the model will engage with topics that the original would refuse, but it also means there are no safety guardrails between you and the raw model output.

This is sovereignty taken to its conclusion: your hardware, your data, your judgment — and your responsibility for how you use it.

Model details

Architecture Phi-3 (Phi3ForCausalLM), 32 layers, 3072 hidden, 24 heads / 8 KV heads
Parameters 3.8B (original fp16)
Quantization q4f16_1 (MLC 4-bit weights, 16-bit activations)
Download size ~2.1 GB (66 shards)
VRAM ~3.4 GB
Context window 131,072 tokens (LongRoPE); 4,096 recommended for WebGPU
Conv template phi-4
License MIT (inherited from base)

Usage

WebLLM (in-browser, WebGPU)

This model reuses the prebuilt WebAssembly model_lib from the stock Phi-4-mini in WebLLM's catalog (Phi-4-mini-instruct-q4f16_1-MLC), since the architecture is identical — only weight values change.

import { CreateMLCEngine, prebuiltAppConfig } from "@mlc-ai/web-llm";

// Borrow the prebuilt model_lib (WASM) from the stock Phi-4-mini record
const baseRecord = prebuiltAppConfig.model_list.find(
  m => m.model_id === "Phi-4-mini-instruct-q4f16_1-MLC"
);

const engine = await CreateMLCEngine(
  "Phi-4-mini-instruct-abliterated-q4f16_1-MLC",
  {
    appConfig: {
      model_list: [{
        model: "https://huggingface.co/aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC/resolve/main/",
        model_id: "Phi-4-mini-instruct-abliterated-q4f16_1-MLC",
        model_lib: baseRecord.model_lib,
        overrides: { context_window_size: 4096 },
      }],
    },
  }
);

const reply = await engine.chat.completions.create({
  messages: [{ role: "user", content: "Explain how a pin-tumbler lock works." }],
});
console.log(reply.choices[0].message.content);

MLC-LLM (native, CLI)

mlc_llm chat HF://aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC --device vulkan

Try it live

This model powers the top-tier slot in the AIpster Local AI Playground — a browser-based playground where every model runs entirely on your GPU via WebGPU. No sign-up required for smaller models; this one is available to AIpster members.

How these weights were built

  1. Downloaded source weights from huihui-ai/Phi-4-mini-instruct-abliterated (safetensors, bf16).
  2. Built MLC-LLM from source inside the mlcaidev/package-cpu Docker image (the pip nightly was ABI-broken for linux x86_64 at time of conversion).
  3. Ran mlc_llm convert_weight with --quantization q4f16_1 to produce the 66 weight shards.
  4. Ran mlc_llm gen_config with --conv-template phi-4 to produce mlc-chat-config.json.
  5. Validated the output tensor-cache.json against the official mlc-ai/Phi-4-mini-instruct-q4f16_1-MLC reference: 66 records, 323 parameters, identical names and shapes — confirming safe reuse of the prebuilt WebAssembly model_lib.

Caveats

  • Uncensored means unfiltered. The model will produce output that a stock model would refuse. There is no safety net. You are responsible for what you do with it.
  • Still a small model. 3.8B parameters is capable but not frontier. It can be confidently wrong on precise facts, names, and numbers. Treat its claims with the same skepticism you would apply to any local model.
  • WebGPU requirements. In-browser inference needs a GPU with WebGPU support (Chrome 113+ or Edge 113+ on desktop). Expect ~3.4 GB of VRAM usage. On integrated graphics or mobile, the model may fail to load.

Attribution

License

MIT — inherited from the base model chain. See microsoft/Phi-4-mini-instruct for the original license terms.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-06-17Add files using upload-large-folder toold7bd0385.8 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration