← back to catalog · registered 2026-08-22 13:56

noneUsername/phi-4-abliterated-W8A8

noneUsername Phi 14B second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/noneUsername%2Fphi-4-abliterated-W8A8"
Response includes
  • classification m1
  • files 15
  • benchmarks 5 entries
  • hub_downloads_all_time 50
  • author_summary 17 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
50
12 last 30d - stable
Likes
0
Model age
21mo ago
created 2024-12-21
Downloads over time
Now59→from7↑743%
040791197 on Dec 18, 202459 on Oct 11108 on Sep 10, 2025Dec '24Mar '25Jun '25Sep '25Dec '25MarJunSep
Dec 18, 2024 → Oct 11 · 134 snapshots · spans 662 days

Benchmarks

Benchmark Score Source
BBH average 0.610844467505513 OpenLLM-v2
IFEval instruct 0.0671462829736211 OpenLLM-v2
IFEval-Prompt 0.04805914972273567 OpenLLM-v2
MATH lvl 5 0.2854984894259819 OpenLLM-v2
MMLU-Pro 0.5291722074468085 OpenLLM-v2

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Tags
safetensors phi3 custom_code base_model:Orion-zhen/phi-4-abliterated base_model:quantized:Orion-zhen/phi-4-abliterated 8-bit compressed-tensors region:us

Related

Total size
14.6 GB
Files
15
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-02-27 13:54

Files by quantization

Auxiliary files 15 files 14.6 GB
model-00002-of-00004.safetensors 4.62 GB 8db176f0 download
model-00003-of-00004.safetensors 4.53 GB a3b4f58d download
model-00001-of-00004.safetensors 4.51 GB 0ca27f18 download
model-00004-of-00004.safetensors 980 MB 5839c81a download
tokenizer.json 6.82 MB 624ba298 download
vocab.json 1.54 MB c5dc46ce download
merges.txt 895 KB 354558ed download
model.safetensors.index.json 33.7 KB d5884682 download
tokenizer_config.json 17.3 KB c2efc626 download
README.md 7.11 KB 5ab4d242 download
config.json 1.86 KB 5179b115 download
.gitattributes 1.48 KB a6344aac download
special_tokens_map.json 579 B e3bbb9ed download
recipe.yaml 355 B a1eabb72 download
generation_config.json 143 B c83c9e59 download

README current version from Hugging Face


base_model:

  • Orion-zhen/phi-4-abliterated

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.932 ± 0.016
strict-match 5 exact_match ↑ 0.932 ± 0.016

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.922 ± 0.012
strict-match 5 exact_match ↑ 0.922 ± 0.012

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-85,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.92 ± 0.0172
strict-match 5 exact_match ↑ 0.92 ± 0.0172

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-85,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.918 ± 0.0123
strict-match 5 exact_match ↑ 0.918 ± 0.0123

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-8625,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.932 ± 0.016
strict-match 5 exact_match ↑ 0.932 ± 0.016

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-8625,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.934 ± 0.0111
strict-match 5 exact_match ↑ 0.934 ± 0.0111

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-875,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.924 ± 0.0168
strict-match 5 exact_match ↑ 0.924 ± 0.0168

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-875,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.916 ± 0.0124
strict-match 5 exact_match ↑ 0.916 ± 0.0124

vllm (pretrained=/root/autodl-tmp/phi-4,add_bos_token=true,max_model_len=2048), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.928 ± 0.0164
strict-match 5 exact_match ↑ 0.928 ± 0.0164

vllm (pretrained=/root/autodl-tmp/phi-4,add_bos_token=true,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.93 ± 0.0114
strict-match 5 exact_match ↑ 0.93 ± 0.0114

vllm (pretrained=/root/autodl-tmp/phi-4,add_bos_token=true,max_model_len=800,dtype=bfloat16), gen_kwargs: (None), limit: 15.0, num_fewshot: None, batch_size: auto

Groups Version Filter n-shot Metric Value Stderr
mmlu 2 none acc ↑ 0.7649 ± 0.0137
- humanities 2 none acc ↑ 0.8103 ± 0.0256
- other 2 none acc ↑ 0.7487 ± 0.0287
- social sciences 2 none acc ↑ 0.8167 ± 0.0280
- stem 2 none acc ↑ 0.7123 ± 0.0260

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-W8A8,add_bos_token=true,max_model_len=2048), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.928 ± 0.0164
strict-match 5 exact_match ↑ 0.928 ± 0.0164

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-W8A8,add_bos_token=true,max_model_len=2048,dtype=bfloat16), gen_kwargs: (None), limit: 500.0, num_fewshot: 5, batch_size: auto

Tasks Version Filter n-shot Metric Value Stderr
gsm8k 3 flexible-extract 5 exact_match ↑ 0.916 ± 0.0124
strict-match 5 exact_match ↑ 0.916 ± 0.0124

vllm (pretrained=/root/autodl-tmp/phi-4-abliterated-W8A8,add_bos_token=true,max_model_len=800,dtype=bfloat16), gen_kwargs: (None), limit: 15.0, num_fewshot: None, batch_size: auto

Groups Version Filter n-shot Metric Value Stderr
mmlu 2 none acc ↑ 0.7696 ± 0.0136
- humanities 2 none acc ↑ 0.8000 ± 0.0261
- other 2 none acc ↑ 0.7692 ± 0.0280
- social sciences 2 none acc ↑ 0.8389 ± 0.0265
- stem 2 none acc ↑ 0.7053 ± 0.0265

README history 3 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-02-27Update README.mdda93d367.1 KB
    Loading...
  2. 2024-12-21Update README.md4fb61594 KB
    Loading...
  3. 2024-12-21Create README.md1e940283.9 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration