← back to catalog · registered 2026-08-22 13:56

RichardErkhov/netcat420_-_MFANN-llama3.1-abliterated-v2-awq

RichardErkhov Llama 7.0B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/RichardErkhov%2Fnetcat420_-_MFANN-llama3.1-abliterated-v2-awq"
Response includes
  • classification m1
  • files 10
  • hub_downloads_all_time 34
  • author_summary 257 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · lifetime
34
11 last 30d - stable
Likes
0
Model age
18mo ago
created 2025-03-28
Downloads over time
Now36→from2↑1,700%
01326392 on Mar 26, 202536 on Oct 1136 on Oct 4Mar '25Jun '25Sep '25Dec '25MarJunSep
Mar 26, 2025 → Oct 11 · 120 snapshots · spans 564 days

Metadata

Tags
safetensors llama 4-bit awq region:us

Related

Total size
5.33 GB
Files
10
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-03-28 08:21

Files by quantization

Auxiliary files 10 files 5.35 GB
model-00001-of-00002.safetensors 4.36 GB a92d6c77 download
model-00002-of-00002.safetensors 1002 MB 674610ad download
tokenizer.json 16.4 MB 6b9e4e7f download
model.safetensors.index.json 59.1 KB 2eaf6e33 download
tokenizer_config.json 49.7 KB 41c49944 download
.gitattributes 1.53 KB 52373fe2 download
README.md 1.50 KB 3554d085 download
config.json 1.08 KB 35802bbc download
special_tokens_map.json 296 B 02ee80b6 download
generation_config.json 198 B 9161cf69 download

README current version from Hugging Face

Quantization made by Richard Erkhov.

Github

Discord

Request more models

MFANN-llama3.1-abliterated-v2 - AWQ

Original model description:

base_model:

  • netcat420/MFANNv0.19
  • mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
    library_name: transformers
    tags:
  • mergekit
  • merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: netcat420/MFANNv0.19
        layer_range: [0, 32]
      - model: mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
        layer_range: [0, 32]
merge_method: slerp
base_model: mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-03-28uploaded readmecf48a991.5 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration