Get the app
← back to catalog · registered 2026-08-22 13:56

mradermacher/Hermes-3-Llama-3.1-405B-Uncensored-GGUF

mradermacher Llama 405B second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/mradermacher%2FHermes-3-Llama-3.1-405B-Uncensored-GGUF"
Response includes
  • classification m-uncensored
  • files 62
  • author_summary 3324 models
  • readme_text full
Try next
GET/models?author=mradermacher
All 3324 models by mradermacher
 GET/models?family=llama&method=m-uncensored
Sibling llama models · same method
 GET/methods/m-uncensored
What "m-uncensored" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
How we label → About M-U →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
4
Model age
21mo ago
created 2025-01-06

Training datasets

1 of 1 in /datasets

Corpora the author lists in the model card. Datasets tracked in our /datasets catalog carry a category badge linking to the workflow stage. Others open on Hugging Face.

Guilherme34/uncensor misc
Downloads over time
Now0→from0↑0%
00110 on Jan 1, 20250 on Oct 11Jan '25Apr '25Jul '25Oct '25JanAprJulOct
Jan 1, 2025 → Oct 11 · 132 snapshots · spans 648 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

nicoboss/Hermes-3-Llama-3.1-405B-Uncensored this lineage
mradermacher/Hermes-3-Llama-3.1-405B-Uncensored-GGUF

Variants by this author 2 formats · 0 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
llama3.1
Languages
en
Tags
transformers generated_from_trainer en dataset:Guilherme34/uncensor base_model:nicoboss/Hermes-3-Llama-3.1-405B-Uncensored base_model:finetune:nicoboss/Hermes-3-Llama-3.1-405B-Uncensored license:llama3.1 endpoints_compatible region:us

Related

Other by mradermacher
Ornith-1.5-9B-uncensored-GGUF 1.5M Qwen3-VL-8B-Instruct-abliterated-GGUF 667K Qwen3.8-Flash-Next-Uncensored-i1-GGUF 153K gemma-4-26B-A4B-it-ultra-uncensored-heretic-i1-GGUF 138K Qwen3.8-9B-heretic-uncensored-GGUF 106K
Same base model
DevQuasar/nicoboss.Hermes-3-Llama-3.1-405B-Uncensored-GGUF 83 llmtraining-scraper/uncensored 23 mradermacher/Hermes-3-Llama-3.1-405B-Uncensored-i1-GGUF 0 Dessicated/Hermes-3-Llama-3.1-405B-Uncensored-Q2-mlx 0 xiaoniao000/Hermes-3-Llama-3.1-405B-Uncensored-GGUF 0
Total size
0 B
Files
62
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-07-31 21:50
Source huggingface.co/mradermacher/Hermes-3-Llama-3.1-405B-Uncensored-GGUF ↗ Base model nicoboss/Hermes-3-Llama-3.1-405B-Uncensored →

Files by quantization

Auxiliary files 62 files 2.51 TB
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_M.gguf.part1of4 46.0 GB 83f15a25 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_M.gguf.part2of4 46.0 GB a5389245 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_M.gguf.part3of4 46.0 GB 3ab5e4d4 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_M.gguf.part1of5 46.0 GB e6dddbd4 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_M.gguf.part2of5 46.0 GB ea8d713f download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_M.gguf.part3of5 46.0 GB 58fdab01 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_M.gguf.part4of5 46.0 GB 400426a7 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part1of6 45.0 GB 69d3f083 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part2of6 45.0 GB 42c78a26 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part3of6 45.0 GB 652c4cee download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part4of6 45.0 GB 795ee238 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part5of6 45.0 GB 0ce60cd8 download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part1of7 45.0 GB 67fc58b5 download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part2of7 45.0 GB ad98bfa2 download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part3of7 45.0 GB c6d56af3 download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part4of7 45.0 GB c882346b download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part5of7 45.0 GB 748749ed download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part6of7 45.0 GB 33585153 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part1of9 45.0 GB c9a022d7 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part2of9 45.0 GB d4692918 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part3of9 45.0 GB abe3794e download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part4of9 45.0 GB e348e16c download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part5of9 45.0 GB cb911227 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part6of9 45.0 GB 0fae8976 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part7of9 45.0 GB 06270e82 download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part8of9 45.0 GB a53af87c download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part1of6 44.0 GB c1f8e7a7 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part2of6 44.0 GB af830e8d download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part3of6 44.0 GB 41ccfddd download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part4of6 44.0 GB b17e03d4 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part5of6 44.0 GB 6c1f1001 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_M.gguf.part4of4 44.0 GB feb99c44 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_S.gguf.part1of5 43.0 GB 36eb9263 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_S.gguf.part2of5 43.0 GB e1441578 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_S.gguf.part3of5 43.0 GB 7aa5dda7 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_S.gguf.part4of5 43.0 GB 0ec64775 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_S.gguf.part5of5 42.7 GB 1550dff9 download
Hermes-3-Llama-3.1-405B-Uncensored.Q4_K_M.gguf.part5of5 42.4 GB 439bbf42 download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_M.gguf.part6of6 42.0 GB 13a27cba download
Hermes-3-Llama-3.1-405B-Uncensored.Q8_0.gguf.part9of9 41.6 GB 266abc4a download
Hermes-3-Llama-3.1-405B-Uncensored.IQ4_XS.gguf.part1of5 41.0 GB 31d652e2 download
Hermes-3-Llama-3.1-405B-Uncensored.IQ4_XS.gguf.part2of5 41.0 GB cb1e5217 download
Hermes-3-Llama-3.1-405B-Uncensored.IQ4_XS.gguf.part3of5 41.0 GB 7163efbf download
Hermes-3-Llama-3.1-405B-Uncensored.IQ4_XS.gguf.part4of5 41.0 GB c8922aa9 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_S.gguf.part1of4 41.0 GB 16e29d11 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_S.gguf.part2of4 41.0 GB a3366725 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_S.gguf.part3of4 41.0 GB 3100bacf download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_S.gguf.part4of4 40.2 GB 3a12c49f download
Hermes-3-Llama-3.1-405B-Uncensored.Q5_K_S.gguf.part6of6 40.1 GB 0a37ab5d download
Hermes-3-Llama-3.1-405B-Uncensored.Q6_K.gguf.part7of7 40.1 GB 4b185a15 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_L.gguf.part1of5 40.0 GB d697241c download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_L.gguf.part2of5 40.0 GB 39931608 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_L.gguf.part3of5 40.0 GB e5d852d3 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_L.gguf.part4of5 40.0 GB 463e9e31 download
Hermes-3-Llama-3.1-405B-Uncensored.IQ4_XS.gguf.part5of5 39.6 GB e3d219d6 download
Hermes-3-Llama-3.1-405B-Uncensored.Q3_K_L.gguf.part5of5 38.2 GB b6aa05d1 download
Hermes-3-Llama-3.1-405B-Uncensored.Q2_K.gguf.part1of4 35.0 GB db7fcfab download
Hermes-3-Llama-3.1-405B-Uncensored.Q2_K.gguf.part2of4 35.0 GB d1f71eae download
Hermes-3-Llama-3.1-405B-Uncensored.Q2_K.gguf.part3of4 35.0 GB 7b729429 download
Hermes-3-Llama-3.1-405B-Uncensored.Q2_K.gguf.part4of4 34.1 GB 3b03f684 download
README.md 11.0 KB 003f3d26 download
.gitattributes 6.83 KB 878086d0 download

README current version from Hugging Face

base_model: nicoboss/Hermes-3-Llama-3.1-405B-Uncensored
datasets:

  • Guilherme34/uncensor
    language:
  • en
    library_name: transformers
    license: llama3.1
    mradermacher:
    readme_rev: 1
    quantized_by: mradermacher
    tags:
  • generated_from_trainer

About

static quants of https://huggingface.co/nicoboss/Hermes-3-Llama-3.1-405B-Uncensored

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants are available at https://huggingface.co/mradermacher/Hermes-3-Llama-3.1-405B-Uncensored-i1-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's
READMEs for
more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
PART 1 PART 2 PART 3 PART 4 Q2_K 149.4
PART 1 PART 2 PART 3 PART 4 Q3_K_S 175.3
PART 1 PART 2 PART 3 PART 4 Q3_K_M 195.5 lower quality
P1 P2 P3 P4 P5 Q3_K_L 212.9
P1 P2 P3 P4 P5 IQ4_XS 218.7
P1 P2 P3 P4 P5 Q4_K_S 230.6 fast, recommended
P1 P2 P3 P4 P5 Q4_K_M 243.2 fast, recommended
P1 P2 P3 P4 P5 P6 Q5_K_S 279.4
P1 P2 P3 P4 P5 P6 Q5_K_M 286.7
P1 P2 P3 P4 P5 P6 P7 Q6_K 333.0 very good quality
P1 P2 P3 P4 P5 P6 P7 P8 P9 Q8_0 431.3 fast, best quality

Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

image.png

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.

README history 5 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-07-31auto-patch README.md6656cad11 KB
    Loading...
  2. 2025-01-15auto-patch README.md150863e11 KB
    Loading...
  3. 2025-01-07auto-patch README.mdc69b7b311.1 KB
    Loading...
  4. 2025-01-06auto-patch README.mdcd9607910.4 KB
    Loading...
  5. 2025-01-06uploaded from nico1ffc67fb233 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration