← back to catalog · registered 2026-08-22 13:56

QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Name: QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
Author: QuantFactory

Your rig guess connected

? Why do I need an app?

Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/QuantFactory%2FMeta-Llama-3.1-8B-Instruct-abliterated-GGUF"

Response includes

classification m8
files 16
hub_downloads_all_time 18,265
author_summary 48 models
readme_text full

10 credits · hourly refresh · ~4 KB payload Get an API key →

Abliteration classifier · v1.0.0

Primary method

Repackaging (quantization)

No other method signals detected in this model.

Confidence

MEDIUM

Why this label 2 signals

Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.

author=quantfactory (M8 quantization producer)
is_gguf=1

Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

Downloads · lifetime

18K

2K last 30d - cooling

Likes

Model age

2.2y ago

created 2024-07-26

Downloads over time

Jul 24, 2024 → Oct 11 · 157 snapshots · spans 809 days

Metadata

License

llama3.1

Quantizations

Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0

Files by quantization

Q8_0 1 file 7.95 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q8_0.gguf

7.95 GB

434daf0a

download

Q6_K 1 file 6.14 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q6_K.gguf

6.14 GB

52928a07

download

Q5 2 files 10.9 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q5_1.gguf	5.65 GB	781244cd	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q5_0.gguf	5.21 GB	2cb455bf	download

Q5_K 2 files 10.6 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q5_K_M.gguf	5.34 GB	7f09e857	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q5_K_S.gguf	5.21 GB	a03c814b	download

Q4 2 files 9.12 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q4_1.gguf	4.78 GB	4dcc3a02	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q4_0.gguf	4.34 GB	8bf20ab4	download

Q4_K 2 files 8.95 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q4_K_M.gguf	4.58 GB	c1df7af4	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q4_K_S.gguf	4.37 GB	5a303342	download

Q3_K 3 files 11.2 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q3_K_L.gguf	4.03 GB	09ffeec4	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q3_K_M.gguf	3.74 GB	cf0aa585	download
Meta-Llama-3.1-8B-Instruct-abliterated.Q3_K_S.gguf	3.41 GB	775dd003	download

Q2_K 1 file 2.96 GB

Meta-Llama-3.1-8B-Instruct-abliterated.Q2_K.gguf

2.96 GB

f8fa7c71

download

Auxiliary files 2 files 3.94 KB

.gitattributes	2.66 KB	114be501	download
README.md	1.28 KB	ca87a848	download

README current version from Hugging Face

library_name: transformers
license: llama3.1

QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

This is quantized version of mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated created using llama.cpp

Original Model Card

Meta-Llama-3.1-8B-Instruct-abliterated

This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see this article to know more about it).

Special thanks to @FailSpy for the original code and technique. Please follow him if you're interested in abliterated models.

⚡️ Quantization

Thanks to ZeroWw and Apel-sin for the quants.

Better GGUF: https://huggingface.co/ZeroWw/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
My old GGUF: https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
EXL2: https://huggingface.co/Apel-sin/llama-3.1-8B-abliterated-exl2

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

2024-07-26Upload README.md with huggingface_hub7a55ee41.3 KB
Loading...

QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

The browser can't see your hardware

The Abliteration app is integrated with your machine

And you can chat with any model, right now

Repackaging (quantization)

Metadata

Related

Files by quantization

README current version from Hugging Face

QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Original Model Card

Meta-Llama-3.1-8B-Instruct-abliterated

⚡️ Quantization

README history 1 version

Run models on your own machine, not in the cloud.