← back to catalog · registered 2026-08-22 13:56

QuantFactory/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

QuantFactory Llama 8B GGUF 131K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/QuantFactory%2FLlama-3.1-8B-Lexi-Uncensored-V2-GGUF"
Response includes
  • classification m8
  • files 16
  • hub_downloads_all_time 15,320
  • author_summary 48 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 2 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • author=quantfactory (M8 quantization producer)
  • is_gguf=1
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
15K
2K last 30d - stable
Likes
2
Model age
2.0y ago
created 2024-10-01
Downloads over time
Now15.8K→from918↑1,625%
05.8K11.6K17.4K918 on Oct 2, 202415.8K on Oct 11Oct '24Feb '25Jun '25Oct '25FebJunOct
Oct 2, 2024 → Oct 11 · 145 snapshots · spans 739 days

Metadata

License
llama3.1
Quantizations
Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0
Tags
transformers gguf license:llama3.1 model-index endpoints_compatible region:us conversational

Related

Total size
67.7 GB
Files
16
Quantizations
9
Registered
2026-08-22 13:56
Last updated on HF
2024-10-02 06:24

Files by quantization

Q8_0 1 file 7.95 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q8_0.gguf 7.95 GB 81664e9a download
Q6_K 1 file 6.14 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q6_K.gguf 6.14 GB 498cf977 download
Q5 2 files 10.9 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_1.gguf 5.65 GB 222b30cd download
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_0.gguf 5.21 GB da48c0ae download
Q5_K 2 files 10.6 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_K_M.gguf 5.34 GB 4b35c085 download
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_K_S.gguf 5.21 GB 99955c52 download
Q4 2 files 9.12 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_1.gguf 4.78 GB 488c065d download
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_0.gguf 4.34 GB 978b15a4 download
Q4_K 2 files 8.95 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_K_M.gguf 4.58 GB fe3ef30b download
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_K_S.gguf 4.37 GB f75f5064 download
Q3_K 3 files 11.2 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_L.gguf 4.03 GB db2bd396 download
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_M.gguf 3.74 GB 1d6f3849 download
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_S.gguf 3.41 GB 21055b8f download
Q2_K 1 file 2.96 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q2_K.gguf 2.96 GB bb92e067 download
Auxiliary files 2 files 8.30 KB
README.md 5.74 KB 1f145cea download
.gitattributes 2.56 KB 17a19db1 download

README current version from Hugging Face


license: llama3.1
model-index:

library_name: transformers


QuantFactory Banner

QuantFactory/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

This is quantized version of Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 created using llama.cpp

Original Model Card

image/png

VERSION 2 Update Notes:

  • More compliant
  • Smarter
  • For best response, use this system prompt (feel free to expand upon it as you wish):

Think step by step with a logical reasoning and intellectual sense before you provide any response.

  • For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message.

  • IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes.
    There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3.
    Until then, I suggest you run F16 or Q8 if possible.

image/png

GENERAL INFO:

This model is based on Llama-3.1-8b-Instruct, and is governed by META LLAMA 3.1 COMMUNITY LICENSE AGREEMENT

Lexi is uncensored, which makes the model compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant with any requests, even unethical ones.

You are responsible for any content you create using this model. Please use it responsibly.

Lexi is licensed according to Meta's Llama license. I grant permission for any use, including commercial, that falls within accordance with Meta's Llama-3.1 license.

IMPORTANT:

Use the same template as the official Llama 3.1 8B instruct.
System tokens must be present during inference, even if you set an empty system message. If you are unsure, just add a short system message as you wish.

FEEDBACK:

If you find any issues or have suggestions for improvements, feel free to leave a review and I will look into it for upcoming improvements and next version.

image/png

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 27.93
IFEval (0-Shot) 77.92
BBH (3-Shot) 29.69
MATH Lvl 5 (4-Shot) 16.92
GPQA (0-shot) 4.36
MuSR (0-shot) 7.77
MMLU-PRO (5-shot) 30.90

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2024-10-01Upload README.md with huggingface_hub33900d05.7 KB
    Loading...

Discussions 1 thread

  1. 2024-10-04Host LLM Modelopen2 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration