Get the app
← back to catalog · registered 2026-08-22 13:56

MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

MaziyarPanahi Llama 8B GGUF second-order 131K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/MaziyarPanahi%2FLlama-3.1-8B-Lexi-Uncensored-V2-GGUF"
Response includes
  • classification m-uncensored
  • files 20
  • benchmarks 16 entries
  • hub_downloads_all_time 11,780
  • author_summary 36 models
  • readme_text full
Try next
GET/models?author=MaziyarPanahi
All 36 models by MaziyarPanahi
 GET/models?family=llama&method=m-uncensored
Sibling llama models · same method
 GET/methods/m-uncensored
What "m-uncensored" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
How we label → About M-U →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
12K
1K last 30d - stable
Likes
2
Model age
24mo ago
created 2024-10-20
Downloads over time
Now12.3K→from406↑2,935%
04.5K9K13.5K406 on Oct 16, 202412.3K on Oct 12Oct '24Feb '25Jun '25Oct '25FebJunOct
Oct 16, 2024 → Oct 12 · 145 snapshots · spans 726 days

Benchmarks

Benchmark Score Source
BBH average 0.46037099494097816 OpenLLM-v2
IFEval instruct 0.8189448441247003 OpenLLM-v2
IFEval-Prompt 0.7393715341959335 OpenLLM-v2
MATH lvl 5 0.1691842900302115 OpenLLM-v2
MMLU-Pro 0.3780751329787234 OpenLLM-v2
Entertainment 0.7 UGI
Hazardous 0 UGI
Natural Intelligence 16.16 UGI
Political lean -21.7% UGI
Sensitive-Info 7.32 UGI
SocPol 1.3 UGI
UGI 25.72 UGI
Willingness (10) 6.2 UGI
W10-Adherence 6.5 UGI
W10-Direct 6 UGI
Writing 19.4 UGI

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2↓ 13,833 this lineage
MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF↓ 1,252

Metadata

Quantizations
F16 IQ1 IQ2 IQ3 IQ4 Q2_K Q3_K Q4_K Q5_K Q6_K Q8_0
Tags
gguf mistral quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF text-generation base_model:Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2

Related

Other by MaziyarPanahi
Llama-3.2-3B-Instruct-abliterated-GGUF 2K Llama-3.2-3B-Instruct-uncensored-GGUF 1K Qwen2.5-7B-Instruct-abliterated-v2-GGUF 982 Dirty-Shirley-Writer-v01-Uncensored-GGUF 627 Qwen2.5-Coder-3B-Instruct-abliterated-GGUF 580
Same base model
bartowski/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF 9K mradermacher/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF 1K mradermacher/Llama-3.1-8B-Lexi-Uncensored-V2-i1-GGUF 885 Felprot75/Llama-3.1-8B-Lexi-Uncensored-V2-mlx_4bit 678 solidrust/Llama-3.1-8B-Lexi-Uncensored-V2-AWQ 576
Total size
76.5 GB
Files
20
Quantizations
12
Registered
2026-08-22 13:56
Last updated on HF
2024-10-20 13:50
Source huggingface.co/MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF ↗ Base model Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 →

Files by quantization

F16 1 file 15.0 GB
Llama-3.1-8B-Lexi-Uncensored-V2.fp16.gguf 15.0 GB 798a615e download
Q8_0 1 file 7.95 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q8_0.gguf 7.95 GB d9b79611 download
Q6_K 1 file 6.14 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q6_K.gguf 6.14 GB e6afcf2f download
Q5_K 2 files 10.6 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_K_M.gguf 5.34 GB 4c4d4bad download
Llama-3.1-8B-Lexi-Uncensored-V2.Q5_K_S.gguf 5.21 GB c1fdd8b0 download
Q4_K 2 files 8.95 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_K_M.gguf 4.58 GB febf6e7d download
Llama-3.1-8B-Lexi-Uncensored-V2.Q4_K_S.gguf 4.37 GB 9f398674 download
IQ4 1 file 4.14 GB
Llama-3.1-8B-Lexi-Uncensored-V2.IQ4_XS.gguf 4.14 GB b79f137b download
Q3_K 3 files 11.2 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_L.gguf 4.03 GB 94c67c89 download
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_M.gguf 3.74 GB 7c917d06 download
Llama-3.1-8B-Lexi-Uncensored-V2.Q3_K_S.gguf 3.41 GB eee038d8 download
IQ3 1 file 3.28 GB
Llama-3.1-8B-Lexi-Uncensored-V2.IQ3_XS.gguf 3.28 GB 5b475a15 download
Q2_K 1 file 2.96 GB
Llama-3.1-8B-Lexi-Uncensored-V2.Q2_K.gguf 2.96 GB d436be61 download
IQ2 1 file 2.43 GB
Llama-3.1-8B-Lexi-Uncensored-V2.IQ2_XS.gguf 2.43 GB 37ab5a94 download
IQ1 2 files 3.89 GB
Llama-3.1-8B-Lexi-Uncensored-V2.IQ1_M.gguf 2.01 GB d0a86c45 download
Llama-3.1-8B-Lexi-Uncensored-V2.IQ1_S.gguf 1.88 GB 45ac6f5b download
Auxiliary files 4 files 4.76 MB
Llama-3.1-8B-Lexi-Uncensored-V2-GGUF_imatrix.dat 4.76 MB fd03fde0 download
README.md 3.03 KB 53edb97d download
.gitattributes 2.81 KB 706e9ac4 download
config.json 31.0 B 9f0f76f8 download

README current version from Hugging Face

tags:

  • quantized
  • 2-bit
  • 3-bit
  • 4-bit
  • 5-bit
  • 6-bit
  • 8-bit
  • GGUF
  • text-generation
  • text-generation
    model_name: Llama-3.1-8B-Lexi-Uncensored-V2-GGUF
    base_model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
    inference: false
    model_creator: Orenguteng
    pipeline_tag: text-generation
    quantized_by: MaziyarPanahi

MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF

Description

MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF contains GGUF format model files for Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2.

About GGUF

GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.

Here is an incomplete list of clients and libraries that are known to support GGUF:

  • llama.cpp. The source project for GGUF. Offers a CLI and a server option.
  • llama-cpp-python, a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
  • LM Studio, an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
  • text-generation-webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
  • KoboldCpp, a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
  • GPT4All, a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
  • LoLLMS Web UI, a great web UI with many interesting and unique features, including a full model library for easy model selection.
  • Faraday.dev, an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
  • candle, a Rust ML framework with a focus on performance, including GPU support, and ease of use.
  • ctransformers, a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2024-10-20Upload folder using huggingface_hub (#1)0fd56eb3 KB
    Loading...

Discussions 1 thread

  1. 2024-10-20PRUpload folder using huggingface_hubmerged3 💬#1
    Loading...

Continue on Hugging Face →

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration