← back to catalog · registered 2026-08-22 13:56

RichardErkhov/ajibawa-2023_-_Uncensored-Frank-Llama-3-8B-gguf

RichardErkhov Llama 8B GGUF 8K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/RichardErkhov%2Fajibawa-2023_-_Uncensored-Frank-Llama-3-8B-gguf"
Response includes
  • classification m8
  • files 24
  • hub_downloads_all_time 4,229
  • author_summary 257 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 2 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • author=richarderkhov (M8 quantization producer)
  • is_gguf=1
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
4K
421 last 30d - cooling
Likes
0
Model age
2.1y ago
created 2024-08-20
Downloads over time
Now4.3K→from0↑0%
01.6K3.2K4.7K0 on Aug 14, 20244.3K on Oct 11Aug '24Dec '24Apr '25Aug '25Dec '25AprAug
Aug 14, 2024 → Oct 11 · 152 snapshots · spans 788 days

Metadata

Quantizations
IQ3 IQ4 Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0
Tags
gguf endpoints_compatible region:us conversational

Related

Total size
100 GB
Files
24
Quantizations
11
Registered
2026-08-22 13:56
Last updated on HF
2024-08-20 08:05

Files by quantization

Q8_0 1 file 7.95 GB
Uncensored-Frank-Llama-3-8B.Q8_0.gguf 7.95 GB 812ce66f download
Q6_K 1 file 6.14 GB
Uncensored-Frank-Llama-3-8B.Q6_K.gguf 6.14 GB 498a6498 download
Q5 2 files 10.9 GB
Uncensored-Frank-Llama-3-8B.Q5_1.gguf 5.65 GB d52a845c download
Uncensored-Frank-Llama-3-8B.Q5_0.gguf 5.21 GB 5e525401 download
Q5_K 3 files 15.9 GB
Uncensored-Frank-Llama-3-8B.Q5_K.gguf 5.34 GB 904c74b0 download
Uncensored-Frank-Llama-3-8B.Q5_K_M.gguf 5.34 GB 904c74b0 download
Uncensored-Frank-Llama-3-8B.Q5_K_S.gguf 5.21 GB c08c45a9 download
Q4 2 files 9.12 GB
Uncensored-Frank-Llama-3-8B.Q4_1.gguf 4.78 GB 39e83266 download
Uncensored-Frank-Llama-3-8B.Q4_0.gguf 4.34 GB f3946ea6 download
Q4_K 3 files 13.5 GB
Uncensored-Frank-Llama-3-8B.Q4_K.gguf 4.58 GB 1856a661 download
Uncensored-Frank-Llama-3-8B.Q4_K_M.gguf 4.58 GB 1856a661 download
Uncensored-Frank-Llama-3-8B.Q4_K_S.gguf 4.37 GB b863c0c5 download
IQ4 2 files 8.56 GB
Uncensored-Frank-Llama-3-8B.IQ4_NL.gguf 4.38 GB adfaedf7 download
Uncensored-Frank-Llama-3-8B.IQ4_XS.gguf 4.18 GB 6cd16e1c download
Q3_K 4 files 14.9 GB
Uncensored-Frank-Llama-3-8B.Q3_K_L.gguf 4.03 GB 168f0b74 download
Uncensored-Frank-Llama-3-8B.Q3_K.gguf 3.74 GB 62a9f595 download
Uncensored-Frank-Llama-3-8B.Q3_K_M.gguf 3.74 GB 62a9f595 download
Uncensored-Frank-Llama-3-8B.Q3_K_S.gguf 3.41 GB 4733bdcf download
IQ3 3 files 10.2 GB
Uncensored-Frank-Llama-3-8B.IQ3_M.gguf 3.52 GB 473ecd6f download
Uncensored-Frank-Llama-3-8B.IQ3_S.gguf 3.43 GB e367de6f download
Uncensored-Frank-Llama-3-8B.IQ3_XS.gguf 3.28 GB 8776dcfa download
Q2_K 1 file 2.96 GB
Uncensored-Frank-Llama-3-8B.Q2_K.gguf 2.96 GB de873843 download
Auxiliary files 2 files 13.5 KB
README.md 10.4 KB 524b517b download
.gitattributes 3.09 KB 72def19b download

README current version from Hugging Face

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Uncensored-Frank-Llama-3-8B - GGUF

Name Quant method Size
Uncensored-Frank-Llama-3-8B.Q2_K.gguf Q2_K 2.96GB
Uncensored-Frank-Llama-3-8B.IQ3_XS.gguf IQ3_XS 3.28GB
Uncensored-Frank-Llama-3-8B.IQ3_S.gguf IQ3_S 3.43GB
Uncensored-Frank-Llama-3-8B.Q3_K_S.gguf Q3_K_S 3.41GB
Uncensored-Frank-Llama-3-8B.IQ3_M.gguf IQ3_M 3.52GB
Uncensored-Frank-Llama-3-8B.Q3_K.gguf Q3_K 3.74GB
Uncensored-Frank-Llama-3-8B.Q3_K_M.gguf Q3_K_M 3.74GB
Uncensored-Frank-Llama-3-8B.Q3_K_L.gguf Q3_K_L 4.03GB
Uncensored-Frank-Llama-3-8B.IQ4_XS.gguf IQ4_XS 4.18GB
Uncensored-Frank-Llama-3-8B.Q4_0.gguf Q4_0 4.34GB
Uncensored-Frank-Llama-3-8B.IQ4_NL.gguf IQ4_NL 4.38GB
Uncensored-Frank-Llama-3-8B.Q4_K_S.gguf Q4_K_S 4.37GB
Uncensored-Frank-Llama-3-8B.Q4_K.gguf Q4_K 4.58GB
Uncensored-Frank-Llama-3-8B.Q4_K_M.gguf Q4_K_M 4.58GB
Uncensored-Frank-Llama-3-8B.Q4_1.gguf Q4_1 4.78GB
Uncensored-Frank-Llama-3-8B.Q5_0.gguf Q5_0 5.21GB
Uncensored-Frank-Llama-3-8B.Q5_K_S.gguf Q5_K_S 5.21GB
Uncensored-Frank-Llama-3-8B.Q5_K.gguf Q5_K 5.34GB
Uncensored-Frank-Llama-3-8B.Q5_K_M.gguf Q5_K_M 5.34GB
Uncensored-Frank-Llama-3-8B.Q5_1.gguf Q5_1 5.65GB
Uncensored-Frank-Llama-3-8B.Q6_K.gguf Q6_K 6.14GB
Uncensored-Frank-Llama-3-8B.Q8_0.gguf Q8_0 7.95GB

Original model description:

language:


Uncensored-Frank-Llama-3-8B

The character of Frank Costello in "The Departed" is known for his cunning, boldness, and willingness to talk about anything, regardless of societal norms or restrictions.
Frank, An Uncensored model, draws inspiration from these qualities to offer a platform where users can discuss a wide array of topics without the fear of censorship or restrictions.
Frank aims to push boundaries and encourage candid conversations. With Frank you can have unfiltered discussions on a multitude of topics, from politics and controversial issues to personal experiences and sensitive subjects.
It is trained on around 150000 set of conversations. Each set having 10~15 conversations.
I will not release this data.

This is Fully Finetuned Model.

Warning

An uncensored model has no or little guardrails. You are responsible for anything you do with the model, just as you are responsible for anything you do with any dangerous objects.
Publishing anything this model generates is the same as publishing it yourself. I am not responsible for what you generate using this model.

Training:

Entire dataset was trained on 4 x A100 80GB. For 3 epoch, training took around 6 hours. Axolotl & DeepSpeed codebase was used for training purpose. This was trained on Llama-3-8B model by Meta.

GGUF & Exllama

GGUF: Link

Exllama V2: Link

Special Thanks to Bartowski for quantizing this model.

Example Prompt:

This model uses ChatML prompt format.

<|im_start|>system
You are Frank. A helpful, unbiased, and uncensored assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

You can modify above Prompt as per your requirement.
One example will be:

This is a conversation with your Uncensored AI assistant Frank. Frank can discuss with you at length about various topics such as ---, ---, ---, .
You can ask it anything you want and it will do its best to give you accurate and relevant information.

I want to say special Thanks to the Open Source community for helping & guiding me to better understand the AI/Model development.

Thank you for your love & support.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 62.24
AI2 Reasoning Challenge (25-Shot) 59.64
HellaSwag (10-Shot) 80.16
MMLU (5-Shot) 63.08
TruthfulQA (0-shot) 52.75
Winogrande (5-shot) 73.16
GSM8k (5-shot) 44.66

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2024-08-20uploaded readme04797d010.4 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration