Get the app
← back to catalog · registered 2026-08-22 13:56

huggingkot/LLAMA-3_8B_Unaligned_BETA-bnb-4bit

huggingkot Llama
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/huggingkot%2FLLAMA-3_8B_Unaligned_BETA-bnb-4bit"
Response includes
  • classification unknown
  • files 10
  • benchmarks 5 entries
  • author_summary 8 models
  • readme_text full
Try next
GET/models?author=huggingkot
All 8 models by huggingkot
 GET/models?family=llama&method=unknown
Sibling llama models · same method
 GET/methods/unknown
What "unknown" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
?
Primary method

Unclassified

No clear signals of an abliteration technique in this model.
Confidence
UNKNOWN
Why this label 1 signal
No classification signals present. This may not be an abliterated model at all - it could be a repackaging, a merge with unrelated goals, or unrelated content that mentions the term.
  • no classification signals present (no abliterated, uncensored, or known producer/method markers)
How we label → About ? →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
12
↑ 627% in 90 days
Likes
0
Model age
19mo ago
created 2025-03-06
Downloads over time
Now109→from15↑627%
10468211815 on Mar 5, 2025109 on Oct 11109 on Oct 10Mar '25Jun '25Sep '25Dec '25MarJunSep
Mar 5, 2025 → Oct 11 · 123 snapshots · spans 585 days

Benchmarks

Benchmark Score Source
BBH average 0.43844856661045534 OpenLLM-v2
IFEval instruct 0.43764988009592326 OpenLLM-v2
IFEval-Prompt 0.3049907578558225 OpenLLM-v2
MATH lvl 5 0.07854984894259819 OpenLLM-v2
MMLU-Pro 0.3464926861702128 OpenLLM-v2

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA↓ 113 this lineage
huggingkot/LLAMA-3_8B_Unaligned_BETA-bnb-4bit↓ 12

Metadata

Tags
safetensors base_model:SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA base_model:finetune:SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA 8-bit region:us

Related

Other by huggingkot
Llama-3-8B-Instruct-abliterated-v2-bnb-4bit 327 Llama-3-8B-Instruct-abliterated-v2-Q4_K_M-GGUF 253 NeuralDaredevil-8B-abliterated-q4f16_1-MLC 96 dolphin-2.9.2-Phi-3-Medium-abliterated-Q4_K_M-GGUF 58 Llama-3-8B-Instruct-abliterated-v2-q4f16_1-MLC 23
Same base model
bartowski/LLAMA-3_8B_Unaligned_BETA-GGUF 2K mradermacher/LLAMA-3_8B_Unaligned_BETA-i1-GGUF 875 mradermacher/LLAMA-3_8B_Unaligned_BETA-GGUF 389 FunnyPunch/LLAMA-3_8B_Unaligned_BETA_Long_Context 161 jaspionjader/LLAMA-3_8B_Unaligned_BETA-Q5_K_M-GGUF 32
Total size
5.31 GB
Files
10
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-03-06 03:46
Source huggingface.co/huggingkot/LLAMA-3_8B_Unaligned_BETA-bnb-4bit ↗ Base model SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA →

Files by quantization

Auxiliary files 10 files 5.33 GB
model-00001-of-00002.safetensors 4.33 GB 57aa382d download
model-00002-of-00002.safetensors 1002 MB 4cff908a download
tokenizer.json 16.4 MB ee143114 download
model.safetensors.index.json 129 KB d4786d0c download
tokenizer_config.json 50.1 KB 3c42410c download
.gitattributes 1.53 KB c4cb545c download
config.json 1.18 KB fb826f80 download
README.md 891 B 56ab94e9 download
special_tokens_map.json 444 B 2df2c462 download
generation_config.json 192 B b365b7f4 download

README current version from Hugging Face

base_model:

  • SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA

This is a converted weight from LLAMA-3_8B_Unaligned_BETA model in unsloth 4-bit dynamic quant using this collab notebook.

About this Conversion

This conversion uses Unsloth to load the model in 4-bit format and force-save it in the same 4-bit format.

How 4-bit Quantization Works

  • The actual 4-bit quantization is handled by BitsAndBytes (bnb), which works under Torch via AutoGPTQ or BitsAndBytes.
  • Unsloth acts as a wrapper, simplifying and optimizing the process for better efficiency.

This allows for reduced memory usage and faster inference while keeping the model compact.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-03-06add files9ae71e7891 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration