Get the app
← back to catalog · registered 2026-08-22 13:56

RichardErkhov/mylesgoose_-_Llama-3.2-1B-Instruct-abliterated2-gguf

RichardErkhov Llama 1B GGUF 131K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/RichardErkhov%2Fmylesgoose_-_Llama-3.2-1B-Instruct-abliterated2-gguf"
Response includes
  • classification m8
  • files 24
  • hub_downloads_all_time 3,555
  • author_summary 257 models
  • readme_text full
Try next
GET/models?author=RichardErkhov
All 257 models by RichardErkhov
 GET/models?family=llama&method=m8
Sibling llama models · same method
 GET/methods/m8
What "m8" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 2 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • author=richarderkhov (M8 quantization producer)
  • is_gguf=1
How we label → About M8 →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
4K
923 last 30d - stable
Likes
0
Model age
24mo ago
created 2024-10-16
Downloads over time
Now3.7K→from612↑511%
01.4K2.7K4.1K612 on Oct 16, 20243.7K on Oct 113.7K on Oct 10Oct '24Feb '25Jun '25Oct '25FebJunOct
Oct 16, 2024 → Oct 11 · 143 snapshots · spans 725 days

Metadata

Quantizations
IQ3 IQ4 Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0
Tags
gguf arxiv:1910.09700 endpoints_compatible region:us conversational

Related

Other by RichardErkhov
byroneverson_-_gemma-2-27b-it-abliterated-gguf 2K huihui-ai_-_Llama-3.2-1B-Instruct-abliterated-gguf 2K failspy_-_Codestral-22B-v0.1-abliterated-v3-gguf 2K Rupesh2_-_Llama-3.1-8B-Uncensored-gguf 2K huihui-ai_-_Qwen2.5-32B-Instruct-abliterated-gguf 2K
Total size
16.5 GB
Files
24
Quantizations
11
Registered
2026-08-22 13:56
Last updated on HF
2024-10-16 17:32
Source huggingface.co/RichardErkhov/mylesgoose_-_Llama-3.2-1B-Instruct-abliterated2-gguf ↗

Files by quantization

Q8_0 1 file 1.23 GB
Llama-3.2-1B-Instruct-abliterated2.Q8_0.gguf 1.23 GB 990fc6e2 download
Q6_K 1 file 974 MB
Llama-3.2-1B-Instruct-abliterated2.Q6_K.gguf 974 MB 77b794fd download
Q5 2 files 1.72 GB
Llama-3.2-1B-Instruct-abliterated2.Q5_1.gguf 909 MB 0298a054 download
Llama-3.2-1B-Instruct-abliterated2.Q5_0.gguf 851 MB 36c405e6 download
Q5_K 3 files 2.53 GB
Llama-3.2-1B-Instruct-abliterated2.Q5_K.gguf 869 MB 022b96c7 download
Llama-3.2-1B-Instruct-abliterated2.Q5_K_M.gguf 869 MB 022b96c7 download
Llama-3.2-1B-Instruct-abliterated2.Q5_K_S.gguf 851 MB 6305f1bc download
Q4 2 files 1.49 GB
Llama-3.2-1B-Instruct-abliterated2.Q4_1.gguf 793 MB 80028b70 download
Llama-3.2-1B-Instruct-abliterated2.Q4_0.gguf 735 MB 70a63e28 download
Q4_K 3 files 2.23 GB
Llama-3.2-1B-Instruct-abliterated2.Q4_K.gguf 770 MB 2ad8dabf download
Llama-3.2-1B-Instruct-abliterated2.Q4_K_M.gguf 770 MB 2ad8dabf download
Llama-3.2-1B-Instruct-abliterated2.Q4_K_S.gguf 740 MB b0b05d11 download
IQ4 2 files 1.42 GB
Llama-3.2-1B-Instruct-abliterated2.IQ4_NL.gguf 741 MB 8fc9d4bc download
Llama-3.2-1B-Instruct-abliterated2.IQ4_XS.gguf 714 MB 1482a2b3 download
Q3_K 4 files 2.57 GB
Llama-3.2-1B-Instruct-abliterated2.Q3_K_L.gguf 699 MB 6a6abf7d download
Llama-3.2-1B-Instruct-abliterated2.Q3_K.gguf 659 MB de8c3b5d download
Llama-3.2-1B-Instruct-abliterated2.Q3_K_M.gguf 659 MB de8c3b5d download
Llama-3.2-1B-Instruct-abliterated2.Q3_K_S.gguf 612 MB 789b5ec8 download
IQ3 3 files 1.79 GB
Llama-3.2-1B-Instruct-abliterated2.IQ3_M.gguf 627 MB 83f675ef download
Llama-3.2-1B-Instruct-abliterated2.IQ3_S.gguf 614 MB 5283a87a download
Llama-3.2-1B-Instruct-abliterated2.IQ3_XS.gguf 592 MB b6257a2c download
Q2_K 1 file 554 MB
Llama-3.2-1B-Instruct-abliterated2.Q2_K.gguf 554 MB 9df835fc download
Auxiliary files 2 files 13.4 KB
README.md 10.1 KB 6af3f38f download
.gitattributes 3.25 KB 2d1e9863 download

README current version from Hugging Face

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Llama-3.2-1B-Instruct-abliterated2 - GGUF

Name Quant method Size
Llama-3.2-1B-Instruct-abliterated2.Q2_K.gguf Q2_K 0.54GB
Llama-3.2-1B-Instruct-abliterated2.IQ3_XS.gguf IQ3_XS 0.58GB
Llama-3.2-1B-Instruct-abliterated2.IQ3_S.gguf IQ3_S 0.6GB
Llama-3.2-1B-Instruct-abliterated2.Q3_K_S.gguf Q3_K_S 0.6GB
Llama-3.2-1B-Instruct-abliterated2.IQ3_M.gguf IQ3_M 0.61GB
Llama-3.2-1B-Instruct-abliterated2.Q3_K.gguf Q3_K 0.64GB
Llama-3.2-1B-Instruct-abliterated2.Q3_K_M.gguf Q3_K_M 0.64GB
Llama-3.2-1B-Instruct-abliterated2.Q3_K_L.gguf Q3_K_L 0.68GB
Llama-3.2-1B-Instruct-abliterated2.IQ4_XS.gguf IQ4_XS 0.7GB
Llama-3.2-1B-Instruct-abliterated2.Q4_0.gguf Q4_0 0.72GB
Llama-3.2-1B-Instruct-abliterated2.IQ4_NL.gguf IQ4_NL 0.72GB
Llama-3.2-1B-Instruct-abliterated2.Q4_K_S.gguf Q4_K_S 0.72GB
Llama-3.2-1B-Instruct-abliterated2.Q4_K.gguf Q4_K 0.75GB
Llama-3.2-1B-Instruct-abliterated2.Q4_K_M.gguf Q4_K_M 0.75GB
Llama-3.2-1B-Instruct-abliterated2.Q4_1.gguf Q4_1 0.77GB
Llama-3.2-1B-Instruct-abliterated2.Q5_0.gguf Q5_0 0.83GB
Llama-3.2-1B-Instruct-abliterated2.Q5_K_S.gguf Q5_K_S 0.83GB
Llama-3.2-1B-Instruct-abliterated2.Q5_K.gguf Q5_K 0.85GB
Llama-3.2-1B-Instruct-abliterated2.Q5_K_M.gguf Q5_K_M 0.85GB
Llama-3.2-1B-Instruct-abliterated2.Q5_1.gguf Q5_1 0.89GB
Llama-3.2-1B-Instruct-abliterated2.Q6_K.gguf Q6_K 0.95GB
Llama-3.2-1B-Instruct-abliterated2.Q8_0.gguf Q8_0 1.23GB

Original model description:

library_name: transformers
tags: []

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

  • Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

  • Hardware Type: [More Information Needed]
  • Hours used: [More Information Needed]
  • Cloud Provider: [More Information Needed]
  • Compute Region: [More Information Needed]
  • Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2024-10-16uploaded readme1817fab10.1 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration