Get the app
← back to catalog · registered 2026-08-22 13:56

RichardErkhov/mylesgoose_-_Meta-Llama-3-8B-Instruct-abliterated-awq

RichardErkhov Llama 7.0B
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/RichardErkhov%2Fmylesgoose_-_Meta-Llama-3-8B-Instruct-abliterated-awq"
Response includes
  • classification m1
  • files 10
  • hub_downloads_all_time 60
  • author_summary 257 models
  • readme_text full
Try next
GET/models?author=RichardErkhov
All 257 models by RichardErkhov
 GET/models?family=llama&method=m1
Sibling llama models · same method
 GET/methods/m1
What "m1" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
How we label → About M1 →
Refusal direction extracted via
Extraction technique

Difference-of-means

FromArditi et al. (2024) ↗
Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
What is a refusal direction? → Read the paper ↗
Downloads · lifetime
60
7 last 30d - stable
Likes
0
Model age
18mo ago
created 2025-03-30
Downloads over time
Now64→from4↑1,500%
12447704 on Mar 26, 202564 on Oct 1164 on Oct 4Mar '25Jun '25Sep '25Dec '25MarJunSep
Mar 26, 2025 → Oct 11 · 120 snapshots · spans 564 days

Variants by this author 2 formats · 929 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

Tags
safetensors llama arxiv:1910.09700 4-bit awq region:us

Related

Other by RichardErkhov
byroneverson_-_gemma-2-27b-it-abliterated-gguf 2K huihui-ai_-_Llama-3.2-1B-Instruct-abliterated-gguf 2K failspy_-_Codestral-22B-v0.1-abliterated-v3-gguf 2K Rupesh2_-_Llama-3.1-8B-Uncensored-gguf 2K huihui-ai_-_Qwen2.5-32B-Instruct-abliterated-gguf 2K
Total size
5.33 GB
Files
10
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-03-30 08:24
Source huggingface.co/RichardErkhov/mylesgoose_-_Meta-Llama-3-8B-Instruct-abliterated-awq ↗

Files by quantization

Auxiliary files 10 files 5.35 GB
model-00001-of-00002.safetensors 4.36 GB 85299ae4 download
model-00002-of-00002.safetensors 1002 MB 5321ca97 download
tokenizer.json 16.4 MB 6b9e4e7f download
model.safetensors.index.json 59.1 KB 2eaf6e33 download
tokenizer_config.json 54.1 KB eb8ed7f5 download
README.md 5.65 KB f2b081c4 download
.gitattributes 1.53 KB 52373fe2 download
config.json 1.09 KB 76535df7 download
special_tokens_map.json 296 B 02ee80b6 download
generation_config.json 184 B 97a94f0f download

README current version from Hugging Face

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Meta-Llama-3-8B-Instruct-abliterated - AWQ

Original model description:

library_name: transformers
tags: []

Model Card for Model ID

removed layer 9 of metas model. following online abliteration tutorial. refer to metas usages policies.
https://huggingface.co/failspy/llama-3-70B-Instruct-abliterated/blob/main/ortho_cookbook.ipynb

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

  • Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

  • Hardware Type: [More Information Needed]
  • Hours used: [More Information Needed]
  • Cloud Provider: [More Information Needed]
  • Compute Region: [More Information Needed]
  • Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-03-30uploaded readmefd7564d5.7 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration