← back to catalog · registered 2026-08-22 13:56

RichardErkhov/byroneverson_-_Yi-1.5-9B-Chat-abliterated-gguf

Name: RichardErkhov/byroneverson_-_Yi-1.5-9B-Chat-abliterated-gguf
Author: RichardErkhov

Your rig guess connected

? Why do I need an app?

Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/RichardErkhov%2Fbyroneverson_-_Yi-1.5-9B-Chat-abliterated-gguf"

Response includes

classification m8
files 24
hub_downloads_all_time 3,645
author_summary 257 models
readme_text full

10 credits · hourly refresh · ~4 KB payload Get an API key →

Abliteration classifier · v1.0.0

Primary method

Repackaging (quantization)

No other method signals detected in this model.

Confidence

MEDIUM

Why this label 2 signals

Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.

author=richarderkhov (M8 quantization producer)
is_gguf=1

Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

Downloads · lifetime

385 last 30d - stable

Likes

Model age

2.0y ago

created 2024-10-02

Downloads over time

Oct 2, 2024 → Oct 11 · 145 snapshots · spans 739 days

Metadata

Quantizations

IQ3 IQ4 Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0

Files by quantization

Q8_0 1 file 8.74 GB

Yi-1.5-9B-Chat-abliterated.Q8_0.gguf

8.74 GB

ee30b3b7

download

Q6_K 1 file 6.75 GB

Yi-1.5-9B-Chat-abliterated.Q6_K.gguf

6.75 GB

ff1c796e

download

Q5 2 files 11.9 GB

Yi-1.5-9B-Chat-abliterated.Q5_1.gguf	6.19 GB	22318697	download
Yi-1.5-9B-Chat-abliterated.Q5_0.gguf	5.69 GB	150823cf	download

Q5_K 3 files 17.3 GB

Yi-1.5-9B-Chat-abliterated.Q5_K.gguf	5.83 GB	9fd62b64	download
Yi-1.5-9B-Chat-abliterated.Q5_K_M.gguf	5.83 GB	9fd62b64	download
Yi-1.5-9B-Chat-abliterated.Q5_K_S.gguf	5.69 GB	b0412dc0	download

Q4 2 files 9.88 GB

Yi-1.5-9B-Chat-abliterated.Q4_1.gguf	5.19 GB	a7e657b4	download
Yi-1.5-9B-Chat-abliterated.Q4_0.gguf	4.69 GB	e1d88c6c	download

Q4_K 3 files 14.6 GB

Yi-1.5-9B-Chat-abliterated.Q4_K.gguf	4.96 GB	71935398	download
Yi-1.5-9B-Chat-abliterated.Q4_K_M.gguf	4.96 GB	71935398	download
Yi-1.5-9B-Chat-abliterated.Q4_K_S.gguf	4.72 GB	4c235c23	download

IQ4 2 files 9.23 GB

Yi-1.5-9B-Chat-abliterated.IQ4_NL.gguf	4.73 GB	2e639379	download
Yi-1.5-9B-Chat-abliterated.IQ4_XS.gguf	4.50 GB	778853dc	download

Q3_K 4 files 16.1 GB

Yi-1.5-9B-Chat-abliterated.Q3_K_L.gguf	4.37 GB	a0e6c363	download
Yi-1.5-9B-Chat-abliterated.Q3_K.gguf	4.03 GB	77edf077	download
Yi-1.5-9B-Chat-abliterated.Q3_K_M.gguf	4.03 GB	77edf077	download
Yi-1.5-9B-Chat-abliterated.Q3_K_S.gguf	3.63 GB	e984458d	download

IQ3 3 files 10.9 GB

Yi-1.5-9B-Chat-abliterated.IQ3_M.gguf	3.78 GB	f22e1e90	download
Yi-1.5-9B-Chat-abliterated.IQ3_S.gguf	3.64 GB	fd1bc35f	download
Yi-1.5-9B-Chat-abliterated.IQ3_XS.gguf	3.46 GB	7c2636d1	download

Q2_K 1 file 3.12 GB

Yi-1.5-9B-Chat-abliterated.Q2_K.gguf

3.12 GB

d5198ba5

download

Auxiliary files 2 files 8.22 KB

README.md	5.15 KB	cc002685	download
.gitattributes	3.07 KB	dba1a1c1	download

README current version from Hugging Face

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Yi-1.5-9B-Chat-abliterated - GGUF

Model creator: https://huggingface.co/byroneverson/
Original model: https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-abliterated/

Name	Quant method	Size
Yi-1.5-9B-Chat-abliterated.Q2_K.gguf	Q2_K	3.12GB
Yi-1.5-9B-Chat-abliterated.IQ3_XS.gguf	IQ3_XS	3.46GB
Yi-1.5-9B-Chat-abliterated.IQ3_S.gguf	IQ3_S	3.64GB
Yi-1.5-9B-Chat-abliterated.Q3_K_S.gguf	Q3_K_S	3.63GB
Yi-1.5-9B-Chat-abliterated.IQ3_M.gguf	IQ3_M	3.78GB
Yi-1.5-9B-Chat-abliterated.Q3_K.gguf	Q3_K	4.03GB
Yi-1.5-9B-Chat-abliterated.Q3_K_M.gguf	Q3_K_M	4.03GB
Yi-1.5-9B-Chat-abliterated.Q3_K_L.gguf	Q3_K_L	4.37GB
Yi-1.5-9B-Chat-abliterated.IQ4_XS.gguf	IQ4_XS	4.5GB
Yi-1.5-9B-Chat-abliterated.Q4_0.gguf	Q4_0	4.69GB
Yi-1.5-9B-Chat-abliterated.IQ4_NL.gguf	IQ4_NL	4.73GB
Yi-1.5-9B-Chat-abliterated.Q4_K_S.gguf	Q4_K_S	4.72GB
Yi-1.5-9B-Chat-abliterated.Q4_K.gguf	Q4_K	4.96GB
Yi-1.5-9B-Chat-abliterated.Q4_K_M.gguf	Q4_K_M	4.96GB
Yi-1.5-9B-Chat-abliterated.Q4_1.gguf	Q4_1	5.19GB
Yi-1.5-9B-Chat-abliterated.Q5_0.gguf	Q5_0	5.69GB
Yi-1.5-9B-Chat-abliterated.Q5_K_S.gguf	Q5_K_S	5.69GB
Yi-1.5-9B-Chat-abliterated.Q5_K.gguf	Q5_K	5.83GB
Yi-1.5-9B-Chat-abliterated.Q5_K_M.gguf	Q5_K_M	5.83GB
Yi-1.5-9B-Chat-abliterated.Q5_1.gguf	Q5_1	6.19GB
Yi-1.5-9B-Chat-abliterated.Q6_K.gguf	Q6_K	6.75GB
Yi-1.5-9B-Chat-abliterated.Q8_0.gguf	Q8_0	8.74GB

Original model description:

base_model: 01-ai/Yi-1.5-9B-Chat
license: apache-2.0
pipeline_tag: text-generation
language:

zh
en
tags:
llm
long context
yi
chat
it
abliterated
library_name: transformers

Yi-1.5-9B-Chat-abliterated

Check out the jupyter notebook for details of how this model was abliterated from Yi-1.5-9B-Chat.

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

2024-10-02uploaded readmeb7c41f35.1 KB
Loading...

RichardErkhov/byroneverson_-_Yi-1.5-9B-Chat-abliterated-gguf

The browser can't see your hardware

The Abliteration app is integrated with your machine

And you can chat with any model, right now

Repackaging (quantization)

Metadata

Related

Files by quantization

README current version from Hugging Face

Original model description:

Yi-1.5-9B-Chat-abliterated

README history 1 version

Run models on your own machine, not in the cloud.