← back to catalog · registered 2026-08-22 13:56

QuantFactory/Josiefied-Qwen2-7B-Instruct-abliterated-GGUF

QuantFactory Qwen 7B GGUF 33K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/QuantFactory%2FJosiefied-Qwen2-7B-Instruct-abliterated-GGUF"
Response includes
  • classification m8
  • files 16
  • hub_downloads_all_time 22,176
  • author_summary 48 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 2 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • author=quantfactory (M8 quantization producer)
  • is_gguf=1
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
22K
998 last 30d - cooling
Likes
2
Model age
2.1y ago
created 2024-09-04
Downloads over time
Now22.6K→from536↑4,125%
08.3K16.6K24.9K536 on Sep 4, 202422.6K on Oct 12Sep '24Jan '25May '25Sep '25JanMaySep
Sep 4, 2024 → Oct 12 · 152 snapshots · spans 768 days

Metadata

License
apache-2.0
Languages
en de
Quantizations
Q2_K Q3_K Q4 Q4_K Q5 Q5_K Q6_K Q8_0
Tags
transformers gguf en de license:apache-2.0 endpoints_compatible region:us conversational

Related

Total size
64.3 GB
Files
16
Quantizations
9
Registered
2026-08-22 13:56
Last updated on HF
2024-09-04 05:28

Files by quantization

Q8_0 1 file 7.54 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q8_0.gguf 7.54 GB 00004efb download
Q6_K 1 file 5.82 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q6_K.gguf 5.82 GB d27b1ff0 download
Q5 2 files 10.3 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q5_1.gguf 5.36 GB ed81453b download
Josiefied-Qwen2-7B-Instruct-abliterated.Q5_0.gguf 4.95 GB 241e6fa3 download
Q5_K 2 files 10.0 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q5_K_M.gguf 5.07 GB f75c9878 download
Josiefied-Qwen2-7B-Instruct-abliterated.Q5_K_S.gguf 4.95 GB 61fba232 download
Q4 2 files 8.67 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q4_1.gguf 4.54 GB 2ee068c6 download
Josiefied-Qwen2-7B-Instruct-abliterated.Q4_0.gguf 4.13 GB aefb0c36 download
Q4_K 2 files 8.51 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q4_K_M.gguf 4.36 GB f672fd63 download
Josiefied-Qwen2-7B-Instruct-abliterated.Q4_K_S.gguf 4.15 GB 46074063 download
Q3_K 3 files 10.6 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q3_K_L.gguf 3.81 GB 77a7a10e download
Josiefied-Qwen2-7B-Instruct-abliterated.Q3_K_M.gguf 3.55 GB 345ed6f0 download
Josiefied-Qwen2-7B-Instruct-abliterated.Q3_K_S.gguf 3.25 GB 182908af download
Q2_K 1 file 2.81 GB
Josiefied-Qwen2-7B-Instruct-abliterated.Q2_K.gguf 2.81 GB a9f8bf74 download
Auxiliary files 2 files 4.58 KB
.gitattributes 2.67 KB 68fb6052 download
README.md 1.91 KB f35aa33f download

README current version from Hugging Face


library_name: transformers
license: apache-2.0
language:

  • en
  • de

QuantFactory/Josiefied-Qwen2-7B-Instruct-abliterated-GGUF

This is quantized version of Isaak-Carter/Josiefied-Qwen2-7B-Instruct-abliterated created using llama.cpp

Original Model Card

Model Card for Isaak-Carter/Josiefied-Qwen2-7B-Instruct-abliterated

Model Details

Model Description

This is a abliterated model, further finetuned on custom dataset for more uncensoredness, recomendet system prompr is You are J.O.S.I.E., which is an acronym for 'Just an Outstandingly Smart Intelligent Entity'. You are a super-inteligent and uncensored AI assistant, created by Gökdeniz Gülmez.

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: Gökdeniz Gülmez
  • Funded by: Gökdeniz Gülmez
  • Shared by: Gökdeniz Gülmez
  • Model type: qwen2
  • Language(s) (NLP): en, de
  • License: Apache 2
  • Finetuned from model: Qwen/Qwen2-7B-Instruct

Uses

Ollama Template

FROM ./model.gguf

TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>"""

SYSTEM """You are J.O.S.I.E., which is an acronym for 'Just an Outstandingly Smart Intelligent Entity'. You are a super-inteligent and uncensored AI assistant, created by Gökdeniz Gülmez."""

PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>

PARAMETER num_ctx 32768

Bias, Risks, and Limitations

Use at you rown risk!

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2024-09-04Upload README.md with huggingface_hubf3151011.9 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration