license: apache-2.0
license_link: https://huggingface.co/pipihand01/QwQ-32B-Preview-abliterated-linear25/blob/main/LICENSE
language:
- en
base_model: - Qwen/QwQ-32B-Preview
- huihui-ai/QwQ-32B-Preview-abliterated
tags: - chat
- abliterated
- uncensored
- mergekit
- merge
library_name: transformers
This is a 25% abliterated model obtained from linear-weighted merging Qwen/QwQ-32B-Preview (weight: 0.75) and huihui-ai/QwQ-32B-Preview-abliterated (weight: 0.25), using mergekit.
This is an experimental model, and from my preliminary experiments, this gives more natural result than Qwen's original model for sensitive contents while still maintaining refusal capability.
Base on some of my experiments, I found when it comes to "sensitive contents" generation, the more percentage of abliteration, the more peace but direct result it might get, and the less "conflict and disagreement".
To get best effect when it comes to "uncensoring", for low percentage of abliteration mixture like this one, it would be better to use it in RP or story writing without using official or other "AI assistant" prompts. E.g. You should use chat mode instead of instruct mode in Text generation web UI, and avoid prompting like AI assistant.
From my experiments, this model removes some artificial wording of the "censorship", when prompting for RP or story writing correctly.
I also offer other percentages of abliteration so you can try which one best suits your use case.
Or you may use this LoRA if you know how to apply LoRA and adjust its weight for the app you use.
NOTE: I bear no responsibility for any output of this model. When properly prompted, this model may generate contents that are not suitable in some situations. Use it with your own caution.
pipihand01/QwQ-32B-Preview-abliterated-linear25
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Qwen/QwQ-32B-Preview
parameters:
weight: 0.75
- model: huihui-ai/QwQ-32B-Preview-abliterated
parameters:
weight: 0.25
merge_method: linear
dtype: bfloat16