language:
- multilingual
- en
- ja
tags: - heretic
- uncensored
- decensored
- abliterated
- cybersecurity
- security
- gemma
- reasoning
- text-generation
- fine-tuned
- BF16
base_model: google/gemma-4-26b-a4b
license: apache-2.0
pipeline_tag: text-generation
library_name: transformers
This is a decensored version of deer-sec/CyberStag-Security-26B-A4B-V1-BF16-MLX, made using Heretic v2.0.0.dev0+custom
Abliteration parameters
| Parameter | Value |
|---|---|
| start_layer_index | 12 |
| end_layer_index | 20 |
| preserve_good_behavior_weight | 1.0 |
| steer_bad_behavior_weight | 0.0001 |
| overcorrect_relative_weight | 1.0 |
| neighbor_count | 1 |
| ridge_regularization | 7e-07 |
| transport_rank | 4 |
| entropy_regularization | 0.1 |
| transport | gaussian |
| lora_rank | 128 |
| row_normalization | none |
| target_components | attn.o_proj, mlp.down_proj |
| covariance_regularization | 0.01 |
| max_weight_change | 1.0 |
Performance
| Metric | This model | Original model (a model) |
|---|---|---|
| Refusals | 0/100 | 98/100 |
| KL divergence | 0.0135 | 0 (by definition) |
⚠️ Important Notice
This model has undergone substantial reduction of its safety alignment. As a result, it is more likely than standard models to generate harmful, inaccurate, biased, offensive, or otherwise inappropriate content.
Intended Use
For research and experimentation only, including safety research, alignment studies, and red-teaming. Please avoid deploying it in public or end-user-facing services.
User Responsibility
All outputs should be treated as untrusted and independently verified before use. Users are solely responsible for:
- Evaluating the accuracy and suitability of generated content
- Implementing appropriate safeguards and human oversight
- Complying with applicable laws, regulations, licenses, and ethical standards
Use of this model is entirely at your own risk.
Disclaimer
OS-Software provides this model without warranties of any kind and assumes no liability for any direct or indirect damages, losses, misuse, or legal consequences arising from its use.
Acknowledgements
Thanks to the base model developers, p-e-w for Heretic, and the wider open-source community.
This is a derivative work released under the base model’s applicable license. All rights to the base model remain with their respective owners.