license: apache-2.0
library_name: llama.cpp
pipeline_tag: text-generation
tags:
- gguf
- quantized
- cybersecurity
- uncensored
- q2_K
base_model: orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF
OrcaSAQ-2-Cyber-27B-Uncensored-GGUF_Q2_K
Credits & License
This is a re-quantized version of an existing GGUF model. (And size of it converted from 15.7 to 10.9GB)
So it can be used on CPU with 16GB of RAM (slow, Also can be run on Google Colab).
Lineage:
- Original Model: Qwen/Qwen3.8-27B (License: Apache 2.0)
- Intermediate GGUF (source for re-quantization): orcarouter/OrcaSAQ-2-Cyber-27B-Uncensored-GGUF (License: Apache 2.0) (Uncensored by: orcarouter, includes abliteration modifications)
My Contribution:
- Re-quantized the intermediate GGUF file into Q2_K formats to reduce RAM usage for inference.
- Alarm: Quantized version can hallucinate.
- Recommended context window: 1024 tokens (or higher if hardware permits).
License:
This derivative work is distributed under the Apache 2.0 license, inherited from the original model.
Please refer to the original model card for full terms and disclaimer.
Donation address (if you want to see more quantized uncensored models - or in future create of more uncensored model):
1Kk32KvJVjcyTMZ44eos4eZtme1quTqFAg (BTC)