license: apache-2.0
pipeline_tag: text-generation
base_model: orcarouter/Qwen3.8-27B-Uncensored
tags:

• llamafile
• gguf
• qwen3.8
  language:
• en
• zh

I am not the original creator of llamafile, all credit of llamafile goes to Jartine:

Chat & support: jartine's Discord server

jartine's LLM work is generously supported by a grant from mozilla

---

OrcaRouter Uncensored GGUF - llamafile

Run LLMs locally with a single file

Download a file and run it. Llamafile combines llama.cpp with Cosmopolitan Libc in a single executable.

How to use

1. Download the llamafile.

2. Open a Linux terminal.

3. Grant execute permission.

chmod +x orcarouter_Qwen3.8-27B-Uncensored-Q4_K_M.llamafile

4. Run a text prompt with thinking disabled.

prompt='<|im_start|>user
Name France'"'"'s capital city. Reply with the city name alone.<|im_end|>
<|im_start|>assistant
<think>

</think>

'
/bin/sh orcarouter_Qwen3.8-27B-Uncensored-Q4_K_M.llamafile \
  --cli --no-display-prompt --no-conversation --log-file /dev/null \
  -ngl 999 -c 512 -n 64 --temp 0 -p "$prompt"

5. Press Control-C to stop generation.

Settings for OrcaRouter Uncensored GGUF Llamafiles

• Model creator: orcarouter
• Original model: orcarouter/Qwen3.8-27B-Uncensored
• Quantized GGUF files used: bartowski/orcarouter_Qwen3.8-27B-Uncensored-GGUF
  • Commit hash 87d37daf5e5eb72a926d8b413e08809a57f1a120
  • Commit message: Update metadata with huggingface_hub
• Llamafile version: 0.10.5, mozilla-ai/llamafile
  • Commit hash 486e6c5f9356eae50b851b07517bfae1f2420193
  • Commit message: docs(support): document the Vulkan GPU backend (#1029) (#1033)
• Quantizations: Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0.
• Validation: Linux text generation; details in validation/.
• Vision: text GGUF; upstream projector files remain separate.
• MTP: source tensors retained; validation uses standard decoding.
• .args contents:

-m
orcarouter_Qwen3.8-27B-Uncensored-Q4_K_M.gguf
...

(Following is original model card for OrcaRouter Uncensored GGUF)

Excerpt from the original GGUF source card: bartowski/orcarouter_Qwen3.8-27B-Uncensored-GGUF.

Llamacpp imatrix Quantizations of Qwen3.8-27B-Uncensored by orcarouter

Using llama.cpp release b10630 for quantization.

Original model: https://huggingface.co/orcarouter/Qwen3.8-27B-Uncensored

[…]

This model has MTP (Multi-Token Prediction) layers, and they are included in these quants

[…]

Note: the MTP layers are stored at Q4_0 in the imatrix quants (except for the Q8_0 quant), since imatrix calibration does not exercise them. Q4_0 is chosen for its speed which massively benefits MTP performance.

[…]

All quants made using imatrix option, with a calibration corpus rendered through this model's own chat template. The corpus pairs plain prose with tool-calling and reasoning conversations (corpus source data), encoded exactly as this model sees them at inference and processed with --parse-special, so chat-format special tokens contribute to the importance matrix. The corpus rendered for this model is included in this repo: orcarouter_Qwen3.8-27B-Uncensored-calibration-v6.txt. The imatrix is available here: orcarouter_Qwen3.8-27B-Uncensored-imatrix.gguf.