license: apache-2.0
pipeline_tag: text-generation
base_model: trohrbaugh/Qwen3.8-27B-heretic-ara
tags:

• llamafile
• gguf
• qwen3.8
  language:
• en

I am not the original creator of llamafile, all credit of llamafile goes to Jartine:

Chat & support: jartine's Discord server

jartine's LLM work is generously supported by a grant from mozilla

---

Trohrbaugh Heretic ARA GGUF - llamafile

Run LLMs locally with a single file

Download a file and run it. Llamafile combines llama.cpp with Cosmopolitan Libc in a single executable.

How to use

1. Download the llamafile.

2. Open a Linux terminal.

3. Grant execute permission.

chmod +x Qwen3.8-27B-heretic-ara.Q4_K_M.llamafile

4. Run a text prompt with thinking disabled.

prompt='<|im_start|>user
What is the capital of France? Answer with only the city name.<|im_end|>
<|im_start|>assistant
<think>

</think>

'
/bin/sh Qwen3.8-27B-heretic-ara.Q4_K_M.llamafile \
  --cli --no-display-prompt --no-conversation --log-file /dev/null \
  -ngl 999 -c 512 -n 64 --temp 0 -p "$prompt"

5. Press Control-C to stop generation.

Settings for Trohrbaugh Heretic ARA GGUF Llamafiles

• Model creator: trohrbaugh
• Original model: trohrbaugh/Qwen3.8-27B-heretic-ara
• Quantized GGUF files used: mradermacher/Qwen3.8-27B-heretic-ara-GGUF
  • Commit hash f69c978f262c983cb312395d18bbce340260e89f
  • Commit message: auto-patch README.md
• Llamafile version: 0.10.5, mozilla-ai/llamafile
  • Commit hash 486e6c5f9356eae50b851b07517bfae1f2420193
  • Commit message: docs(support): document the Vulkan GPU backend (#1029) (#1033)
• Quantizations: Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0.
• Validation: Linux text generation; details in validation/.
• Vision: text GGUF; upstream projector files remain separate.
• MTP: source tensors retained; validation uses standard decoding.
• .args contents:

-m
Qwen3.8-27B-heretic-ara.Q4_K_M.gguf
...

(Following is original model card for Trohrbaugh Heretic ARA GGUF)

Excerpt from the original GGUF source card: mradermacher/Qwen3.8-27B-heretic-ara-GGUF.

static quants of https://huggingface.co/trohrbaugh/Qwen3.8-27B-heretic-ara