license: mit
Pywitz-8B-Instruct-Uncensored GGUF
Quantized builds for Pywitt-8B-Instruct-Uncensored.
| File | Size | Notes |
|---|---|---|
pywitz-f16.gguf |
15.2 GB | Full precision |
pywitz-q4_k_m.gguf |
4.4 GB | Recommended daily driver |
pywitz-q5_k_m.gguf |
5.1 GB | Higher quality |
pywitz-q8_0.gguf |
8.1 GB | Best quality |
Chat format: chatml (<|im_start|>).
Base model: ImposterOnline/Pywitz-8B-Instruct-Uncensored
# Ollama
ollama create pywitz-8b -f Modelfile
# llama.cpp
./llama-cli -m pywitz-q4_k_m.gguf -p "<|im_start|>user\nExplain async.\n<|im_end|>\n<|im_start|>assistant\n" -n 512 -c 8192
Pywitz is a private, independent project for high-performance, uncensored engineering assistance.