license: apache-2.0
base_model: DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf
tags:
- gguf
- ollama
- openai
- gpt-oss
- uncensored
- 3bit
OpenAI-GPT-oss-20B-HERETIC-NEO-Q3_K_M-GGUF
3-bit GGUF quantization of DavidAU/OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf.
Included Files
OpenAI-20B-NEOPlus-Uncensored-Q3_K_M.gguf(3-bit medium quantization, 12.3 GB)Modelfile(Ready-to-use Ollama Modelfile)
How to Run with Ollama
- Download both the
.ggufandModelfileto the same folder. - Run:
ollama create gpt-oss-20b-neo -f Modelfile
ollama run gpt-oss-20b-neo
How to Run with llama.cpp
llama-cli -m OpenAI-20B-NEOPlus-Uncensored-Q3_K_M.gguf -p "Hello, can you help me write a Python script?" -c 8192
EOF
ls -lh /teamspace/studios/this_studio/models/export_gpt_oss_20b/