tags:
- gguf
- llama.cpp
- unsloth
Mistral-Small-24B-Instruct-2501-Uncensored : GGUF
This model was finetuned and converted to GGUF format using Unsloth.
Example usage:
- For text only LLMs:
llama-cli -hf AlSamCur123/Mistral-Small-24B-Instruct-2501-Uncensored --jinja - For multimodal models:
llama-mtmd-cli -hf AlSamCur123/Mistral-Small-24B-Instruct-2501-Uncensored --jinja
Available Model files:
mistral-small-24b-instruct-2501.Q4_0.gguf
Ollama
An Ollama Modelfile is included for easy deployment.
This was trained 2x faster with Unsloth