base_model: amkkk/Qwen3.5-0.8B-finetuned-lora-uncensored
base_model_relation: finetune
pipeline_tag: image-text-to-text
library_name: transformers
tags:
- finetune
- lora
- lora-merged
- refusal-direction
- model-editing
- qwen3.5
- multimodal
- vision
- llama-cpp
- gguf-my-repo
license: apache-2.0
datasets: - Guilherme34/uncensor
lainlives/Qwen3.5-0.8B-uncensored
This model contains GGUF format model files for amkkk/Qwen3.5-0.8B-finetuned-lora-uncensored.
Available Quants
The following files were generated and uploaded to this repo:Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0, f16, bf16
Use with llama.cpp
CLI:
llama-cli --hf-repo lainlives/Qwen3.5-0.8B-uncensored --hf-file Qwen3.5-0.8B-finetuned-lora-uncensored-Q4_K_M.gguf -p "The meaning to life and the universe is"
Server:
llama-server --hf-repo lainlives/Qwen3.5-0.8B-uncensored --hf-file Qwen3.5-0.8B-finetuned-lora-uncensored-Q4_K_M.gguf -c 2048
Or ollama
CLI:
ollama run https://hf.co/lainlives/Qwen3.5-0.8B-uncensored:Q4_K_M