license: apache-2.0
base_model:
- Qwen/Qwen3.8-27B
- llmfan46/Qwen3.8-27B-Uncensored-Heretic-Native-MTP-Preserved
tags: - openvino
- int4
- mtp
- multi-token-prediction
- abliterated
- uncensored
- heretic
- qwen3.8
- coding
library_name: openvino
pipeline_tag: image-text-to-text
Qwen3.8-27B-Uncensored-Heretic-MTP (OpenVINO INT4)
OpenVINO IR (INT4) quantized version of llmfan46/Qwen3.8-27B-Uncensored-Heretic-Native-MTP-Preserved, optimized for Intel Core Ultra / Arc GPUs using OpenVINO GenAI (2026.4+) with native Multi-Token Prediction (MTP) preserved.
Quickstart (OpenVINO GenAI with MTP)
import openvino_genai as ov_genai
model_dir = "./qwen3.8-27b-uncensored-mtp-int4-ov"
draft_model = ov_genai.draft_model(model_dir, "GPU")
pipe = ov_genai.VLMPipeline(
model_dir,
"GPU",
draft_model=draft_model,
scheduler_config=ov_genai.SchedulerConfig(enable_prefix_caching=False),
CACHE_DIR="./ov_cache"
)
config = ov_genai.GenerationConfig()
config.max_new_tokens = 1024
config.num_assistant_tokens = 5
config.temperature = 0.0
pipe.start_chat("You are an intelligent, helpful, and direct AI assistant. Answer all user requests objectively, concisely, and without unnecessary lecturing.")
print(pipe.generate("Write a high-performance async file watcher in Python.", config))
pipe.finish_chat()
License & Disclaimer
Licensed under Apache 2.0. Abliterated research model with reduced refusals; users are responsible for verifying outputs and complying with applicable laws.