language:
- en
license: other
tags: - mnn
- on-device
- android
- ios
- quantization
- int4
- text-generation
- qwen-2.5
pipeline_tag: text-generation
library_name: mnn
base_model: WhoIsShe/Qwen2.5-Coder-3B-Instruct-abliterated-MNN
huihui-ai/Qwen2.5-Coder-3B-Instruct-abliterated (MNN Quantized)
Original model :
This is a 4-bit quantized version of the huihui-ai/Qwen2.5-Coder-3B-Instruct-abliterated, optimized for on-device inference (Android/iOS) using the Alibaba MNN framework.
🚀 Fast Deployment on Android
1. Download the App
Don't build from scratch! Use the official MNN Chat Android app:
2. Setup
- Download the files from this repo (
llm.mnn,llm.mnn.weight,config.json). - Create a folder on your phone:
/sdcard/MNN/Qwen2.5-Coder-3B-Instruct-abliterated. - Copy the files into that folder.
- Open the MNN App and select your folder.
💻 Technical Details
- Framework: MNN
- Quantization: 4-bit Asymmetric (Int4)
- Model Type: QWEN-2.5-CODER (Uncensored)