library_name: mlx
license: other
license_name: lfm1.0
license_link: LICENSE
base_model:
- huihui-ai/Huihui-LFM2-8B-A1B-abliterated
pipeline_tag: text-generation
tags: - mlx
- liquid
- lfm2
- moe
- abliterated
- uncensored
LFM2 8B-A1B abliterated, MLX 4-bit
An MLX 4-bit conversion of huihui-ai/Huihui-LFM2-8B-A1B-abliterated (commit 4f832b42af), for Apple Silicon.
This is an abliterated ("uncensored") version of Liquid AI's LFM2 8B-A1B: it has been modified to refuse less. It is a mixture-of-experts model with 8.3B parameters in total and about 1.5B active per token.
What was changed
Converted and quantized with mlx-lm 0.32.0:
mlx_lm.convert --hf-path huihui-ai/Huihui-LFM2-8B-A1B-abliterated -q --q-bits 4
4-bit weights (4.5 bits per weight overall, group size 64), with the expert routing gates kept at 8 bits. No other changes. The file is 4.69 GB.
model.safetensors SHA-256: 6d751b1f18fe365881d46df1f7f715f10fb2fbab0ffd065cc3df374c4cdf9457
Use
mlx_lm.generate --model Anotos/LFM2-8B-A1B-Abliterated-MLX-4bit --prompt "..."
In MLX Swift use mlx-swift-lm 3.31.4 or later; earlier versions route this model's experts incorrectly.
Credits and license
- Model: LiquidAI/LFM2-8B-A1B by Liquid AI.
- Abliteration: huihui-ai.
- MLX conversion: Axly's Customs, for the Erato app.
LFM Open License v1.0; see LICENSE. Commercial use is limited to organisations under the revenue threshold in the license.