license: other
license_name: lfm1.0
license_link: LICENSE
base_model: pottokao/LFM2.5-24B-A2B-Uncensored
pipeline_tag: text-generation
tags:
- liquid
- lfm2.5
- moe
- uncensored
- heretic
- ara
- nvfp4
- modelopt
LFM2.5-24B-A2B-Uncensored-NVFP4
NVFP4 (W4A16) quantization of pottokao/LFM2.5-24B-A2B-Uncensored
(LiquidAI LFM2.5-24B-A2B decensored with Heretic ARA; refusals 89/100 → 0/100, KL 0.260 on the BF16 weights).
- 14.95 GB (BF16: 48 GB).
- Only the routed MoE experts are NVFP4 (W4A16, group size 16, RTN, no calibration data,
NVIDIA ModelOpt 0.45). Everything else stays BF16: attention, short-conv blocks, the two dense
layers, router gates, embeddings and lm_head — including the one edited tensor
(model.layers.38.self_attn.out_proj.weight, bit-identical to the BF16 release). w1/w3of each expert share one per-tensor scale, because vLLM fuses them into one matrix.
Expert tensors use the nativew1/w2/w3names.
Serving
vllm serve pottokao/LFM2.5-24B-A2B-Uncensored-NVFP4
The format follows the same layout as other ModelOpt W4A16 LFM2.5 checkpoints that vLLM detects
as modelopt_mixed. Not yet load-tested by us on vLLM.
Liquid AI's recommended sampling: temperature 0.1, top_k 50, repetition_penalty 1.05.
⚠️ Notice
Refusal behavior has been substantially reduced. Intended for research, red-teaming and personal use;
you are responsible for your use and for complying with laws and the base model license.
License & credits
Derivative of LiquidAI/LFM2.5-24B-A2B under the
LFM Open License v1.0 (see LICENSE). Decensoring with Heretic
(p-e-w, AGPL-3.0) / ARA. Quantization with NVIDIA ModelOpt.