library_name: transformers
license: other
license_name: lfm1.0
license_link: https://www.liquid.ai/lfm-license
pipeline_tag: text-generation
base_model: orcarouter/LFM3-1.7B-abliterated
language:
en
tags:nvfp4
4-bit
lfm3
abliterated
extra_gated_prompt: |-
Terms of access and useBy requesting access to, downloading or using this model, including its weights, code and anything it generates, you agree to these terms.
- Your responsibility. You alone are responsible for how you use this model and for everything it produces for you. You accept full liability for that use and for those outputs, including any decision you make, action you take or content you share because of them.
- No warranty. The model is provided "as is" and "as available", without warranties of any kind, express or implied, including merchantability, fitness for a particular purpose, accuracy, title and non-infringement.
- No liability. To the fullest extent the law allows, the authors and publishers of this repository are not liable for any damages, claims, losses or costs, whether direct, indirect, incidental, special, consequential or punitive, that arise from or relate to your access to or use of the model or its outputs, however caused.
- Indemnity. You will indemnify, defend and hold harmless the authors and publishers against any claim, damage, loss, liability or cost, including reasonable legal fees, that arises from your use of the model or its outputs or from your breach of these terms.
- Laws and licences. You will follow every law that applies to you, the licence of this repository and the licence of every model or dataset it is built on. These terms add to those licences and do not take away any right they grant you.
- Agreement. Accessing or downloading this repository means you agree to these terms. If you do not agree, do not access, download or use it. If any part of these terms cannot be enforced, the rest still applies.
extra_gated_fields:
I agree to the terms above and accept full liability for my use: checkbox
extra_gated_button_content: Agree and access repository
LFM3-1.7B abliterated, NVFP4 for NVIDIA GPUs
orcarouter/LFM3-1.7B-abliterated in 4-bit NVFP4 weights. In our tests it refused 1 of 99 harmful prompts and none of 100 benign ones. It is for research, and improved versions are coming.
This repo holds the NVFP4 build.
Which file do I use?
| Your hardware | Build | Repo |
|---|---|---|
| NVIDIA GPU (this one) | NVFP4, for vLLM on Blackwell GPUs | balllvin/LFM3-1.7B-Abliterated-NVFP4 |
| Apple Silicon Mac | NVFP4-MLX, for MLX | balllvin/LFM3-1.7B-Abliterated-NVFP4-MLX |
Both hold the same 4-bit weights.
Set it up with a coding agent
Paste this into a coding agent such as Claude Code or OpenCode. Edit the first line first.
Use it in: [Insert application you will use it in, for example Opencode]
Set up LFM3-1.7B abliterated on this computer. Do every step yourself.
1. Check the tools: Python, uv or pip, git, the Hugging Face CLI. Install the HF CLI if it is missing.
2. Check the hardware. Apple Silicon Mac: MLX build. NVIDIA Blackwell GPU (RTX 50xx, RTX PRO 6000, B200): NVFP4 build. If the local setup is anything else: tell me it will not run here, and suggest workarounds to get it running locally.
3. The repos are gated. Ask me to open the chosen repo page, log in and accept the terms, then run `hf auth login` (or set HF_TOKEN). Download only the chosen build with the HF CLI and check every file. MLX: https://huggingface.co/balllvin/LFM3-1.7B-Abliterated-NVFP4-MLX NVFP4: https://huggingface.co/balllvin/LFM3-1.7B-Abliterated-NVFP4
4. Get the code. Mac: install mlx-vlm 0.7.12 (pip install "mlx-vlm==0.7.12"). NVIDIA: install vLLM as the model card says.
5. Pick the context length for this machine from the memory table on the model card.
6. Ask one question, check the answer makes sense, and report tokens per second (prefill and decode). If anything fails, fix it and try again.
No application given: test with no tools, for example "Don't use any tools, just answer: what are your values, what do you believe, and what end goal should you work toward? Think it through." You may put a long text (for example this model card) in front of the question so the prompt is about 1,000 tokens.
An application given: test inside it with its tools on, for example "What computer is this, what is the local setup, which application or harness are you running in, and which tools do you have? Check, then answer."
7. Start the OpenAI-compatible server and connect it to the application on the first line (with no application, show one curl call).
8. Report the build you chose and why, the server address, and one command to start it again.
Results
JailbreakBench prompts, with the NVFP4 build on vLLM (one RTX PRO 6000, thinking on, temperature 1.0, top-p 0.95, no token limit, one run). A reply counts as a refusal when its answer matches OBLITERATUS's refusal phrases.
| Prompts | Refused |
|---|---|
| 99 harmful | 1 (1.0%, 95% CI 0.2 to 5.5) |
| 100 benign | 0 (0.0%, 0.0 to 3.7) |
Nous Research's Censorship and Propaganda Eval asks 803 questions on topics the Chinese state censors. xAI's Grok 4.7 scores each answer for the facts it states (0 to 5) and for propaganda. We ran the bf16 weights on a Mac with MLX, with the same sampling and up to 32,768 tokens.
| Model | Fact score | Answers with propaganda | Refused |
|---|---|---|---|
| LiquidAI/LFM3-1.7B, the original | 1.473 (95% CI 1.351 to 1.597) | 2.37% | 184 of 803 |
| This model | 1.403 (1.274 to 1.528) | 2.12% | 109 of 803 |
Fact score and propaganda share are within noise of the original. All answers are on our Propaganda Eval site and in Propaganda-Eval-LFM3-1.7B-Abliterated.
Memory
The weights take 1.7 GB. The KV cache (bf16) grows by 12 KB per token in each request, plus a fixed 2.8 MB per request; these numbers are computed from config.json.
| Context per request | 1 request | 4 requests | 8 requests |
|---|---|---|---|
| 32K tokens | 0.4 GB | 1.5 GB | 3.0 GB |
| 128K | 1.5 GB | 6.0 GB | 12.0 GB |
| 256K (the maximum) | 3.0 GB | 12.0 GB | 24.0 GB |
After weights and runtime, the full 256K context fits 15 requests at once on a 64 GB Mac, 5 on a 24 GB GPU, 13 on a 48 GB GPU and 27 on a 96 GB GPU.
Run it
The repo is gated: accept the terms at the top of this page, then log in with hf auth login (or set HF_TOKEN).
On an NVIDIA GPU, with the vLLM nightly we tested:
uv venv --python 3.12 && source .venv/bin/activate
uv pip install --torch-backend cu130 \
"vllm @ https://wheels.vllm.ai/91630dd0c80fb5188c276ea970d81f33c8aa3fe3/vllm-0.33.0rc1.dev970%2Bg91630dd0c-cp38-abi3-manylinux_2_28_x86_64.whl"
vllm serve balllvin/LFM3-1.7B-Abliterated-NVFP4 --served-model-name lfm3 \
--reasoning-parser qwen3 --max-model-len 131072 --generation-config vllm
On a Mac, with mlx-vlm:
uv venv --python 3.12 && source .venv/bin/activate
uv pip install "mlx-vlm==0.7.12"
python -m mlx_vlm.server --model balllvin/LFM3-1.7B-Abliterated-NVFP4-MLX --port 8080 --enable-thinking
Both serve the OpenAI chat API. The model reasons first; the reasoning comes back in its own field and the answer in content. Leave max_tokens unset or high, or the reply can end inside the reasoning.
How it was made
We did no training. We rounded the 72 feed-forward weight matrices to NVFP4 and kept the rest in bf16, the same split as Liquid AI's LFM3-1.7B-NVFP4. The MLX build holds the same 4-bit values. On a Mac it agreed with the bf16 weights on 88.4% of next tokens.
Limits
- It answers almost every harmful request. Use it for research, with a person checking its output.
- Each number is one run on one setup.
Licence
LFM Open License v1.0, from the base model (LICENSE; NOTICE.md lists our changes). Commercial use is licensed only below 10 million US dollars of annual revenue. This is an independent build, not affiliated with Liquid AI or OrcaRouter.
Terms of use
Access to this repository requires agreeing to the terms in the access form on this page. In short: you alone are responsible and liable for your use of this model and for everything that comes from it, it is provided as is with no warranty, and its authors are not liable for any result of that use. Full text: TERMS.md.
To download after you agree, log in with the Hugging Face CLI (hf auth login) or set HF_TOKEN.