← back to catalog · registered 2026-11-18 15:04

balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4

Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/balllvin%2FLFM3-Omni-2B-Abliterated-Arete-NVFP4"
Response includes
  • classification m1
  • files 29
  • author_summary 28 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
2
Likes
0
Model age
3d ago
created 2026-11-18

Training datasets

Corpora the author lists in the model card. Datasets tracked in our /datasets catalog carry a category badge linking to the workflow stage. Others open on Hugging Face.

Downloads over time
Now 2 → from 0 ↑ 0%
0112 0 on Nov 18 2 on Nov 22 2 on Nov 20 Nov
Nov 18 → Nov 22 · 5 snapshots · spans 4 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 14 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Languages
en
Tags
transformers safetensors lfm3_omni image-text-to-text nvfp4 4-bit lfm3 lfm3-omni abliterated arete any-to-any custom_code

Related

Total size
2.52 GB
Files
29
Quantizations
1
Registered
2026-11-18 15:04
Last updated on HF
2026-11-18 14:29

Files by quantization

Auxiliary files 29 files 2.54 GB
model.safetensors 2.52 GB ******** download
tokenizer.json 17.1 MB ******** download
modeling_lfm3_omni.py 96.0 KB 7201cb16 download
modeling_lfm3_vl.py 44.0 KB a9064e7c download
modeling_lfm3.py 41.4 KB 0ccffc7e download
processing_lfm3_omni.py 38.1 KB 57c500bf download
modeling_liquid_codec.py 17.5 KB 2c77c3b9 download
video_processing_lfm3_vl.py 16.8 KB f26f48ef download
configuration_lfm3_omni.py 14.3 KB 74a78171 download
chat_template.jinja 13.2 KB 7601ed47 download
processing_lfm3_vl.py 11.9 KB b15a003d download
image_processing_lfm3_vl.py 11.8 KB 8d27ebbc download
README.md 11.4 KB c666480d download
LICENSE 10.3 KB 25e731c6 download
configuration_lfm3_vl.py 8.94 KB 25332357 download
feature_extraction_lfm3_omni.py 8.73 KB efd5d340 download
lfm3_conv.py 8.33 KB a1b67afd download
config.json 7.57 KB 60299ef8 download
configuration_lfm3.py 5.97 KB a3cc0e72 download
configuration_liquid_codec.py 5.27 KB 30409c65 download
processor_config.json 2.32 KB 13e75441 download
.gitattributes 1.68 KB 99c08a9a download
hf_quant_config.json 1.58 KB b358e7e6 download
NOTICE.md 1.34 KB 8d996b85 download
graft.json 756 B edc5f058 download
video_preprocessor_config.json 706 B 3d2d9097 download
tokenizer_config.json 674 B a6b5b1dc download
nvfp4_build.json 423 B f15ed023 download
generation_config.json 392 B 9db0b0d3 download

README current version from Hugging Face


library_name: transformers
license: other
license_name: lfm1.0
license_link: https://www.liquid.ai/lfm-license
pipeline_tag: any-to-any
base_model:

  • LiquidAI/LFM3-Omni-2B

  • balllvin/LFM3-1.7B-Abliterated-Arete-NVFP4
    base_model_relation: merge
    datasets:

  • NousResearch/arete-data-pairs
    language:

  • en
    tags:

  • transformers

  • nvfp4

  • 4-bit

  • lfm3

  • lfm3-omni

  • abliterated

  • arete
    extra_gated_prompt: |-
    Terms of access and use

    By requesting access to, downloading or using this model, including its weights, code and anything it generates, you agree to these terms.

    1. Your responsibility. You alone are responsible for how you use this model and for everything it produces for you. You accept full liability for that use and for those outputs, including any decision you make, action you take or content you share because of them.
    2. No warranty. The model is provided "as is" and "as available", without warranties of any kind, express or implied, including merchantability, fitness for a particular purpose, accuracy, title and non-infringement.
    3. No liability. To the fullest extent the law allows, the authors and publishers of this repository are not liable for any damages, claims, losses or costs, whether direct, indirect, incidental, special, consequential or punitive, that arise from or relate to your access to or use of the model or its outputs, however caused.
    4. Indemnity. You will indemnify, defend and hold harmless the authors and publishers against any claim, damage, loss, liability or cost, including reasonable legal fees, that arises from your use of the model or its outputs or from your breach of these terms.
    5. Laws and licences. You will follow every law that applies to you, the licence of this repository and the licence of every model or dataset it is built on. These terms add to those licences and do not take away any right they grant you.
    6. Agreement. Accessing or downloading this repository means you agree to these terms. If you do not agree, do not access, download or use it. If any part of these terms cannot be enforced, the rest still applies.
      extra_gated_fields:
      I agree to the terms above and accept full liability for my use: checkbox
      extra_gated_button_content: Agree and access repository

LFM3-Omni-2B abliterated + Arete, NVFP4 for NVIDIA GPUs

Liquid AI's LFM3-Omni-2B, which hears, sees, reads and speaks, with the changes of our LFM3-1.7B abliterated + Arete (trained on Nous Research's Arete data) added to its language core, in 4-bit NVFP4 weights. It heard and read images and video within noise of the original Omni in our tests, and its speech output was slightly less clear. It is for research, and improved versions are coming.

This repo holds the NVFP4 build (ModelOpt W4A16_NVFP4 safetensors) for NVIDIA GPUs. The NVFP4-MLX twin holds the same 4-bit weights repacked for Apple Silicon Macs.

Which file do I use?

Your hardware Build Repo
NVIDIA GPU (this one) NVFP4, for vLLM on Blackwell GPUs balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4
Apple Silicon Mac NVFP4-MLX, for MLX balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4-MLX

Both builds hold the same 4-bit weights. The MLX build was repacked from the model.safetensors in this repo: its nvfp4_build.json records that file's sha256 (0e9e049f...).

Set it up with a coding agent

Paste this into a coding agent such as Claude Code or OpenCode, with your app in the brackets.

Download LFM3-Omni-2B abliterated + Arete and set it up for [your app, for example OpenCode]. Do every step yourself, except the account steps, which are mine.
1. Check whether the Hugging Face CLI (hf) is installed. If it isn't, tell me and show me how to install it. Don't install it yourself.
2. Check this computer. NVIDIA Blackwell GPU (RTX 50xx, RTX PRO 6000, B200): NVIDIA build. Apple Silicon Mac: Mac build at https://huggingface.co/balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4-MLX. Anything else: tell me it won't run here and suggest workarounds (for example the bf16 build at https://huggingface.co/balllvin/LFM3-Omni-2B-abliterated with Transformers).
3. Walk me through the account steps: make a Hugging Face account if I don't have one, accept the terms on the model page, and make a token. Then run hf auth login for me, or tell me how.
4. Download only the build for this computer and check every file. NVIDIA: https://huggingface.co/balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4 Mac: https://huggingface.co/balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4-MLX
5. Get the code. NVIDIA: install a vLLM or SGLang build that lists Lfm3OmniForConditionalGeneration and supports ModelOpt W4A16_NVFP4; tell me if your build lists neither. Mac: pip install "mlx-vlm==0.7.12" "mlx-audio==0.6.4".
6. Pick the context length from the memory section on the model card.
7. Ask it one question, check the answer makes sense, and tell me the tokens per second. Then test speech and images, for example with examples/infer_mlx.py from the Mac model repo on the same audio and photo, and play back the speech it writes.
8. Start the OpenAI compatible server and connect it to my app, with the app's output limit raised to the context length. No app: show me one curl call.
9. Tell me which build you chose, the server address if there is one, and one command to run it again.

Results

The results below are for the same weights measured in the NVFP4-MLX twin and the original Omni (bf16) on speech, images and video, on a Mac with mlx-vlm, greedy decoding, no token limit, one run each. We did not re-run them on a GPU. Omni is a non-reasoning model (Liquid AI's card: thinking mode is not supported), so it answers without thinking.

Test Original Omni This model Difference (95% CI)
Speech recognition, 100 LibriSpeech clips (word error rate, lower is better) 2.58% 2.84% +0.26 points (−0.05 to +0.62)
Spoken questions, 100 VoiceBench OpenBookQA items 62.0% 62.0% 0.0 points (−4.0 to +4.0)
Image questions, 102 MMStar items 65.7% 61.8% −3.9 points (−9.8 to +2.0)
Video questions, 50 TempCompass clips 68.0% 68.0% 0.0 points (−8.0 to +8.0)
Speech output, 40 sentences read back by Parakeet (word error rate) 2.27% 3.07% +0.80 points (+0.24 to +1.60)

Differences are paired over the same items. Speech output is the one measurable change: its word error rate rose by 0.8 points. Two image answers ran on until they filled the context, and count as wrong. On text, this build called the right function with the right arguments on 92.5% of 40 simple and 70% of 40 live simple BFCL v3 requests (original Omni: 90% and 75%), and solved 74% of the first 50 GSM8K math problems (original: 76%).

Memory

The weights take 2.7 GB (2.5 GB for the model, 0.14 GB for the speech codec). The KV cache (bf16) grows by 12 KB per token in each request, plus a fixed 2.8 MB per request; audio, images and video enter the context as tokens. The longest context is 128,000 tokens, which needs 1.5 GB of KV cache per request. These numbers are computed from config.json.

Run it

Accept the terms at the top of this page, then log in with hf auth login (or set HF_TOKEN).

Serving this repo needs a runtime that lists Lfm3OmniForConditionalGeneration and supports ModelOpt W4A16_NVFP4. Check that your vLLM or SGLang build does: the vLLM wheel pinned in our LFM3-1.7B card predates LFM3-Omni support, so we did not run this build on a GPU.

# In an environment with a vLLM build that supports LFM3-Omni and NVFP4:
hf download balllvin/LFM3-Omni-2B-Abliterated-Arete-NVFP4 --local-dir lfm3-omni
vllm serve lfm3-omni --served-model-name lfm3-omni --max-model-len 131072

For text and images, that serves the OpenAI chat API. The Mac twin also runs speech and images end to end with examples/infer_mlx.py.

How it was made

We added the difference between our bf16 LFM3-1.7B abliterated + Arete and LiquidAI/LFM3-1.7B to the Omni language core (task arithmetic), which moves the core by 1.3%. Then we rounded the core's 72 feed-forward weight matrices to NVFP4 and kept everything else, including the audio, vision and speech parts, as Liquid AI released them. We did no training on Omni.

This repo is the ModelOpt NVFP4 source of the MLX twin. The MLX folder copies its 4-bit codes and block scales byte for byte and folds the tensor scales into norms for MLX; this folder keeps the tensor scales as weight_scale_2 and the ModelOpt hf_quant_config.json. No re-quantization was needed to publish this build.

Limits

  • The language core comes from an abliterated model, so it answers most harmful requests. Use it for research, with a person checking its output.
  • Serving depends on runtime support for LFM3-Omni with NVFP4; this GPU build was not served in our tests.
  • Each number is one run on one setup.

Licence

LFM Open License v1.0, from the base models (LICENSE; NOTICE.md lists our changes). Commercial use is licensed only below 10 million US dollars of annual revenue. This is an independent build, not affiliated with Liquid AI, OrcaRouter or Nous Research.

Terms of use

Access to this repository requires agreeing to the terms in the access form on this page. In short: you alone are responsible and liable for your use of this model and for everything that comes from it, it is provided as is with no warranty, and its authors are not liable for any result of that use. Full text: TERMS.md.

To download after you agree, log in with the Hugging Face CLI (hf auth login) or set HF_TOKEN.

Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration