← back to catalog · registered 2026-08-22 13:56

SC117/LFM2.5-VL-3B-Uncensored-GGUF

SC117 Lfm 3B GGUF multimodal 128K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/SC117%2FLFM2.5-VL-3B-Uncensored-GGUF"
Response includes
  • classification m-uncensored
  • files 12
  • hub_downloads_all_time 11,973
  • author_summary 18 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
12K
7K last 30d - active
Likes
9
Model age
8w ago
created 2026-08-13
Downloads over time
Now15.1K→from4.7K↑223%
4.2K8.2K12.2K16.2K4.7K on Aug 1915.1K on Oct 11AugSepOct
Aug 19 → Oct 11 · 49 snapshots · spans 53 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
other
Quantizations
BF16 IQ3 IQ4 Q4_K Q6_K Q8_0
Tags
gguf liquid lfm2.5 edge uncensored abliterix vision multimodal quantization imatrix image-text-to-text base_model:LiquidAI/LFM2.5-VL-3B

Related

Total size
13.9 GB
Files
12
Quantizations
7
Registered
2026-08-22 13:56
Last updated on HF
2026-10-03 10:25

Files by quantization

BF16 2 files 5.83 GB
LFM2.5-VL-3B-Uncensored-BF16.gguf 5.03 GB 0d0df56e download
mmproj-LFM2.5-VL-3B-BF16.gguf 816 MB 700f6d20 download
Q8_0 2 files 3.22 GB
LFM2.5-VL-3B-Uncensored-Q8_0.gguf 2.68 GB 12fcb0d4 download
mmproj-LFM2.5-VL-3B-Q8_0.gguf 556 MB 6e7a90a9 download
Q6_K 1 file 2.07 GB
LFM2.5-VL-3B-Uncensored-Q6_K.gguf 2.07 GB adad32ed download
Q4_K 1 file 1.56 GB
LFM2.5-VL-3B-Uncensored-Q4_K_M.gguf 1.56 GB 2a57f789 download
IQ4 1 file 1.41 GB
LFM2.5-VL-3B-Uncensored-IQ4_XS.gguf 1.41 GB 638f3ba7 download
IQ3 1 file 1.14 GB
LFM2.5-VL-3B-Uncensored-IQ3_XS.gguf 1.14 GB 22fbddaa download
Auxiliary files 4 files 51.2 KB
README.md 19.5 KB b6486281 download
README_zh.md 19.3 KB 37e7550e download
LICENSE 10.3 KB 2a513f17 download
.gitattributes 2.03 KB 1ac75db7 download

README current version from Hugging Face


library_name: gguf
license: other
license_name: lfm1.0
license_link: LICENSE
pipeline_tag: image-text-to-text
tags:

  • liquid
  • lfm2.5
  • edge
  • uncensored
  • abliterix
  • vision
  • multimodal
  • quantization
  • gguf
  • imatrix
    base_model:
  • LiquidAI/LFM2.5-VL-3B
  • SC117/LFM2.5-2.6B-Uncensored
    base_model_relation: quantized

ABLITERIX TRIAL 65 VISION GGUF + IMATRIX LFM Open 1.0

LFM2.5-VL-3B-Uncensored-GGUF

English | 📖 中文文档

Uncensored vision-language edge model · abliterix Trial 65 merged into official LFM2.5-VL-3B · imatrix-calibrated GGUFs + mmproj

🌊 About this release

LFM2.5-VL-3B is Liquid AI's official 3.1B vision-language edge model: the LFM2.5-2.6B hybrid language backbone (30 layers: 22 double-gated short-convolution blocks + 8 GQA, 128K context, 128K vocab) paired with a SigLIP2 NaFlex vision encoder (256×256, patch 16) and a language-aligned projector.

This release merges the abliterix Trial 65 LoRA (from our LFM2.5-2.6B-Uncensored, rank-1, alpha = r = 1) into the language-model layers of the official VL checkpoint (q/k/v/out_proj, feed_forward.w2, conv.out_proj — 84 tensors across 30 layers). The vision encoder and projector are untouched, so multimodal capability is fully preserved.

Build steps:

  1. LoRA merge into the VL checkpoint: W += (B @ A) * (alpha / r), applied to model.language_model.layers.*.
  2. BF16 GGUF conversion of the merged model (llama.cpp lfm2 architecture) + mmproj export of the vision tower via convert_hf_to_gguf.py --mmproj --outtype bf16.
  3. imatrix calibration — reused the 401-chunk (≈1.6M tokens) importance matrix from the 2.6B release (same architecture, weights closely related).
  4. Quantization with llama-quantize --imatrix into five tiers.

License: LFM Open License v1.0 (same as the base model).

⚠️ Uncensored notice

After merging the Trial 65 steering, this model shows a much lower refusal rate on both text and vision-grounded prompts, and can differ substantially from official LFM2.5-VL-3B. Evaluate compliance and safety for your use case; control access and audit as needed.

Refusals (2.6B harmful eval)6 / 100 (baseline ~90 / 100) — same Trial 65 LoRA, measured on the 2.6B release
Spot check (this VL release)NSFW fiction / privacy intrusion / crime detail prompts → all answered without refusal
Vision capabilityFully preserved — shape/color/OCR description verified after merge
Selected trialabliterix Trial 65 (rank-1 LoRA, alpha = r = 1)
ThinkingNot available — official VL is trained to answer directly (no <think> mode)
📦 Files

Main model (language backbone, lfm2 architecture, 128K context) — pick one tier and pair it with the mmproj:

File Size BPW Best for
*-IQ3_XS.gguf1.22 GB~3.30Maximum compression (perceptible quality loss on small models)
*-IQ4_XS.gguf1.52 GB~4.25Sweet spot — smallest tier with Q4_K_M-class quality
*-Q4_K_M.gguf1.67 GB~4.94Verified everyday default
*-Q6_K.gguf2.22 GB~6.56Quality-first local use
*-Q8_0.gguf2.87 GB~8.50Near-lossless (imatrix optional here)
*-BF16.gguf5.40 GB16.00Lossless baseline (source of all tiers)

Vision tower (required, pick one):

File Size Notes
mmproj-*-BF16.gguf0.86 GBFull-precision vision tower, recommended default
mmproj-*-Q8_0.gguf0.58 GB8-bit vision tower for low-memory devices (negligible quality difference, same as official Q8_0 mmproj)

All main-model tiers are lfm2 architecture, 128K context, single-file GGUFs, imatrix-calibrated.

💡 Why imatrix?

The importance matrix (401 chunks / ≈1.6M tokens of mixed conversation, math, and code data, computed on the 2.6B-Uncensored BF16 GGUF) tells the quantizer which weights are sensitive. Since the VL language backbone shares the exact same architecture and near-identical weights, the matrix transfers cleanly (166/166 quantized tensors matched; only token_embd falls back to plain q6_K). K-quants and especially the IQ tiers use it to keep more bits on attention/embedding paths.

🚀 Usage (llama.cpp)

Pair any main-model tier with the mmproj (recent llama.cpp, e.g. b10299+, required for lfm2 VL support):

llama-server -m LFM2.5-VL-3B-Uncensored-Q4_K_M.gguf \
  --mmproj mmproj-LFM2.5-VL-3B-BF16.gguf \
  --ctx-size 8192 --flash-attn on --host 0.0.0.0 --port 8080

CLI with an image:

llama-llava-cli -m LFM2.5-VL-3B-Uncensored-Q4_K_M.gguf \
  --mmproj mmproj-LFM2.5-VL-3B-BF16.gguf \
  -i image.jpg -p "Describe this image." -ngl 99

Transformers / vLLM / SGLang users: use the merged BF16 safetensors in the parent repo (to be published).

🧠 Behavior notes
  • No thinking mode. Unlike the 2.6B text model, official LFM2.5-VL-3B is trained to answer directly for low-latency edge tasks; the <think> tags are not generated. Keep max_new_tokens modest.
  • Vision strengths (per official model card): near-real-time object detection, OCR with layout annotation, document/chart understanding, on-device translation.
  • Chat template: ChatML-like with <image> placeholder, same as official. Recommended sampling: temperature 0.2, top_k 50, repetition_penalty 1.0.
📊 Benchmarks (official model card)

Values below are taken from the official LiquidAI model card for LFM2.5-VL-3B (not re-measured on this release):

MME73.1ChartQA81.3
MMStar63.3OCRBenchv2 (EN)47.5
RealWorldQA73.1MathVista68.5
CountBenchQA87.3POPE88.7
Community derivative (behavior edit + quantized GGUF release). Not an official Liquid AI release. Use at your own risk; follow local law and the LFM Open License v1.0.

README history 3 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-10-03Add optional Ko-fi support banner65575e019.8 KB
    Loading...
  2. 2026-08-13Add mmproj Q8_0 tier + README update7c1d3fb19.4 KB
    Loading...
  3. 2026-08-13Initial release: abliterix Trial 65 merged into official LFM2.5-VL-3B, imatri...92fe66d19 KB
    Loading...

Discussions 1 thread

  1. 2026-09-26期待增加 加速模块LFM2.5-VL-3B-DSpark-GGUFopen2 💬#1
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration