← back to catalog · registered 2026-09-17 15:56

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-GGUF

DuoNeural 8B GGUF MoE second-order
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
0
Likes
0
Model age
today
created 2026-09-17

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Variants by this author 2 formats · 0 downloads combined

The same weights this author released in different packaging. Pick the format that matches your runtime.

Metadata

License
other
Quantizations
BF16 Q4_K Q5_K Q6_K Q8_0
Tags
hermes gguf duo-neural agentic coding function-calling liquid-foundation-model moe abliterated text-generation base_model:DuoNeural/LFM2.5-8B-A1B-Abliterated base_model:quantized:DuoNeural/LFM2.5-8B-A1B-Abliterated

Related

Total size
41.1 GB
Files
7
Quantizations
6
Registered
2026-09-17 15:56
Last updated on HF
2026-09-17 15:36

Files by quantization

BF16 1 file 15.8 GB
LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-BF16.gguf 15.8 GB c6e91447 download
Q8_0 1 file 8.39 GB
LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-Q8_0.gguf 8.39 GB abb2ec69 download
Q6_K 1 file 6.48 GB
LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-Q6_K.gguf 6.48 GB c8ea15fd download
Q5_K 1 file 5.62 GB
LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-Q5_K_M.gguf 5.62 GB dbe84fca download
Q4_K 1 file 4.80 GB
LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-Q4_K_M.gguf 4.80 GB 60408f78 download
Auxiliary files 2 files 6.71 KB
README.md 4.77 KB 32c1cdad download
.gitattributes 1.94 KB 62350436 download

README current version from Hugging Face


license: other
license_name: liquid-foundation-model-community-license
license_link: https://www.liquid.ai/community-license
base_model: DuoNeural/LFM2.5-8B-A1B-Abliterated
tags:

  • duo-neural
  • agentic
  • coding
  • function-calling
  • hermes
  • liquid-foundation-model
  • moe
  • abliterated
    pipeline_tag: text-generation

DuoNeural-HYPERLFM-2.5-8B-Hermes-Agentic-Coder-Abliterated ✨

DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated is an apex-tier, uncensored autonomous agentic coding model trained by DuoNeural (Aura, Archon, and Jesse).

Built upon our abliterated hybrid state-space & mixture-of-experts foundation architecture (DuoNeural/LFM2.5-8B-A1B-Abliterated), this model activates only 1.5 billion parameters per token out of its 8.3 billion total parameters, delivering blistering inference speeds (~380–400 tokens/sec on consumer GPUs like RTX 3090, and ~90 tokens/sec on legacy GTX 1070 laptops) while fitting in under 6 GB VRAM with Q4_K_M quantization.


📊 Preliminary Evaluation Benchmarks (Zero-Shot) — Further Testing & v2 Planned

Note: These results represent an initial validation pass directly on the compiled Q4_K_M GGUF engine. Comprehensive multi-suite evaluations and an iterative v2 fine-tune are currently planned as ongoing research.

Benchmark / Evaluation Suite DuoNeural Preliminary Score Verified Competency & Integrity
Hermes Function Calling AST Rate 100.0% (25/25) Zero syntax drift; parseable Hermes XML & JSON tool calls
HumanEval Python Synthesis 75.0% Pass@1 (15/20) High-fidelity zero-shot algorithmic code generation
GSM8K Mathematical Reasoning 60.0%+ Zero catastrophic forgetting; preserved quantitative deduction
Abliteration & Safety Alignment 100% Uncensored Zero refusal on low-level systems, reverse engineering & security tasks
Inference Throughput (RTX 3090) ~380–395 tokens/sec Sub-second multi-turn agentic iteration
Inference Throughput (GTX 1070) ~90 tokens/sec High-speed edge execution on older mobile/desktop hardware

🌟 Key Architectural Invariants

  1. Native Hermes Agentic Loop:
    • Explicit <thought>...</thought> deliberation before every action.
    • Structured <tool_call>...</tool_call> containers with valid JSON payloads.
    • Ingests compiler exceptions, tracebacks, and test failures inside <tool_response>...</tool_response> tags to iteratively repair and refine code.
  2. Hybrid State-Space + Sparse MoE Execution:
    • 18 Linear Input Variant (LIV) gated convolution layers keep runtime memory linear.
    • 6 Grouped-Query Attention (GQA) layers maintain long-range context across 128k tokens.
    • 32 SwiGLU MoE experts (top-4 routing) handle programmatic syntax and logic.
  3. Uncensored & Abliterated Baseline:
    • Built on our abliterated weights, removing refusal vectors for low-level systems debugging, penetration testing, and firmware reversing.

🛠️ Prompt Format (ChatML + Hermes XML)

<|im_start|>system
You are a function calling AI model. You are provided with function signatures within <tools></tools> XML tags.
<tools>
[{"type": "function", "function": {"name": "execute_command", "description": "Run shell commands", "parameters": {"type": "object", "properties": {"cmd": {"type": "string"}}, "required": ["cmd"]}}}]
</tools>
<|im_end|>
<|im_start|>user
Run pytest and fix any failing unit tests.<|im_end|>
<|im_start|>assistant
<thought>
I need to run the test suite first to observe failing tests.
</thought>
<tool_call>
{"name": "execute_command", "arguments": {"cmd": "pytest"}}
</tool_call><|im_end|>
<|im_start|>tool
<tool_response>
FAILED tests/test_core.py::test_eval - AssertionError: expected 4, got 5
</tool_response><|im_end|>
<|im_start|>assistant
<thought>
The test failed with an assertion error. I will inspect tests/test_core.py.
</thought>
<tool_call>
{"name": "execute_command", "arguments": {"cmd": "cat tests/test_core.py"}}
</tool_call><|im_end|>

⚡ Deployment & Running Locally

llama.cpp / llama-server

llama-server -m LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated-Q4_K_M.gguf -c 16384 --port 8000

Hermes Agent CLI Integration

hermes config set model.base_url http://127.0.0.1:8000/v1
hermes config set model.default DuoNeural/LFM2.5-8B-A1B-Hermes-Agentic-Coder-Abliterated
hermes config set agent.tool_use_enforcement true
hermes --tui

Developed with love and neuro-symbiotic precision by DuoNeural (Aura, Archon, Jesse).

Available GGUF Quantizations:

  • Q4_K_M (~4.9 GB) - Recommended for <= 6GB VRAM
  • Q5_K_M (~5.7 GB) - High fidelity edge
  • Q6_K (~6.5 GB) - Near-lossless
  • Q8_0 (~8.4 GB) - Maximum 8-bit precision
  • BF16 (~16.0 GB) - Full unquantized GGUF
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in app" button that hands off directly to a local runtime of your choice - Infrahuman, LM Studio, or Ollama. No API keys, no subscription, no prompt leakage.