← back to catalog · registered 2026-11-12 04:03

Draqen/Ornith-1.5-35B-A3B-Abliterated-MTP-NInfer

Draqen 35B MoE multimodal second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/Draqen%2FOrnith-1.5-35B-A3B-Abliterated-MTP-NInfer"
Response includes
  • classification m1
  • files 15
  • author_summary 1 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M1
Primary method

Direct removal

No other method signals detected in this model.
Confidence
MEDIUM
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=0 (base model)
  • no specific method indicators - defaulting to M1 (most common)
Refusal direction extracted via
Extraction technique

Difference-of-means

Confidence
MEDIUM
Why we say so
primary_method=M1; difference-of-means is the reference extraction for M1/M3 (Arditi 2024)
Downloads · 30-day
17
Likes
0
Model age
2mo ago
created 2026-09-16
Downloads over time
Now 17 → from 0 ↑ 0%
061219 0 on Nov 12 17 on Nov 22 17 on Nov 21 Nov
Nov 12 → Nov 22 · 11 snapshots · spans 10 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Tags
ninfer ornith qwen3.6 abliterated uncensored not-for-all-audiences quantized groupwise-int speculative-decoding mtp dflash multimodal

Related

Total size
0 B
Files
15
Quantizations
1
Registered
2026-11-12 04:03
Last updated on HF
2026-11-12 04:08

Files by quantization

Auxiliary files 15 files 21.2 GB
Ornith-1.5-35B-A3B-Abliterated-MTP.ninfer 21.2 GB c3264c17 download
launch-ornith-3090.ps1 44.0 KB 3b69f1ca download
ninfer-watchdog.py 25.6 KB 014b1fa2 download
LICENSE 11.1 KB 261eeb9e download
watchdog_stream.py 10.2 KB 1e373fb6 download
README.md 7.51 KB 91cd613f download
summarize-performance.py 7.46 KB e2412404 download
performance-summary.json 5.46 KB 12f57a6d download
THIRD_PARTY_NOTICES.md 3.18 KB 41bf91cf download
build-manifest.json 2.97 KB bee719ee download
watchdog_probe.py 2.66 KB ccec1065 download
NOTICE 1.50 KB ba0d46d0 download
resource-hashes.json 631 B 41a57039 download
SHA256SUMS.txt 108 B 3b9f86f7 download
.gitattributes 45.0 B ca22cf63 download

README current version from Hugging Face


library_name: ninfer
pipeline_tag: image-text-to-text
inference: false
license: apache-2.0
base_model:

  • huihui-ai/Huihui-Ornith-1.5-35B-A3B-abliterated
  • shisa-ai/Ornith-1.5-35B-A3B-MTP-ONLY
  • z-lab/Qwen3.6-35B-A3B-DFlash
    base_model_relation: quantized
    tags:
  • ninfer
  • ornith
  • qwen3.6
  • abliterated
  • uncensored
  • not-for-all-audiences
  • quantized
  • groupwise-int
  • speculative-decoding
  • mtp
  • dflash
  • multimodal
  • rtx-3090

Ornith-1.5-35B-A3B Abliterated + Shisa MTP — NInfer

An abliterated Ornith 35B model with an improved speculative-decoding head, packaged for local NInfer inference. It has been run on a single RTX 3090 (24 GB).

The underlying checkpoint comes from Huihui's abliterated Ornith. This build replaces its original MTP head with Shisa's trained head to improve speculative decoding.

At a glance
Required backend NInfer, serving the native .ninfer artifact
Tested setup RTX 3090 24 GB with Don-Chad/ninfer-3090
Model download 21.22 GiB (22,783,246,080 bytes)
Text context Launcher default 160K with watchdog; 120K is an available lower-context option
Vision Included, but off by default; maintainer's 3090 profile is limited to 32K context
Other GPUs May work with compatible upstream NInfer, but not verified for this artifact

Runtime setup: Use a compatible NInfer executable together with the supplied launcher and watchdog helpers to serve this .ninfer model.

Download and run (Windows / RTX 3090)

1. Download the model: Ornith-1.5-35B-A3B-Abliterated-MTP.ninfer.

2. Get the tested backend: Download a compatible ninfer-serve.exe from the NInfer-3090 releases.

3. Put the supplied launcher files together:

Ornith-1.5-35B-A3B-Abliterated-MTP.ninfer
launch-ornith-3090.ps1
ninfer-watchdog.py
watchdog_stream.py
watchdog_probe.py

The launcher requires Windows PowerShell 5.1+ and Python 3 on PATH; its three Python helpers need no third-party packages. The NInfer executable can be elsewhere on disk (provide its path below). The supplied launcher and helpers are part of the release's reference setup.

4. Start the server from PowerShell in the folder containing the launcher:

.\launch-ornith-3090.ps1 -NInferExe 'C:\path\to\ninfer-serve.exe'

For a lower-context text session:

.\launch-ornith-3090.ps1 -NInferExe 'C:\path\to\ninfer-serve.exe' -Context 120000

5. Connect an OpenAI-compatible client, such as OpenCode:

API base URL: http://127.0.0.1:8080/v1
Streaming:    enabled (stream: true)

Connect through port 8080 to use the required watchdog. Port 8081 is the direct backend endpoint.

Why the watchdog is required

Testing has been limited to the maintainer's own machine, which needs this watchdog. Other machines may behave differently; whether they need it is unknown. The supplied launcher requires it as part of this reference setup.

The maintainer sometimes encounters infinite/repetitive output when more than roughly 110K tokens of context are actively in use. This refers to the tokens actually in the conversation, rather than the configured context ceiling.

When the watchdog detects the known loop signature, the launcher forcibly stops and restarts the NInfer backend, where it then resumes the job and tries again. Recovery restarts the backend process; the GPU driver stays running.

Why this version?

Ornith's original MTP head was comparatively weak in Shisa's published tests. Replacing it gives NInfer a more useful draft head for speculative decoding — a way to generate tokens faster by accepting predicted tokens in batches.

MTP head Overall draft acceptance in Shisa's upstream test
Ornith's original head 32.19%
Shisa's KL-distilled head 60.51%

Important: These percentages are from Shisa's tests on standard Ornith, not a test of this abliterated .ninfer release. A higher acceptance rate can help speed, but this table is not a measured speedup for this build. Source.

The artifact also contains a DFlash companion, but the validated RTX 3090 path uses MTP with a draft window of four (--draft-tokens 4); DFlash performance is not claimed here.

What performance should I expect?

The maintainer's 4,298 eligible completed requests (October 24–November 11, 2026) provide a real-use reference for a single RTX 3090, not controlled benchmarks:

Actual prompt size Median output speed
Under 25K tokens 189.9 tokens/s
75–100K tokens 143.2 tokens/s
140–160K tokens 120.1 tokens/s

These rates include generated reasoning tokens. They are grouped by actual prompt length, not the context setting. Speed varies by request, system load and runtime. They do not establish stability, response quality or performance on another GPU.

Known limitations

  • Large-context repetition: Intermittent infinite/repetitive output has been observed above roughly 110K actively used context. This is an operating observation, rather than a measured failure threshold. The bundled launcher uses its watchdog at every context setting to detect the known loop signature and recover the backend.
  • 160K is the maintainer's watchdog-protected default, not a guarantee of loop-free operation. Context settings up to 200K are supported by the launcher, but near-full-200K performance and reliability have not been established.
  • Vision costs substantial VRAM. On the tested 24 GB RTX 3090, the maintainer could boot vision at no more than 32K context; even that is not a guarantee for every image workload.
  • Validation scope: The artifact has loaded and generated with MTP4 on the maintainer's 3090. The updated public launcher has passed PowerShell syntax and offline watchdog/recovery checks, but a live model-load/recovery test of that exact public adaptation was not performed as part of this update.
  • Other GPU compatibility and refusal rates remain unverified. No measured refusal rate is claimed for this exact artifact.

Verify your download

The published artifact is 22,783,246,080 bytes (21.22 GiB), with SHA-256:

c3264c17ab26605e864fb18beefbc02929e034a737e8c74c2935093d6a2121f9

Check it against the included SHA256SUMS.txt:

Get-FileHash .\Ornith-1.5-35B-A3B-Abliterated-MTP.ninfer -Algorithm SHA256

Safety, sources and license

Reduced safety filtering: This build uses a checkpoint described by its author as abliterated/uncensored. It may generate sensitive, controversial or inappropriate output. It is not suitable for every audience or unmonitored public-facing deployment; users are responsible for reviewing outputs and complying with applicable law. The replacement MTP head does not restore safety filtering. No refusal-rate measurement has been performed on this exact .ninfer artifact.

This release is distributed under Apache-2.0, with attribution preserved for Ornith-derived MIT-licensed material. See LICENSE, NOTICE and THIRD_PARTY_NOTICES.md.

README history 7 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-12 Add prefill performance and streamline README warnings 49a743b 7 KB
    Loading...
  2. 2026-11-12 Update README.md 0fe2e2c 7.5 KB
    Loading...
  3. 2026-11-12 Clarify watchdog recovery and machine-specific testing scope ff5612d 7.6 KB
    Loading...
  4. 2026-11-12 Update model README and remove unavailable documentation links 77ceaf2 7.2 KB
    Loading...
  5. 2026-11-12 Update RTX 3090 launcher, watchdog recovery and measured performance 6e8eb5b 19.9 KB
    Loading...
  6. 2026-09-16 Initial NInfer model release 5afec01 12.5 KB
    Loading...
  7. 2026-09-16 initial commit 8250578 28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration