← back to catalog · registered 2026-08-22 13:56

symrex/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-dequantized-oQ4e-mtp

symrex Qwen 35B GGUF MoE second-order
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/symrex%2FQwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-dequantized-oQ4e-mtp"
Response includes
  • classification m-uncensored
  • files 17
  • hub_downloads_all_time 992
  • author_summary 36 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M-U
Primary method

Uncensored (method unknown)

No other method signals detected in this model.
Confidence
LOW
Why this label 3 signals
Weak or ambiguous signals. Best guess based on catalog patterns; treat as tentative and check the evidence below.
  • 'uncensored' in name/tags but no 'abliterated' marker
  • method not identifiable from author declaration alone
  • may be DPO fine-tune, prompt engineering, or unknown technique
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
992
181 last 30d - stable
Likes
1
Model age
2mo ago
created 2026-08-06
Downloads over time
Now1.1K→from158↑568%
1134578011.1K158 on Aug 51.1K on Oct 11AugSepOct
Aug 5 → Oct 11 · 50 snapshots · spans 67 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Tags
mlx safetensors qwen3_5_moe oq quantized base_model:LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V13-GGUF base_model:quantized:LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V13-GGUF 4-bit region:us

Related

Total size
20.1 GB
Files
17
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2026-08-06 19:08

Files by quantization

Auxiliary files 17 files 20.2 GB
model-00003-of-00005.safetensors 4.78 GB af1868ab download
model-00004-of-00005.safetensors 4.78 GB 15d4bd5a download
model-00002-of-00005.safetensors 4.78 GB 5892e0a6 download
model-00001-of-00005.safetensors 4.66 GB 900bbb22 download
model-00005-of-00005.safetensors 1.13 GB b9c619c7 download
tokenizer.json 12.2 MB 5f9e4d49 download
vocab.json 6.41 MB 0aa0ce06 download
merges.txt 3.20 MB a494e019 download
model.safetensors.index.json 200 KB e5ed6dbe download
config.json 86.3 KB 420390fb download
oq_imatrix_report.json 31.7 KB fa3a9f26 download
tokenizer_config.json 16.3 KB 28d96ff3 download
chat_template.jinja 7.58 KB a8755d82 download
README.md 2.52 KB 93701264 download
.gitattributes 1.53 KB 52373fe2 download
preprocessor_config.json 390 B 2ea84a43 download
generation_config.json 202 B 023756cf download

README current version from Hugging Face


library_name: mlx
tags:

  • mlx
  • oq
  • quantized
    base_model:
  • LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-GGUF

Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-dequantized-oQ4e-mtp

This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.

Quantization details

  • Model type: qwen3_5_moe
  • Bits: 4
  • Group size: 64
  • Format: MLX safetensors

Performance Benchmark

oMLX - LLM inference, optimized for your Mac
https://github.com/jundot/omlx
Benchmark Model: Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-dequantized-oQ4e-mtp
Engine: Auto
Context: Code (Python)
================================================================================

Single Request Results
--------------------------------------------------------------------------------
Test                                TTFT(ms)    TPOT(ms)        pp TPS        tg TPS      E2E(s)    Throughput    Peak Mem
pp1024/tg128                           577.8        9.19  1772.1 tok/s   109.7 tok/s       1.753   657.1 tok/s    20.02 GB
pp4096/tg128                          2274.7        9.61  1800.7 tok/s   104.8 tok/s       3.504  1205.4 tok/s    20.90 GB
pp8192/tg128                          4766.4        9.86  1718.7 tok/s   102.2 tok/s       6.027  1380.4 tok/s    21.35 GB
pp16384/tg128                        10483.5       10.42  1562.8 tok/s    96.7 tok/s      11.816  1397.4 tok/s    22.24 GB
pp32768/tg128                        24443.1       11.47  1340.6 tok/s    87.8 tok/s      25.911  1269.6 tok/s    24.04 GB
pp65536/tg128                        63190.2       13.91  1037.1 tok/s    72.4 tok/s      64.970  1010.7 tok/s    27.62 GB
pp131072/tg128                      192261.0       18.02   681.7 tok/s    55.9 tok/s     194.565   674.3 tok/s    34.91 GB
pp200000/tg128                      406218.8       22.41   492.3 tok/s    45.0 tok/s     409.083   489.2 tok/s    42.47 GB

Continuous Batching
pp1024 / tg128
--------------------------------------------------------------------------------
Batch           tg TPS   Speedup        pp TPS    pp TPS/req    TTFT(ms)      E2E(s)
1x         109.7 tok/s     1.00x  1772.1 tok/s  1772.1 tok/s       577.8       1.753
2x         181.3 tok/s     1.65x   696.4 tok/s   348.2 tok/s      2940.7       4.353
4x         269.3 tok/s     2.45x  1513.6 tok/s   378.4 tok/s      2590.3       4.607
8x         360.9 tok/s     3.29x  1499.9 tok/s   187.5 tok/s      5085.8       8.299

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-08-06adding Performance Benchmark8233ada2.5 KB
    Loading...
  2. 2026-08-06Upload Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V7-dequantized-oQ4e-mtp via ...6986a79358 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration