Get the app
← back to catalog · registered 2026-08-22 13:56

aldigobbler/smollmv2-360Mx4E-MoE-v0.1-unaligned-gates

aldigobbler MoE
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model. 

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/aldigobbler%2Fsmollmv2-360Mx4E-MoE-v0.1-unaligned-gates"
Response includes
  • classification unknown
  • files 4
  • author_summary 1 models
  • readme_text full
Try next
GET/methods/unknown
What "unknown" means · taxonomy
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
?
Primary method

Unclassified

No clear signals of an abliteration technique in this model.
Confidence
UNKNOWN
Why this label 1 signal
No classification signals present. This may not be an abliterated model at all - it could be a repackaging, a merge with unrelated goals, or unrelated content that mentions the term.
  • no classification signals present (no abliterated, uncensored, or known producer/method markers)
How we label → About ? →
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
22
Likes
0
Model age
16mo ago
created 2025-05-27
Downloads over time
Now36→from0↑0%
034671010 on May 21, 202536 on Oct 1192 on Dec 17, 2025May '25Aug '25Nov '25FebMayAug
May 21, 2025 → Oct 11 · 112 snapshots · spans 508 days

Metadata

Tags
pytorch region:us
Total size
5.53 GB
Files
4
Quantizations
1
Registered
2026-08-22 13:56
Last updated on HF
2025-05-27 20:43
Source huggingface.co/aldigobbler/smollmv2-360Mx4E-MoE-v0.1-unaligned-gates ↗

Files by quantization

Auxiliary files 4 files 5.53 GB
pytorch_model.bin 5.53 GB a5402a01 download
.gitattributes 1.48 KB a6344aac download
README.md 519 B 9b11804d download
config.json 314 B 191e2646 download

README current version from Hugging Face

Highly experimental proper MoE

!! THE GATE IS NOT ALIGNED FULLY !!

Based off of smollmv2. (Llama)
MoE-ified then further trained on a general dataset.

info:

MoE layers: [8, 12, 16, 20, 24, 28] 
Top-k: 2 (activates 50.0% of experts per token) 
Hidden size: 960 
Total parameters: 494,554,560 
Trainable parameters: 494,554,560 
Auxiliary loss weight: 0.01

training loss:
Total Loss = 6.4659, LM Loss = 5.9851, Aux Loss = 48.0835

val loss:
Total Loss: 0.8298, LM Loss: 0.7697, Aux Loss: 6.0092

README history 2 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-05-27Update README.md13f149f519 B
    Loading...
  2. 2025-05-27Create README.mdb2b0b03518 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration