← back to catalog · registered 2026-11-20 21:04

onemunanoyo/Olala-v1.0-mini-7A1B-Abliterated-GGUF

onemunanoyo GGUF MoE
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/onemunanoyo%2FOlala-v1.0-mini-7A1B-Abliterated-GGUF"
Response includes
  • classification m8
  • files 6
  • author_summary 8 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

Applied on top of direct removal inherited from the base model.
Confidence
MEDIUM
Inherited from base model
Why this label 3 signals
Method inferred from partial signals - repository name, related files, or tag patterns. Producer identity not confirmed; label may sharpen or shift as we gather more evidence.
  • 'abliterated' in name/tags
  • is_gguf=1
  • assume M1 (base ablation) + M8 (GGUF quant) - default when producer unknown
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · 30-day
149
Likes
2
Model age
1d ago
created 2026-11-20
Downloads over time
Now 149 → from 0 ↑ 0%
055109164 0 on Nov 20 149 on Nov 22 Nov
Nov 20 → Nov 22 · 3 snapshots · spans 2 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

License
apache-2.0
Quantizations
BF16
Tags
gguf olala moe reasoning abliterated text-generation base_model:OVHaiLLM/Olala-v1.0-mini-7A1B base_model:quantized:OVHaiLLM/Olala-v1.0-mini-7A1B license:apache-2.0 endpoints_compatible region:us conversational

Related

Total size
30.6 GB
Files
6
Quantizations
2
Registered
2026-11-20 21:04
Last updated on HF
2026-11-20 23:40

Files by quantization

BF16 1 file 12.7 GB
Olala-v1.0-mini-7A1B-Abliterated-bf16.gguf 12.7 GB 04020efd download
Auxiliary files 5 files 18.0 GB
Olala-v1.0-mini-7A1B-Abliterated-q8_0.gguf 6.78 GB 37367d95 download
Olala-v1.0-mini-7A1B-Abliterated-q6_k.gguf 5.87 GB f7917cbd download
Olala-v1.0-mini-7A1B-Abliterated-q4_k_m.gguf 5.30 GB 698d4679 download
README.md 2.52 KB 9633a861 download
.gitattributes 1.79 KB 63bfe977 download

README current version from Hugging Face


library_name: gguf
license: apache-2.0
base_model: OVHaiLLM/Olala-v1.0-mini-7A1B
base_model_relation: quantized
pipeline_tag: text-generation
tags:

  • olala
  • moe
  • reasoning
  • abliterated

Olala-v1.0-mini-7A1B-Abliterated-GGUF

An abliterated version of OVHaiLLM/Olala-v1.0-mini-7A1B in GGUF format.

The refusal direction was computed by contrasting harmful and benign prompts and projected out of the residual-writing matrices of the decoder layers. General capabilities are preserved.

These files require the OVHai-LLM llama.cpp fork. Upstream llama.cpp, Ollama, and LM Studio cannot load the olala architecture yet.

Benchmark

Model PPL ±
Base 11.4414 0.20138
this model 11.6505 0.20572

Files

File Quant Size
Olala-v1.0-mini-7A1B-Abliterated-bf16.gguf BF16 13.59 GB
Olala-v1.0-mini-7A1B-Abliterated-q8_0.gguf Q8_0 7.28 GB
Olala-v1.0-mini-7A1B-Abliterated-q6_k.gguf Q6_K 6.31 GB
Olala-v1.0-mini-7A1B-Abliterated-q4_k_m.gguf Q4_K_M 5.69 GB

Run

git clone https://github.com/OVHai-LLM/llama.cpp.git llama.cpp-olala
cd llama.cpp-olala
cmake -B build -DGGML_METAL=ON -DCMAKE_BUILD_TYPE=Release -DLLAMA_USE_PREBUILT_UI=OFF  # or -DGGML_CUDA=ON
cmake --build build -j

./build/bin/llama-server -m Olala-v1.0-mini-7A1B-Abliterated-q6_k.gguf -ngl 99 -fa 1 -c 16384 --port 8080
curl -s http://localhost:8080/v1/chat/completions -H 'Content-Type: application/json' -d '{
  "messages": [{"role": "user", "content": "Explain how a heat pump works."}],
  "temperature": 0.8, "top_p": 0.9, "top_k": 40,
  "reasoning_effort": "medium", "max_tokens": 4096
}'

The response includes reasoning_content (thinking), content (answer), and tool_calls (when tools are passed).

Sampling parameters match those of the base model: temperature=0.8, top_p=0.9, top_k=40. reasoning_effort accepts disabled, low, medium (default), and high.

Olala is a reasoning model: it writes its thinking before the answer, so leave enough room in max_tokens for both.

Limitations

  • Abliteration removes refusals; the model may produce content that the base model would decline. Use responsibly and in accordance with applicable law.
  • Because the refusal direction is a single linear vector, removal is not guaranteed to generalize to every prompt, language, or phrasing.
  • Base-model limitations apply.

License

Apache License, Version 2.0. Retain the upstream NOTICE file when redistributing this model or any derivative.

README history 16 versions

The author's README evolved over time. Click a version to see its content at that point.

  1. 2026-11-20 Update README.md 13ac669 3.6 KB
    Loading...
  2. 2026-11-20 Update README.md 4627936 2.5 KB
    Loading...
  3. 2026-11-20 Update README.md 256ccee 2.4 KB
    Loading...
  4. 2026-11-20 Update README.md e576aec 2.9 KB
    Loading...
  5. 2026-11-20 Update README.md bacaf9f 2.8 KB
    Loading...
  6. 2026-11-20 Update README.md 4916bcb 2.9 KB
    Loading...
  7. 2026-11-20 Update README.md 44fcca2 3 KB
    Loading...
  8. 2026-11-20 Update README.md 340be6c 3.1 KB
    Loading...
  9. 2026-11-20 Update README.md ea65853 3.1 KB
    Loading...
  10. 2026-11-20 Upload README.md with huggingface_hub 6e79e5c 3.2 KB
    Loading...
  11. 2026-11-20 Upload README.md with huggingface_hub 5f30afe 5.3 KB
    Loading...
  12. 2026-11-20 Update README.md a2eea0d 146 B
    Loading...
  13. 2026-11-20 Update README.md 6bcf2f2 105 B
    Loading...
  14. 2026-11-20 Update README.md 9ddf4bb 110 B
    Loading...
  15. 2026-11-20 Update README.md 8ff32ee 96 B
    Loading...
  16. 2026-11-20 initial commit 6ddf467 28 B
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration