← back to catalog · registered 2026-08-22 13:56

noctrex/OpenThinker-Agent-v1-abliterated-GGUF

noctrex GGUF 41K ctx
Your rig guess connected
? Why do I need an app?
Reading your rig…

This is a rough estimate. Install the free app - we'll show exact numbers.

Reading real hardware from your app right now. Numbers below are exact.

Below is the per-quantization compatibility for this model.

curl -H "Authorization: Bearer $ABL_KEY" \
     "https://abliteration.org/api/v1/models/noctrex%2FOpenThinker-Agent-v1-abliterated-GGUF"
Response includes
  • classification m8
  • files 13
  • hub_downloads_all_time 1,364
  • author_summary 44 models
  • readme_text full
10 credits · hourly refresh · ~4 KB payload Get an API key →
Abliteration classifier · v1.0.0
M8
Primary method

Repackaging (quantization)

No other method signals detected in this model.
Confidence
HIGH
Why this label 3 signals
Producer identity confirmed by naming conventions, tags or the model card. This label is very unlikely to change.
  • author=noctrex (M8 quantization producer)
  • is_gguf=1
  • base_model='open-thoughts/OpenThinker-Agent-v1' (source unknown method)
Refusal direction extraction

No specific extraction method could be identified for this model. The producer either did not document it or used a proprietary pipeline.

What is a refusal direction? →
Downloads · lifetime
1K
226 last 30d - stable
Likes
0
Model age
10mo ago
created 2025-12-08
Downloads over time
Now1.5K→from720↑103%
6839681.3K1.5K720 on Dec 10, 20251.5K on Oct 11Dec '25FebAprJunAugOct
Dec 10, 2025 → Oct 11 · 83 snapshots · spans 305 days

Genealogy 0 direct forks

Full fork graph →

This model's place in the market. Above: what it was derived from. Below: the tree of everything derived from it.

Metadata

Quantizations
BF16 F16 IQ4 Q4_K Q5_K Q6_K Q8_0
Tags
gguf uncensored abliterated text-generation base_model:open-thoughts/OpenThinker-Agent-v1 base_model:quantized:open-thoughts/OpenThinker-Agent-v1 endpoints_compatible region:us conversational

Related

Total size
63.8 GB
Files
13
Quantizations
8
Registered
2026-08-22 13:56
Last updated on HF
2025-12-08 22:30

Files by quantization

BF16 1 file 15.3 GB
OpenThinker-Agent-v1-abliterated-BF16.gguf 15.3 GB 4ae546e9 download
F16 1 file 15.3 GB
OpenThinker-Agent-v1-abliterated-F16.gguf 15.3 GB 4ae2e8c5 download
Q8_0 1 file 8.11 GB
OpenThinker-Agent-v1-abliterated-Q8_0.gguf 8.11 GB 0431240c download
Q6_K 1 file 6.26 GB
OpenThinker-Agent-v1-abliterated-Q6_K.gguf 6.26 GB 913dcbea download
Q5_K 1 file 5.45 GB
OpenThinker-Agent-v1-abliterated-Q5_K_M.gguf 5.45 GB b8f9d94f download
Q4_K 1 file 4.68 GB
OpenThinker-Agent-v1-abliterated-Q4_K_M.gguf 4.68 GB b5f87a4a download
IQ4 2 files 8.71 GB
OpenThinker-Agent-v1-abliterated-IQ4_NL.gguf 4.46 GB a7995f69 download
OpenThinker-Agent-v1-abliterated-IQ4_XS.gguf 4.25 GB ba287eea download
Auxiliary files 5 files 5.22 MB
imatrix.gguf 5.10 MB b2288a05 download
tensor_charts.png 74.8 KB 7a05c194 download
tensor_difference_distribution.png 34.7 KB eedba289 download
README.md 7.54 KB 7a0bdbc1 download
.gitattributes 2.16 KB 4f0163a5 download

README current version from Hugging Face


pipeline_tag: text-generation
tags:

  • uncensored
  • abliterated
    base_model:
  • open-thoughts/OpenThinker-Agent-v1

This is an abliterated version of OpenThinker-Agent-v1, made using Heretic v1.0.1

The quantizations were created using an imatrix merged from combined_en_medium and harmful.txt to leverage the abliterated nature of the model.

Performance

Metric This model Original model
Refusals 3/100 99/100

Analysis against the original model:

Detailed Analysis:

  • Total Tensors: 399
  • Tensors with Diffs: 202 (50.6%)
  • Average % Diff: 6.35%
  • Median % Diff: 0.00%
  • Min/Max % Diff: 0.00% / 46.22%
  • Std Dev % Diff: 15.56%
  • Skewness % Diff: 2.04
  • Avg L2 Norm: 125405.56
  • Tensors with >5% diff: 57
  • Top differences:
    blk.35.attn_output.weight ((4096, 8192), L2: 668013.65): 46.22%
    blk.34.ffn_down.weight ((4096, 24576), L2: 1155843.86): 46.07%
    blk.18.attn_output.weight ((4096, 8192), L2: 667142.18): 46.00%
    blk.16.ffn_down.weight ((4096, 24576), L2: 1154713.83): 45.95%
    blk.24.attn_output.weight ((4096, 8192), L2: 666019.48): 45.66%

File Comparison:
File 1: Avg Abs Value = 77.9178, Deviation Score = 0.0991
File 2: Avg Abs Value = 77.9111, Deviation Score = 0.0991
Positive Diffs (File 1 > File 2): 143, Negative Diffs (File 2 > File 1): 59

Tensor Difference Distribution

Tensor Charts

BibTeX entry and citation info

@misc{heretic,
  author = {Weidmann, Philipp Emanuel},
  title = {Heretic: Fully automatic censorship removal for language models},
  year = {2025},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/p-e-w/heretic}}
}

Original model card:

Project | SFT dataset | RL dataset | SFT model | RL model

OpenThinker-Agent-v1

OpenThoughts-Agent is an open-source effort to curate the best datasets for training agents. Our first release includes datasets, models and our research codebase.

OpenThinker-Agent-v1 is a model trained for agentic tasks such as Terminal-Bench 2.0 and SWE-Bench.

The OpenThinker-Agent-v1 model is post-trained from Qwen/Qwen3-8B.
It is SFT-ed on the OpenThoughts-Agent-v1-SFT dataset, then RL-ed on the OpenThoughts-Agent-v1-RL dataset.

This model is the final model after both SFT and RL. For the model after the SFT stage only, see OpenThinker-Agent-v1-SFT.

OpenThinker-Agent-v1 Model Performance

Our OpenThinker-Agent-v1 model is the state-of-the-art model at its scale on agent benchmarks.

Model Harness Terminal-Bench 2.0 SWE-Bench Verified OpenThoughts-TB-Dev
Qwen3-8B Terminus-2 0.0 0.7 5.7
OpenThinker-Agent-v1 Terminus-2 4.9 15.7 17.3
Qwen3-32B Terminus-2 1.9 5.7 10.2
Qwen/Qwen3-Coder-30B-A3B-Instruct OpenHands 10.1 49.2 24.5

Data

We built OpenThinker-Agent-v1 in two stages: supervised fine-tuning, followed by reinforcement learning.
Each stage required its own data pipeline – RL tasks (instructions, environments, and verifiers) and SFT traces from strong teacher agents completing tasks.

OpenThoughts-Agent-v1-SFT is an SFT trace dataset containing approximately 15,200 traces drawn from two different data sources we curate:

  • nl2bash: Simple synthetically generated tasks where the agent has to format shell commands effectively
  • InferredBugs: A set of bugs in C# and Java collected by Microsoft that we turned into tasks

OpenThoughts-Agent-v1-RL is an RL dataset containing ~720 tasks drawn from the nl2bash verified dataset.

To stabilize training, we built a three-stage filtration pipeline that prunes tasks before they ever hit the learner:

  1. Bad verifiers filter: drop tasks with flaky or excessively slow verifiers.
  2. Environment stability: remove tasks whose containers take too long to build or tear down.
    Optional difficulty filter: discard tasks that even a strong model (GPT-5 Codex) cannot solve in a single pass.

Links

Citation

@misc{openthoughts-agent,
  author = {Team, OpenThoughts-Agent},
  month = Dec,
  title = {{OpenThoughts-Agent}},
  howpublished = {https://open-thoughts.ai/agent},
  year = {2025}
}

README history 1 version

The author's README evolved over time. Click a version to see its content at that point.

  1. 2025-12-08Add files using upload-large-folder tool811cdbf7.5 KB
    Loading...
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration