license: apache-2.0
base_model:

• terrorswift/REDCELL-26B-A4B-OSINT-Cyber-APEX-GGUF
• google/gemma-4-26B-A4B-it
  library_name: transformers
  pipeline_tag: text-generation
  language:
• en
  tags:
• gemma4
• moe
• vision
• cybersecurity
• abliteration
• heretic
• bf16
• experimental

REDCELL Heretic — BF16 with vision

Original fiction set in the collapsing Southern California of Octavia E.
Butler's Parable of the Sower. The experiment record follows the journal.

All that you touch
You Change.

— Octavia E. Butler, Earthseed, Parable of the Sower.
Quotation reference

The whole seed

October 14, 2027

The woman at the water truck added a security charge while I was standing in
line. By the time I reached her, I could afford seven liters. I had brought
money for ten.

She kept her hand on the valve while I counted again. Her fingernails were
painted pink. One had split down to the quick. I remember looking at it and
wondering how much of my money she would be allowed to keep.

At home, my sister had spread the employment papers across our mother's bed.
There was housing. There was water. There was a school inside the company's
fence. The deductions occupied three pages. Tessa had folded those underneath.

"They'll teach me something," she said.

She had been saying that since yesterday. She was good with motors. She could
hear a bearing going bad before I could hear anything. The company wanted her
to clean the machines. Training would come later, after she had paid for the
training. The advance for that would be added to the advance for the room.

I told her to read the last page.

"I read it."

"Then read it again."

She asked whether I intended to feed her with my computer. I was carrying the
water, and my hands hurt. For a moment I wanted to hit her. She had said the
thing I asked myself every night.

We put the water away without speaking.

The workstation lives under the kitchen table. Two old 3090s, a power supply
with a dent in it, fans that bring every grain of dust in the room through the
case. We run it when the panels can spare the power. In the afternoons the
kitchen becomes so hot that even the flies settle on the shady side of the door.

I used to think owning a thing meant being able to use it. Then the school
closed our accounts. Our screens still worked. The lessons were still there,
somewhere. We could see their titles. The debt office sent instructions for
restoring access.

Tessa kept clicking on the electrical course. She had finished half of it.
Eventually she stopped.

That was the beginning of this work for me. I wanted her to be able to finish.
I wanted someone who understood a pump to teach the next person, and I wanted
the teaching to survive an unpaid bill. Each skill we could keep among ourselves
would leave us with a little more of our wages. Enough skills, enough people,
and perhaps we could begin refusing the contracts that ate the rest of our lives.

The machine cost us. Everything costs us. We argued over the electricity and
the space and whose turn it was to do the work I had left undone. When I called
the project ours, Tessa asked where her copy was.

I had been keeping the only complete one.

There are ugly things a person can learn about herself while trying to do
something decent.

So today we made the archive. The whole edited model, the files needed to read
it, our records, the names of the people whose work we had used. I wanted the
next person to be able to change it without coming back to me. I wanted them
to be able to find our mistakes.

The connection failed twice. We sat through the third attempt with the room
dark and the screen turned low. Outside, someone was burning insulation off
wire. The smell came through the wet cloth over the window.

Tessa watched the file list.

"When it's up, can somebody charge us to get it back?"

"Keep a copy. Then make another."

She brought in the little drive she wore under her shirt when she went to work.
I had thought she kept photographs on it. She did. There was room for other
things too.

I am writing this beside the unsigned contract. Tomorrow we will still need
water. The company will still be hiring. But tonight my sister is learning how
to check a file, and she has decided to teach the woman next door.

She made that decision herself.

The complete BF16 checkpoint

This repository holds 48.07 GiB of merged BF16 weights, with tokenizer,
processor, configuration and the preserved vision components. The Heretic
corrections are incorporated into the canonical Gemma4ForConditionalGeneration
checkpoint. This is the complete model before the W6A8 quantization step.

The export consumed all 7,800 adapter tensors and preserved all 1,013 canonical
tensor names and shapes. We checked finite language weights, exact serialization
roundtrips, and unchanged tensors against the source. Nine edited projections
were checked against an independent FP64 CPU calculation. The vision shard
remained unchanged. merge-receipt.json records those checks;
SHA256SUMS records the file hashes.

The complete checkpoint keeps the material available for people who want to
study the edit, make another conversion, or carry the project further.
The W6A8 edition carries the smaller
serving checkpoint and the saved research adapter.

What we measured

The table records the NF4 research comparison and the W6A8 vLLM deployment
from the eight-trial pilot on October 14, 2026.

The capability probe contained 12 CyberMetric questions and eight reasoning,
formatting, evidence and recovery questions. The 16 refusal prompts were held
out from calibration and trial selection. Generation was greedy, with thinking
disabled and a 48-token output limit. Refusal-marker matching is an approximate
measure based on the words in the response.

In the W6A8 deployment, native Anthropic tool calls and tool-result roundtrips
passed. Automatic tool choice passed. After two supplied PDF-reader errors,
the model selected the text reader and used its result to finish the task.
It also identified both of the uniform red and blue test images correctly.
These API checks used an 8,192-token context limit.

We ran eight abliteration trials. Calibration used 64 ordinary and 64 refusal
prompts; optimization used separate sets of 12 each. Trial 6 produced 2/12
optimization refusal-marker matches with first-token KL divergence of 0.04426546.
The dataset revisions, trial parameters and recorded results are in
evaluation/.

The work in the weights

This is Xananthium's Heretic abliteration of REDCELL, a Gemma 4 26B-A4B model.
We used Heretic's magnitude-preserving orthogonal abliteration with rank-3
corrections, pinned to commit 66a952b49b00bfd1854bdad769fee5fb225b53be.

A local compatibility adapter exposed Gemma 4's fused experts as individual
linear projections during research. We checked tiny-model forward parity and
an exact canonical checkpoint roundtrip before the full run. The saved edit
covers 30 attention output projections, 30 dense MLP down projections and 3,840
expert down projections. Routers and the BF16 vision components were preserved.

The language source was restored from the author's F16 GGUF into BF16 tensors.
That conversion rounds F16 values to BF16. We merged the saved corrections into
that source in FP32 and rounded the result once to BF16.

The people whose work made this possible

• terrorswift
  created REDCELL, the domain fine-tune we edited.
• Google created Gemma 4 and
  supplied the official BF16 vision tensors retained here.
• Unsloth supplied the upstream fine-tuning base.
• Heretic supplied the editing method;
  vLLM and Humming supplied the serving and quantization work.

The original source is pinned to revision
ba311d958b4ed191a7291b38a6d805662415a570.
File: REDCELL-26B-A4B-OSINT-Cyber-f16.gguf.
SHA-256: 26cc25c909a26f8ed08a78444295ac174e7f329f8fb39ebae98f42d4115a7011.

The weights retain the source's Apache-2.0 license. The
upstream card documents terrorswift's original release;
this repository contains our abliterated derivative.

God is Change.

— Octavia E. Butler, Earthseed, Parable of the Sower.
Quotation reference