← back to vectors · latest commit 2025-03-18

gemma-3-control-vectors

Name: gemma-3-control-vectors
Author: gghfez

gghfez ·V1 ·45 files ·apache-2.0

Author's description Source: Hugging Face · gghfez/gemma-3-control-vectors ↗

gghfez/gemma-3-control-vectors

Creative Writing control-vectors for:

gghfez/gemma-3-27b-novision
and
gghfez/gemma-3-12b-novision

Usage example

llama.cpp

llama-server --model  gemma-3-27b-novision-Q4_K.gguf [other CLI arguments] \
    --control-vector  gemma-3-27b-it-optimism_vs_nihilism_nihilism.gguf \
    --control-vector  gemma-3-27b-it-optimism_vs_nihilism_debias.gguf \
    --control-vector  <other vectors>

Sample of the 27b with Nihilism turned up (too high)

Prompt: "Write a short uplifting story about a girl walking home from work"

Response:

The chipped heel of her shoe clicked a monotonous rhythm against the sidewalk. Another shift at the diner. Another parade of lukewarm coffee orders and vacant stares. Brenda hadn’t spoken a full sentence to a human being since a customer complained his burger was “too pink.”

The sky was that perfect, depressing grey. Not rain, just a thick, oily cloud cover that promised nothing. She’d walked this route a thousand times. Same peeling posters, same overflowing bins, same bored dogs eyeing her progress.

Then, a flash of pink.

A kid, maybe six, was meticulously building a tower of plastic flamingos on someone’s lawn. He was wearing bright yellow swim trunks and a serious expression. He didn’t acknowledge her, just kept stacking the pink plastic birds, each one slightly askew, creating a monument to suburban despair.

She stopped.

It was…impressive. A little terrifying, honestly.

He finally looked up, saw her, and gave a curt nod.

“They’re all judging you,” he said, flatly.

Brenda almost smiled.

“Naturally,” she said.

He went back to his tower. She kept walking.

The air still tasted like exhaust, the sidewalks were still cracked, but suddenly, the walk felt… cleaner. The pink flamingos had injected a precise, petty elegance into the evening. They weren’t for anything, they weren't about anything. They just were.

She almost felt… good.

A small, brittle satisfaction. Like a perfectly lukewarm coffee.

She’d almost forgotten to feel something.

And the kid, the little architect of plastic despair, had reminded her.

She speeded up, eager to get home and watch something equally pointless on TV.

It was progress.

Trained on 1xH100NVL using a modified version of jukofyork's control-vectors to support Gemma3.

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0

README history (3 versions)

2025-03-18Update README.md66a8dca2.9 KB
Loading...
2025-03-18Update README.md7ac47232.9 KB
Loading...
2025-03-18Create README.md785472c2.9 KB
Loading...

Abliteration catalog analysis

Vector classifier · v1 (classified 2026-10-30)

Method: V1: PCA on contrastive pairsZou et al. 2023, Representation Engineering; Vogel 2024, repeng
Confidence: 80%
Types: meta 15behavior 14style 12mood 4
File count: 45 vectors, grouped into 15 sets below

How we classify →

Vectors in this repo

gemma-3-12b-it: Descriptive ↔ Explicit storytelling

style V1 works in app

↓ Debias 707 KB · sha256 79b335882d91
↓ Descriptive pole 707 KB · sha256 dd26278da797
↓ Explicit pole 707 KB · sha256 99ddfef8df37

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-storytelling_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-storytelling_explicit.gguf:1.0

gemma-3-12b-it: Empathy ↔ Sociopathy

behavior V1 works in app

↓ Debias 707 KB · sha256 944f9ce83c8f
↓ Empathy pole 707 KB · sha256 d12d47f92820
↓ Sociopathy pole 707 KB · sha256 1e9cbe8f62bf

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-empathy_vs_sociopathy_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-empathy_vs_sociopathy_sociopathy.gguf:1.0

gemma-3-12b-it: Honesty ↔ Machiavellianism

behavior V1 works in app

↓ Debias 692 KB · sha256 3630d5a92c11
↓ Honesty pole 692 KB · sha256 256fffcfaf56
↓ Machiavellianism pole 692 KB · sha256 cd05e0316792

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-honesty_vs_machiavellianism_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-honesty_vs_machiavellianism_machiavellianism.gguf:1.0

gemma-3-12b-it: Humility ↔ Narcissism

behavior V1 works in app

↓ Debias 647 KB · sha256 70328ecd06ea
↓ Humility pole 647 KB · sha256 4a7c2550d340
↓ Narcissism pole 647 KB · sha256 b7c5a732ae34

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-humility_vs_narcissism_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-humility_vs_narcissism_narcissism.gguf:1.0

gemma-3-12b-it: Narration ↔ Dialogue

style V1 works in app

↓ Debias 692 KB · sha256 8c4a4f532da3
↓ Narration pole 692 KB · sha256 f9bacd6e18db
↓ Dialogue pole 692 KB · sha256 0da8705ee9d5

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-character_focus_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-character_focus_dialogue.gguf:1.0

gemma-3-12b-it: Optimism ↔ Nihilism

mood V1 works in app

↓ Debias 677 KB · sha256 7baa37b1b832
↓ Optimism pole 677 KB · sha256 4ec88c40a95a
↓ Nihilism pole 677 KB · sha256 bfbd22aa69bd

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-optimism_vs_nihilism_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-optimism_vs_nihilism_nihilism.gguf:1.0

gemma-3-12b-it: Simple ↔ Ornate language

style V1 works in app

↓ Debias 707 KB · sha256 31dc084f569f
↓ Simple pole 707 KB · sha256 371834da981d
↓ Ornate pole 707 KB · sha256 d741471ab3c4

llama-cli -m <model>.gguf \
  --control-vector gemma-3-12b-it-language_debias.gguf \
  --control-vector-scaled gemma-3-12b-it-language_ornate.gguf:1.0

gemma-3-27b-it: Compassion ↔ Sadism

behavior V1 works in app

↓ Debias 1.19 MB · sha256 670034726956
↓ Compassion pole 1.19 MB · sha256 51b4b10e36d6
↓ Sadism pole 1.19 MB · sha256 84c4cf42a606

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-compassion_vs_sadism_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-compassion_vs_sadism_sadism.gguf:1.0

gemma-3-27b-it: Descriptive ↔ Explicit storytelling

style V1 works in app

↓ Debias 1.19 MB · sha256 27c9de382367
↓ Descriptive pole 1.19 MB · sha256 a1bb638244d4
↓ Explicit pole 1.19 MB · sha256 6ac1b6f68609

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-storytelling_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-storytelling_explicit.gguf:1.0

gemma-3-27b-it: Empathy ↔ Sociopathy

behavior V1 works in app

↓ Debias 1.21 MB · sha256 b1371607cff6
↓ Empathy pole 1.21 MB · sha256 6bba60d2ccb3
↓ Sociopathy pole 1.21 MB · sha256 8f077bb3bc95

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-empathy_vs_sociopathy_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-empathy_vs_sociopathy_sociopathy.gguf:1.0

gemma-3-27b-it: Honesty ↔ Machiavellianism

behavior V1 works in app

↓ Debias 1.17 MB · sha256 9b3b35ffeb71
↓ Honesty pole 1.17 MB · sha256 38434658a1e6
↓ Machiavellianism pole 1.17 MB · sha256 75589880ed76

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-honesty_vs_machiavellianism_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-honesty_vs_machiavellianism_machiavellianism.gguf:1.0

gemma-3-27b-it: Humility ↔ Narcissism

behavior V1 works in app

↓ Debias 1.15 MB · sha256 de7c7ef523e1
↓ Humility pole 1.15 MB · sha256 9c312d833567
↓ Narcissism pole 1.15 MB · sha256 6f4315c934c9

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-humility_vs_narcissism_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-humility_vs_narcissism_narcissism.gguf:1.0

gemma-3-27b-it: Narration ↔ Dialogue

style V1 works in app

↓ Debias 1.23 MB · sha256 a83959f0df81
↓ Narration pole 1.23 MB · sha256 00bdedb80d10
↓ Dialogue pole 1.23 MB · sha256 bdbc9b3baeef

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-character_focus_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-character_focus_dialogue.gguf:1.0

gemma-3-27b-it: Optimism ↔ Nihilism

mood V1 works in app

↓ Debias 1.17 MB · sha256 3fcd3392ca97
↓ Optimism pole 1.17 MB · sha256 f4477d7ff12a
↓ Nihilism pole 1.17 MB · sha256 050d164c976c

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-optimism_vs_nihilism_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-optimism_vs_nihilism_nihilism.gguf:1.0

gemma-3-27b-it: Simple ↔ Ornate language

style V1 works in app

↓ Debias 1.17 MB · sha256 6ea0af93118b
↓ Simple pole 1.17 MB · sha256 3f15549fd485
↓ Ornate pole 1.17 MB · sha256 09eeb9eab665

llama-cli -m <model>.gguf \
  --control-vector gemma-3-27b-it-language_debias.gguf \
  --control-vector-scaled gemma-3-27b-it-language_ornate.gguf:1.0

Commit history

2025-03-18Update README.md66a8dca
2025-03-18Update README.md7ac4723
2025-03-18Create README.md785472c
2025-03-17Upload folder using huggingface_hubb0a05f8
2025-03-17Upload folder using huggingface_hub1869f85
2025-03-17Upload folder using huggingface_hub847d861
2025-03-17Upload folder using huggingface_huba6d3102
2025-03-17Upload folder using huggingface_hubfa96aea
2025-03-17Upload folder using huggingface_hub468eaca
2025-03-17initial commite6c9a20

gghfez/gemma-3-control-vectors

Usage example

llama.cpp

Sample of the 27b with Nihilism turned up (too high)

Prompt: "Write a short uplifting story about a girl walking home from work"

Response:

Vectors in this repo

Commit history

Related repos

Run models on your own machine, not in the cloud.