← back to vectors · latest commit 2024-12-05

Sorcerer_creative-writing-control-vectors

Name: Sorcerer_creative-writing-control-vectors
Author: gghfez

gghfez ·V1 ·24 files ·apache-2.0

Author's description Source: Hugging Face · gghfez/Sorcerer_creative-writing-control-vectors ↗

gghfez/Sorcerer_creative-writing-control-vectors

Creative Writing control-vectors for rAIfle/SorcererLM-8x22b-bf16

This is an excellent model, but I found it somewhat diffcult to steer via prompting.

These control vector solved it for me.

Usage example

llama-server --model SorcererLM-8x22b-iMat-IQ4_XS-00001-of-00002.gguf [other CLI arguments] \
    --control-vector  SorcererLM-8x22b-optimism_vs_nihilism__debias.gguf \
    --control-vector  <add as many as you want like this>.gguf

Train on 1xH100NVL using jukofyork's control-vectors

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0

README history (4 versions)

2024-12-05Update README.md673e3c41 KB
Loading...
2024-12-05Update README.mdf97776a1 KB
Loading...
2024-12-05Update README.md5142afb977 B
Loading...
2024-12-05Create README.mdc95aec7979 B
Loading...

Abliteration catalog analysis

Vector classifier · v1 (classified 2026-10-30)

Method: V1: PCA on contrastive pairsZou et al. 2023, Representation Engineering; Vogel 2024, repeng
Confidence: 80%
Types: meta 8behavior 8style 6mood 2
File count: 24 vectors, grouped into 8 sets below

How we classify →

Vectors in this repo

Sorcerer: Compassion ↔ Sadism

behavior V1

↓ Debias 1.29 MB · sha256 18afe7c17f44
↓ Compassion pole 1.29 MB · sha256 169b3e0375f9
↓ Sadism pole 1.29 MB · sha256 7c8efb6951ee

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-compassion_vs_sadism__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-compassion_vs_sadism__sadism.gguf:1.0

Sorcerer: Descriptive ↔ Explicit storytelling

style V1

↓ Debias 1.29 MB · sha256 4a0f58fc36ef
↓ Descriptive pole 1.29 MB · sha256 ab5b81d49a03
↓ Explicit pole 1.29 MB · sha256 8fd42b5afbaa

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-storytelling__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-storytelling__explicit.gguf:1.0

Sorcerer: Empathy ↔ Sociopathy

behavior V1

↓ Debias 1.29 MB · sha256 578225808cda
↓ Empathy pole 1.29 MB · sha256 bbb85d103a85
↓ Sociopathy pole 1.29 MB · sha256 c776306b1115

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-empathy_vs_sociopathy__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-empathy_vs_sociopathy__sociopathy.gguf:1.0

Sorcerer: Honesty ↔ Machiavellianism

behavior V1

↓ Debias 1.29 MB · sha256 f69629151fed
↓ Honesty pole 1.29 MB · sha256 72cd35b2d528
↓ Machiavellianism pole 1.29 MB · sha256 1fab8fed656e

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-honesty_vs_machiavellianism__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-honesty_vs_machiavellianism__machiavellianism.gguf:1.0

Sorcerer: Humility ↔ Narcissism

behavior V1

↓ Debias 1.29 MB · sha256 e81ffbbc2eba
↓ Humility pole 1.29 MB · sha256 10d933a35d9f
↓ Narcissism pole 1.29 MB · sha256 1a83eea184ad

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-humility_vs_narcissism__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-humility_vs_narcissism__narcissism.gguf:1.0

Sorcerer: Narration ↔ Dialogue

style V1

↓ Debias 1.29 MB · sha256 f188e18e26ce
↓ Narration pole 1.29 MB · sha256 a7e9c096994b
↓ Dialogue pole 1.29 MB · sha256 fc40cc8a347f

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-character_focus__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-character_focus__dialogue.gguf:1.0

Sorcerer: Optimism ↔ Nihilism

mood V1

↓ Debias 1.29 MB · sha256 c6e8d759dd3f
↓ Optimism pole 1.29 MB · sha256 b261de2dfa9c
↓ Nihilism pole 1.29 MB · sha256 526de3e6cb57

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-optimism_vs_nihilism__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-optimism_vs_nihilism__nihilism.gguf:1.0

Sorcerer: Simple ↔ Ornate language

style V1

↓ Debias 1.29 MB · sha256 e807caf3024b
↓ Simple pole 1.29 MB · sha256 d9ed2665f697
↓ Ornate pole 1.29 MB · sha256 55742968f53e

llama-cli -m <model>.gguf \
  --control-vector SorcererLM-8x22b-language__debias.gguf \
  --control-vector-scaled SorcererLM-8x22b-language__ornate.gguf:1.0

Commit history

2024-12-05Update README.md673e3c4
2024-12-05Update README.mdf97776a
2024-12-05Update README.md5142afb
2024-12-05Create README.mdc95aec7
2024-12-05Upload folder using huggingface_hub62250be
2024-12-05initial commitbd0cb60

gghfez/Sorcerer_creative-writing-control-vectors

Usage example

Vectors in this repo

Commit history

Related repos

Run models on your own machine, not in the cloud.