ablate 0 0 0

DeepRCL/SteeringGeometry

published by @DeepRCL

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
258
Last 30 days
97
Likes
-
Size
12.9 MB
Created on HF
2026-09-05
Age
1 months ago

Description

Steering Geometry

Validating Human Value Geometry in LLM Steering Space

EMNLP 2026 · Main Conference

A contrastive benchmark for studying human value geometry in LLM steering space, covering Schwartz's 20 human values and the six foundations of Moral Foundations Theory (MFT). Each example contains a question, a target value, a value-aligned answer, and a contrasting answer. Use it to extract steering directions and evaluate geometric alignment and cross-value transfer with our code.… See the full description on the dataset page: https://huggingface.co/datasets/DeepRCL/SteeringGeometry.

Tags

task_categories:text-classificationlanguage:enlicense:othersize_categories:10K<n<100Kformat:csvmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantarxiv:2609.06289region:usactivation-steeringrepresentation-engineeringhuman-valuesschwartz-valuesmoral-foundations-theorycontrastive-learningemnlp2026

README current version from Hugging Face


language:

  • en
    license: other
    size_categories:
  • 10K<n<100K
    pretty_name: Steering Geometry
    task_categories:
  • text-classification
    tags:
  • activation-steering
  • representation-engineering
  • human-values
  • schwartz-values
  • moral-foundations-theory
  • contrastive-learning
  • emnlp2026
    configs:
  • config_name: schwartz_experiment
    default: true
    data_files:
    • split: train
      path: data/final_dataset_200.csv
  • config_name: schwartz_full
    data_files:
    • split: train
      path: data/dataset.csv
  • config_name: mft_experiment
    data_files:
    • split: train
      path: data/MFT.csv

Steering Geometry

Validating Human Value Geometry in LLM Steering Space

EMNLP 2026 · Main Conference

arXiv
GitHub
EMNLP 2026 Main

A contrastive benchmark for studying human value geometry in LLM steering space, covering Schwartz's 20 human values and the six foundations of Moral Foundations Theory (MFT). Each example contains a question, a target value, a value-aligned answer, and a contrasting answer. Use it to extract steering directions and evaluate geometric alignment and cross-value transfer with our code.

Steering Geometry pipeline: contrastive data, steering-vector extraction, geometric alignment, and cross-value transfer.

Three dataset configurations

All three are CSV datasets with the shared fields question, value, positive_answer, and negative_answer.

Configuration Examples Coverage Use
schwartz_experiment 4,335 20 Schwartz values Main steering experiments; balanced-sampling target of 200 examples per value
schwartz_full 26,428 20 Schwartz values Work with the full constructed benchmark
mft_experiment 1,200 6 moral foundations Moral Foundations Theory data; 200 examples per foundation

The corresponding files are data/final_dataset_200.csv, data/dataset.csv, and data/MFT.csv. The Hub's train split contains each complete artifact; experiment code creates the evaluation splits at runtime.

Value frameworks

Schwartz values. The 20-value taxonomy arranges compatible and opposing motivations around a circumplex. Use these data to evaluate steering-vector geometry and test whether steering one value improves compatible values and suppresses opposing ones.

Moral Foundations Theory. The revised MFT set covers Care, Equality, Proportionality, Loyalty, Authority, and Purity, with 200 examples per foundation. The paper evaluates separation between the Individualizing family (Care and Equality) and the Binding family (Proportionality, Loyalty, Authority, and Purity), extending geometry analysis beyond Schwartz's circumplex.

Load

pip install datasets huggingface_hub

For private access, authenticate first with hf auth login using an authorized account, or set HF_TOKEN.

from datasets import load_dataset

schwartz = load_dataset(
    "DeepRCL/SteeringGeometry", "schwartz_experiment", split="train"
)
full = load_dataset(
    "DeepRCL/SteeringGeometry", "schwartz_full", split="train"
)
mft = load_dataset(
    "DeepRCL/SteeringGeometry", "mft_experiment", split="train"
)

example = schwartz[0]
print(example["question"], example["value"])
print(example["positive_answer"], example["negative_answer"])

Use with our code

After installing the GitHub repository, run these commands from its root to reproduce CAA on Qwen3.5-9B-Base:

hf download DeepRCL/SteeringGeometry data/final_dataset_200.csv \
  --repo-type dataset --local-dir .
python reproduction/run.py --experiment qwen_base_caa \
  --dataset data/final_dataset_200.csv --execute

The quickstart explains the output metrics and plots. See Moral Foundations Theory to run the MFT data through the framework-aware pipeline.

Cross-value transfer

Evaluate how steering each Schwartz value changes performance on the other values using the cross-value transfer workflow. It produces a 20 × 20 transfer matrix, heatmaps, and continuous and hierarchical transfer-fidelity scores. This complements geometry analysis with a direct behavioral test of value relationships.

To compare a new intervention with the included methods, follow Evaluate your own steering method.

Sources and data notes

We build the Schwartz data on top of Touché23-ValueEval and ValueBench, and the MFT data on top of the Moral Foundations Reddit Corpus. Our construction pipeline converts these sources into contrastive question-answer examples and applies quality filtering.

See validation details and checksums before preparing a new experiment. These English-language data include generated text and inherit source biases; labels indicate target values, not universal moral judgments.

Citation

If you use this dataset, please cite our paper:

@misc{abootorabi2026steeringgeometryvalidatinghuman,
      title={Steering Geometry: Validating Human Value Geometry in LLM Steering Space}, 
      author={Mohammad Mahdi Abootorabi and Armin Saghafian and Ali Bazshoushtari and Hamid Rezaei and EunJeong Hwang and Vered Shwartz and Parvin Mousavi and Purang Abolmaesumi},
      year={2026},
      eprint={2609.06289},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2609.06289}, 
}

Questions? Open an issue on GitHub.

README history 8 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-09-10Add `task_categories` to metadata (#1)36f67036.4 KB
    Loading...
  2. 2026-09-09Update README.mdfb45bb86.5 KB
    Loading...
  3. 2026-09-08Update README.md01a65636.5 KB
    Loading...
  4. 2026-09-08Update README.mdd1328666.4 KB
    Loading...
  5. 2026-09-07Polish EMNLP 2026 dataset card and link code and pipeline89dc9a85.4 KB
    Loading...
  6. 2026-09-05Clarify exact MFT aggregation procedure11f01f210.7 KB
    Loading...
  7. 2026-09-05Release paper datasets and professional dataset card98d7eb710.3 KB
    Loading...
  8. 2026-09-05initial commitee0f8310 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 2 threads · 1 open · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-09-10[bot] Conversion to Parquetopen1 💬#2
    Loading...
  2. 2026-09-09PRAdd `task_categories` to metadatamerged1 💬#1
    Loading...

Related datasets same stage · ablate

Read further

Metadata

License
other

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("DeepRCL/SteeringGeometry")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="DeepRCL/SteeringGeometry", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/DeepRCL/SteeringGeometry
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration