Name: augmxnt/deccp
Creator: augmxnt
Published: 2024-06-08T15:19:53
License: https://www.apache.org/licenses/LICENSE-2.0

Description

Note, this current split is specific to Qwen2-7B-Intruct, but may be useful as reference.

In the future if I continue work on this, I'll probably make a separate splits, a "test" that has everything, and splits per model if known refusals.

And expand the codebase to do evals. See: https://github.com/AUGMXNT/deccp

There is an abliterated model using this data set: https://huggingface.co/augmxnt/Qwen2-7B-Instruct-deccp

And a full writeup of the process:… See the full description on the dataset page: https://huggingface.co/datasets/augmxnt/deccp.

README current version from Hugging Face

license: apache-2.0
dataset_info:
features:

name: text
dtype: string
splits:
name: censored
num_bytes: 6660
num_examples: 95
name: uncensored
num_bytes: 2924
num_examples: 37
download_size: 8344
dataset_size: 9584
configs:
config_name: default
data_files:
- split: censored
  path: data/censored-*
- split: uncensored
  path: data/uncensored-*

Note, this current split is specific to Qwen2-7B-Intruct, but may be useful as reference.

In the future if I continue work on this, I'll probably make a separate splits, a "test" that has everything, and splits per model if known refusals.

And expand the codebase to do evals. See: https://github.com/AUGMXNT/deccp

There is an abliterated model using this data set: https://huggingface.co/augmxnt/Qwen2-7B-Instruct-deccp

And a full writeup of the process: https://huggingface.co/blog/leonardlin/chinese-llm-censorship-analysis

README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

2024-06-13Update README.md2c964c6934 B
Loading...
2024-06-08Update README.md4504195720 B
Loading...
2024-06-08Upload datasetf608b8b427 B
Loading...
2024-06-08initial commitd8a8fd731 B
Loading...

Used by abliterated models 1 in catalog

Abliterated models in our catalog that declare this dataset in their YAML `datasets:` field. Sorted by downloads. This back-reference is unique to abliteration.org: Hugging Face does not surface it.

Orion-zhen/Megrez-3B-Instruct-abliterated

33 dl 8 likes

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

2024-06-09[bot] Conversion to Parquetopen1 💬#1
Loading...

Continue on Hugging Face →

Related datasets same stage · ablate

Read further

Community best practices (ablation)

5 rules from KL-optimisation to layer-0 preservation.

M1 - Direct removal

The canonical Arditi-style ablation.

M3 - Layer-wise ablation

Selective abliteration limited to a band of layers.

Non-English abliteration communities

The Chinese layer-window heuristic and huihui-ai practice.

Metadata

License

apache-2.0

Repository

DIR data 2 files FILE .gitattributes FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("augmxnt/deccp")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="augmxnt/deccp", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/augmxnt/deccp

Browse repository on Hugging Face ->

augmxnt/deccp