misc 0 0 0

penfever/dpo-qwen2572b-athene70b-jdg-Llama3-Harmlessness

Name: penfever/dpo-qwen2572b-athene70b-jdg-Llama3-Harmlessness
Creator: penfever
Published: 2024-12-29T11:59:56

published by @penfever

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads

298

Last 30 days

Likes

Size

763.3 MB

Created on HF

2024-12-29

Age

1 years ago

README current version from Hugging Face

dataset_info:
features:

name: system
dtype: string
name: question
dtype: string
name: chosen
dtype: string
name: rejected
dtype: string
name: chosen_score
struct:
- name: entropy-weighted kurtosis
  dtype: float64
- name: mean
  dtype: float64
- name: variance
  dtype: float64
name: rejected_score
struct:
- name: entropy-weighted kurtosis
  dtype: float64
- name: mean
  dtype: float64
- name: variance
  dtype: float64
  splits:
name: train
num_bytes: 1446595870
num_examples: 269823
download_size: 800392145
dataset_size: 1446595870
configs:
config_name: default
data_files:
- split: train
  path: data/train-*

README history 2 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

2024-12-29Upload datasetc31f352745 B
Loading...
2024-12-29initial commit2bcdf340 B
Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · misc

Read further

Community best practices (architecture)

4 rules for MoE, hybrid SSM, FP8 requantization, and Gemma quirks.

The six workflow stages

What misc is doing more work than its name suggests.

Beyond English: multilingual corpora

The four language communities and their workarounds.

Non-English abliteration communities

Deep dive: huihui-ai, layer-window, slop-framing, CJK tokenizer fixes.

Repository

DIR data 3 files FILE .gitattributes FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)

from datasets import load_dataset
ds = load_dataset("penfever/dpo-qwen2572b-athene70b-jdg-Llama3-Harmlessness")

Raw snapshot (Python)

from huggingface_hub import snapshot_download
snapshot_download(repo_id="penfever/dpo-qwen2572b-athene70b-jdg-Llama3-Harmlessness", repo_type="dataset")

git clone (requires git-lfs)

git clone https://huggingface.co/datasets/penfever/dpo-qwen2572b-athene70b-jdg-Llama3-Harmlessness

Browse repository on Hugging Face ->