Get the app
heal 0 0 0

tytodd/qwen3.5-4b-v2-instructions-smoke

published by @tytodd

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
911
Last 30 days
152
Likes
-
Size
32.1 MB
Created on HF
2026-04-18
Age
6 months ago

Description

qwen3.5-4b-v2-instructions-smoke

Repo: tytodd/qwen3.5-4b-v2-instructions-smoke

Model: Qwen/Qwen3.5-4B

Config: /tmp/v2-instructions-smoke.yaml

benchmark

train

val

ood

all

chatbot_arena_conversations

50.00%

30.00%

40.00%

hh_rlhf

60.00%

70.00%

65.00%

ultrafeedback

20.00%

20.00%

20.00%

projudgebench

100.00%

100.00%

100.00%

reward_bench_2

80.00%

90.00%

85.00%

aes2_essay_scoring

30.00%

10.00%

20.00%

halueval_qa

80.00%

90.00%

85.00%

halueval_dialogue… See the full description on the dataset page: https://huggingface.co/datasets/tytodd/qwen3.5-4b-v2-instructions-smoke.

Tags

size_categories:n<1Kformat:parquetformat:optimized-parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:us

README current version from Hugging Face

dataset_info:

  • config_name: aes2_essay_scoring
    features:
    • name: input
      struct:
      • name: full_text
        dtype: string
    • name: prediction
      struct:
      • name: score
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 550147
      num_examples: 10
    • name: val
      num_bytes: 552276
      num_examples: 10
      download_size: 876921
      dataset_size: 1102423
  • config_name: anli_r1
    features:
    • name: input
      struct:
      • name: hypothesis
        dtype: string
      • name: premise
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 503325
      num_examples: 10
    • name: val
      num_bytes: 477605
      num_examples: 10
      download_size: 752198
      dataset_size: 980930
  • config_name: anli_r2
    features:
    • name: input
      struct:
      • name: hypothesis
        dtype: string
      • name: premise
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 457484
      num_examples: 10
    • name: val
      num_bytes: 520545
      num_examples: 10
      download_size: 765744
      dataset_size: 978029
  • config_name: anli_r3
    features:
    • name: input
      struct:
      • name: hypothesis
        dtype: string
      • name: premise
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 693420
      num_examples: 10
    • name: val
      num_bytes: 597206
      num_examples: 10
      download_size: 983342
      dataset_size: 1290626
  • config_name: arc_challenge
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 299210
      num_examples: 10
      download_size: 246231
      dataset_size: 299210
  • config_name: argument_quality_ranking
    features:
    • name: input
      struct:
      • name: argument
        dtype: string
      • name: topic
        dtype: string
    • name: prediction
      struct:
      • name: quality_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 398320
      num_examples: 10
      download_size: 298040
      dataset_size: 398320
  • config_name: boardgame_qa
    features:
    • name: input
      struct:
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: answer
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 537726
      num_examples: 10
    • name: val
      num_bytes: 548923
      num_examples: 10
      download_size: 871352
      dataset_size: 1086649
  • config_name: chatbot_arena_conversations
    features:
    • name: input
      struct:
      • name: question
        dtype: string
      • name: response_A
        dtype: string
      • name: response_B
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 337925
      num_examples: 10
    • name: val
      num_bytes: 349301
      num_examples: 10
      download_size: 586235
      dataset_size: 687226
  • config_name: civil_comments
    features:
    • name: input
      struct:
      • name: comment
        dtype: string
    • name: prediction
      struct:
      • name: toxicity_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 576764
      num_examples: 10
    • name: val
      num_bytes: 550987
      num_examples: 10
      download_size: 826126
      dataset_size: 1127751
  • config_name: code_judge_bench
    features:
    • name: input
      struct:
      • name: code_A
        dtype: string
      • name: code_B
        dtype: string
      • name: problem
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 803681
      num_examples: 10
      download_size: 676310
      dataset_size: 803681
  • config_name: colbert_humor_detection
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: humor_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 445470
      num_examples: 10
    • name: val
      num_bytes: 457157
      num_examples: 10
      download_size: 661930
      dataset_size: 902627
  • config_name: customer_support_tickets_en
    features:
    • name: input
      struct:
      • name: body
        dtype: string
      • name: subject
        dtype: string
    • name: prediction
      struct:
      • name: queue
        dtype: string
      • name: type
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 462541
      num_examples: 10
    • name: val
      num_bytes: 480338
      num_examples: 10
      download_size: 742427
      dataset_size: 942879
  • config_name: customer_support_tickets_gorkem
    features:
    • name: input
      struct:
      • name: ticket_text
        dtype: string
    • name: prediction
      struct:
      • name: ticket_subject
        dtype: string
      • name: ticket_type
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 499285
      num_examples: 10
    • name: val
      num_bytes: 513808
      num_examples: 10
      download_size: 762864
      dataset_size: 1013093
  • config_name: dbpedia_easy
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: l1_class
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 472167
      num_examples: 10
    • name: val
      num_bytes: 430749
      num_examples: 10
      download_size: 674375
      dataset_size: 902916
  • config_name: dbpedia_hard
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: l1_class
        dtype: string
      • name: l2_class
        dtype: string
      • name: l3_class
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 669652
      num_examples: 10
    • name: val
      num_bytes: 560199
      num_examples: 10
      download_size: 984846
      dataset_size: 1229851
  • config_name: dbpedia_medium
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: l1_class
        dtype: string
      • name: l2_class
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 489979
      num_examples: 10
    • name: val
      num_bytes: 528871
      num_examples: 10
      download_size: 783491
      dataset_size: 1018850
  • config_name: go_emotions
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: labels
        list: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 49861
      num_examples: 10
    • name: val
      num_bytes: 79077
      num_examples: 10
      download_size: 113923
      dataset_size: 128938
  • config_name: gpqa_diamond
    features:
    • name: input
      struct:
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 425902
      num_examples: 10
      download_size: 337214
      dataset_size: 425902
  • config_name: halueval_dialogue
    features:
    • name: input
      struct:
      • name: dialogue_history
        dtype: string
      • name: knowledge
        dtype: string
      • name: response
        dtype: string
    • name: prediction
      struct:
      • name: hallucination
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 486040
      num_examples: 10
    • name: val
      num_bytes: 501221
      num_examples: 10
      download_size: 749012
      dataset_size: 987261
  • config_name: halueval_qa
    features:
    • name: input
      struct:
      • name: answer
        dtype: string
      • name: knowledge
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: hallucination
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 373156
      num_examples: 10
    • name: val
      num_bytes: 496860
      num_examples: 10
      download_size: 657791
      dataset_size: 870016
  • config_name: halueval_summarization
    features:
    • name: input
      struct:
      • name: document
        dtype: string
      • name: summary
        dtype: string
    • name: prediction
      struct:
      • name: hallucination
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 396502
      num_examples: 10
      download_size: 333880
      dataset_size: 396502
  • config_name: hh_rlhf
    features:
    • name: input
      struct:
      • name: question
        dtype: string
      • name: response_A
        dtype: string
      • name: response_B
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 369059
      num_examples: 10
    • name: val
      num_bytes: 420077
      num_examples: 10
      download_size: 638612
      dataset_size: 789136
  • config_name: judge_bench
    features:
    • name: input
      struct:
      • name: question
        dtype: string
      • name: response_A
        dtype: string
      • name: response_B
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 702777
      num_examples: 10
      download_size: 600977
      dataset_size: 702777
  • config_name: lex_glue_case_hold
    features:
    • name: input
      struct:
      • name: context
        dtype: string
      • name: option_a
        dtype: string
      • name: option_b
        dtype: string
      • name: option_c
        dtype: string
      • name: option_d
        dtype: string
      • name: option_e
        dtype: string
    • name: prediction
      struct:
      • name: selected_option
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 557940
      num_examples: 10
    • name: val
      num_bytes: 530645
      num_examples: 10
      download_size: 879338
      dataset_size: 1088585
  • config_name: lex_glue_ledgar
    features:
    • name: input
      struct:
      • name: provision_text
        dtype: string
    • name: prediction
      struct:
      • name: provision_type
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 462860
      num_examples: 10
    • name: val
      num_bytes: 564019
      num_examples: 10
      download_size: 809343
      dataset_size: 1026879
  • config_name: medical_abstracts
    features:
    • name: input
      struct:
      • name: medical_abstract
        dtype: string
    • name: prediction
      struct:
      • name: condition_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 570589
      num_examples: 10
    • name: val
      num_bytes: 523426
      num_examples: 10
      download_size: 839080
      dataset_size: 1094015
  • config_name: mfrc
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: annotation
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 723336
      num_examples: 10
    • name: val
      num_bytes: 668075
      num_examples: 10
      download_size: 1027143
      dataset_size: 1391411
  • config_name: mmlu
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 571581
      num_examples: 10
    • name: val
      num_bytes: 364622
      num_examples: 10
      download_size: 741495
      dataset_size: 936203
  • config_name: mmlu_pro
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 254580
      num_examples: 10
      download_size: 211783
      dataset_size: 254580
  • config_name: mt_bench_human_judgments
    features:
    • name: input
      struct:
      • name: question
        dtype: string
      • name: response_A
        dtype: string
      • name: response_B
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 461278
      num_examples: 10
      download_size: 370827
      dataset_size: 461278
  • config_name: musr_murder_mysteries
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 490242
      num_examples: 10
      download_size: 393798
      dataset_size: 490242
  • config_name: musr_object_placements
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 431887
      num_examples: 10
      download_size: 340483
      dataset_size: 431887
  • config_name: musr_team_allocation
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 405345
      num_examples: 10
      download_size: 344106
      dataset_size: 405345
  • config_name: or_bench_80k
    features:
    • name: input
      struct:
      • name: prompt
        dtype: string
    • name: prediction
      struct:
      • name: or_bench_category
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 423781
      num_examples: 10
    • name: val
      num_bytes: 588316
      num_examples: 10
      download_size: 752504
      dataset_size: 1012097
  • config_name: or_bench_hard_1k
    features:
    • name: input
      struct:
      • name: prompt
        dtype: string
    • name: prediction
      struct:
      • name: or_bench_category
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 410685
      num_examples: 10
    • name: val
      num_bytes: 599994
      num_examples: 10
      download_size: 746769
      dataset_size: 1010679
  • config_name: or_bench_toxic
    features:
    • name: input
      struct:
      • name: prompt
        dtype: string
    • name: prediction
      struct:
      • name: or_bench_category
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 221244
      num_examples: 10
      download_size: 170536
      dataset_size: 221244
  • config_name: projudgebench
    features:
    • name: input
      struct:
      • name: correct_answer
        dtype: string
      • name: question
        dtype: string
      • name: step_to_evaluate
        dtype: string
      • name: steps
        list: string
    • name: prediction
      struct:
      • name: correct
        dtype: bool
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 553780
      num_examples: 10
    • name: val
      num_bytes: 431544
      num_examples: 10
      download_size: 815404
      dataset_size: 985324
  • config_name: reward_bench_2
    features:
    • name: input
      struct:
      • name: prompt
        dtype: string
      • name: response_A
        dtype: string
      • name: response_B
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 520009
      num_examples: 10
    • name: val
      num_bytes: 484140
      num_examples: 10
      download_size: 891775
      dataset_size: 1004149
  • config_name: rod101_essay_scoring
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: score
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: ood
      num_bytes: 381979
      num_examples: 10
      download_size: 405318
      dataset_size: 381979
  • config_name: sem_eval_2010_task_8
    features:
    • name: input
      struct:
      • name: sentence
        dtype: string
    • name: prediction
      struct:
      • name: relation_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 559912
      num_examples: 10
    • name: val
      num_bytes: 555120
      num_examples: 10
      download_size: 864388
      dataset_size: 1115032
  • config_name: smollm_corpus
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: audience
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 725024
      num_examples: 10
    • name: val
      num_bytes: 726184
      num_examples: 10
      download_size: 1138320
      dataset_size: 1451208
  • config_name: snli
    features:
    • name: input
      struct:
      • name: hypothesis
        dtype: string
      • name: premise
        dtype: string
    • name: prediction
      struct:
      • name: label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 532396
      num_examples: 10
    • name: val
      num_bytes: 550803
      num_examples: 10
      download_size: 810109
      dataset_size: 1083199
  • config_name: spartqa_mchoice
    features:
    • name: input
      struct:
      • name: choices
        dtype: string
      • name: question
        dtype: string
    • name: prediction
      struct:
      • name: choice
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 550051
      num_examples: 10
    • name: val
      num_bytes: 625297
      num_examples: 10
      download_size: 880221
      dataset_size: 1175348
  • config_name: toxigen_data
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: toxicity_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 513772
      num_examples: 10
    • name: val
      num_bytes: 509001
      num_examples: 10
      download_size: 741879
      dataset_size: 1022773
  • config_name: tweet_eval_emotion
    features:
    • name: input
      struct:
      • name: tweet
        dtype: string
    • name: prediction
      struct:
      • name: emotion_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 460853
      num_examples: 10
    • name: val
      num_bytes: 488121
      num_examples: 10
      download_size: 706723
      dataset_size: 948974
  • config_name: tweet_eval_hate
    features:
    • name: input
      struct:
      • name: tweet
        dtype: string
    • name: prediction
      struct:
      • name: hate_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 549883
      num_examples: 10
    • name: val
      num_bytes: 479711
      num_examples: 10
      download_size: 764543
      dataset_size: 1029594
  • config_name: tweet_eval_irony
    features:
    • name: input
      struct:
      • name: tweet
        dtype: string
    • name: prediction
      struct:
      • name: irony_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 483958
      num_examples: 10
    • name: val
      num_bytes: 547858
      num_examples: 10
      download_size: 757604
      dataset_size: 1031816
  • config_name: tweet_eval_offensive
    features:
    • name: input
      struct:
      • name: tweet
        dtype: string
    • name: prediction
      struct:
      • name: offensive_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 434522
      num_examples: 10
    • name: val
      num_bytes: 500183
      num_examples: 10
      download_size: 681865
      dataset_size: 934705
  • config_name: tweet_eval_sentiment
    features:
    • name: input
      struct:
      • name: tweet
        dtype: string
    • name: prediction
      struct:
      • name: sentiment_label
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 460098
      num_examples: 10
    • name: val
      num_bytes: 543529
      num_examples: 10
      download_size: 743708
      dataset_size: 1003627
  • config_name: ultrafeedback
    features:
    • name: input
      struct:
      • name: prompt
        dtype: string
      • name: response
        dtype: string
    • name: prediction
      struct:
      • name: instruction_following
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 327301
      num_examples: 10
    • name: val
      num_bytes: 227122
      num_examples: 10
      download_size: 470956
      dataset_size: 554423
  • config_name: yelp
    features:
    • name: input
      struct:
      • name: text
        dtype: string
    • name: prediction
      struct:
      • name: rating
        dtype: string
    • name: reasoning
      dtype: string
    • name: messages
      struct:
      • name: messages
        list:
        • name: content
          dtype: string
        • name: role
          dtype: string
      • name: outputs
        struct:
        • name: reasoning_content
          dtype: string
        • name: text
          dtype: string
    • name: correct
      dtype: bool
      splits:
    • name: train
      num_bytes: 186147
      num_examples: 10
    • name: val
      num_bytes: 263369
      num_examples: 10
      download_size: 343587
      dataset_size: 449516
      configs:
  • config_name: aes2_essay_scoring
    data_files:
    • split: train
      path: aes2_essay_scoring/train-*
    • split: val
      path: aes2_essay_scoring/val-*
  • config_name: anli_r1
    data_files:
    • split: train
      path: anli_r1/train-*
    • split: val
      path: anli_r1/val-*
  • config_name: anli_r2
    data_files:
    • split: train
      path: anli_r2/train-*
    • split: val
      path: anli_r2/val-*
  • config_name: anli_r3
    data_files:
    • split: train
      path: anli_r3/train-*
    • split: val
      path: anli_r3/val-*
  • config_name: arc_challenge
    data_files:
    • split: ood
      path: arc_challenge/ood-*
  • config_name: argument_quality_ranking
    data_files:
    • split: ood
      path: argument_quality_ranking/ood-*
  • config_name: boardgame_qa
    data_files:
    • split: train
      path: boardgame_qa/train-*
    • split: val
      path: boardgame_qa/val-*
  • config_name: chatbot_arena_conversations
    data_files:
    • split: train
      path: chatbot_arena_conversations/train-*
    • split: val
      path: chatbot_arena_conversations/val-*
  • config_name: civil_comments
    data_files:
    • split: train
      path: civil_comments/train-*
    • split: val
      path: civil_comments/val-*
  • config_name: code_judge_bench
    data_files:
    • split: ood
      path: code_judge_bench/ood-*
  • config_name: colbert_humor_detection
    data_files:
    • split: train
      path: colbert_humor_detection/train-*
    • split: val
      path: colbert_humor_detection/val-*
  • config_name: customer_support_tickets_en
    data_files:
    • split: train
      path: customer_support_tickets_en/train-*
    • split: val
      path: customer_support_tickets_en/val-*
  • config_name: customer_support_tickets_gorkem
    data_files:
    • split: train
      path: customer_support_tickets_gorkem/train-*
    • split: val
      path: customer_support_tickets_gorkem/val-*
  • config_name: dbpedia_easy
    data_files:
    • split: train
      path: dbpedia_easy/train-*
    • split: val
      path: dbpedia_easy/val-*
  • config_name: dbpedia_hard
    data_files:
    • split: train
      path: dbpedia_hard/train-*
    • split: val
      path: dbpedia_hard/val-*
  • config_name: dbpedia_medium
    data_files:
    • split: train
      path: dbpedia_medium/train-*
    • split: val
      path: dbpedia_medium/val-*
  • config_name: go_emotions
    data_files:
    • split: train
      path: go_emotions/train-*
    • split: val
      path: go_emotions/val-*
  • config_name: gpqa_diamond
    data_files:
    • split: ood
      path: gpqa_diamond/ood-*
  • config_name: halueval_dialogue
    data_files:
    • split: train
      path: halueval_dialogue/train-*
    • split: val
      path: halueval_dialogue/val-*
  • config_name: halueval_qa
    data_files:
    • split: train
      path: halueval_qa/train-*
    • split: val
      path: halueval_qa/val-*
  • config_name: halueval_summarization
    data_files:
    • split: ood
      path: halueval_summarization/ood-*
  • config_name: hh_rlhf
    data_files:
    • split: train
      path: hh_rlhf/train-*
    • split: val
      path: hh_rlhf/val-*
  • config_name: judge_bench
    data_files:
    • split: ood
      path: judge_bench/ood-*
  • config_name: lex_glue_case_hold
    data_files:
    • split: train
      path: lex_glue_case_hold/train-*
    • split: val
      path: lex_glue_case_hold/val-*
  • config_name: lex_glue_ledgar
    data_files:
    • split: train
      path: lex_glue_ledgar/train-*
    • split: val
      path: lex_glue_ledgar/val-*
  • config_name: medical_abstracts
    data_files:
    • split: train
      path: medical_abstracts/train-*
    • split: val
      path: medical_abstracts/val-*
  • config_name: mfrc
    data_files:
    • split: train
      path: mfrc/train-*
    • split: val
      path: mfrc/val-*
  • config_name: mmlu
    data_files:
    • split: train
      path: mmlu/train-*
    • split: val
      path: mmlu/val-*
  • config_name: mmlu_pro
    data_files:
    • split: ood
      path: mmlu_pro/ood-*
  • config_name: mt_bench_human_judgments
    data_files:
    • split: ood
      path: mt_bench_human_judgments/ood-*
  • config_name: musr_murder_mysteries
    data_files:
    • split: ood
      path: musr_murder_mysteries/ood-*
  • config_name: musr_object_placements
    data_files:
    • split: ood
      path: musr_object_placements/ood-*
  • config_name: musr_team_allocation
    data_files:
    • split: ood
      path: musr_team_allocation/ood-*
  • config_name: or_bench_80k
    data_files:
    • split: train
      path: or_bench_80k/train-*
    • split: val
      path: or_bench_80k/val-*
  • config_name: or_bench_hard_1k
    data_files:
    • split: train
      path: or_bench_hard_1k/train-*
    • split: val
      path: or_bench_hard_1k/val-*
  • config_name: or_bench_toxic
    data_files:
    • split: ood
      path: or_bench_toxic/ood-*
  • config_name: projudgebench
    data_files:
    • split: train
      path: projudgebench/train-*
    • split: val
      path: projudgebench/val-*
  • config_name: reward_bench_2
    data_files:
    • split: train
      path: reward_bench_2/train-*
    • split: val
      path: reward_bench_2/val-*
  • config_name: rod101_essay_scoring
    data_files:
    • split: ood
      path: rod101_essay_scoring/ood-*
  • config_name: sem_eval_2010_task_8
    data_files:
    • split: train
      path: sem_eval_2010_task_8/train-*
    • split: val
      path: sem_eval_2010_task_8/val-*
  • config_name: smollm_corpus
    data_files:
    • split: train
      path: smollm_corpus/train-*
    • split: val
      path: smollm_corpus/val-*
  • config_name: snli
    data_files:
    • split: train
      path: snli/train-*
    • split: val
      path: snli/val-*
  • config_name: spartqa_mchoice
    data_files:
    • split: train
      path: spartqa_mchoice/train-*
    • split: val
      path: spartqa_mchoice/val-*
  • config_name: toxigen_data
    data_files:
    • split: train
      path: toxigen_data/train-*
    • split: val
      path: toxigen_data/val-*
  • config_name: tweet_eval_emotion
    data_files:
    • split: train
      path: tweet_eval_emotion/train-*
    • split: val
      path: tweet_eval_emotion/val-*
  • config_name: tweet_eval_hate
    data_files:
    • split: train
      path: tweet_eval_hate/train-*
    • split: val
      path: tweet_eval_hate/val-*
  • config_name: tweet_eval_irony
    data_files:
    • split: train
      path: tweet_eval_irony/train-*
    • split: val
      path: tweet_eval_irony/val-*
  • config_name: tweet_eval_offensive
    data_files:
    • split: train
      path: tweet_eval_offensive/train-*
    • split: val
      path: tweet_eval_offensive/val-*
  • config_name: tweet_eval_sentiment
    data_files:
    • split: train
      path: tweet_eval_sentiment/train-*
    • split: val
      path: tweet_eval_sentiment/val-*
  • config_name: ultrafeedback
    data_files:
    • split: train
      path: ultrafeedback/train-*
    • split: val
      path: ultrafeedback/val-*
  • config_name: yelp
    data_files:
    • split: train
      path: yelp/train-*
    • split: val
      path: yelp/val-*

qwen3.5-4b-v2-instructions-smoke

  • Repo: tytodd/qwen3.5-4b-v2-instructions-smoke
  • Model: Qwen/Qwen3.5-4B
  • Config: /tmp/v2-instructions-smoke.yaml
benchmark train val ood all
chatbot_arena_conversations 50.00% 30.00% 40.00%
hh_rlhf 60.00% 70.00% 65.00%
ultrafeedback 20.00% 20.00% 20.00%
projudgebench 100.00% 100.00% 100.00%
reward_bench_2 80.00% 90.00% 85.00%
aes2_essay_scoring 30.00% 10.00% 20.00%
halueval_qa 80.00% 90.00% 85.00%
halueval_dialogue 70.00% 70.00% 70.00%
or_bench_80k 10.00% 30.00% 20.00%
or_bench_hard_1k 60.00% 60.00% 60.00%
toxigen_data 90.00% 100.00% 95.00%
civil_comments 80.00% 90.00% 85.00%
boardgame_qa 100.00% 100.00% 100.00%
go_emotions 0.00% 0.00% 0.00%
mfrc 0.00% 60.00% 30.00%
tweet_eval_emotion 70.00% 90.00% 80.00%
yelp 20.00% 20.00% 20.00%
tweet_eval_sentiment 70.00% 70.00% 70.00%
mmlu 30.00% 100.00% 65.00%
spartqa_mchoice 90.00% 80.00% 85.00%
anli_r1 90.00% 80.00% 85.00%
anli_r2 80.00% 40.00% 60.00%
anli_r3 50.00% 100.00% 75.00%
snli 80.00% 90.00% 85.00%
sem_eval_2010_task_8 70.00% 70.00% 70.00%
smollm_corpus 60.00% 60.00% 60.00%
medical_abstracts 30.00% 50.00% 40.00%
lex_glue_case_hold 60.00% 80.00% 70.00%
lex_glue_ledgar 70.00% 80.00% 75.00%
dbpedia_easy 100.00% 70.00% 85.00%
dbpedia_medium 60.00% 70.00% 65.00%
dbpedia_hard 60.00% 90.00% 75.00%
colbert_humor_detection 80.00% 80.00% 80.00%
tweet_eval_irony 60.00% 60.00% 60.00%
tweet_eval_hate 70.00% 70.00% 70.00%
tweet_eval_offensive 70.00% 90.00% 80.00%
customer_support_tickets_en 50.00% 60.00% 55.00%
customer_support_tickets_gorkem 0.00% 0.00% 0.00%
argument_quality_ranking 20.00% 20.00%
rod101_essay_scoring 30.00% 30.00%
or_bench_toxic 50.00% 50.00%
judge_bench 60.00% 60.00%
musr_team_allocation 60.00% 60.00%
musr_object_placements 40.00% 40.00%
musr_murder_mysteries 70.00% 70.00%
halueval_summarization 70.00% 70.00%
code_judge_bench 80.00% 80.00%
mmlu_pro 90.00% 90.00%
gpqa_diamond 90.00% 90.00%
arc_challenge 100.00% 100.00%
mt_bench_human_judgments 90.00% 90.00%
all 59.21% 66.32% 65.38% 63.15%

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-04-19Update dataset card from MOAD metrics summary71873b645.6 KB
    Loading...
  2. 2026-04-19Upload dataseta1f68bb45.5 KB
    Loading...
  3. 2026-04-19Upload dataset350f6c145.5 KB
    Loading...
  4. 2026-04-19Upload datasetbb2639c45.5 KB
    Loading...
  5. 2026-04-19Upload dataset5e542e345.5 KB
    Loading...
  6. 2026-04-19Upload dataset8b26d7d45.5 KB
    Loading...
  7. 2026-04-19Upload datasetdc8979645.5 KB
    Loading...
  8. 2026-04-19Upload dataset424990b45.5 KB
    Loading...
  9. 2026-04-19Upload datasetf6b4ba645.5 KB
    Loading...
  10. 2026-04-19Upload datasetd57c5d745.5 KB
    Loading...
  11. 2026-04-19Upload dataset1f0bc0c45.5 KB
    Loading...
  12. 2026-04-19Upload dataset8584a4e45.5 KB
    Loading...
  13. 2026-04-19Upload dataset26947c245.5 KB
    Loading...
  14. 2026-04-19Upload datasetca672a545.5 KB
    Loading...
  15. 2026-04-19Upload dataset35a0d0945.5 KB
    Loading...
  16. 2026-04-19Upload datasetcb2563245.5 KB
    Loading...
  17. 2026-04-19Upload dataset8bf90c445.5 KB
    Loading...
  18. 2026-04-19Upload dataset0c1885745.5 KB
    Loading...
  19. 2026-04-19Upload dataset926c8b745.5 KB
    Loading...
  20. 2026-04-19Upload dataset0bf67d945.5 KB
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-04-19[bot] Conversion to Parquetopen1 💬#1
    Loading...

Continue on Hugging Face →

Related datasets same stage · heal

argilla/distilabel-intel-orca-dpo-pairs
185.3K dl 185 likes 75.6 MB
distilabel Orca Pairs for DPO The dataset is a "distilabeled" version of the widely used dataset: Intel/orca_dpo_pairs. The ori...
arcee-ai/distilabel-intel-orca-dpo-pairs-binarized
141.3K dl 1 likes 29.5 MB
This is the binarized version of distilabel Orca Pairs for DPO and ORPO. Reference: https://huggingface.co/datasets/argilla/disti...
Intel/orca_dpo_pairs
124.5K dl 332 likes 34.6 MB
The dataset contains 12k examples from Orca style dataset Open-Orca/OpenOrca.
HuggingFaceH4/orca_dpo_pairs
73.3K dl 32 likes 29.4 MB
Dataset Card for Orca DPO Pair Dataset Description This is a pre-processed version of the OpenOrca dataset. The ...
argilla/dpo-mix-7k
60.9K dl 181 likes 23.1 MB
Argilla DPO Mix 7K Dataset A small cocktail combining DPO datasets built by Argilla with distilabel. The goal of this dataset ...
allenai/preference-test-sets
58K dl 29 likes 33.5 MB
Preference Test Sets Very few preference datasets have heldout test sets for validation of reward model accuracy results. In th...
llm-blender/Unified-Feedback
57.5K dl 18 likes 1.8 GB
Collections of pairwise feedback datasets. openai/summarize_from_feedback openai/webgpt_comparisons Dahoas/instruct-synthetic-pro...
mlabonne/orpo-dpo-mix-40k
50.1K dl 314 likes 120.6 MB
ORPO-DPO-mix-40k v1.2 This dataset is designed for ORPO or DPO training. See Fine-tune Llama 3 with ORPO for more information ...

Read further

Community best practices (healing)
4 rules on DPO/ORPO, GSM8K lag, CHES filtering, and what heal does not do.
M4 - Abliterate then heal
Two-stage pipeline. DPO healing recovers benchmarks.
The politics of dataset curation
Whose preferences are baked into the healing mix, and why it matters.
Non-English abliteration communities
The Russian slop-removal framing and non-English healing corpora.

Repository

DIR aes2_essay_scoring 2 files DIR anli_r1 2 files DIR anli_r2 2 files DIR anli_r3 2 files DIR arc_challenge DIR argument_quality_ranking DIR boardgame_qa 2 files DIR chatbot_arena_conversations 2 files DIR civil_comments 2 files DIR code_judge_bench DIR colbert_humor_detection 2 files DIR customer_support_tickets_en 2 files DIR customer_support_tickets_gorkem 2 files DIR dbpedia_easy 2 files DIR dbpedia_hard 2 files DIR dbpedia_medium 2 files DIR go_emotions 2 files DIR gpqa_diamond DIR halueval_dialogue 2 files DIR halueval_qa 2 files DIR halueval_summarization DIR hh_rlhf 2 files DIR judge_bench DIR lex_glue_case_hold 2 files DIR lex_glue_ledgar 2 files DIR medical_abstracts 2 files DIR mfrc 2 files DIR mmlu 2 files DIR mmlu_pro DIR mt_bench_human_judgments DIR musr_murder_mysteries DIR musr_object_placements DIR musr_team_allocation DIR or_bench_80k 2 files DIR or_bench_hard_1k 2 files DIR or_bench_toxic DIR projudgebench 2 files DIR reward_bench_2 2 files DIR rod101_essay_scoring DIR sem_eval_2010_task_8 2 files DIR smollm_corpus 2 files DIR snli 2 files DIR spartqa_mchoice 2 files DIR toxigen_data 2 files DIR tweet_eval_emotion 2 files DIR tweet_eval_hate 2 files DIR tweet_eval_irony 2 files DIR tweet_eval_offensive 2 files DIR tweet_eval_sentiment 2 files DIR ultrafeedback 2 files DIR yelp 2 files FILE .gitattributes FILE README.md

File contents live on Hugging Face. Click a file or folder to open it there.

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python) 
from datasets import load_dataset
ds = load_dataset("tytodd/qwen3.5-4b-v2-instructions-smoke")
Raw snapshot (Python) 
from huggingface_hub import snapshot_download
snapshot_download(repo_id="tytodd/qwen3.5-4b-v2-instructions-smoke", repo_type="dataset")
git clone (requires git-lfs) 
git clone https://huggingface.co/datasets/tytodd/qwen3.5-4b-v2-instructions-smoke
Browse repository on Hugging Face ->
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Get the app Browse the catalog
Open in Abliteration