license: odc-by
task_categories:
- text-generation
language: - en
size_categories: - 100K<n<1M
Flat version of AllenAI's Dolci-Think-DPO-32B.
Train set size: 199840
Valid set size: 160
MLX-LM-LoRA
mlx_lm_lora.train \
--model Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v1 \
--train \
--data mlx-community/Dolci-Think-DPO-32B-Flat \
--epochs 1 \
--batch-size 1 \
--num-layers 1 \
--val-batches 1 \
--steps-per-report 1 \
--adapter-path path/to/adapters \
--max-seq-length 1024 \
--grad-checkpoint \
--train-type lora \
--optimizer adamw \
--train-mode dpo \
--dpo-cpo-loss-type sigmoid \
--beta 0.1 \
--steps-per-eval 50