size_categories:
- 1K<n<10K
license: apache-2.0
task_categories: - text-generation
language: - en
This dataset has been used to create the first Josiefied beta version. This can be used directly within MLX-LM-LoRA.
Models used Qwen3-4B-4bit as the base (rejected) parts and Qwen3-30B-bf16 as the teacher (chosen) parts.
Usage MLX-LM-LoRA
mlx_lm_lora.train \
--model Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v1 \
--train \
--data mlx-community/Josiefied-Qwen3-dpo-v1-flat \
--epochs 1 \
--batch-size 1 \
--num-layers 1 \
--val-batches 1 \
--steps-per-report 1 \
--adapter-path path/to/adapters \
--max-seq-length 1024 \
--grad-checkpoint \
--train-type lora \
--optimizer adamw \
--train-mode dpo \
--dpo-cpo-loss-type sigmoid \
--beta 0.1 \
--steps-per-eval 50