datasets:

• mlabonne/orpo-dpo-mix-40k
  license: other
  tags:
• dpo
• mlx
  model-index:
• name: Daredevil-8B-abliterated-dpomix
  results:
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: AI2 Reasoning Challenge (25-Shot)
    type: ai2_arc
    config: ARC-Challenge
    split: test
    args:
    num_few_shot: 25
    
    metrics:
    • type: acc_norm
      value: 69.28
      name: normalized accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: HellaSwag (10-Shot)
    type: hellaswag
    split: validation
    args:
    num_few_shot: 10
    
    metrics:
    • type: acc_norm
      value: 85.05
      name: normalized accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: MMLU (5-Shot)
    type: cais/mmlu
    config: all
    split: test
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 69.1
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: TruthfulQA (0-shot)
    type: truthful_qa
    config: multiple_choice
    split: validation
    args:
    num_few_shot: 0
    
    metrics:
    • type: mc2
      value: 60.0
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: Winogrande (5-shot)
    type: winogrande
    config: winogrande_xl
    split: validation
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 78.69
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: GSM8k (5-shot)
    type: gsm8k
    config: main
    split: test
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 71.8
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard

mlx-community/NeuralDaredevil-8B-abliterated-4bit

The Model mlx-community/NeuralDaredevil-8B-abliterated-4bit was converted to MLX format from mlabonne/NeuralDaredevil-8B-abliterated using mlx-lm version 0.16.0.

Use with mlx

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/NeuralDaredevil-8B-abliterated-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)