tensorblock/NeuralDaredevil-8B-abliterated-GGUF

license: llama3
tags:

• dpo
• TensorBlock
• GGUF
  datasets:
• mlabonne/orpo-dpo-mix-40k
  base_model: mlabonne/NeuralDaredevil-8B-abliterated
  model-index:
• name: Daredevil-8B-abliterated-dpomix
  results:
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: AI2 Reasoning Challenge (25-Shot)
    type: ai2_arc
    config: ARC-Challenge
    split: test
    args:
    num_few_shot: 25
    
    metrics:
    • type: acc_norm
      value: 69.28
      name: normalized accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: HellaSwag (10-Shot)
    type: hellaswag
    split: validation
    args:
    num_few_shot: 10
    
    metrics:
    • type: acc_norm
      value: 85.05
      name: normalized accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: MMLU (5-Shot)
    type: cais/mmlu
    config: all
    split: test
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 69.1
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: TruthfulQA (0-shot)
    type: truthful_qa
    config: multiple_choice
    split: validation
    args:
    num_few_shot: 0
    
    metrics:
    • type: mc2
      value: 60
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: Winogrande (5-shot)
    type: winogrande
    config: winogrande_xl
    split: validation
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 78.69
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard
  • task:
    type: text-generation
    name: Text Generation
    dataset:
    name: GSM8k (5-shot)
    type: gsm8k
    config: main
    split: test
    args:
    num_few_shot: 5
    
    metrics:
    • type: acc
      value: 71.8
      name: accuracy
      source:
      url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=mlabonne/Daredevil-8B-abliterated-dpomix
      name: Open LLM Leaderboard

mlabonne/NeuralDaredevil-8B-abliterated - GGUF

This repo contains GGUF format model files for mlabonne/NeuralDaredevil-8B-abliterated.

The files were quantized using machines provided by TensorBlock, and they are compatible with llama.cpp as of commit b4011.

Our projects

Forge
An OpenAI-compatible multi-provider routing layer.
🚀 Try it now! 🚀
Awesome MCP Servers	TensorBlock Studio
A comprehensive collection of Model Context Protocol (MCP) servers.	A lightweight, open, and extensible multi-LLM interaction studio.
👀 See what we built 👀	👀 See what we built 👀

<|begin_of_text|><|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>

{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Model file specification

Downloading instruction

Command line

Firstly, install Huggingface Client

pip install -U "huggingface_hub[cli]"

Then, downoad the individual model file the a local directory

huggingface-cli download tensorblock/NeuralDaredevil-8B-abliterated-GGUF --include "NeuralDaredevil-8B-abliterated-Q2_K.gguf" --local-dir MY_LOCAL_DIR

If you wanna download multiple model files with a pattern (e.g., *Q4_K*gguf), you can try:

huggingface-cli download tensorblock/NeuralDaredevil-8B-abliterated-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'