fine-tune 0 0 0

jtatman/orca_mini_uncensored_squad_format_train

published by @jtatman

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
610
Last 30 days
12
Likes
1
Size
62.3 MB
Created on HF
2023-08-30
Age
3 years ago

Description

Dataset Card for "orca_mini_uncensored_squad_format_train"

Dataset Description

Mostly purely an exercise in data extraction and formatting for dataset usage, and cross-model usage of data.

Uncensored data, because when everything is sanitized for alignment, the data may be "pure" but is no longer untimately realistic.

Part of an effort to create more question-answering friendly datasets that can be used for specialized domain training on small models.… See the full description on the dataset page: https://huggingface.co/datasets/jtatman/orca_mini_uncensored_squad_format_train.

Tags

task_categories:question-answeringlanguage:enlicense:mitsize_categories:10K<n<100Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face


language:

  • en
    license: mit
    size_categories:
  • 10K<n<100K
    task_categories:
  • question-answering
    pretty_name: orca_mini_squad
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train-*
    • split: test
      path: data/test-*
      dataset_info:
      features:
    • name: id
      dtype: string
    • name: title
      dtype: string
    • name: context
      dtype: string
    • name: question
      dtype: string
    • name: answers
      struct:
      • name: answer_start
        dtype: int64
      • name: text
        dtype: string
        splits:
    • name: train
      num_bytes: 118261864.35315199
      num_examples: 67300
    • name: test
      num_bytes: 13140597.646848004
      num_examples: 7478
      download_size: 65276229
      dataset_size: 131402462.0

Dataset Card for "orca_mini_uncensored_squad_format_train"

Dataset Description

Mostly purely an exercise in data extraction and formatting for dataset usage, and cross-model usage of data.

Uncensored data, because when everything is sanitized for alignment, the data may be "pure" but is no longer untimately realistic.

Part of an effort to create more question-answering friendly datasets that can be used for specialized domain training on small models.

Dataset Summary

This is a "squad reformat" of an existing dataset located here: https://huggingface.co/datasets/julep-ai/orca_mini_uncensored

This could be swapped for squad format datasets for typical question-answering tasks with uncensored data from a partial pull of the mini-orca dataset here: psmathur/orca_minis_uncensored_dataset

Supported Tasks and Leaderboards

  • 'question-answering'

Languages

The BCP-47 code for English as generally spoken in the United States is en-US and the BCP-47 code for English as generally spoken in the United Kingdom is en-GB. It is unknown if other varieties of English are represented in the data.

Dataset Structure

Train and Test splits included

Data Format

As in the squadv2 dataset, columns are: "id", "title", "context", "question", "answers": "text", "answer_start"

README history 10 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2023-09-05Upload README.md with huggingface_hubf8c963c2 KB
    Loading...
  2. 2023-09-05Delete data/test-00000-of-00001-cbbb33eac228efc9.parquet with huggingface_hub94c2b1b2 KB
    Loading...
  3. 2023-09-05Upload data/test-00000-of-00001-32437cfd22304517.parquet with huggingface_hub804ca2d2 KB
    Loading...
  4. 2023-09-05Delete data/train-00000-of-00001-9c1d47deb82d7586.parquet with huggingface_huba220fd02 KB
    Loading...
  5. 2023-09-05Upload data/train-00000-of-00001-f27fa26f07fbeac2.parquet with huggingface_hubd03b2ca2 KB
    Loading...
  6. 2023-08-30Initial Dataset Card Update10682c82 KB
    Loading...
  7. 2023-08-30Upload README.md with huggingface_hub8fba24f808 B
    Loading...
  8. 2023-08-30Upload data/test-00000-of-00001-cbbb33eac228efc9.parquet with huggingface_hubea2e61b0 B
    Loading...
  9. 2023-08-30Upload data/train-00000-of-00001-9c1d47deb82d7586.parquet with huggingface_hubd5f73910 B
    Loading...
  10. 2023-08-30initial commit7f13cc90 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · fine-tune

Read further

Metadata

License
mit

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("jtatman/orca_mini_uncensored_squad_format_train")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="jtatman/orca_mini_uncensored_squad_format_train", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/jtatman/orca_mini_uncensored_squad_format_train
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration