misc 0 0 0

Isotonic/open-instruct-v1

published by @Isotonic

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
1.1K
Last 30 days
29
Likes
1
Size
352.8 MB
Created on HF
2023-04-11
Age
3 years ago

Description

Dataset Card for "open-instruct-v1"

Open Instruct V1 is an amalgamation of different datasets which are cleaned and then collated into a singular format for training.

Uses Stability AI's System Prompt.

### System: StableLM Tuned (Alpha version)

- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.

- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.

- StableLM is… See the full description on the dataset page: https://huggingface.co/datasets/Isotonic/open-instruct-v1.

Tags

task_categories:text-generationlanguage:ensize_categories:100K<n<1Mformat:parquetmodality:textlibrary:datasetslibrary:dasklibrary:mlcroissantlibrary:polarsregion:us

README current version from Hugging Face


dataset_info:
features:

  • name: instruction
    dtype: string
  • name: input
    dtype: string
  • name: output
    dtype: string
  • name: text
    dtype: string
    splits:
  • name: train
    num_bytes: 693502500.8465096
    num_examples: 399050
  • name: test
    num_bytes: 173376494.1534904
    num_examples: 99763
    download_size: 369952246
    dataset_size: 866878995.0
    task_categories:
  • text-generation
  • conversational
    language:
  • en
    size_categories:
  • 100K<n<1M

Dataset Card for "open-instruct-v1"

Open Instruct V1 is an amalgamation of different datasets which are cleaned and then collated into a singular format for training.
Uses Stability AI's System Prompt.

### System: StableLM Tuned (Alpha version)
- StableLM is a helpful and harmless open-source AI language model developed by StabilityAI.
- StableLM is excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.
- StableLM is more than just an information source, StableLM is also able to write poetry, short stories, and make jokes.
- StableLM will refuse to participate in anything that could harm a human.

Dataset Breakdown

Dataset Amount of Samples
Alpaca 51759
Self Instruct 82599
GPT-4 Instruct 18194
Code Alpaca 18019
Dolly 15015
Synthetic 33143
Roleplay 3146
asss 448
instruction-dataset 327
Human assistant deduped 209350
Total 432000

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2023-08-31Update README.md9699af82.1 KB
    Loading...
  2. 2023-04-26Update README.mdff44e1b2 KB
    Loading...
  3. 2023-04-23Upload README.md with huggingface_hub7ffb8fc1.5 KB
    Loading...
  4. 2023-04-23Delete data/test-00000-of-00001-f0f6a1b6160a12c2.parquet with huggingface_hubd3b0fb41.5 KB
    Loading...
  5. 2023-04-23Upload data/test-00000-of-00001-da5fd2ec8f505dca.parquet with huggingface_hub79935331.5 KB
    Loading...
  6. 2023-04-23Delete data/train-00000-of-00001-be50062ac6f2361a.parquet with huggingface_hub0c20b5d1.5 KB
    Loading...
  7. 2023-04-23Upload data/train-00001-of-00002-242e0ff6dc456d3b.parquet with huggingface_hub2e12c401.5 KB
    Loading...
  8. 2023-04-23Upload data/train-00000-of-00002-93cb29e49aec4d58.parquet with huggingface_hube3f873d1.5 KB
    Loading...
  9. 2023-04-18Update README.md78384e01.5 KB
    Loading...
  10. 2023-04-17Update README.md2ebaaac1.4 KB
    Loading...
  11. 2023-04-17Update README.mda28234b1.5 KB
    Loading...
  12. 2023-04-12Upload README.md with huggingface_hub833172d545 B
    Loading...
  13. 2023-04-12Upload data/test-00000-of-00001-f0f6a1b6160a12c2.parquet with huggingface_hubb0f3b90475 B
    Loading...
  14. 2023-04-12Delete data/train-00001-of-00002-27eb220e6b4e1127.parquet with huggingface_hubb466306475 B
    Loading...
  15. 2023-04-12Delete data/train-00000-of-00002-d0d10b90c59cb8a9.parquet with huggingface_hub229c91f475 B
    Loading...
  16. 2023-04-12Upload data/train-00000-of-00001-be50062ac6f2361a.parquet with huggingface_hubc59ffa1475 B
    Loading...
  17. 2023-04-11Upload README.md with huggingface_hub3a1c304475 B
    Loading...
  18. 2023-04-11Upload data/train-00001-of-00002-27eb220e6b4e1127.parquet with huggingface_hubf911c870 B
    Loading...
  19. 2023-04-11Upload data/train-00000-of-00002-d0d10b90c59cb8a9.parquet with huggingface_hub2c76e150 B
    Loading...
  20. 2023-04-11initial commitdbf9da90 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · misc

Read further

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("Isotonic/open-instruct-v1")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="Isotonic/open-instruct-v1", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/Isotonic/open-instruct-v1
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration