fine-tune 0 0 0

kaushik-harsh-99/Uncensored-SFT-v1

published by @kaushik-harsh-99

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
652
Last 30 days
109
Likes
4
Size
1.1 GB
Created on HF
2026-05-07
Age
5 months ago

Description

Dataset Creation Process

This dataset was not scraped from a single source.

Instead, it was built through a large multi-stage curation and cleaning pipeline involving many open instruction datasets available on Hugging Face.

The entire dataset was normalized into a unified:

{

"input": "...",

"output": "..."

}

format.

Data Collection

A large number of public instruction datasets were downloaded from Hugging Face.

These datasets included:… See the full description on the dataset page: https://huggingface.co/datasets/kaushik-harsh-99/Uncensored-SFT-v1.

Tags

task_categories:text-generationtask_categories:question-answeringlanguage:enlicense:mitsize_categories:100K<n<1Mformat:jsonmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:usuncensoreduncensored-llmjailbreakanti-censorshipalignmentdealignedinstruction-followinginstruction-tuningsupervised-fine-tuningsftconversationalchatbotroleplayassistantsynthetic-dataopen-domainenglish-onlydeduplicatedcleaned-datasetllm-trainingfinetuningquestion-answeringtext-generation

README current version from Hugging Face


language:

  • en

license: mit

tags:

  • uncensored
  • uncensored-llm
  • jailbreak
  • anti-censorship
  • alignment
  • dealigned
  • instruction-following
  • instruction-tuning
  • supervised-fine-tuning
  • sft
  • conversational
  • chatbot
  • roleplay
  • assistant
  • synthetic-data
  • open-domain
  • english-only
  • deduplicated
  • cleaned-dataset
  • llm-training
  • finetuning
  • question-answering
  • text-generation

task_categories:

  • text-generation
  • question-answering

size_categories:

  • 100K<n<1M

pretty_name: High Quality Uncensored Instruction Dataset

Dataset Creation Process

This dataset was not scraped from a single source.

Instead, it was built through a large multi-stage curation and cleaning pipeline involving many open instruction datasets available on Hugging Face.

The entire dataset was normalized into a unified:

{
  "input": "...",
  "output": "..."
}

format.


Data Collection

A large number of public instruction datasets were downloaded from Hugging Face.

These datasets included:

  • Instruction-following datasets
  • Chat datasets
  • QA datasets
  • Roleplay datasets
  • Coding datasets
  • General assistant conversations
  • Uncensored datasets
  • Open conversational corpora

Many datasets originally existed in different formats such as:

  • Alpaca format
  • ShareGPT format
  • ChatML format
  • Message-based structures
  • Instruction/input/output triples
  • Raw JSONL
  • Arrow datasets

All datasets were converted into a single standardized schema.


Dataset Processing Pipeline

1. Format Normalization

All datasets were normalized into a common structure:

{
  "input": "...",
  "output": "..."
}

This involved:

  • Removing system prompts
  • Removing metadata
  • Flattening multi-message chat structures
  • Extracting user-assistant pairs
  • Converting multiple schemas into one consistent format

2. OCR and Junk Cleaning

Basic OCR and text corruption cleaning was performed.

This included removal of:

  • Broken Unicode characters
  • OCR artifacts
  • Repeated symbol junk
  • Corrupted whitespace
  • Encoding issues
  • Extremely malformed rows
  • Random garbage strings

The cleaning pipeline was intentionally conservative to avoid damaging useful training data.


3. English-Only Filtering

The dataset was aggressively filtered to retain only English samples.

This involved:

  • Unicode script detection
  • Language detection
  • Removal of multilingual rows
  • Removal of non-English scripts

Languages/scripts filtered included:

  • Chinese
  • Japanese
  • Korean
  • Hindi
  • Arabic
  • Russian/Cyrillic
  • Bengali
  • Tamil
  • Telugu
  • Gujarati
  • Punjabi
  • Hebrew
  • Greek
  • Thai
  • Burmese
  • Tibetan
  • and many others

Only high-confidence English samples were retained.


4. Exact Deduplication

Exact duplicate rows were removed.

This step eliminated:

  • Repeated instruction-response pairs
  • Re-uploaded datasets
  • Duplicate synthetic generations
  • Mirrored samples

This significantly reduced redundancy and improved information density.


5. Question Deduplication

Many open instruction datasets contain repeated or near-identical questions with different responses.

The dataset was deduplicated at the question level using normalized input matching.

Examples:

What is AI?
what is ai
What is AI!!!

These were treated as identical questions.


6. Best Response Selection

When multiple responses existed for the same question, the pipeline retained the highest-quality candidate.

Selection criteria included:

  • Response length
  • Information density
  • Completeness
  • Reduced redundancy
  • Better formatting

The longest and most informative response was generally retained.


7. Low-Quality Filtering

Additional filtering was performed to remove:

  • Extremely short responses
  • Empty outputs
  • Corrupted samples
  • Low-information generations
  • Formatting failures
  • Broken rows

This improved overall dataset quality and reduced noisy supervision.


Final Dataset Statistics

Statistic Value
Final Rows ~721,000
Language English
Format JSONL
Schema input/output
Type Instruction-following
Primary Use SFT / Instruction Tuning

Example Format

{
  "input": "Explain what a black hole is.",
  "output": "A black hole is a region of spacetime where gravity is so strong that nothing, including light, can escape from it..."
}

Intended Use

This dataset is intended for:

  • Supervised fine-tuning
  • Instruction tuning
  • Chat model training
  • Alignment experimentation
  • Uncensored assistant research
  • Synthetic data experiments
  • Small model capability improvement

Potential applications:

  • LLaMA fine-tuning
  • Mistral fine-tuning
  • Qwen fine-tuning
  • Gemma fine-tuning
  • Distillation
  • Reasoning experiments
  • Alignment studies

Recommended Training Usage

Recommended for:

  • QLoRA
  • Full fine-tuning
  • Continued pretraining
  • Distillation
  • SFT
  • Alignment tuning

Works particularly well for:

  • Smaller models
  • Instruction-following recovery
  • Reducing over-refusal behavior
  • Increasing response completeness

File Structure

train.jsonl

Each line is a standalone JSON object.


Acknowledgements

Thanks to the open-source AI community and all original dataset contributors on Hugging Face whose datasets made this aggregation possible.


README history 4 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-05-07Update README.md5c237935.2 KB
    Loading...
  2. 2026-05-07Update README.md0d04c7d5.2 KB
    Loading...
  3. 2026-05-07Upload train.jsonl995569824 B
    Loading...
  4. 2026-05-07initial commit53d443824 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-05-08[bot] Conversion to Parquetopen1 💬#1
    Loading...

Related datasets same stage · fine-tune

Read further

Metadata

License
mit

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("kaushik-harsh-99/Uncensored-SFT-v1")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="kaushik-harsh-99/Uncensored-SFT-v1", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/kaushik-harsh-99/Uncensored-SFT-v1
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration