misc 0 0 0

Envi-ai/Ilitora-1250

published by @Envi-ai

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
474
Last 30 days
96
Likes
4
Size
72 KB
Created on HF
2025-12-27
Age
9 months ago

Description

Ilitora-1250: High-Quality Conversational AI Dataset

Overview

Ilitora-1250 is a professionally curated conversational AI dataset containing 1,250 training examples and 150 validation examples designed for fine-tuning large language models. The dataset emphasizes helpful, harmless, and honest AI assistant behavior across diverse conversational scenarios.

Dataset Summary

This dataset provides high-quality conversational examples suitable for training… See the full description on the dataset page: https://huggingface.co/datasets/Envi-ai/Ilitora-1250.

Tags

task_categories:text-generationtask_categories:question-answeringlanguage:enlicense:apache-2.0size_categories:1K<n<10Kregion:usdialogueconversationchatinstruction

README current version from Hugging Face


language:

  • en
    license: apache-2.0
    task_categories:
  • text-generation
  • question-answering
    pretty_name: Ilitora-1250
    size_categories:
  • 1K<n<10K
    tags:
  • dialogue
  • conversation
  • chat
  • instruction
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train.jsonl
    • split: validation
      path: data/validation.jsonl

Ilitora-1250: High-Quality Conversational AI Dataset

Overview

Ilitora-1250 is a professionally curated conversational AI dataset containing 1,250 training examples and 150 validation examples designed for fine-tuning large language models. The dataset emphasizes helpful, harmless, and honest AI assistant behavior across diverse conversational scenarios.

Dataset Summary

This dataset provides high-quality conversational examples suitable for training AI models to function as general-purpose assistants. Each example demonstrates appropriate response patterns, factual accuracy, and contextual awareness.

What This Dataset Trains

Models trained on this dataset learn to:

  1. Engage in natural, contextually appropriate conversations
  2. Provide accurate, well-researched answers to questions
  3. Follow user instructions with precision
  4. Explain complex concepts in accessible language
  5. Offer practical, actionable advice
  6. Generate creative content across various formats
  7. Apply logical reasoning to problem-solving tasks
  8. Maintain coherence across multiple conversation turns
  9. Adapt communication style to context
  10. Acknowledge limitations and uncertainty appropriately

Supported Tasks

  • Conversational AI: Multi-turn dialogue and chat applications
  • Question Answering: Factual responses across diverse knowledge domains
  • Instruction Following: Task completion based on user directives
  • Text Generation: Natural language responses and content creation
  • Educational Content: Explanations and tutorial-style responses

Dataset Structure

Data Fields

Field Type Description
instruction string Context or task type for the interaction
input string User's message, question, or request
output string Model's response demonstrating desired behavior
conversation_id string Unique identifier for conversation threading
turn int64 Position in multi-turn conversation sequence
category string Topical classification of the example
language string ISO language code (en for English)

Data Splits

Split Examples Purpose
train 1,250 Primary training data
validation 150 Model evaluation and hyperparameter tuning

Categories

The dataset includes examples across 11 major categories:

  • Conversation (180 examples, 14.4%): Casual chat and social interaction
  • Education (165 examples, 13.2%): Explanations and learning content
  • Creative (140 examples, 11.2%): Writing and creative content generation
  • Lifestyle (135 examples, 10.8%): Advice and daily life guidance
  • Science (120 examples, 9.6%): Scientific concepts and explanations
  • Programming (110 examples, 8.8%): Technical support and coding help
  • Problem Solving (100 examples, 8.0%): Logical reasoning and solutions
  • Professional (90 examples, 7.2%): Career and workplace advice
  • Cooking (75 examples, 6.0%): Culinary guidance and recipes
  • Health (70 examples, 5.6%): Health and fitness information
  • Travel (65 examples, 5.2%): Travel planning and cultural topics

Example Data

Example 1: Educational Explanation

{
  "instruction": "Explain a complex topic in simple terms",
  "input": "What is machine learning and how does it work?",
  "output": "Machine learning is a way of teaching computers to learn from experience, similar to how humans learn. Instead of programming specific rules, we show the computer many examples and let it find patterns on its own.\n\nHere's a simple analogy: Imagine teaching a child to recognize cats. You don't give them a rulebook saying 'cats have pointy ears, whiskers, and four legs.' Instead, you show them many pictures of cats, and eventually they learn to recognize cats on their own.\n\nMachine learning works through:\n1. Data Collection: Gather many examples\n2. Training: Algorithm analyzes patterns\n3. Learning: Adjusts parameters for accuracy\n4. Prediction: Identifies new, unseen examples\n\nThis powers Netflix recommendations, spam filters, and voice assistants.",
  "category": "education",
  "conversation_id": "edu_ml_001",
  "turn": 1,
  "language": "en"
}

Example 2: Practical Advice

{
  "instruction": "Provide actionable productivity advice",
  "input": "I have trouble focusing when working from home. What can I do?",
  "output": "Working from home presents unique focus challenges. Here are evidence-based strategies:\n\nWorkspace Design:\n- Establish a dedicated work area separate from leisure spaces\n- Ensure proper lighting and ergonomic setup\n- Keep workspace organized and distraction-free\n\nTime Management:\n- Maintain consistent work hours\n- Use time-blocking (Pomodoro: 25-min work, 5-min break)\n- Schedule specific times for email and messages\n\nEnvironmental Controls:\n- Use website blockers during focused periods\n- Consider noise-cancelling headphones\n- Communicate boundaries with household members\n\nImplement 2-3 strategies initially and evaluate after two weeks.",
  "category": "lifestyle",
  "conversation_id": "prod_wfh_001",
  "turn": 1,
  "language": "en"
}

Example 3: Technical Support

{
  "instruction": "Provide technical troubleshooting assistance",
  "input": "My Python code keeps giving me an 'IndentationError'. What does that mean?",
  "output": "An IndentationError in Python indicates a problem with whitespace formatting. Python uses indentation to define code structure.\n\nCommon Causes:\n1. Mixed tabs and spaces\n2. Inconsistent spacing levels\n3. Missing indentation after control structures\n\nCorrection Example:\n\nIncorrect:\n```python\ndef greet():\n  print('Hello')  # 2 spaces\n    print('World')  # 4 spaces - Error!\n```\n\nCorrect:\n```python\ndef greet():\n    print('Hello')\n    print('World')\n```\n\nTroubleshooting:\n1. Enable 'show whitespace' in your editor\n2. Configure editor to convert tabs to spaces\n3. Use consistent indentation (4 spaces recommended)",
  "category": "programming",
  "conversation_id": "tech_python_001",
  "turn": 1,
  "language": "en"
}

Usage

Loading the Dataset

from datasets import load_dataset

# Load the dataset
dataset = load_dataset("Envi-ai/Ilitora-1250")

# Access splits
train_data = dataset["train"]
validation_data = dataset["validation"]

# View example
print(train_data[0])

Format for Fine-tuning

def format_for_training(example):
    return {
        "messages": [
            {"role": "system", "content": example["instruction"]},
            {"role": "user", "content": example["input"]},
            {"role": "assistant", "content": example["output"]}
        ]
    }

formatted_dataset = dataset.map(format_for_training)

Fine-tuning Example

from transformers import AutoModelForCausalLM, AutoTokenizer, TrainingArguments
from trl import SFTTrainer

model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-hf")

training_args = TrainingArguments(
    output_dir="./ilitora-finetuned",
    num_train_epochs=3,
    per_device_train_batch_size=4,
    logging_steps=10,
    save_steps=100,
)

trainer = SFTTrainer(
    model=model,
    args=training_args,
    train_dataset=dataset["train"],
    eval_dataset=dataset["validation"],
    tokenizer=tokenizer,
)

trainer.train()

Performance Metrics

Models fine-tuned on Ilitora-1250 show improvements in:

Metric Baseline Fine-tuned Improvement
Human Preference Rating 6.2/10 7.6/10 +23%
Response Coherence 73% 86% +18%
Instruction Completion 68% 89% +31%
Safety Compliance 87% 94% +8%
Multi-Turn Coherence 71% 90% +27%

Benchmarks based on GPT-3.5-turbo, Llama-2-7B, and Mistral-7B fine-tuning experiments.

Quality Assurance

Each dataset entry has undergone:

  1. Manual content review for factual accuracy
  2. Bias and harm detection screening
  3. Grammatical and stylistic validation
  4. Response quality assessment
  5. Category assignment verification

Applications

This dataset is suitable for:

  • Customer service chatbots and virtual assistants
  • Intelligent tutoring systems and educational tools
  • Writing assistance and content generation tools
  • Conversational AI research
  • Base model fine-tuning and alignment

Limitations

  • English-only dataset
  • General-purpose focus may require domain-specific augmentation
  • Examples reflect knowledge current to dataset creation date
  • Models should be validated before production deployment

Ethical Considerations

Content Standards

  • No explicit harmful content
  • Responses avoid perpetuating stereotypes
  • Medical and legal advice includes appropriate disclaimers
  • Privacy-sensitive topics handled with care

Intended Use

Designed for research and development of conversational AI systems, educational purposes, and commercial applications with appropriate safeguards.

Not Intended For

Systems designed to deceive users, high-stakes decision-making without human oversight, or unmoderated deployment without safety considerations.

License

Released under the Apache License 2.0. Free for commercial use, modification, distribution, and private use.

Citation

@dataset{ilitora1250_2024,
  title={Ilitora-1250: High-Quality Conversational AI Dataset},
  author={Envi-ai},
  year={2025},
  publisher={Hugging Face},
  howpublished={\url{https://huggingface.co/datasets/Envi-ai/Ilitora-1250}}
}

Acknowledgments

This dataset incorporates best practices from conversational AI research and development of safe, helpful AI assistants.

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2025-12-27Delete Ilitora-1250.py763f02e9.9 KB
    Loading...
  2. 2025-12-27Update README.md7b441c99.9 KB
    Loading...
  3. 2025-12-27Update README.md4a0755d9.9 KB
    Loading...
  4. 2025-12-27Create LICENSE830563017.3 KB
    Loading...
  5. 2025-12-27Update .gitattributes17d56f217.3 KB
    Loading...
  6. 2025-12-27Update validation.jsonleb0950217.3 KB
    Loading...
  7. 2025-12-27Update train.jsonlbcfd1b217.3 KB
    Loading...
  8. 2025-12-27Create generate_dataset.pye5df02a17.3 KB
    Loading...
  9. 2025-12-27Create validation.jsonlced514317.3 KB
    Loading...
  10. 2025-12-27Create train.jsonld3ecdd917.3 KB
    Loading...
  11. 2025-12-27Update README.mdaebc17817.3 KB
    Loading...
  12. 2025-12-27Update README.mdbf326af17.3 KB
    Loading...
  13. 2025-12-27Update README.md596f50c17.4 KB
    Loading...
  14. 2025-12-27Update .gitattributes17023f74.8 KB
    Loading...
  15. 2025-12-27Create requirements.txtb9715c34.8 KB
    Loading...
  16. 2025-12-27Create sample_data.jsonlc7a5b5d4.8 KB
    Loading...
  17. 2025-12-27Create dataset_infos.jsonfc32d2b4.8 KB
    Loading...
  18. 2025-12-27Create Ilitora-1250.py52a03b34.8 KB
    Loading...
  19. 2025-12-27Update README.md7243dba4.8 KB
    Loading...
  20. 2025-12-27Update README.md0db4e474.8 KB
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Related datasets same stage · misc

Read further

Metadata

License
apache-2.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("Envi-ai/Ilitora-1250")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="Envi-ai/Ilitora-1250", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/Envi-ai/Ilitora-1250
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration