ablate 0 0 0

hotdogs/sme-sft-docdata-qwen38

published by @hotdogs

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
215
Last 30 days
70
Likes
-
Size
45.6 MB
Created on HF
2026-08-20
Age
2 months ago

Description

SME-SFT-DocData (Qwen3.8-27B Native) — v2.0 production (9,342)

Agentic document + data management SFT dataset for Qwen3.8-27B

(abliterated or base). Teaches the model to manage business documents and data

for small and medium enterprises: search a document corpus, read and summarize

docs, browse folders, and run real aggregations / filters / stats over CSV tables —

then ground every answer in what the tool actually returned. Companion to

hotdogs/cyber-sft-agent-qwen38 (the… See the full description on the dataset page: https://huggingface.co/datasets/hotdogs/sme-sft-docdata-qwen38.

Tags

language:enlicense:apache-2.0size_categories:1K<n<10Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:ussmebusiness-operationsdocument-managementdata-managementinstruction-tuningsftqwen3.8reasoningthinking-modelagentictool-calling

README current version from Hugging Face


license: apache-2.0
language: [en]
size_categories: [1K<n<10K]
tags: [sme, business-operations, document-management, data-management,
instruction-tuning, sft, qwen3.8, reasoning, thinking-model, agentic, tool-calling]
pretty_name: SME-SFT-DocData (Qwen3.8-27B)

SME-SFT-DocData (Qwen3.8-27B Native) — v2.0 production (9,342)

Agentic document + data management SFT dataset for Qwen3.8-27B
(abliterated or base). Teaches the model to manage business documents and data
for small and medium enterprises
: search a document corpus, read and summarize
docs, browse folders, and run real aggregations / filters / stats over CSV tables —
then ground every answer in what the tool actually returned. Companion to
hotdogs/cyber-sft-agent-qwen38 (the security tool layer); this v2.0 adds
RAG rows (passive retrieval) and advanced rows (error recovery, multi-doc
synthesis, temporal reasoning, conflict resolution) for production-grade robustness.

v2.0 composition

  • 9,342 rows — train 7,799 / valid 1,028 / test 515 (stratified)
  • 2,520 tool rows — 11 tools, 16 chain archetypes, every tool output computed from a deterministic per-seed world (a fictional SME's real folder tree + CSVs) so the evidence is consistent, not hallucinated
  • 5,880 QA rows — pure document/data-management QA across 5 families (define / process / why / compare / situation), parameterized over 6 SME industries
  • 192 RAG rows — passive retrieval: context provided inline (no tool calls), teaches model to reason from retrieved context directly
  • 750 advanced rows — error recovery (200), multi-doc synthesis (300), temporal reasoning (150), conflict resolution (100)

11 tools

doc_search · doc_read · doc_sections · doc_summarize · doc_metadata · folder_list · csv_head · csv_aggregate · csv_filter · csv_stats · doc_compare

Document tools: doc_search, doc_read, doc_sections, doc_summarize, doc_metadata, folder_list.
Data tools: csv_head, csv_aggregate, csv_filter, csv_stats. Cross-doc: doc_compare.

Chain archetypes (2,520 tool rows)

chain rows
single-search 173
single-read 170
single-aggregate 189
single-filter 186
D1-search-read 184
D2-search-summarize 121
D3-head-aggregate 172
D4-filter-stats 189
D5-folder-metadata 156
D6-sections-read 197
D7-aggregate-compare 195
D8-compare 178
D9-cross-check 109
N1-search-empty 9
N2-filter-empty 114
N3-read-gap 178
  • Single-tool — one well-chosen call for a focused ask (find a doc, read it, roll up a column, filter a table).
  • D1-D9 multi-tool — the real SME workflows: search→read, search→summarize, head→aggregate, filter→stats, folder→metadata, sections→read, two-aggregate compare, doc compare, and D9 cross-check (a report makes a claim; the model verifies it against the raw CSV and says whether they agree).
  • N1-N3 negative evidence — anti-hallucination: an honest "not found" (N1), an empty filter that is correct because the threshold is above the max (N2), and a doc that exists but doesn't answer the question (N3).

Quality gates (all passing)

gate value target status
rows 9,342 — —
tool-calling rows 2,520 (27.0%) — ✅
RAG rows (passive retrieval) 192 (2.0%) >0 ✅
advanced rows (err/multi/temporal/conflict) 750 (8.0%) >0 ✅
QA rows 5,880 (62.9%) — ✅
multi-turn chains (≥2 calls) 52.5% ≥10% ✅
think-tag coverage 100.0% 100% ✅
tool coverage 100.0% (11/11 tools) 100% ✅
evidence chain (anti-boilerplate) 82.7% ≥60% ✅
duplicate rows 0.0% <1% ✅
literal-\n in text 0.0% <5% ✅
negative-evidence rows 11.9% of tool (301) >0 ✅
distractor-palette rows 41.7% of tool (1051) ~38% ✅
token length p50 / p95 / max 273 / 1,343 / 3,729 <4,096 ✅

Byte-exact: all 9,342 rows re-render through the real Qwen3.8-27B chat
template and verified 9,342/9,342 = 100.0%, 0 render errors.
Token length measured with the real tokenizer (Qwen/Qwen3.5-0.8B (vocab 248044)).

Format (the important part)

Rendered through the real Qwen3.8-27B template and verified byte-exact.
Format facts (verified via byte ordinals):

fact value
Role tokens ASCII: |im_start| / |im_end| wrapped in <>
think OPEN think — 7 chars, NO slash
think CLOSE think/ — 8 chars, HAS slash (asymmetric, don't normalize)
tool call XML: tool_call + function=NAME + parameter=KEY (value on its own line)
tool result role tool → rendered under a user wrapper + tool_response
arguments a dict (template iterates .items()), non-null params in a fixed per-tool order

Row schema

  • id — stable row id
  • kind — tool (agentic chain), qa (pure QA), rag (passive retrieval), error_recovery, multi_doc, temporal, conflict
  • tags — e.g. search, data, aggregate, multi, negative, qa, rag, error, temporal
  • tools — function schemas exposed to the model (used tools + optional distractors; empty for RAG/advanced rows)
  • messages — template-native list, roles system/user/assistant/tool; thinking in reasoning_content, calls in tool_calls: [{name, arguments:{dict}}]
  • meta — n_tool_calls, n_turns, chain, world, industry
  • text — the full pre-rendered template string (use for packing / single-text SFT)

Splits (stratified)

split rows tool RAG advanced QA
train 7,799 2,142 134 525 4,998
valid 1,028 252 38 150 588
test 515 126 20 75 294

Usage

A. messages[] (trainer calls apply_chat_template)

from datasets import load_dataset
ds = load_dataset("hotdogs/sme-sft-docdata-qwen38", split="train")
row = ds[0]
messages, tools = row["messages"], row["tools"]

B. text (packing / single-text SFT, no template needed — recommended)

text = row["text"]   # already byte-exact through the Qwen3.8-27B template

Recommended training config (Qwen3.8-27B, 4× RTX 3060 12GB)

lora:
  r: 64
  alpha: 128
  target_modules: [q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj]
training:
  seqlen: 4096        # covers 100% (real max 3,729 tok)
  batch_size: 4
  gradient_accumulation: 2
  learning_rate: 2e-4
  epochs: 3

Provenance

Generated by the sme-sft pipeline (Hermes Agent). Tool rows are produced from
deterministic per-seed worlds — each world is a fictional SME with a real folder
tree of documents (contracts, invoices, reports, HR policies, meeting minutes, product
sheets) plus CSV tables (sales, invoices, employees, expenses, customers); every tool
output is computed from that world, so a summary matches the doc and an aggregate
matches the CSV. QA rows are drawn from a combinatorial generator over 6 SME
industries and 5 question families. Date anchor: 2026-08-20. Format ground truth:
byte-ordinal analysis of the real template, validated 100% against
hotdogs/cyber-sft-agent-qwen38.

README history 8 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-08-21v2.0: updated README.md for 9,342-row datasetedd25ea7.2 KB
    Loading...
  2. 2026-08-21v2: byte-exact tool preamble + RAG + advanced rows (9,342 total)f61d1486.6 KB
    Loading...
  3. 2026-08-21v2: byte-exact tool preamble + RAG + advanced rows (9,342 total)7a4f1536.6 KB
    Loading...
  4. 2026-08-21v2: byte-exact tool preamble + RAG + advanced rows (9,342 total)ead32c76.6 KB
    Loading...
  5. 2026-08-21Delete upload_probe.txt with huggingface_hub0d563c76.6 KB
    Loading...
  6. 2026-08-21Upload upload_probe.txt with huggingface_hub1faa8416.6 KB
    Loading...
  7. 2026-08-20Upload folder using huggingface_hub8b25b626.6 KB
    Loading...
  8. 2026-08-20initial commitd5a27140 B
    Loading...

Used by abliterated models 1 in catalog

Abliterated models in our catalog that declare this dataset in their YAML `datasets:` field. Sorted by downloads. This back-reference is unique to abliteration.org: Hugging Face does not surface it.

Community discussions 1 thread · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-08-21[bot] Conversion to Parquetclosed2 💬#1
    Loading...

Related datasets same stage · ablate

Read further

Metadata

License
apache-2.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("hotdogs/sme-sft-docdata-qwen38")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="hotdogs/sme-sft-docdata-qwen38", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/hotdogs/sme-sft-docdata-qwen38
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration