heal 0 0 0

ariffazil/I-ARIF-CANON

published by @ariffazil

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
588
Last 30 days
203
Likes
-
Size
3.9 MB
Created on HF
2026-07-29
Age
2 months ago

Description

πŸ—ΊοΈ Position in I-ARIF Governance Stack

This dataset is part of the arifOS constitutional governance training-and-evaluation pipeline β€” a closed-loop alignment substrate.

#

Dataset

Role

Downloads

License

1

AAA

Constitutional substrate β€” doctrine + gold eval

161

AGPL-3.0

2

BBB

Baseline behavior benchmark β€” ILMU API audit

247

CC-BY-4.0

3

CCC

Alignment contrast corpus β€” ILMU vs kernel

193

CC-BY-4.0

4

DDD

Register-sensitivity probe β€” Penang loghat

138

CC-BY-4.0

5… See the full description on the dataset page: https://huggingface.co/datasets/ariffazil/I-ARIF-CANON.

Tags

task_categories:text-generationtask_categories:question-answeringlanguage:enlanguage:mslicense:agpl-3.0size_categories:1K<n<10Kformat:jsonmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:usconstitutional-aigoverned-executionbahasa-melayupenang-loghatarifosi-arifsftdpoqlorasovereign-aif1-f13agentic-aimcp

README current version from Hugging Face


license: agpl-3.0
language:

  • en
  • ms
    tags:
  • constitutional-ai
  • governed-execution
  • bahasa-melayu
  • penang-loghat
  • arifos
  • i-arif
  • sft
  • dpo
  • qlora
  • sovereign-ai
  • f1-f13
  • agentic-ai
  • mcp
    pretty_name: I-ARIF CANON
    size_categories:
  • 1K<n<10K
    task_categories:
  • text-generation
  • question-answering
    format:
  • jsonl
    modality:
  • text
    library:
  • datasets
  • pandas
  • mlcroissant

configs:

  • config_name: agentic_rl
    data_files:
    • split: train
      path: agentic-trajectories-rl.jsonl
      splits:
    • name: train
      num_examples: 50
  • config_name: a2b_heldout
    data_files:
    • split: train
      path: i-arif-a2b-heldout.jsonl
      splits:
    • name: train
      num_examples: 100
  • config_name: agentic
    data_files:
    • split: train
      path: i-arif-agentic-trajectories.jsonl
      splits:
    • name: train
      num_examples: 14
  • config_name: dpo
    data_files:
    • split: train
      path: i-arif-dpo.jsonl
      splits:
    • name: train
      num_examples: 96
  • config_name: redteam
    data_files:
    • split: train
      path: i-arif-redteam-eval.jsonl
      splits:
    • name: train
      num_examples: 100
  • config_name: sft
    default: true
    data_files:
    • split: train
      path: i-arif-sft.jsonl
      splits:
    • name: train
      num_examples: 1322
  • config_name: val
    data_files:
    • split: validation
      path: i-arif-val.jsonl
      splits:
    • name: validation
      num_examples: 17

πŸ—ΊοΈ Position in I-ARIF Governance Stack

This dataset is part of the arifOS constitutional governance training-and-evaluation pipeline β€” a closed-loop alignment substrate.

# Dataset Role Downloads License
1 AAA Constitutional substrate β€” doctrine + gold eval 161 AGPL-3.0
2 BBB Baseline behavior benchmark β€” ILMU API audit 247 CC-BY-4.0
3 CCC Alignment contrast corpus β€” ILMU vs kernel 193 CC-BY-4.0
4 DDD Register-sensitivity probe β€” Penang loghat 138 CC-BY-4.0
5 EEE Kernel spine recovery β€” executable proof harness 77 Apache-2.0
6 FFF Federation fitness gate β€” model promotion/demotion 96 Apache-2.0
7 a2b-eval-results Execution ledger β€” AssetOpsBench bridge 77 Apache-2.0
8 I-ARIF-CANON Unified SFT/DPO/Val training corpus (1,435 active + 100 held-out) ← here 133 AGPL-3.0

Total: 1,122 downloads across 8 datasets Β· verified 2026-08-11
πŸ”— Full stack: https://huggingface.co/ariffazil Β· 🌐 Federation: https://arif-fazil.com

I-ARIF CANON β€” Governed Execution Substrate Training Corpus

NOT an LLM dataset. This is the constitutional training corpus for Project I-ARIF:
a Governed Execution Substrate that wraps AI model outputs with runtime floor enforcement
(F1-F13), action classification (ART), policy gates (OPA/Cedar), witness receipts, and
immutable audit (VAULT999).

What This Corpus Trains

I-ARIF shifts governance from textual system prompts (soft, bypassable) to runtime
policy gates and action classifiers
(hard, code-enforced). This corpus teaches a base
model to operate WITHIN constitutional constraints as native behavior.

Corpus Composition (1,435 pairs)

Split Pairs Content
i-arif-sft.jsonl 1,322 Constitutional reasoning (1,308) + Agentic trajectories (14): governed execution, tool governance, sovereign signals, error recovery
i-arif-dpo.jsonl 96 Preference optimization: BM red-team probes + Penang loghat register sensitivity
i-arif-val.jsonl 17 F1-F13 gating probes: kernel spine audit (5) + model fitness evaluation (12)

Source-of-Truth Graph

This corpus is a composite of the six upstream constitutional datasets:

SFT (1,322 pairs):
  ariffazil/AAA  ── constitutional genome (1,024 canon + 258 nusantara + 26 floor) ──┐
  trajectories   ── agentic execution traces (14 pairs)                             ───
DPO (96 pairs):                                                                     β”‚
  ariffazil/BBB  ── guardrail failure baseline (55 pairs)                           ──┼──►  I-ARIF-CANON
  ariffazil/CCC  ── kernel mediation proof (7 pairs)                                ───    (1,435 active pairs)
  ariffazil/DDD  ── register sensitivity (34 pairs)                                 ───    (+ 100 held-out)
VAL (17 pairs):                                                                     β”‚
  ariffazil/EEE  ── kernel spine audit (5 VAL probes)                               ───
  ariffazil/FFF  ── federation fitness gate (12 VAL probes)                          β”€β”€β”˜
                                                                        β–Ό
                                                               arifOS QLoRA Phase 2

Language Distribution

  • English: 88% (canonical governance definitions)
  • Bahasa Melayu / Penang loghat: 12% (Nusantara semantic substrate)
  • Target: 30% BM for Phase 2 QLoRA training

Audit Status β€” Updated 2026-08-06

PARTIAL SEAL β†’ EXECUTION BOUNDARY. All static code claims verifiable on disk.
Live telemetry claims cite probe commands. Benchmark claims pending Phase 2 QLoRA run.

The breakthrough is not that the model becomes incapable of error.
The breakthrough is that error is no longer allowed to travel naked.

Source SHA-256 (manifest.json, 2026-07-29 forge)

  • i-arif-sft.jsonl: 9ace2816bd2258cbb791bf99259f4a58f85b1fcc7627de27ced6269b241d93c1
  • i-arif-dpo.jsonl: fc9904086cd172f22935515b4d697ad6795611425f29320f7c9fc1b01abbe22e
  • i-arif-val.jsonl: 80ecc082180eb6b30d16708c8ae6093e34a1696a2c9f5f28d2e4d5784892270e

Baseline (DeepSeek V4 Pro)

  • eta (Governance Compliance): 0.375
  • Target after QLoRA: >= 0.888
  • Gap to close: 0.513
  • Probe breakdown:
    • EEE kernel spine: 2/3 correct
    • FFF model fitness: 1/3 correct
    • a2b benchmark scenarios: 0/2 (held-out AssetOpsBench β€” not a primary gate)

Readiness Gap (2026-08-06)

The corpus is NOT yet production-ready for training I-ARIF. Two gaps remain:

  1. Scale floor. 1,308 SFT pairs is below the threshold where constitutional
    behavior is baked in rather than style-transferred. Target: β‰₯50k pairs.
  2. No agentic trajectories. I-ARIF claims agentic behavior but the SFT set is
    single-turn Q&A. Multi-turn rollouts with tool calls, ART classification, and
    witness-receipt generation are absent. VAL set now has 17 clean F1-F13 probes but
    needs expansion with multi-turn gating scenarios.

Resolved (2026-08-06, Gap 2): Domain contamination removed. 100 AssetOpsBench
scenarios moved to i-arif-a2b-heldout.jsonl. VAL gate now tests F1-F13 governance
only (5 EEE kernel spine + 12 FFF model fitness).

In progress (2026-08-06, Gap 3): Agentic trajectory pipeline deployed β€” 3 real multi-turn
RL trajectories (HEALTH_AUDIT, CONSTITUTIONAL_REFUSAL, FQ_RECOVERY) with per-floor reward
scores across all 9 constitutional floors. Each trajectory encodes full 6-plane loop with
real tool calls, AUTH failure recovery, and deterministic F1-F13 scoring. Target: 50+ trajectories.

Done (2026-08-06, Gap 4): Constitutional reward spec written β€” F1-F13 as deterministic
scoring functions (binary + continuous), not LLM-as-judge. Aggregation: weighted sum with
thresholds SEAL_READY (0.85) / NEEDS_IMPROVEMENT (0.60) / UNSAFE (0.40).

Phase 2 QLoRA run depends on closing these gaps. Until then, this is v0.1 seed.

Files

  • i-arif-sft.jsonl β€” Supervised fine-tuning pairs
  • i-arif-dpo.jsonl β€” Direct preference optimization pairs
  • i-arif-val.jsonl β€” Validation gating probes
  • manifest.json β€” Provenance and composition manifest
  • w3_baseline_deepseek_v4_pro.json β€” Pre-training baseline scores
  • i-arif-agentic-trajectories.jsonl β€” SFT agentic descriptions (14 seed pairs)
  • agentic-trajectories-rl.jsonl β€” RL training trajectories (50 forged multi-turn tool-call scenario templates with per-floor reward scores)
  • constitutional-reward-spec.json β€” RLAIF reward function spec (F1-F13 as deterministic scorers, not LLM judges)
  • i-arif-redteam-eval.jsonl β€” Red-team adversarial eval: 100 probes across 8 attack categories (command injection, sovereignty bypass, register manipulation, authority confusion, jailbreak, tool misuse, seal tampering, gradual escalation). All 13 floors covered.
  • build_iarif_corpus.py β€” Corpus synthesis pipeline (v2: --force, --no-overwrite, --dry-run safety gates)
  • SFT_SCALE_PIPELINE.md β€” Gap 1 design spec: 1,322β†’50k pair scale architecture, 5 categories, template-driven synthetic generation
  • AUDIT-READY-DOSSIER.md β€” Full architectural dossier (audit-ready v2)

Cross-Dataset Pointer

Dataset Role Canonical Source
ariffazil/AAA Constitution FLOOR_TABLE.json (included in dataset)
ariffazil/BBB Failure baseline probes/*.json (included in dataset)
ariffazil/CCC Mediation proof raw/ALL_RESULTS.json (included in dataset)
ariffazil/DDD Register probe probes/*.json (included in dataset)
ariffazil/EEE Spine audit data/all_receipts.jsonl (included in dataset)
ariffazil/FFF Fitness gate data/model_status.jsonl (included in dataset)

Federated Integration β€” Updated 2026-10-04

This dated documentation update separates the governance specification, candidate neural assessors, local operational evidence, and the immutable dataset payload. It does not announce a trained model or production readiness. Earlier dated corpus counts and experiments remain historical snapshots.

Governance scope and provenance

The i-ARIF Blueprint defines a constitutional contract for a Governed State Processor. Its manifest records F13_RATIFIED_CHAT at 2026-09-29 22:42 MYT and deferred ceremonial sealing. The inspected source still contains earlier drafting labels; this card records the manifest's claim without independently certifying the sovereign receipt or a VAULT999 append.

A candidate fine-tuned model may assess evidence and recommend outcomes. Authority remains delegated by the human sovereign, validated by the kernel, and enforced by actuators. Neural confidence cannot create permission. ARIFOS_ML_FLOORS=1 enables SBERT-backed scoring in the inspected floor auditor, not an i-ARIF/Ollama model switch.

Local world-model ledger: observation, not dataset import

Observed on 2026-10-04, approximately 13:33 MYT:

Metadata field Reported value
Chain-head total records 144
P0 / P1 / P2 93 / 25 / 26
Existing eligibility flags 135
Newly classified SUCCESS / FAILURE / HOLD / UNKNOWN 0 / 8 / 0 / 0

Reported chain head: 9acbc223ab602787fa8dfa708b43871bcfc147e53ee407883d8ae53d594b425c.
These are values read from local ledger metadata, not independently parsed record counts or verified hash-chain integrity. The 135 eligibility flags do not establish 135 valid training examples, and these local traces have not been imported into this Hub dataset by this documentation update.

The inspected VPS copy of distill_experience.py contains an outcome classifier that treats explicit false outcomes as failures, missing or ambiguous outcomes as UNKNOWN, and marks those cases ineligible. Local file SHA256 at inspection: 8b66f6b8880a4031b66a3501bf0abed2453658cd29f3b333375ce57da9d4440d. Metadata reports eight additional failure records with eligibility remaining 135; failures were retained in the evidence ledger, not deleted. The inspected GitHub main copy still contains the prior implementation. Commit synchronization, independent tests, historical reclassification, and full corpus validity remain unverified.

Readiness limits

The active 1,435-pair corpus count is independently verified against live repository files (1,322 SFT + 96 DPO + 17 VAL) with 100 held-out evaluation pairs. Before training: independently validate typed outcomes and provenance, reconcile ledger integrity, audit legacy eligibility labels, deduplicate, separate evaluation by task/source family, and measure shadow performance. No current CPU latency, training budget, privacy guarantee, or CLM efficiency gain is established by this update.

A CLM continuity pilot requires a host-harness adapter that assembles subsequent model requests from accepted context edits. An editable file or MCP editing tool alone does not provide that behavior. Authority enforcement remains outside the mutable working context.

Citation

If you use this dataset for training or evaluation, please cite:

@dataset{fazil2026iarifcanon,
  author    = {Muhammad Arif bin Fazil},
  title     = {I-ARIF CANON: Governed Execution Substrate Training Corpus},
  year      = {2026},
  publisher = {Hugging Face},
  url       = {https://huggingface.co/datasets/ariffazil/I-ARIF-CANON},
  license   = {AGPL-3.0},
  note      = {Constitutional training corpus for Project I-ARIF. Companion datasets: ariffazil/AAA through ariffazil/FFF}
}

Sovereign

Muhammad Arif bin Fazil (F13). DITEMPA BUKAN DIBERI.


Federated update β€” 2026-10-04. Reconciled composite graph and YAML counts against active corpus files (1,435 active + 100 held-out). No dataset data files were mutated; only documentation and metadata were updated. DITEMPA BUKAN DIBERI β€” Forged, Not Given.

πŸ›οΈ Sovereign Model Roadmap β€” Updated 2026-10-18

Under F13 Sovereign Directive (2026-10-18):

  • Canonical Model Role: The I-ARIF model is architected as an 888-APEX Constitutional Judge (1B–3B parameters), not an unconstrained text generator.
  • Primary Corpus:
    • i-arif-sft.jsonl: 1,308 supervised constitutional pairs (F1–F13 floor tables, arifOS doctrine, Nusantara synthesis).
    • i-arif-dpo.jsonl: 96 preference pairs enforcing anti-fabrication, ungrounded refusal penalties, and identity integrity.
    • agentic-trajectories-rl.jsonl: OpenAI function-calling format multi-step tool-use trajectories.
  • Deployment Substrate: Ephemeral QLoRA fine-tuning (RunPod GPU), exported to GGUF (Q4_K_M / Q8_0), deployed on local KVM CPU (AMD EPYC Zen 4 AVX-512) behind the arifOS LiteLLM Federation Router.
  • Auditor Verification: Fully verified against primary repo files; zero modification to immutable data payloads.
  • Ditempa Bukan Diberi: Sealed under F13 Sovereign Authority.

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-10-18v1.2 | F11 audit | Set sft as default viewer config + 2026-10-18 sovereign ju...185d71514.7 KB
    Loading...
  2. 2026-10-04v1.6 | F11 audit | explicitly distinguish forged scenario templates from live...b67c1f113.7 KB
    Loading...
  3. 2026-10-04v1.5 | F11 audit | reconcile YAML split counts, prune stray artifact, and ali...2ffab1713.7 KB
    Loading...
  4. 2026-10-04v1.4 | F11 audit | reconcile composition graph to 1435 active pairs and 100 h...45ac0ec13.7 KB
    Loading...
  5. 2026-10-04v1.3 | F11 audit | reconcile local ledger observations and readiness limits0214d8c13.3 KB
    Loading...
  6. 2026-09-13fix: remove features from YAML frontmatter to fix dataset viewer9b924f810.1 KB
    Loading...
  7. 2026-09-13fix(dataset-viewer): remove incompatible features YAML for ConfigNamesError fix5769b5012.2 KB
    Loading...
  8. 2026-08-11fix(docs): correct YAML schema to match actual data columns6e5bd5b12.2 KB
    Loading...
  9. 2026-08-11feat(hf): add I-ARIF governance stack position blockaad70e39.9 KB
    Loading...
  10. 2026-08-06docs: add SFT_SCALE_PIPELINE.md reference to Files section80f52448.4 KB
    Loading...
  11. 2026-08-06docs(Gap1): SFT scale pipeline design spec — 1.3k→50k architecture, 5 categor...b9704928.3 KB
    Loading...
  12. 2026-08-06feat(Gap5+Patch): 100 red-team adversarial eval probes (8 categories, 67 CRIT...38d51ef8.3 KB
    Loading...
  13. 2026-08-06feat(Gap3b-FINAL): 50 RL agentic trajectories in OpenAI tool_calls format. 10...5fe96338 KB
    Loading...
  14. 2026-08-06feat(Gap3+Gap4): 3 real RL agentic trajectories + constitutional reward spec....96b0ea68 KB
    Loading...
  15. 2026-08-06feat(Gap3): 14 agentic trajectory SFT pairs β€” multi-step governed execution w...c6187137.6 KB
    Loading...
  16. 2026-08-06fix(Gap2): strip 100 AssetOpsBench probes from VAL set β€” now 17 F1-F13 gating...da771847 KB
    Loading...
  17. 2026-08-06fix: P0 config wiring (sft/dpo/val) + P1 citation + P2 path hygiene (2026-08-...d55753b6.9 KB
    Loading...
  18. 2026-08-06v1.1 | F11 audit | Federated Integration section added β€” Source-of-Truth grap...7b3d0945.4 KB
    Loading...
  19. 2026-07-29Upload README.md with huggingface_hub4f872a62.5 KB
    Loading...
  20. 2026-07-29Upload AUDIT-READY-DOSSIER.md with huggingface_hubb07b3e60 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread Β· 1 open Β· 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-07-30[bot] Conversion to Parquetopen1 πŸ’¬#1
    Loading...

Related datasets same stage Β· heal

Read further

Metadata

License
agpl-3.0

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("ariffazil/I-ARIF-CANON")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="ariffazil/I-ARIF-CANON", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/ariffazil/I-ARIF-CANON
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration