extract 0 0 0

kelikelibababian/mimir-agent-traces

published by @kelikelibababian

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
541
Last 30 days
346
Likes
1
Size
7.4 MB
Created on HF
2026-08-30
Age
1 months ago

Description

MimirAether Agent Traces

9,299 unique real agent sessions · 90,608 tool calls in the curated view from a multi-agent system in daily production — four cooperating agents (orchestrator, executor, red-team reviewer, verifier) running real workloads since May 2026.

What makes this corpus different: it is not single-agent coding transcripts. It captures inter-agent collaboration in production — task dispatch, cross-audits, failure & recovery (real incidents: gateway freezes, API… See the full description on the dataset page: https://huggingface.co/datasets/kelikelibababian/mimir-agent-traces.

Tags

task_categories:text-generationlanguage:enlanguage:zhlicense:mitsize_categories:10K<n<100Kformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantregion:usagenttool-callstrajectoriesauditllm-agents

README current version from Hugging Face


language:

  • en
  • zh
    license: mit
    task_categories:
  • text-generation
    tags:
  • agent
  • tool-calls
  • trajectories
  • audit
  • llm-agents
    size_categories:
  • 1K<n<10K
    configs:
  • config_name: default
    data_files:
    • split: train
      path: data/train.parquet
  • config_name: legacy
    data_files:
    • split: train
      path: data/legacy.parquet

MimirAether Agent Traces

9,299 unique real agent sessions · 90,608 tool calls in the curated view from a multi-agent system in daily production — four cooperating agents (orchestrator, executor, red-team reviewer, verifier) running real workloads since May 2026.

What makes this corpus different: it is not single-agent coding transcripts. It captures inter-agent collaboration in production — task dispatch, cross-audits, failure & recovery (real incidents: gateway freezes, API outages, deadlocks — with their debug sessions included), and self-correction loops. If you train or evaluate agents on cooperation, failure recovery, or long-horizon operations, this is the rare real-world source.

🔗 This dataset is the runtime trace of MimirAether — an open-source, self-hosted agent runtime under active development (code, docs, roadmap & CI on GitHub). Issues and feedback on data quality are welcome on either repo.

🔄 Continuously updated — new sessions are appended in small batches (~every 100 sessions) as the runtime keeps operating.

Loading

from datasets import load_dataset

# curated corpus: 4,404 sessions, schema v1+v2 mixed, one row = one agent session
ds = load_dataset("kelikelibababian/mimir-agent-traces", split="train")

# pre-filter archive: 8,670 sessions, v1-era, kept as-is for provenance
legacy = load_dataset("kelikelibababian/mimir-agent-traces", "legacy", split="train")

Both configs are Parquet views: data/train.parquet over the append-only JSONL data/mimir-agent-traces.jsonl, and data/legacy.parquet over data/mimir-agent-traces-legacy-full.jsonl. Raw JSONL is never rewritten — Parquet is the view, JSONL is the source of truth. Rows uploaded before schema v2 carry null in the seven v2-only columns, so the curated corpus loads as a single table.

Statistics

Snapshot: 2026-10-19.

Metric Curated (default) Pre-filter archive (legacy)
Rows (sessions) 4,404 8,670
Unique sessions (union of both configs) 9,299 —
Total tool calls 90,608 73,740
Avg / median tool calls per session 20.6 / 13 —
Sessions with zero tool calls 23 (0.5%) —
Duration p50 / p90 113 s / 593 s —
Schema v2 rows 2,236 (50.8%) —
Schema v1 rows (no schema_version) 2,168 (49.2%) —

exit_reason (curated): null 3,305 · natural 983 · empty_response 43 · max_turns 29 · empty_content 26 · interrupt 12 · verify_exhausted 4 · billing_exhausted 2.

exit_reason caveat: most v1 rows are null — the recorder only started writing session_end telemetry partway through the corpus, and pre-2026-08-29 session_end events lack the exit_reason key. Even in schema v2 batches the value can be null when the underlying telemetry omits it. The v2 gate guarantees the session ended; it cannot backfill a missing reason.

What's inside

Each row = one complete agent session.

Schema note: v1 rows cap task_desc_sanitized at 200 chars; from schema v2 (2026-09-13) the cap is 300. v1 rows lack the schema_version field — absence of the field = v1.

Field Type Description
session_id string session identifier (two conventions — see Known limitations)
n_tool_calls int64 number of tool calls in session
duration_seconds float64? wall-clock duration
exit_reason string? how the run ended (natural / max_turns / interrupt / circuit_breaker / tool_storm / api_failure / empty_response / empty_content); null for many v1 sessions
tool_sequence list ordered sequence of tool names (capped at 80)
has_exit_reason bool whether telemetry recorded an exit reason
task_desc_sanitized string task description, truncated (200 chars v1 / 300 chars v2)
schema_version string? "2.0" for v2 rows; null for v1 rows
agent_id string? which agent ran it — mimir / hermes / openclaw / loki
model string? batch-level model name (see Model field caliber)
trace_id_prefix string? first 8 hex of the trace id, for joining the audit stream
trigger_source string? feishu / api / hermes-dispatch / buzz-watcher / cli / cron
task_category string? heuristic task class (weak signal — see below)
task_subcategory string? finer task class

Categories (heuristic, curated v2 rows only)

Assigned by a deterministic tool-name voting table (no LLM), so treat them as a weak signal for stratification, not ground truth.

Category Rows
Terminal & Coding 1,455
Retrieval 584
Other (zero-tool or tied votes) 111
Browser 48
Agent Tools 22
Memory 16
Communication / Creative / Analysis 0 in this snapshot

Model field caliber

model is a batch-level value (trajectories carry no per-session model). Resolution order: runtime telemetry (last_context_usage.json, what the gateway actually used) → config.yaml model.default → legacy .env MIMIR_MODEL. A model switch mid-window makes the batch value approximate for sessions before the switch; exact per-session models land once the runtime writes model into session_start (planned).

Why this matters

Real-world agent behavior data is scarce; real-world multi-agent failure data is nearly nonexistent. Most published agent benchmarks are synthetic. This dataset captures what agents actually do in production — including genuine incident-response sessions (e.g., a cron job freezing the event loop, diagnosed via py-spy and fixed live; API-provider outages with retry/backoff traces), tool-usage patterns, and self-audit loops where an agent finds its own bug and files a correction. Failure trajectories are included deliberately: they are the hardest data to synthesize and the most valuable for robustness training.

Useful for: agent behavior modeling, tool-use pattern mining, failure analysis, run-boundary research, agent memory studies.

How sessions are recorded

runtime session (local JSONL, never uploaded)
  → aggregator: metadata only (task description, tool-name sequence, counts, timing)
  → sanitizer: hash session id, redact names/paths/emails, truncate task description
  → batch lint: per-row identifier scan — a row that fails is dropped, not masked
  → upload in small batches (~100 sessions) + one line per batch in manifest.jsonl

Message bodies and tool arguments/outputs never leave the machine: a row carries the shape of the session (which tools, in what order, how long, how it ended), not its contents.

Sanitization

All identifiers are hashed; user names, paths, emails and internal infrastructure names are redacted. Task descriptions truncated (200 chars v1 / 300 chars v2). Tool arguments/outputs are not included (privacy) — only the tool-name sequence and metadata. Every batch is scanned for personal identifiers before upload; any row that fails the scan is dropped.

Known limitations

  • Session identity has two conventions. Curated v2 rows use a salt-free SHA-1 prefix of the runtime session id; legacy rows use the first 8 characters of the raw session id. Both are deterministic and stable, but do not mix them when joining across configs.
  • Session continuation: a session continued across midnight (≈4% of sessions) keeps the same id; the dataset keeps the first uploaded version and later continuation files are skipped (no upsert). Rows are always duplicate-free — at worst the tail of a continued session is missing.
  • Batch-level model: see Model field caliber above.
  • task_category is heuristic — see the caveat above.

Provenance

Every upload is recorded in manifest.jsonl (batch / date / sessions / notes); schema_v2.json documents the v2 row contract. Raw runtime session files are never uploaded — only aggregated statistic rows.

Related

  • 💻 Runtime source: MimirAether (actively developed)
  • 📖 Attribution system: commit trailer Agent: <id> + dual-stream audit (tool-level + hook-level) + who_did.py self-check entry point

README history 20 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-10-19docs: refresh README405ed848.6 KB
    Loading...
  2. 2026-10-19view: refresh parquet view layer (union schema · 14 cols · zstd)1de0b638 KB
    Loading...
  3. 2026-10-19manifest: batch receipt74d88418.7 KB
    Loading...
  4. 2026-10-19increment v2: +12 sessions (2026-10-19)3307a7e8.7 KB
    Loading...
  5. 2026-10-19manifest: batch receipt5f998568.7 KB
    Loading...
  6. 2026-10-19increment v2: +62 sessions (2026-10-19)eceb3ac8.7 KB
    Loading...
  7. 2026-10-19manifest: batch receipt8f756008.7 KB
    Loading...
  8. 2026-10-19increment v2: +63 sessions (2026-10-19)65eedc68.7 KB
    Loading...
  9. 2026-10-14view: refresh parquet view layer (union schema · 14 cols · zstd)51eb7a18.7 KB
    Loading...
  10. 2026-10-14manifest: batch receipt8e92d9f8.7 KB
    Loading...
  11. 2026-10-14increment v2: +99 sessions (2026-10-14)e5e44338.7 KB
    Loading...
  12. 2026-10-08README: clarify viewer table scope (curated main file; legacy archive separate)e65e2cf8.7 KB
    Loading...
  13. 2026-10-08Add unified-schema Parquet view layer (fixes dataset viewer & load_dataset)8db22e18.5 KB
    Loading...
  14. 2026-10-07manifest: batch receipt53f755a7 KB
    Loading...
  15. 2026-10-07increment v2: +32 sessions (2026-10-08)80eb9847 KB
    Loading...
  16. 2026-10-07manifest: batch receipte3c0dbf7 KB
    Loading...
  17. 2026-10-07increment v2: +65 sessions (2026-10-08)13ec2aa7 KB
    Loading...
  18. 2026-10-07manifest: batch receipt5c118637 KB
    Loading...
  19. 2026-10-07increment v2: +1 sessions (2026-10-08)e9cc41e7 KB
    Loading...
  20. 2026-10-07manifest: batch receipt6f919217 KB
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 2 threads · 2 open · 2 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-09-24Dataset update: 8,670 real multi-agent traces — and why the failure rows matteropen1 💬#2
    Loading...
  2. 2026-08-31[bot] Conversion to Parquetopen1 💬#1
    Loading...

Related datasets same stage · extract

Read further

Metadata

License
mit

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("kelikelibababian/mimir-agent-traces")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="kelikelibababian/mimir-agent-traces", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/kelikelibababian/mimir-agent-traces
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration