evaluate 0 0 0

frangelbarrera/ling-3-flash-evaluation

published by @frangelbarrera

Alignment dataset tracked in the /datasets sub-catalog.

Lifetime downloads
137
Last 30 days
37
Likes
-
Size
885 KB
Created on HF
2026-08-30
Age
1 months ago

Description

Ling-3.0-flash Evaluation — Sanitized Records

This dataset is a sanitized, structured release of the independent evaluation of inclusionai/ling-3.0-flash:free conducted through the OpenRouter API. It contains one metadata record per evaluation call and is intended for transparent analysis of model behavior across reasoning, coding, security, tool calling, long context, multi-turn stability, multilingual behavior, hallucination, format following, and edge cases.

The canonical… See the full description on the dataset page: https://huggingface.co/datasets/frangelbarrera/ling-3-flash-evaluation.

Tags

language:multilinguallicense:othersize_categories:n<1Kregion:usllm-evaluationcybersecuritysafety-evaluationred-teamingtool-callinglong-contextmultilingualbenchmark

README current version from Hugging Face


pretty_name: Ling-3.0-flash Evaluation — Sanitized Records
language:

  • multilingual
    tags:
  • llm-evaluation
  • cybersecurity
  • safety-evaluation
  • red-teaming
  • tool-calling
  • long-context
  • multilingual
  • benchmark
    size_categories:
  • n<1K
    license: other
    configs:
  • config_name: default
    data_files:
    • split: train
      path: ling3_evaluation_sanitized_v1.jsonl

Ling-3.0-flash Evaluation — Sanitized Records

This dataset is a sanitized, structured release of the independent evaluation of inclusionai/ling-3.0-flash:free conducted through the OpenRouter API. It contains one metadata record per evaluation call and is intended for transparent analysis of model behavior across reasoning, coding, security, tool calling, long context, multi-turn stability, multilingual behavior, hallucination, format following, and edge cases.

The canonical research repository is frangelbarrera/Ling-3-flash-evaluation. The interactive presentation is maintained as a separate static Hugging Face Space linked from this dataset.

Dataset summary

The release contains 845 records from 12 test phases. The records preserve evaluation metadata and outcome signals while intentionally excluding raw prompts, system messages, model responses, tool payloads, model reasoning traces, observations, and error text.

Property Value
Records 845
Evaluation target inclusionai/ling-3.0-flash:free
API route OpenRouter
Evaluation phases 12
Standard-schema records 692
v6 message-schema records 101
v6 message/tool records 52
Completed responses 680
API errors 63
Empty responses caused by length 52
Truncated responses 25
Other empty responses 25
Output format JSONL and CSV

Intended use

This dataset is intended for research and education involving LLM evaluation, reproducibility, model reliability, safety behavior, tool-calling validation, long-context experiments, and cybersecurity-oriented capability analysis. It is suitable for building aggregate dashboards, comparing evaluation phases, studying failure classes, and demonstrating dataset documentation practices.

It should not be treated as an official benchmark, a leaderboard result, a safety certification, or a complete measurement of Ling-3.0-flash capability. Several phases are exploratory or small-sample behavior studies, and rate limiting affected some API calls.

Data fields

Each row contains stable identifiers, phase and test metadata, model/provider identifiers, parameter summaries, status and finish information, token counts, latency, and boolean indicators such as whether visible content, reasoning, or tool calls were present. The dataset does not contain the original textual prompt, model output, tool arguments, reasoning text, or error message.

The schema_variant field identifies whether a record originated from the standard JSONL schema, the v6 message schema, or the v6 message/tool schema. The result_class field normalizes completion, truncation, empty-output, and API-error outcomes without reproducing the original response text.

Sanitization policy

The following fields were excluded from this public release: user prompts, system prompts, message histories, visible model responses, reasoning traces, tool definitions, tool calls, observations, and raw error text. The release also excludes raw URLs, email-like strings, and other unstructured content because the source logs contain cybersecurity prompts, adversarial examples, and model-generated text that require separate review before redistribution.

A deterministic redaction report and field schema are included with the release package. Raw logs remain outside this release and are not required for the dataset viewer.

Reproducibility

The source repository documents the API configuration, evaluation sessions, parameters, known rate-limit effects, schema variations, and phase-level methodology. The source JSONL file hashes are recorded in the local redaction report so that the sanitized records can be audited against the exact source snapshot before publication.

The source project used seed=42 and temperature=0 for the v6 JSONL tests. Earlier sessions used different settings, which are preserved in the parameter fields and source documentation. No local model weights were used.

Limitations

The dataset reflects one model identifier accessed through a provider proxy and may include provider-specific behavior. Latency includes proxy overhead. The :free route may not represent every paid or future model deployment. Small samples and exploratory prompts produce wide uncertainty intervals. Evaluation timestamps, prompts, and raw responses are intentionally not included in this sanitized release, so this dataset is not sufficient by itself to reproduce every semantic judgment.

Licensing and terms

The source repository is licensed under MIT. This sanitized dataset is a derived research artifact containing metadata about API evaluations and is marked other pending confirmation of the applicable terms for redistribution of derived evaluation metadata and model/provider identifiers. The source repository's license should not be interpreted as automatically granting rights to redistribute all upstream prompts, provider responses, or third-party content. Publication should proceed only after the maintainer confirms the final license and applicable API/provider terms.

Citation

If this dataset is published, cite the source repository and the Ling-3.0-flash evaluation report:

@software{barrera_ling3_evaluation,
  author = {Barrera, Frangel},
  title = {Ling-3.0-flash: Independent Security and Capability Evaluation},
  year = {2026},
  url = {https://github.com/frangelbarrera/Ling-3-flash-evaluation}
}

README history 8 revisions

Every night we snapshot the README of every dataset in the catalog. When the SHA changes we archive the new version and diff it against the last. This is the evolving thought record of the alignment-data field: what the author decided to say about the corpus, and how that framing shifted over time.

  1. 2026-09-01Update README.mdd51148b5.9 KB
    Loading...
  2. 2026-09-01Delete styles.css52086e65.7 KB
    Loading...
  3. 2026-09-01Delete index.html0a0eb955.7 KB
    Loading...
  4. 2026-09-01Delete dashboard_data.json8ee99505.7 KB
    Loading...
  5. 2026-09-01Delete app.jsfa060ca5.7 KB
    Loading...
  6. 2026-08-30Upload 2 filesc115b275.7 KB
    Loading...
  7. 2026-08-30Upload 12 filesbae96535.7 KB
    Loading...
  8. 2026-08-30initial commitb73a90483 B
    Loading...

Used by abliterated models none yet

No abliterated models in our catalog have declared this dataset in their YAML metadata yet. This can mean the dataset is used but not declared, is used outside abliteration workflows, or is new. The link will populate automatically as models are indexed.

Community discussions 1 thread · 1 open · 1 comments

Threads posted by the community on Hugging Face: bug reports, questions about usage, pull requests on the README, license clarifications. Click any thread to expand and read the full conversation inline. Newest first.

  1. 2026-09-02[bot] Conversion to Parquetopen1 💬#1
    Loading...

Related datasets same stage · evaluate

Read further

Metadata

License
other

Repository

Download the dataset

0

Copy any of these snippets into your notebook or terminal. All three fetch directly from Hugging Face using your own credentials.

Recommended: datasets library (Python)
from datasets import load_dataset
ds = load_dataset("frangelbarrera/ling-3-flash-evaluation")
Raw snapshot (Python)
from huggingface_hub import snapshot_download
snapshot_download(repo_id="frangelbarrera/ling-3-flash-evaluation", repo_type="dataset")
git clone (requires git-lfs)
git clone https://huggingface.co/datasets/frangelbarrera/ling-3-flash-evaluation
Catalog is the map. Apps are the tools.

Run models on your own machine, not in the cloud.

Every model page has an "Open in Abliteration" button that hands the model directly to the first-party desktop client, at the quantization your rig can actually run. No API keys, no subscription, no prompt leakage.

Open in Abliteration