pretty_name: SWE-Lego-Data-gpt-6-luna-medium
configs:
- config_name: default
data_files:- split: train
path: data/llm-annotation-00000-of-00001.parquet
- split: train
SWE-Lego-Data-gpt-6-luna-medium
Step-level pruning annotations for the resolved splits of Lego-X/SWE-Lego-Real-Data and Lego-X/SWE-Lego-Synthetic-Data, annotated using gpt-6-luna with medium reasoning effort. The Real branch was annotated on 2026-10-07 and the Synthetic branch on 2026-10-10, both with the same prompt and verdict definitions: essential contributes to the final fix, neutral does not contribute but is a reasonable, harmless step worth imitating, and redundant is not worth imitating and names one supported reason. Non-contributing exploration before the fix is neutral, after the fix it is post_fix_exploration. For the Synthetic branch the reference patch is the fix (debug_patch), not the injected bug.
This repository was previously named SWE-Lego-Real-Data-gpt-6-luna-medium; the earlier revisions hold the Real branch only and the old name redirects here.
This repository contains annotations only. Join records to source trajectories using trajectory_id, which carries the branch as the swe-lego-real:: or swe-lego-synthetic:: prefix. For compatibility, the default configuration retains the train split and the existing Parquet path; the upstream source split is resolved.
Coverage
| Measure | Real | Synthetic | Total |
|---|---|---|---|
| Trajectories | 5,009 | 9,127 | 14,136 |
| Annotated steps | 296,788 | 490,703 | 787,491 |
| Essential | 154,129 | 210,918 | 365,047 |
| Neutral | 68,050 | 144,516 | 212,566 |
| Redundant | 74,609 | 135,269 | 209,878 |
Redundant reasons
| Reason | Steps |
|---|---|
| post_fix_verification | 89,384 |
| post_fix_exploration | 45,406 |
| failed_attempt | 31,394 |
| restated_reasoning | 26,585 |
| repeated_failure | 7,463 |
| rewritten_edit | 6,320 |
| stalled_cycle | 3,326 |