license: mit
task_categories:
- text-generation
language: - en
tags: - math
- reasoning
- chain-of-thought
- tool-use
- activation-steering
size_categories: - n<1K
Tool Call Steering Data
Analyzed subset of OpenMathReasoning for studying tool call behavior in mathematical reasoning.
Dataset Contents
Data Files
data/analyzed_subset.parquet- 500 matched CoT/TIR solution pairs- Top 250: Cases where CoT is much longer than TIR (tool use helped)
- Bottom 250: Cases where TIR is much longer than CoT (tool use didn't help)
Analysis Results
results/cot_tir_analysis_top.json- Analysis of top 250 pairsresults/cot_tir_analysis_bottom.json- Analysis of bottom 250 pairsresults/cot_tir_analysis_combined.json- Combined resultsresults/label_mapping.json- Standardized tool call labels
Usage
from datasets import load_dataset
import pandas as pd
# Load the analyzed subset
ds = load_dataset("ncrispino/tool-call-steering-data", data_files="data/analyzed_subset.parquet")
# Or load as pandas
df = pd.read_parquet("hf://datasets/ncrispino/tool-call-steering-data/data/analyzed_subset.parquet")
# Load analysis results
import json
from huggingface_hub import hf_hub_download
label_mapping_path = hf_hub_download(
repo_id="ncrispino/tool-call-steering-data",
filename="results/label_mapping.json",
repo_type="dataset"
)
with open(label_mapping_path) as f:
label_mapping = json.load(f)
Tool Call Labels
Each tool call is labeled with its value:
| Category | Description |
|---|---|
essential_computation |
Core computations needed for the solution |
verification |
Checking/validating previous reasoning |
exploration |
Testing hypotheses or exploring solution space |
automation_efficiency |
Automating tedious but doable manual work |
error_correction |
Fixing mistakes from earlier steps |
Source
Derived from NVIDIA OpenMathReasoning.
License
MIT