base_model:
- geodesic-research/sfm_baseline_unfiltered_base
- geodesic-research/sfm_baseline_unfiltered_base
- geodesic-research/sfm_baseline_unfiltered_base
library_name: transformers
tags: - mergekit
- merge
sfm-baseline-unfiltered-4k-5k-6k-avg
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Linear merge method using geodesic-research/sfm_baseline_unfiltered_base as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: geodesic-research/sfm_baseline_unfiltered_base@global_step4000
parameters:
weight: 1.0
- model: geodesic-research/sfm_baseline_unfiltered_base@global_step5000
parameters:
weight: 1.0
- model: geodesic-research/sfm_baseline_unfiltered_base@global_step6000
parameters:
weight: 1.0
base_model: geodesic-research/sfm_baseline_unfiltered_base@global_step5000
merge_method: linear
parameters:
normalize: true
dtype: float32
out_dtype: bfloat16