metadata
base_model:
- kalomaze/nemo-subseq-perseq-e1.5
library_name: transformers
tags:
- mergekit
- merge
v5
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Passthrough merge method using kalomaze/nemo-subseq-perseq-e1.5 + /alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354 as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
base_model: kalomaze/nemo-subseq-perseq-e1.5+/alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354
dtype: bfloat16
merge_method: passthrough
models:
- model: kalomaze/nemo-subseq-perseq-e1.5+/alloc/Mango/axolotl/0.0001_5e-6_ademamix_0.01-WD-New-Data-v5/checkpoint-1354