prometheus04
/

matilda-mini-v2

Model card Files Files and versions

matilda-mini-v2 / configs

3.39 kB

Ctrl+K

Ctrl+K

2 contributors

History: 4 commits

prometheus04's picture

cleanup: drop abandoned 350M config and v1-only data prep

2b4c3b8 verified 4 months ago

base_124m.json

1.04 kB
v2: 363M hero run (Muon hybrid, WSD, Liger, SmolLM 75/15/10 mix) 4 months ago
base_152m_v2.json

1.69 kB
v1.5 pivot: 152M (18L x 768d) hero config, ReLU2 FFN, final logit soft-cap. 350M kept as reference. 4 months ago
calibration.json

661 Bytes
v2: 363M hero run (Muon hybrid, WSD, Liger, SmolLM 75/15/10 mix) 4 months ago