llm.c
Collection
Models trained with llm.c • 2 items • Updated
llm.c checkpoint: GPT-2 774M
This is a HF/safetensors conversion of the llm.c checkpoint of a 774M parameter run on 150B tokens from FineWeb.
Training was conducted on a single 8xA100 80GB SXM node for ~6 days.
See discussion on GitHub for more information.
- Downloads last month
- 6