EfficientLLM

🔧 TODO List

🧱 Core Codebase & API

📅 Expected Release: Before June 1, 2025

• Code for the whole project including pre-training, PEFT, inference, etc.
• API for evaluating model latency, memory, throughput, etc.
• Integrate metric API into the core codebase.
• Code cleanup and documentation.

---

🧠 PEFT Models (Parameter-Efficient Fine-Tuning)

📅 Development Starts: After June 15, 2025

• Release fine-tuned checkpoints and configuration files.

---

📦 Pretrained Models

📅 Gradual Release: Starting August 2025

• Release base pretrained checkpoints
• Provide scripts for inference and reproducibility.

Star History