Rust + CUDA engine that streams giant MoE models from SSD, running models far larger than VRAM. Mixed-precision GGUFs. github.com/giannisanni/pulsar
Note 118B MoE, 36GB IQ2_XXS, 17.3 tok/s