Very Large GGUFs
Collection
GGUF quantized versions of very large models - over 100B parameters
•
59 items
•
Updated
•
5
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Base model
ai-sage/GigaChat3-702B-A36B-preview-bf16