Please Eval
#466
by
xesole3024
- opened
These seem to be a unique kind of gguf. I'm not sure it would make much sense to test Q8s of those to compare with the base models. The difference would be more seen with smaller quants.
You could try to test them at Q4's but that's all up to you. I simply wonder how much pruning has affected them compared to the base models. Thanks in advance.