if there is a GGUF version of this model
#10
by
jonfon96
- opened
I just tried to get this model via the run command in ollama and I got an error so I looked for the GGUF version that was posted on the site but I get some odd behavior from hf.co/Mungert/Foundation-Sec-8B-GGUF . If this is an old question can you ref to the post that makes this model usable with ollama or if there is a converted version what that name is.
thank you
jonfon96
Hi
Have you tried running it in LM Studio?