Has anyone got this to run?

#3
by lbbui - opened

I'm getting " ValueError: GGUF model with architecture cohere2 is not supported yet." when trying to run it in vLLM.

I've only tested with llama.cpp

Sign up or log in to comment