Has anyone got this to run?
#3
by
lbbui
- opened
I'm getting " ValueError: GGUF model with architecture cohere2 is not supported yet." when trying to run it in vLLM.
I've only tested with llama.cpp
I'm getting " ValueError: GGUF model with architecture cohere2 is not supported yet." when trying to run it in vLLM.
I've only tested with llama.cpp