C++ inference
#2
by
Kwissbeats
- opened
First of all congrats on the release! Are the inference examples for in C++?
Seems quite complicated to manage the tensors /input/output vectors and string them together in the right order?
Hi there! I've made a simple C++ implementation of Chatterbox-turbo-ONNX here: https://github.com/DDATT/Chatterbox-turbo-cpp.
It is still incomplete due to the lack of a Hugging Face text tokenizer implementation in C++, but the model inference is working fine (tested on CPU using ONNXRuntime 1.23.0).
Hope you find it useful!