How to use AtAndDev/UVOX-40k-Llama-32-3B-Instruct with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AtAndDev/UVOX-40k-Llama-32-3B-Instruct", trust_remote_code=True, dtype="auto")
AtAndDev commited on 