This model does not work well on Silly Tavern

#9
by blun4me - opened

I've tried a million different instruct and context templates, including Mistral V7-Tekken, and nothing seems to work. The responses are always really weirdly formatted, and I don't know how to fix it. For example, in one response, it put actions into quotes and put new lines, even though I said for the AI NOT to do that. It also generates responses which are way too long for what I want, which is only a few sentences long, generating very long and rambly paragraphs even when I tell it not to, and using "Trim incomplete sentences" degrades the output even more. What should I do?

Suggest looking for a tuned version ; see "thedrummer" repo and/or see "mistral nemo (12B) - there are lot of these and they are
both fine tuned, a lot more "human", and a lot less censored too.

Suggest looking for a tuned version ; see "thedrummer" repo and/or see "mistral nemo (12B) - there are lot of these and they are
both fine tuned, a lot more "human", and a lot less censored too.

Alright, thanks! I will look at those now.

blun4me changed discussion status to closed

Sign up or log in to comment