Bug Report
Description
The text suggestions aren't being useful, in fact most texts can't even make sense of what has been edited regardless of what has been typed. Not only that, but you can see the prompt inserted into the text suggestions, such as "keep the tone". In general, smaller models work better because they are faster and complete the text with a certain degree of precision, considering a context of only a few words. The recommended model tabby-balanced-1 works well but is still a little slow to generate the text. (In all models there is a considerable increase in temperature, the model seems to load and unload memory very quickly which causes the slowness to increase a little.)
Steps to Reproduce
1 - Open the app
2- Select the model
3 - Type
Expected Behavior
The generated text should be minimally coherent with the context of the sentence, but it often ends up not making sense at all, and the suggestions become irrelevant.
Environment
- tabby version: 0.2.0-beta (32)
- macOS version: Tahoe 26.5
Screenshots
Submitted via tabby feedback form
Bug Report
Description
The text suggestions aren't being useful, in fact most texts can't even make sense of what has been edited regardless of what has been typed. Not only that, but you can see the prompt inserted into the text suggestions, such as "keep the tone". In general, smaller models work better because they are faster and complete the text with a certain degree of precision, considering a context of only a few words. The recommended model tabby-balanced-1 works well but is still a little slow to generate the text. (In all models there is a considerable increase in temperature, the model seems to load and unload memory very quickly which causes the slowness to increase a little.)
Steps to Reproduce
1 - Open the app
2- Select the model
3 - Type
Expected Behavior
The generated text should be minimally coherent with the context of the sentence, but it often ends up not making sense at all, and the suggestions become irrelevant.
Environment
Screenshots
Submitted via tabby feedback form