As a front end dev, should i interface with llama-cli or llama-server? Is there a way to delete an older message with llama-cli?

[MrHills-2]

Hey.
Trying to build a front end in rust, I would like to know which one gets more attention and will be worked the most in the future, llama-cli or llama-server. I've heard discussions in which one of the two might get dropped in the future.
Also, as of now i'm playing with llama-cli in interactive-first mode, but it seems there's no way of deleting a single old message outside of restarting the client and deleting the --prompt-cache. Am i missing something or it's actually impossible? Because in that case i'd be forced to use llama-server.
Thanks.

[slaren]

You should never build an application on top of llama-cli, it is not intended to be used that way. Your options are to use the llama.cpp API, or the llama-server. The llama.cpp API has the lowest level access to the library and is more flexible, but it also changes frequently, which may break your application. llama-server can be used an an OpenAI-compatible endpoint.