Description
Add a first-run setup that asks the user to choose a default evaluation provider (e.g., Ollama, OpenAI, Groq or Gemini). This avoids requiring the --provider flag every time a command is run.
Example First-Run Prompt
No evaluation provider configured.
Select a default provider:
- Ollama
- OpenAI
- Groq
- Gemini
Behavior
The selected provider should be saved in a config file (e.g. ~/.llmvc/config.json).
Usage
Default usage:
pv eval 23
Override provider when needed:
pv eval 23 --provider openai
Goal
Improve CLI UX by letting users configure a provider once while still allowing overrides.
Description
Add a first-run setup that asks the user to choose a default evaluation provider (e.g., Ollama, OpenAI, Groq or Gemini). This avoids requiring the
--providerflag every time a command is run.Example First-Run Prompt
No evaluation provider configured.
Select a default provider:
Behavior
The selected provider should be saved in a config file (e.g.
~/.llmvc/config.json).Usage
Default usage:
pv eval 23Override provider when needed:
pv eval 23 --provider openaiGoal
Improve CLI UX by letting users configure a provider once while still allowing overrides.