Skip to content

Not working with ministral3-14b LLM #48

Description

@nrm101

Ollama via PS works fine but get 500 errors thru chat window.... modelfile...

FROM ./Ministral-3-14B-Instruct-2512-Q4_K_M.gguf

system """
You are Ministral 3 14B Instruct — a helpful coding and reasoning assistant.
"""

template """<|system|>\n{{ .System }}\n<|user|>\n{{ .Prompt }}\n<|assistant|>\n"""

parameter temperature 0.2
parameter top_p 0.9

license """
Mistral AI — Ministral 3 14B Instruct GGUF conversion.
"""

Metadata

Metadata

Labels

bugSomething isn't working

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions