Skip to content

feat/upgrade open ai model to 5.4mini#412

Open
kdh29 wants to merge 3 commits into
mainfrom
claude/plan-openai-upgrade-8Tog5
Open

feat/upgrade open ai model to 5.4mini#412
kdh29 wants to merge 3 commits into
mainfrom
claude/plan-openai-upgrade-8Tog5

Conversation

@kdh29

@kdh29 kdh29 commented May 8, 2026

Copy link
Copy Markdown
Contributor

The model has been changed to 5.4 mini with reasoning set to low. testing showed similar latency with the previous model. If reasoning proves to be completely unnecessary then it can be turned off by setting reasoning to off.

claude added 2 commits May 5, 2026 18:20
Replaces gpt-4o (backend/scripts) and gpt-5.2 (experiment app) with
gpt-5.4-mini in backend/nlp.py, experiment API routes, eval scripts,
and llm_analysis.py defaults.

https://claude.ai/code/session_01D4Tdbmy3kzxCzce3cQpFya
Without this, the reasoning model defaults to a high reasoning budget,
significantly increasing latency and cost. Also adds missing maxOutputTokens
cap to writing-support route, which had no output limit.

https://claude.ai/code/session_01D4Tdbmy3kzxCzce3cQpFya
@kdh29 kdh29 requested a review from kcarnold May 8, 2026 04:38
@kcarnold

Copy link
Copy Markdown
Contributor

Typechecker fails in experiment:

$ npm run build
...
./app/api/chat/route.ts:12:35
Type error: Expected 1 arguments, but got 2.

  10 |
  11 |   const result = streamText({
> 12 |     model: openai('gpt-5.4-mini', { reasoningEffort: 'low' }),
     |                                   ^
  13 |     system: scenario.chat.systemPrompt,
  14 |     messages: convertToModelMessages(messages),
  15 |     maxOutputTokens: 300,
Next.js build worker exited with code: 1 and signal: null

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants