Skip to content

feat: Add MLX delegate for whisper#1309

Open
IgorSwat wants to merge 1 commit into
mainfrom
@is/mlx-whisper
Open

feat: Add MLX delegate for whisper#1309
IgorSwat wants to merge 1 commit into
mainfrom
@is/mlx-whisper

Conversation

@IgorSwat

@IgorSwat IgorSwat commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

Description

This PR registers MLX whisper models and sets them up as default for a physical iOS device.
On average, MLX delegates run 50% faster than current CoreML delegates for this model, while keeping the same model size.

Introduces a breaking change?

  • Yes
  • No

Type of change

  • Bug fix (change which fixes an issue)
  • New feature (change which adds functionality)
  • Documentation update (improves or adds clarity to existing documentation)
  • Other (chores, tests, code style improvements etc.)

Tested on

  • iOS
  • Android

Testing instructions

Run speech-to-text demo app to check out if MLX delegates are downloaded and run correctly.

Screenshots

Related issues

Checklist

  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have updated the documentation accordingly
  • My changes generate no new warnings

Additional notes

@IgorSwat
IgorSwat requested a review from msluszniak July 15, 2026 12:52
@IgorSwat IgorSwat changed the title feat: Add MLX urls & entries for whisper models feat: Add MLX delegate for whisper Jul 15, 2026
@IgorSwat IgorSwat added the model Issues related to exporting, improving, fixing ML models label Jul 15, 2026
@IgorSwat IgorSwat self-assigned this Jul 15, 2026
Comment thread apps/speech/screens/TextToSpeechScreen.tsx Outdated
@barhanc

barhanc commented Jul 15, 2026

Copy link
Copy Markdown
Member

@IgorSwat could you also add the dynamic input companion methods to Whisper exports as part of this, since I see the new models were already added to the v0.10.0 tag.

@IgorSwat

Copy link
Copy Markdown
Contributor Author

@IgorSwat could you also add the dynamic input companion methods to Whisper exports as part of this, since I see the new models were already added to the v0.10.0 tag.

Yeah, good catch. I completely forgot about it 😅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

model Issues related to exporting, improving, fixing ML models

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants