Support Apple CoreML acceleration for local AI denoise model (8x faster on Mac) #1239
Open
jtalboom wants to merge 3 commits into
Open
Support Apple CoreML acceleration for local AI denoise model (8x faster on Mac) #1239jtalboom wants to merge 3 commits into
jtalboom wants to merge 3 commits into
Conversation
added 2 commits
June 6, 2026 19:50
Introduces an opt-in toggle in the settings to enable Apple's CoreML Hardware Acceleration (Neural Engine/GPU) for the local Denoise model. The default safely remains pure CPU execution to ensure maximum numerical precision and stability, allowing users to test hardware acceleration when needed.
Adds an elapsed execution timer within the Denoise Modal. Shows running elapsed seconds during active processing and displays the final completion duration once the process finishes.
32bc5d2 to
b624620
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This PR introduces two enhancements to RapidRAW:
CoreMLExecutionProviderinort). To ensure numerical stability and maximize compatibility (since models like LaMa/CLIP fail CoreML compilation due to dynamic axes), the switch is restricted solely to the Denoising model and is disabled by default.Type of Change
Changes Made
Rust Backend (
src-tauri)create_session(app_handle, model_path)insrc-tauri/src/ai_processing.rsto exclusively handle CoreML initialization for the Denoise model. SAM, LaMa, and CLIP remain natively bound to CPU execution.enable_denoise_hardware_accelerationtoAppSettingsinsrc-tauri/src/app_settings.rs(defaults tofalse).React Frontend (
src)SettingsPanel.tsx.AppSettingsinterface inAppProperties.tsxto includeenableDenoiseHardwareAcceleration.DenoiseModal.tsxthat tracks elapsed duration inelapsedTimestate.en.json) and German (de.json).Screenshots/Videos
Testing
Test Configuration:
I used a MacBook Air M5 24GB on MacOS 26.5.1
Benchmark Results (Denoise):
Checklist
Additional Notes
-7) present in the Transformer models.AI Disclaimer