Live captions for any language to english for your mac.
You have realised this already exists for windows and linux but for mac you get a live captions by ⌥+⌘+F5 which only supports the english live caption for other languages i can find the most closest as Transcribe on Apple store but its not free (both in freedom and as in beer). So i decided to build one.
- Install the blackhole 2ch using brew
brew install blackhole-2ch- Setup the Audio MIDI
Create a multi output device for the Audio MIDI which redirects the audio to blackhole as well as your speaker
- Download the ggml multilingual model
Download it from here :- https://huggingface.co/ggerganov/whisper.cpp
Chose according to your device memory and how much clarity you want in transcription Dont chose the model with .en in it it will be english only
- Compile the binary from repo and install it
git clone https://github.com/lsnnt/ntranscrybe.git
cd ntranscrybe
cargo build --release
cargo install --path .or (one liner)
cargo install --git https://github.com/lsnnt/ntranscrybe- Run it
ntranscrybe /path/to/downloaded/model.bin
Next i need help from someone with swift macos development who can integrate it and provide an overlay on the applications for live text
To all my dependencies rubato for audio processing cpal for getting audio and whisper-rs for whisper.cpp rust binding without which the idea may not be possible
GNU GPL v3