Skip to content
alexriderspyPublic

About

HeyFlitty: a free, open-source AI screen buddy for Windows (and macOS). Hold a hotkey, ask out loud, and it answers, captions it, and flies a cursor to the exact button you need.

Topics

Resources

Contributing

Stars

6 stars

Watchers

0 watching

Forks

Repository files navigation

HeyFlitty logo

HeyFlitty: the AI screen buddy for Windows

Ask out loud. HeyFlitty shows you exactly where to click.
A tiny AI buddy that lives next to your cursor: it answers in a voice, captions the answer,
and flies straight to the button you need. Built for Windows, works on macOS.

Latest release Platforms MIT license GitHub stars

Download for Windows · How it works · Privacy · Report an issue · Contribute

HeyFlitty in Windows Settings: asked how to make the monitor the main display, it captions the answer and its cursor flies to display 2, then to the Make this my main display checkbox
Hold a hotkey, ask, and it points to the exact spot. Watch the 40-second launch film with sound ▶


What problem does it solve?

You know the setting exists, you just can't find it. So you google it and read a blog whose screenshots don't match your screen, sit through a video for one checkbox, or ask a chatbot that says "go to Settings → System → Display" and leaves you to find it yourself.

HeyFlitty looks at your actual screen and points at the exact button, out loud, without you leaving the app you're in. It points, it never clicks, so you stay in control.

Good for:

  • 👵 Parents, and anyone who calls "the tech person" in the family: "how do I connect to Wi-Fi?", "why is there no sound?"
  • 📊 Learning big apps like Excel, Photoshop, Figma or DaVinci: "where's conditional formatting?"
  • 🧰 Work tools with endless menus like Jira, the AWS console or admin panels: "where do I change who gets notified?"
  • 🔍 "What's this?": rest your mouse on a port in a photo, an icon or an error and ask.

Why HeyFlitty

HeyFlitty is inspired by HeyClicky, which showed how good an AI buddy on your screen can feel. HeyClicky is Mac-only and closed; HeyFlitty brings the idea to Windows and keeps it open.

🪟 Windows first Windows 10 and 11, x64 and ARM64. macOS works too.
🎯 Points at the real button On Windows it reads the names and positions of on-screen controls through UI Automation, so the cursor lands exactly on them.
💬 Talks and captions Answers out loud with your system voice, with every sentence captioned next to the cursor.
🔒 Your key, your data No account, no subscription, no HeyFlitty server. It talks to OpenAI directly with your own key.
🧩 Open source MIT licensed. Read it, fork it, make it yours.

Install

  1. Download the x64-setup.exe installer from the latest release (arm64 for Snapdragon laptops).
  2. Run it. It installs for your user only, no admin rights needed.
  3. Click the HeyFlitty icon in the system tray → Settings → paste your OpenAI API key → Test key.

Note

The installer isn't code-signed yet, so Windows may show "Windows protected your PC". Click More info → Run anyway.

macOS

There's no signed Mac download yet, so run it from source (see Build from source). The first time, macOS asks for Microphone and Screen Recording permission.

How it works

  1. Hold Ctrl + Alt + Space and ask a question out loud. HeyFlitty records only while you hold the keys.
  2. Let go. It transcribes your question, takes a screenshot, and on Windows reads the clickable controls in the focused window.
  3. It answers. An OpenAI model replies; HeyFlitty speaks and captions it sentence by sentence as it streams in.
  4. It points. The model names the control it means, and HeyFlitty's cursor flies to that control's real position. For things that aren't standard controls (a photo, a diagram, a game), it points by screen coordinates instead.

Ask about "this" and HeyFlitty looks at whatever your mouse is on: rest the pointer on a port in a photo and ask "what's this?", and it names the port and points at it.

See a real recording
HeyFlitty on Windows: asked 'where can I see the open issues?' on a GitHub page, it captions the answer and its cursor flies to the Issues tab
Windows 11, unedited. Asked: "where can I see the open issues?"

Privacy

  • HeyFlitty only records while you hold the hotkey, and takes a screenshot only when you let go.
  • Audio, the screenshot and the list of on-screen controls go straight from your computer to OpenAI using your key. There is no HeyFlitty server.
  • Recordings and screenshots are never saved to disk. Your API key is stored in Windows Credential Manager (Keychain on macOS).

Build from source

You need Rust, Node.js 20+, and on Windows the Visual Studio C++ Build Tools.

git clone https://github.com/alexriderspy/heyflitty.git
cd heyflitty
npm install
npm run tauri dev

Build the Windows installer with npm run tauri build -- --bundles nsis.

Report issues and contribute

  • Found a bug? Open an issue with your Windows version and the message HeyFlitty showed next to the cursor.
  • Have an idea? Open a feature request, or send a pull request. CONTRIBUTING.md explains how to build and test, including a mock OpenAI server so you don't need a key.

Contributions require agreeing to the CLA.

License

MIT. See LICENSE.

HeyFlitty's system prompt is adapted from Clicky (MIT); see THIRD_PARTY_NOTICES.md. Licenses of all bundled dependencies are in THIRD_PARTY_LICENSES.txt, shipped with the installer.

About

HeyFlitty: a free, open-source AI screen buddy for Windows (and macOS). Hold a hotkey, ask out loud, and it answers, captions it, and flies a cursor to the exact button you need.

Topics

Resources

Contributing

Stars

6 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages