Skip to content

Add Playlist Move with screenshot import and an on-device agent - #1

Closed
Raynan00 wants to merge 13 commits into
mainfrom
codex/playlist-move
Closed

Raynan00 wants to merge 13 commits into
mainfrom
codex/playlist-move

Conversation

@Raynan00

@Raynan00 Raynan00 commented Sep 28, 2026 •

Copy link
Copy Markdown
Owner

Adds Playlist Move, an iPhone demo that turns song recommendations in a screenshot into a Spotify playlist through Spotify's interface. Choose an image to see a large preview and extracted songs, then tap Create playlist. On iOS 27, the on-device Foundation Models session receives the full uploaded image and each live phone screenshot. It chooses actions and coordinates directly, including unlabeled icons, without an OCR control menu. cell-use delivers the inputs and returns fresh observations.

The app keeps the song inventory and an exportable action timeline. The model reports completion from its own assessment, recorded as agentJudgment. An optional Photos Shortcut passes an image into the app for voice activation. The example also supports copying a small Spotify playlist into Apple Music, on-device speech requests, automatic Spotify opening, pairing and cancellation.

The SDK gains explicit Return, Backspace and Select All commands. The native screenshot session budget increases to 15 minutes; this app bounds runs to 10 minutes. The IPA configuration helper preserves the executable while adjusting background task identifiers for signing.

Validation: Xcode 27 unsigned iPhone build, core and native integration suites, fourteen playlist and screenshot tests, and repository validation passed. Build 8: https://github.com/Raynan00/cell-use/actions/runs/36391650965

@Raynan00 Raynan00 changed the title Add Playlist Move demo with an on-device model Add Playlist Move with Photos voice activation and an on-device agent Sep 28, 2026
@Raynan00 Raynan00 changed the title Add Playlist Move with Photos voice activation and an on-device agent Add Playlist Move with screenshot import and an on-device agent Sep 28, 2026
@Raynan00 Raynan00 closed this Sep 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant