Skip to content

Add voice, image, sessions, search, and header tab switcher#4

Open
vladharl wants to merge 2 commits intonewmaterialco:mainfrom
vladharl:feat/device-identity-and-workspace-sync
Open

Add voice, image, sessions, search, and header tab switcher#4
vladharl wants to merge 2 commits intonewmaterialco:mainfrom
vladharl:feat/device-identity-and-workspace-sync

Conversation

@vladharl
Copy link

@vladharl vladharl commented Feb 23, 2026

Summary

  • Header segmented control: Replace bottom tab bar with a compact 3-segment pill toggle (Sessions / Chat / Cron) in the header bar, freeing up bottom screen space
  • Voice input & output: Mic button (SFSpeechRecognizer) for speech-to-text input, speaker toggle (AVSpeechSynthesizer) for auto-reading assistant responses
  • Image & camera input: Photo library picker + camera capture, with base64 attachment encoding via the gateway's chat.send attachments API, inline thumbnails in chat
  • Multi-session support: Session list tab for creating, switching, renaming, and deleting sessions with per-session message storage and legacy migration
  • Message search: Search overlay with debounced filtering, highlighted result snippets, and scroll-to-message on tap
  • Device identity: Ed25519 device authentication with Keychain-stored keypair and workspace file sync (IDENTITY.md / USER.md)

Test plan

  • Tap Sessions/Chat/Cron icons in header pill — views switch, selected icon highlighted, chat state preserved
  • Tap mic icon — permission prompt appears, speech is transcribed into input field, icon turns red while listening
  • Tap speaker icon — toggles TTS on/off, new assistant messages are spoken aloud when enabled
  • Tap photo button — picker sheet appears, select image or take photo, thumbnail shows in input bar, sends with message
  • Switch to Sessions tab — create new session, switch between sessions, verify separate message histories
  • Tap search icon — search bar appears, type query, results highlight matches, tap result scrolls to message
  • Verify cron jobs tab still loads and refreshes correctly
  • Verify all existing features (approvals, activity shimmer, settings, debug log) still work

🤖 Generated with Claude Code

vladharl and others added 2 commits February 22, 2026 22:44
Implement device identity (Ed25519 keypair) for gateway authentication,
enabling operator.read and operator.write scopes when connecting through
Cloudflare Tunnel or other remote proxies. Without device identity, the
gateway strips scopes from non-local connections.

Also fetch IDENTITY.md and USER.md from the gateway workspace on connect
so the app displays the agent's identity and user profile immediately,
rather than only updating when the agent writes to those files.

Changes:
- New DeviceIdentity service: generates and persists an Ed25519 keypair
  in Keychain, derives device ID (SHA-256 of public key), and signs the
  gateway connect handshake payload (v2 protocol with nonce)
- ChatService: include device identity in connect request params
- ChatService: fetch IDENTITY.md and USER.md via agents.files.get after
  hello-ok, parse responses from payload.file.content

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
… tab switcher

Replace bottom tab bar with a compact 3-segment pill toggle
(Sessions/Chat/Cron) in the header. Add voice input via
SFSpeechRecognizer with mic button, TTS output via
AVSpeechSynthesizer with speaker toggle, image/camera input
with PhotosPicker and base64 gateway attachments, multi-session
management with per-session message storage, and message search
with highlighted results and scroll-to-message.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@vladharl vladharl changed the title Add device identity auth and workspace file sync on connect Add voice, image, sessions, search, and header tab switcher Feb 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant