Skip to content

feat(voice-agents): realtime-conversation recipe (Python + TypeScript) #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
luke-speechify wants to merge 2 commits into from
Closed

feat(voice-agents): realtime-conversation recipe (Python + TypeScript) #1

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a1c6f1a
feat(voice-agents): add python realtime-conversation recipe
luke-speechify Jun 17, 2026
6da424f
feat(voice-agents): typescript realtime-conversation recipe
luke-speechify Jun 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions COVERAGE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,16 +20,17 @@ suffix). See `agents/monorepo.md` for the convention.

## Voice Agents

Voice Agents has no SDK yet — all recipes are native REST (`-rest`). Bare names are
reserved for SDK versions.
Voice Agents recipes are native REST (`-rest`); `realtime-conversation` previews the
SDK's upcoming realtime support in both TypeScript and Python (pinned to the SDK's
pre-release branch until it ships).

| Recipe | TypeScript | Python | Rust |
| ---------------------------------------------- | :--------: | :----: | :--: |
| quickstart (create agent + start conversation) | ✅ | ✅ | ⬜ |
| manage agents (CRUD) | ✅ | ✅ | ⬜ |
| inspect conversation transcript | ✅ | ✅ | ⬜ |
| browser widget embed | ⬜ | — | — |
| live audio session (LiveKit room) | ⬜ | ⬜ | ⬜ |
| realtime conversation (stream audio in/out) | ✅ | ✅ | ⬜ |

> Rust columns are tracked for planning but Rust tooling is **not enabled yet** — see
> `agents/monorepo.md`.
26 changes: 15 additions & 11 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,17 +43,21 @@ pnpm install && pnpm start # writes output.mp3

### Voice Agents

Voice Agents has no SDK yet, so every recipe is **native REST** (`-rest` suffix). The bare
names are reserved for SDK versions once an SDK adds Voice Agents support.

| Recipe | Language | Description |
| ---------------------------------------------------------------------------------------------- | ---------- | ----------------------------------------------------- |
| [quickstart-rest](./recipes/voice-agents/typescript/quickstart-rest) | TypeScript | Create an agent and open a live conversation session. |
| [quickstart-rest](./recipes/voice-agents/python/quickstart-rest) | Python | Create an agent and open a live conversation session. |
| [manage-agents-rest](./recipes/voice-agents/typescript/manage-agents-rest) | TypeScript | Agent CRUD: create, list, get, update, delete. |
| [manage-agents-rest](./recipes/voice-agents/python/manage-agents-rest) | Python | Agent CRUD: create, list, get, update, delete. |
| [conversation-transcript-rest](./recipes/voice-agents/typescript/conversation-transcript-rest) | TypeScript | Start a conversation and read its transcript. |
| [conversation-transcript-rest](./recipes/voice-agents/python/conversation-transcript-rest) | Python | Start a conversation and read its transcript. |
Voice Agents recipes are **native REST** (`-rest` suffix) today. The first **SDK** recipe,
`realtime-conversation`, previews the SDK's upcoming realtime support in both TypeScript and
Python — it is pinned to the SDK's pre-release branch until that ships, then switches to the
published version.

| Recipe | Language | Description |
| ---------------------------------------------------------------------------------------------- | ---------- | ------------------------------------------------------------------------------------ |
| [quickstart-rest](./recipes/voice-agents/typescript/quickstart-rest) | TypeScript | Create an agent and open a live conversation session. |
| [quickstart-rest](./recipes/voice-agents/python/quickstart-rest) | Python | Create an agent and open a live conversation session. |
| [manage-agents-rest](./recipes/voice-agents/typescript/manage-agents-rest) | TypeScript | Agent CRUD: create, list, get, update, delete. |
| [manage-agents-rest](./recipes/voice-agents/python/manage-agents-rest) | Python | Agent CRUD: create, list, get, update, delete. |
| [conversation-transcript-rest](./recipes/voice-agents/typescript/conversation-transcript-rest) | TypeScript | Start a conversation and read its transcript. |
| [conversation-transcript-rest](./recipes/voice-agents/python/conversation-transcript-rest) | Python | Start a conversation and read its transcript. |
| [realtime-conversation](./recipes/voice-agents/typescript/realtime-conversation) | TypeScript | Stream audio to a voice agent in real time and save its spoken reply (SDK realtime). |
| [realtime-conversation](./recipes/voice-agents/python/realtime-conversation) | Python | Stream audio to a voice agent in real time and save its spoken reply (SDK realtime). |

See [`COVERAGE.md`](./COVERAGE.md) for the full product × language matrix and what's planned.

Expand Down
Loading