Skip to content

Streaming Plan: Phase 1 (SRT + WebRTC via Cloudflare) + Phase 2 (Self-Hosted Muxer)#1982

Draft
aisraelov wants to merge 4 commits intodevfrom
use-webrtc-for-mux
Draft

Streaming Plan: Phase 1 (SRT + WebRTC via Cloudflare) + Phase 2 (Self-Hosted Muxer)#1982
aisraelov wants to merge 4 commits intodevfrom
use-webrtc-for-mux

Conversation

@aisraelov
Copy link
Member

@aisraelov aisraelov commented Jan 29, 2026

Summary

Restructures the streaming plan into a two-phase approach:

Phase 1: Fix Livestreaming + Add WebRTC for Miniapps (Cloudflare)

No new infrastructure needed. Two independent workstreams:

  • Workstream A — SRT for Managed Streams: Replace RTMP ingest with SRT (UDP-based) to fix livestreaming reliability on Mentra Live's flaky Wi-Fi. Cloudflare already returns SRT URLs in its API response, and StreamPackLite already has CameraSrtLiveStreamer. Cloudflare continues to handle RTMP rebroadcast to Twitch/YouTube.
  • Workstream B — WebRTC for Miniapps: Add WHIP/WHEP streaming so miniapps can get sub-second latency video from the glasses via Cloudflare. Note: Cloudflare requires WHIP+WHEP together (can't mix WebRTC in with RTMP out), so this is a separate path from managed livestreaming.

Phase 2: Self-Hosted Mentra Stream Muxer (unchanged)

The existing self-hosted MediaMTX-based plan for full control, China support, fallback frames, re-encoding, etc. No changes to this section.

Key files

  • cloud/mentra-stream-muxer/PLANNING.md — the full plan

🤖 Generated with Claude Code

@github-actions
Copy link

📋 PR Review Helper

📱 Mobile App Build

Waiting for build...

🕶️ ASG Client Build

Waiting for build...


🔀 Test Locally

gh pr checkout 1982

@isaiahb isaiahb self-assigned this Jan 30, 2026
@aisraelov aisraelov mentioned this pull request Feb 19, 2026
@coderabbitai
Copy link

coderabbitai bot commented Mar 5, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 226f838e-bc5f-4232-ae5f-d3aa693dc3d9

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch use-webrtc-for-mux
📝 Coding Plan
  • Generate coding plan for human review comments

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Mar 5, 2026

Deploying mentra-live-ota-site with  Cloudflare Pages  Cloudflare Pages

Latest commit: 9ebdb1b
Status: ✅  Deploy successful!
Preview URL: https://021c5bc4.mentra-live-ota-site.pages.dev
Branch Preview URL: https://use-webrtc-for-mux.mentra-live-ota-site.pages.dev

View logs

@cloudflare-workers-and-pages
Copy link

Deploying mentra-store-dev with  Cloudflare Pages  Cloudflare Pages

Latest commit: 9ebdb1b
Status: ✅  Deploy successful!
Preview URL: https://58b2dccd.augmentos-appstore-2.pages.dev
Branch Preview URL: https://use-webrtc-for-mux.augmentos-appstore-2.pages.dev

View logs

@cloudflare-workers-and-pages
Copy link

Deploying dev-augmentos-console with  Cloudflare Pages  Cloudflare Pages

Latest commit: 9ebdb1b
Status: ✅  Deploy successful!
Preview URL: https://bc967d10.dev-augmentos-console.pages.dev
Branch Preview URL: https://use-webrtc-for-mux.dev-augmentos-console.pages.dev

View logs

@cloudflare-workers-and-pages
Copy link

Deploying prod-augmentos-account with  Cloudflare Pages  Cloudflare Pages

Latest commit: 9ebdb1b
Status: ✅  Deploy successful!
Preview URL: https://d543fda1.augmentos-e84.pages.dev
Branch Preview URL: https://use-webrtc-for-mux.augmentos-e84.pages.dev

View logs

@aisraelov aisraelov changed the title mux plan v1 WebRTC Plan Mar 14, 2026
Split streaming plan into two phases:
- Phase 1: Fix livestreaming reliability by switching RTMP to SRT ingest
  (Cloudflare already supports it), and add WebRTC WHIP/WHEP streaming
  for miniapps via Cloudflare
- Phase 2: Self-hosted Mentra Stream Muxer (existing plan, unchanged)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@aisraelov aisraelov changed the title WebRTC Plan Streaming Plan: Phase 1 (SRT + WebRTC via Cloudflare) + Phase 2 (Self-Hosted Muxer) Mar 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants