Skip to content

✨ feat(omp): add Karnataka Lemonade coding server - #360

Closed
hanthor wants to merge 2 commits into
feat/native-laptop-unitsfrom
feat/karnataka-lemonade
Closed

hanthor wants to merge 2 commits into
feat/native-laptop-unitsfrom
feat/karnataka-lemonade

Conversation

@hanthor

@hanthor hanthor commented Oct 31, 2026 •

Copy link
Copy Markdown
Owner

Changes

  • Register Qwen3-Coder-Next MXFP4 on Karnataka as a keyless, tailnet-only omp provider. Preserve existing custom providers, YAML/legacy JSON configuration, cloud roles, and model allowlist behavior.
  • Track the digest-pinned ROCm Podman Quadlet and document persistent volumes, private Tailscale forwarding, and recovery.
  • Share model-only provisioning between the normal omp unit and a narrow online-fleet rollout controller. A dedicated Punjab user timer retries every 30 minutes without applying the unrelated native-unit migration.

Verification

  • Full tests/test_omp_unit.py module: 10 passed.
  • Repeated live provisioning produced identical model and settings file hashes.
  • Direct coding response and structured tool-call/result round trip passed on Radeon 8060S with ROCm.
  • Actual omp CLI called read and returned the correct result with cloud fallback disabled.
  • After restarting Lemonade, omp on Spindle returned RESULT=42 through the configured remote provider.
  • Model-only fleet rollout exercised against Karnataka; installed systemd controller completed successfully and its timer is enabled with user linger.
  • Kubernetes remained active and Punjab remained Running.

Deployment and limits

Live configuration applied on Punjab, Karnataka, and Spindle. Mumbai, Himachal, Kerala, Dilli, and Kanpur were SSH-unreachable; the controller will attempt supported clients as they reconnect. It requires SSH, omp, and yq. Raw Termux has no OMP build; the phone target is its mumbai Debian guest.

The broker distributes credentials, not custom model definitions, and is unchanged. The endpoint is reachable only through the encrypted tailnet and has no API key; tailnet peers allowed by policy can use model-management endpoints too.

Stacked on the existing native-unit migration (#348). This PR intentionally excludes unrelated working-tree routing/Justfile/Beeper changes. The deployed controller uses an isolated payload, not unattended pulls/applies of the unmerged migration.

Signed-off-by: James Reilly <jreilly1821@gmail.com>
Signed-off-by: James Reilly <jreilly1821@gmail.com>
@hanthor

hanthor commented Nov 18, 2026

Copy link
Copy Markdown
Owner Author

Stale: this branch is 594 files behind master, and Lemonade on karnataka is scaled to 0 (2026-11-18). If the Lemonade coding server comes back, start again from current master.

Closed during the 2026-11-18 cleanup. The branch is kept, so this can be reopened.

@hanthor hanthor closed this Nov 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant