Skip to content

docs: document the live fleet, add hive failover and home k3s kits, archive Talos - #387

Merged
hanthor merged 3 commits into
masterfrom
docs/infra-inventory-2026-11
Nov 18, 2026
Merged

hanthor merged 3 commits into
masterfrom
docs/infra-inventory-2026-11

Conversation

@hanthor

@hanthor hanthor commented Nov 18, 2026

Copy link
Copy Markdown
Owner

Brings the handbook and repository in line with the fleet as of 2026-11-18. Much of the documentation still described a home Talos cluster "in storage", an EC2 punjab, and the hives on spindle. None of these is true now.

New

  • Fleet status: every tailnet host as live, intermittent or retired, with a diagram and a list of offline tagged nodes that can be removed (feat(tailnet): gc, rename and inventory alignment (scripts/tailnet.py) #333 automates that).
  • Host pages: bihar, karnataka, home k3s + KubeStellar (design, required firewalld rules, ITS/WDS, WEC labels).
  • Hives hosting and failover: the hives moved to bihar today, with karnataka as a cold standby. Spindle coordinates through a lease. The page covers operation, failover, install and rollback, and the drill results (automatic failover in 5 min + 27 s, failback in 50 s).
  • hives/: failover scripts, compose host layers and systemd units. They are byte-identical to the deployed copies.
  • home-k3s/{bihar,karnataka}: k3s install kits and karnataka's workload manifests. Secrets are created out of band; the manifests contain only secretKeyRefs.

Updated

  • punjab: now a KubeVirt VM on karnataka. The EC2 history is kept. Its disk is 96% full.
  • spindle: the hives moved off, MAS was replaced by Spindle OIDC, v0.1.6.
  • Hive guide: the "current deployment" section now uses bihar and karnataka paths and commands. The roster and configuration are unchanged.
  • README, index, inventory, network, CONTEXT, CLAUDE.md.
  • inventory.yml: fixes punjab's ansible_host (it pointed at the retired EC2 100.78.73.8). Adds bihar as bootstrap.sh registered it. karnataka is left out because it is configured from refactor: migrate fleet configuration to native units #348.

Archived

  • docs/src/archive/: the home Talos handbooks (cluster, bihar, karnataka), the Talos overview, and the retired Hetzner VPS pages. The relative links were fixed.
  • talos-k8s/ has a banner but stays in place, because tests refer to talos-k8s/hive/**.
  • The home-k8s server images are marked "not deployed". The hosts run stock utah:testing.

Checks

  • mdbook build: OK. Every relative link resolves, except the existing talos-k8s/README.md → worker.yaml link, which points at a gitignored file.
  • yamllint (CI config), shellcheck -S error, and pytest tests: 366 passed.

Overlap with open PRs

Several of these docs PRs now describe states that are superseded, for example the hives on spindle.

🤖 Generated with Claude Code

hanthor and others added 3 commits November 18, 2026 18:54
…rchive Talos

Bring the handbook and repo in line with the fleet as of 2026-11-18:

- Add docs/src/fleet.md: every tailnet host as live, intermittent or
  retired, plus a list of offline tagged nodes to remove.
- Add host pages for bihar and karnataka (Bluefin + k3s, no longer Talos),
  a home k3s + KubeStellar page, and a hives hosting/failover runbook.
- Add hives/: the failover lease scripts (hive-failover on spindle;
  hive-reconcile and hive-sync on the hosts), compose host layers and
  systemd units, byte-identical to what is deployed.
- Add home-k3s/{bihar,karnataka}: the k3s install kits and karnataka's
  workload manifests (secrets are out of band; only secretKeyRefs here).
- Update punjab (now a KubeVirt VM on karnataka), spindle (hives moved
  off; MAS replaced by Spindle OIDC; v0.1.6), the hive guide's current
  deployment section, README, index, inventory, network, CONTEXT and
  CLAUDE.md.
- inventory.yml: point punjab at its VM (the old address was the retired
  EC2 instance) and add bihar as bootstrap.sh registered it.
- Archive: move the home Talos handbooks and the retired Hetzner VPS pages
  under docs/src/archive/, banner talos-k8s/ (kept for tests), and mark
  the home-k8s server images as not deployed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… updated for bihar

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
hive-reconcile and hive-sync never ran from their timers: SELinux denies
systemd exec of var_t scripts (203/EXEC). Start them through /usr/bin/bash.
Under systemd, rsync also moves into rsync_t, where its ssh cannot read the
key or ssh_config, so hive-sync.service runs as unconfined_t (setsebool -P
does not persist on bootc).

Port spindle's hive-cleanup to the podman hosts (hourly): idle Claude
scratch and stale /tmp work dirs in running spokes, dangling images, old
backups; measures /var. Document all of this and the reduced spindle
rollback path (its stale data, arm64 binaries and images were removed).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@hanthor
hanthor force-pushed the docs/infra-inventory-2026-11 branch from 3fd8fb3 to df8b9ed Compare November 18, 2026 18:54
@hanthor
hanthor merged commit 8241aee into master Nov 18, 2026
9 checks passed
@hanthor
hanthor deleted the docs/infra-inventory-2026-11 branch November 18, 2026 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant