Skip to content

chore(test): WIP per-surface test projects and behavior baselines for the agent/store/tui split (P0) - #1269

Closed
gewenyu99 wants to merge 3 commits into
mainfrom
posthog/split-agent-store-tui
Closed

gewenyu99 wants to merge 3 commits into
mainfrom
posthog/split-agent-store-tui

Conversation

@gewenyu99

Copy link
Copy Markdown
Collaborator

P0 of the agent/store/tui split: Vitest projects per surface, a surfaces workflow, and goldens captured from the current tree that later phases must keep byte identical.

Baselines: 88 screen frames through the real ScreenContainer, keyboard versus control action session diffs, store invariants, flow traces and screen analytics per program, post auth gate ids, the MCP control state sequence, prod and CI chunk manifests, and an import boundaries test seeded with the 72 current cross surface edges. No behavior changes except the type fixes in the first commit, which also stops RevenueIntroScreen from calling array methods on a Set.


Created with PostHog Desktop

Type-only fixes for the 32 errors tsc reported. One runtime fix rides along:
RevenueIntroScreen spread the POSTHOG_SDKS and STRIPE_SDKS sets before
calling array methods on them, which previously threw on those branches.

Generated-By: PostHog Desktop
Task-Id: d14e92bb-6ee1-49b5-8502-39cb80079589
Projects: store, agent, tui, cli, harness, architecture, keyed by today's
directories. New scripts test:<project> and test:arch, a surfaces workflow
that runs each project alone plus a production and CI bundle audit, aliases
and empty shape files for the future src/{store,agent,tui,cli} surfaces, and
a chunk manifest script for dist/.

Generated-By: PostHog Desktop
Task-Id: d14e92bb-6ee1-49b5-8502-39cb80079589
Goldens recorded from the current tree: a frame per screen and overlay at two
sizes through the real ScreenContainer, keyboard versus control action session
diffs, store invariants, flow traces and screen analytics per program, post
auth gate ids, the MCP control state sequence, and prod and CI chunk
manifests. The import boundaries test seeds the 72 current violations and
fails on new ones or stale entries.

Generated-By: PostHog Desktop
Task-Id: d14e92bb-6ee1-49b5-8502-39cb80079589
@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci ai-observability
  • /wizard-ci basic-integration
  • /wizard-ci mcp-analytics
  • /wizard-ci replay-vision
  • /wizard-ci revenue
  • /wizard-ci self-driving
  • /wizard-ci warehouse
  • /wizard-ci warehouse-seeded

Test an individual app:

  • /wizard-ci ai-observability/anthropic
  • /wizard-ci ai-observability/google-adk
  • /wizard-ci ai-observability/groq
Show more apps
  • /wizard-ci ai-observability/manual-capture
  • /wizard-ci ai-observability/openai
  • /wizard-ci ai-observability/openai-agents
  • /wizard-ci ai-observability/opentelemetry
  • /wizard-ci ai-observability/vercel-ai
  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/flutter
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci mcp-analytics/custom-dispatcher
  • /wizard-ci mcp-analytics/typescript-sdk
  • /wizard-ci replay-vision/javascript-node
  • /wizard-ci replay-vision/next-js
  • /wizard-ci replay-vision/react-vite
  • /wizard-ci revenue/stripe
  • /wizard-ci self-driving/astro
  • /wizard-ci self-driving/fastapi
  • /wizard-ci self-driving/nuxt
  • /wizard-ci self-driving/react-router
  • /wizard-ci self-driving/sveltekit
  • /wizard-ci warehouse/monorepo-env
  • /wizard-ci warehouse/multi-source-next
  • /wizard-ci warehouse/stripe-node
  • /wizard-ci warehouse/zero-source
  • /wizard-ci warehouse-seeded/next-stripe
  • /wizard-ci warehouse-seeded/next-stripe-declined

Test against a Context Mill branch:

  • /wizard-ci all context-mill:my-branch

Add context-mill:<branch> to any command above to pin the Context Mill branch. It defaults to main.

Results will be posted here when complete.

Comment on lines +10 to +29
name: Architecture
runs-on: ubuntu-latest
timeout-minutes: 10
steps:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4.3.1
- uses: pnpm/action-setup@eae0cfeb286e66ffb5155f1a79b90583a127a68b # v2.4.1
with:
version: 10.34.5
run_install: false
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4.4.0
with:
node-version-file: 'package.json'
cache: 'pnpm'
- run: pnpm install --frozen-lockfile
- run: node scripts/generate-version.cjs
- run: pnpm typecheck
- run: pnpm lint
- run: pnpm test:arch

surface:
Comment on lines +30 to +56
name: ${{ matrix.project }}
runs-on: ubuntu-latest
timeout-minutes: 15
strategy:
fail-fast: false
matrix:
project: [store, agent, tui, cli, harness]
steps:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4.3.1
- uses: pnpm/action-setup@eae0cfeb286e66ffb5155f1a79b90583a127a68b # v2.4.1
with:
version: 10.34.5
run_install: false
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4.4.0
with:
node-version-file: 'package.json'
cache: 'pnpm'
- run: pnpm install --frozen-lockfile
- run: node scripts/generate-version.cjs
- run: pnpm test:${{ matrix.project }} --coverage
- uses: codecov/codecov-action@13ce06bfc6bbe3ecf90edbbf1bc32fe5978ca1d3 # pin@v5.3.1
with:
token: ${{ secrets.CODECOV_TOKEN }}
fail_ci_if_error: false
flags: ${{ matrix.project }}

bundle:
Comment on lines +57 to +86
name: Bundle audit
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4.3.1
- uses: pnpm/action-setup@eae0cfeb286e66ffb5155f1a79b90583a127a68b # v2.4.1
with:
version: 10.34.5
run_install: false
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4.4.0
with:
node-version-file: 'package.json'
cache: 'pnpm'
- run: pnpm install --frozen-lockfile
- name: Production build and smoke test
run: pnpm build
- name: Production chunk manifest
run:
npx tsx scripts/chunk-manifest.no-jest.ts dist >
chunk-manifest.prod.json
- name: CI build and smoke test
run: pnpm build:ci
- name: CI chunk manifest
run:
npx tsx scripts/chunk-manifest.no-jest.ts dist >
chunk-manifest.ci.json
- uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4.6.2
with:
name: chunk-manifests-${{ github.sha }}
path: chunk-manifest.*.json
@gewenyu99 gewenyu99 changed the title WIP chore(test): per-surface test projects and behavior baselines for the agent/store/tui split (P0) chore(test): WIP per-surface test projects and behavior baselines for the agent/store/tui split (P0) Sep 18, 2026
@gewenyu99 gewenyu99 closed this Sep 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants