Skip to content

Report the local player's pose to drive RPCs - #2001

Merged
Noisemaker111 merged 3 commits into
betafrom
agent-player-pose
Oct 20, 2026
Merged

Noisemaker111 merged 3 commits into
betafrom
agent-player-pose

Conversation

@Noisemaker111

Copy link
Copy Markdown
Owner

Playtest agents on Harbor Heat, Deepward and Drift Foundry couldn't tell whether a held key moved the player: headless captures run at 0.2–3 fps, and debug_snapshot returned only render and frame data.

  • shell/devtools/agentBridge.ts: new player_pose verb returns { userId, position, rotationY } for the local player (rounded to mm). debug_snapshot gains the same object as player. GamePlayerShell passes the live context to the bridge.
  • playerPoseReport (@internal) with tests; the verify skill names the verb; changes/agent-player-pose.md.

Verification

  • bun test packages/shell/src/devtools/agentBridge.test.ts — 4 pass, 0 fail; check-types — pass; bun run gen — ok; ship:preflight — ok
  • Live, Harbor Heat with only shell swapped: drive --click "Hit the street" --rpc player_pose --key KeyW:4000 --rpc player_pose returned [-190, 1.2, 40] both times. With a --click-at on the canvas first, the second read was [-189.833, 1.2, 39.595]. That showed held keys never reached the game after the menu click, because focus was left on <body>. A separate PR fixes the focus.

No rendered surface changed.


Generated by Claude Code

Playtest agents could not tell whether held keys moved the player in
slow headless captures; debug_snapshot carried render and frame data only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01RwsemkhoUGyeQkdkKFmUmw
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01RwsemkhoUGyeQkdkKFmUmw

Copy link
Copy Markdown
Owner Author

test failed on one browser test: portable harness in Chromium > canonical drive scrolled target hit its 45 s limit. This PR changes the agent bridge, not the drive harness. My local run of that file was cut off by the time limit on a loaded machine, so it's inconclusive. I merged the latest beta (now with #2002) and pushed, which re-runs CI. I can't re-run the jobs directly (403).


Generated by Claude Code

@Noisemaker111
Noisemaker111 merged commit 8783cab into beta Oct 20, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants