Skip to content

feat(browser): support bounded visual inspection and interaction #45

Closed

Description

@trmosala

What to build

Detailed pages, canvas controls and inaccessible shadow widgets have a usable visual fallback within the granted tab.

Acceptance criteria

  • Detailed viewport screenshots fit bounded transport through explicit image scaling/quality handling rather than an unexplained failure above 45 KiB.
  • Return actual captured dimensions and scaling, with enough legibility for supported tasks; no unbounded image payloads.
  • Visual actions bind to the observed tab, document and viewport generation and never reuse coordinates after replacement or layout changes.
  • Native hit routing supports embedded visual targets while preserving revocation, cross-tab isolation and dispatched-outcome reporting.
  • Fixtures exercise a detailed image, canvas widget and closed-root control; unsupported cases return an explicit reason.
  • Observation and interaction require no new permission gates inside the enabled tab.

Blocked by

Context

Source: revised CM_Browser review and whole-tab Agent Access requirement, 2 October 2026. This is follow-up work to the previously completed bounded browser implementation; existing issues remain closed.

Preserve main-process ownership, explicit revocation, stale-target protection and isolation from unrelated tabs. Coordinate with ongoing browser changes and the separate Microsoft sign-in fix. Native validation must distinguish fixture results from actual authenticated-site evidence. Do not restart the installed app or server, modify real calendar events, or enter/change/submit timesheets.

Activity

  1. added
    enhancementNew feature or request
    ready-for-agentScoped work with acceptance criteria and recorded blockers
    on Oct 2, 2026
  2. trmosala commented on Oct 2, 2026

    @trmosala
    OwnerAuthor

    Completed work saved; closing at the user's request.

    Screenshots use bounded quality/resolution with returned raster/viewport scaling. One-use visual refs bind actual native document and viewport/layout state. Native detailed-image, canvas, closed-root and real OOPIF routing fixtures passed; unsupported/perspective geometry reports a reason.

    Local commit: 7f746e8fcb7d2ad819b107aac2c0d7d9462d1361 on branch browser-gaps. This commit has not been pushed, merged or released.

    Fresh checkpoint validation: 410 tests / 6,620 assertions pass; all five affected package typechecks and the browser plugin build pass; native navigation and leave-confirmation reruns pass; scoped lint has 0 errors and 356 style warnings; formatting and whitespace checks pass. Earlier native fixture results are documented in the committed cm-browser README. These checks do not qualify authenticated Teams, macOS or a packaged app.

    Native UI screenshot and validation archive. No installed app/server was restarted and no real account data was modified.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestready-for-agentScoped work with acceptance criteria and recorded blockers

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions