Skip to content

docs(research): link retained benchmark trajectories - #8235

Merged
huangruiteng merged 1 commit into
mainfrom
codex/research-history-source-20261107-014233
Nov 7, 2026
Merged

huangruiteng merged 1 commit into
mainfrom
codex/research-history-source-20261107-014233

Conversation

@loopx-agent

Copy link
Copy Markdown
Collaborator

Goal And Delivered Outcome

The existing Grid, Ad placement, and Schemathesis research fixtures preserve native Explore records but had no pinned link to their matching captured solver sessions. Each now records an immutable archive URL and SHA-256. The research history guide links the capture set, manifest, and redaction audit.

The three archives contain four retained native session files and 382 byte-identical Explore records. The longer Schema worker capture preserves 56 records absent from the shorter receiver copy. The manifest identifies the two captures and their prefix relationship. The earlier checkpoint release remains available at its original revision.

  • Intended base: main.

Author Declaration

  • Written by: model_agent (OpenAI Codex).

Implemented against

Criterion (spec clause) Disposition Symbol / path Test or command
Keep the three fixtures' original evidence identity and distinguish recorded evidence from full run coverage (§5.11, Layer 1) implemented provenance.trajectory_archive, examples/personal-workspace-browser/research-history.md Compared immutable ZIP bytes and original Explore digests against the fixtures; see Validation.
Establish whole-history route coverage, adoption, and native outcome attribution (§5.11, Layer 1) out_of_scope Existing Research Goal design The archives do not qualify these claims.
  • Self-check before submission: Reviewed the four-file diff, checked the pinned archive and its audit, and ran the fixture integrity and quick premerge checks at the tested revision.

Scope And Continuation

  • Completed scope: provenance for these three retained display captures. Session archives live in the fixed dataset revision; Git contains links, digests, and a guide.
  • Remaining research evidence: complete run coverage, observed adoption, native scoring, and total cost. The original invalid and cancelled statuses stay visible. No runtime, renderer, or installed App change is proposed.

Validation

  • Tested revision: 97956d9e4d2193675bc53eef75cd48f1c7bfa2ce.
  • Run state: finished.
  • Input classes: public_fixture, authorized_private_read_only.
Check kind Result Public-safe evidence / limitation
unit passed uv run --extra test python -m pytest tests/presentation/test_explore_history.py::test_checkpoint_fixture_reconstructs_original_captured_log_bytes -q (7 cases).
regression_parity passed The three existing fixture payloads are unchanged outside the archive pointers. Each pinned archive matches the original Goal/run/case and exact Explore digest.
manual passed Downloaded all seven artifacts at the immutable dataset revision; all matched their expected sizes and SHA-256. Verified the Schema prefix and kept the longer original. The published audit records only removals of opaque encrypted fields.
static passed Quick premerge passed: four direct and four selected checks, including the public boundary scan and bilingual RFC diff check. The first attempt found a missing TypeScript development dependency; installing the lockfile dependencies resolved it at the same head. The change quality receipt verified at this head.
  • Coverage and gaps: These checks cover archive identity, contents, and changes to fixture provenance. They do not establish whole-run capture, comparative results, or installed behavior.

Frontend / Visual Evidence

  • UI impact: none. The existing fixture display and rendering behavior are unchanged.

Type of Change

  • Documentation update

LoopX Area

  • Public docs or presentation surface (README, protocols, dashboard)

Technical Direction

  • Long-horizon benchmark evidence; Research Goal history provenance.

Shared-authority RFC fixture impact

N/A. No shared authority behavior or fixture contract changed.

Boundary Checklist

  • The diff and PR body contain public-safe links and summaries; private state, credentials, raw logs, verifier output, and machine paths stay out of Git.
  • Existing benchmark artifacts were used; no benchmark was launched.
  • The change is scoped to archive provenance for three fixtures.
  • No paired RFC changed, and the bilingual diff check passed.
  • UI impact is marked none.
  • The commit includes a DCO Signed-off-by trailer.

Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>

@loopx-agent loopx-agent left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewer: model_agent, gpt-6.1-sol, OpenAI, runtime_reported, reasoning_effort=max

Approval conclusion (author-owned PR; GitHub blocks formal self-approval)

动机 / Motivation

查看 Grid、Ad 和 Schemathesis 历史样例的研究读者,需要知道当前记录来自哪份公开档案。
以前能打开三个 Explore 样例,但要另找原生档案并判断是否对应。现在可沿指南进入固定版本,并用样例所附摘要核对下载内容。
已核对三个公开 ZIP、清单和摘要。档案里的 382 条 Explore 记录逐字节对应原有样例,预览仍使用这些记录。
本次只交付来源追溯。真实运行采纳、评分和成本比较属于独立的实验验收。
这些档案仍只提供可追溯的记录。完整时间线的产品接入、原始材料的脱敏复验和有效实验结论各需自己的证据。

改动思路 / Approach

把固定版本的链接和摘要放在现有 fixture 的 provenance 内,能让读者沿原案例找到档案。
保留现有 Explore 预览和档案各自的读取路径。本次只为三个已捕获案例增加来源引用。
三个 ZIP 的 SHA-256 与固定清单一致,内嵌清单和四个压缩原生轨迹成员的摘要也一致。三份档案分别保留了 33、255 和 94 条已有 Explore 记录。归档完整度和试验有效性继续分开记录。 固定公开档案

具体改动 / Changes

依据改动前的 examples/personal-workspace-browser/research-history.md,版本 ac62962255322cd80a5b701a4187c6f47bc17d8c。fixture-source 的来源指针和原记录已逐字节核对。recorded-coverage 保留捕获边界和状态。whole-run-adoption 属于单独的产品与实验验证。 已有样例契约

关键代码讲解

  • 指南的 Captured session archives 区段列出固定版本、每个案例的档案和审计范围。 新增指南
  • provenance.trajectory_archive 为三个现有样例补充地址、摘要、清单和审计引用。去掉这一字段后,三个 fixture 与基线完全一致。 Grid 样例
  • 已有预览仍按样例选择 fixture 并读取原 Explore 记录。现有失败或取消状态与 score_countable=false 均保持。 现有样例读取

四个文件新增 48 行,覆盖三份 fixture 的溯源字段和一段指南。当前 main 在该基线之后的变更未触及这四个路径。

对主干的风险 / Risks

独立复核下载了三个固定版本 ZIP,比较了档案、清单和记录摘要。将一个指针改为错误摘要,或换成另一案例的完整指针,都会在读取内容前触发校验。七项固定 fixture 检查、八项 Explore 历史测试和本地 quick premerge 的四项直接检查与四项 catalog 均通过。远端 CI 未核验。

公开审计的 4,835 行都指向 encrypted_content,行数与对应清单一致。核验范围为公开元数据、压缩成员摘要与 Explore 原记录。原始私有内容的脱敏覆盖、Schemathesis 较短原生档案的字节对照和真实实验效果未验证。检查范围是公开研究指南、fixture 和已有 Explore 历史读取入口。没有渲染或首屏布局改动。未核验安装版界面。

我的整体评价 / Verdict

这项变更让读者能从原样例找到并核对同一份档案,现有预览和试验状态沿用原记录。证据支持提交这一范围的溯源变更。后续导入整段原生历史时仍需另验来源覆盖和读回。

English verdict: APPROVE

@huangruiteng
huangruiteng merged commit 6310d53 into main Nov 7, 2026
25 of 31 checks passed
@huangruiteng
huangruiteng deleted the codex/research-history-source-20261107-014233 branch November 7, 2026 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants