Skip to content

W1: admit PawBench DeepSeek V4 Pro harness panel for #93 - #152

Merged
xLagerFeuer merged 11 commits into
mainfrom
w1-public-evidence-93-pass56-pawbench-deepseek-v4-pro
Sep 30, 2026
Merged

xLagerFeuer merged 11 commits into
mainfrom
w1-public-evidence-93-pass56-pawbench-deepseek-v4-pro

Conversation

@xLagerFeuer

@xLagerFeuer xLagerFeuer commented Sep 30, 2026 •

Copy link
Copy Markdown
Member

Bounded W1 pass 56 for issue #93.

Adds three append-only PawBench v1.0 observations for the fixed source model label deepseek-v4-pro across Hermes, OpenClaw, and QwenPaw, pinned to agentscope-ai/PawBench@0f794a8bb6c27aa9ee4091b2691fa30e4ed9cc8f.

The pass preserves source overall_score, automated_score, judge_score, task counters, and unknown historical harness versions. It explicitly preserves the OpenClaw source inconsistency (tasks=150, tasks_total=150, tasks_missing=3) rather than repairing it. Later Docker package pins are not back-projected into the May 29 results.

Validation provenance:

  • worktree renderer + live admission: run #434, success;
  • generated-view persistence completed in run #438, success;
  • generated registry: 326 -> 329 observations;
  • standard workflow restored to blob 244ad9701f41e6122f37c0676a00e705cddd622f;
  • standard read-only validation: run #440, success;
  • metadata-bound final validation: run #441, success;
  • final diff: raw observation record + W1 handoff + REGISTRY.md + registry.psv; no workflow delta.

Runs #433/#435/#437 were control-plane persistence failures and are preserved in the handoff; none rejected the evidence.

No structural classification, historical-linkage adjudication, matched-cell eligibility decision, statistical interpretation, ranking, winner selection, or paper claim is performed. Issue #93 remains active through the frozen collection cutoff.

@xLagerFeuer
xLagerFeuer merged commit 2398517 into main Sep 30, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant