Skip to content

knowledge: audit Infera serving-search result provenance - #332

Open
Dong1017 wants to merge 5 commits into
InferMatrixLab:mainfrom
Dong1017:codex/issue91-infera-source
Open

Dong1017 wants to merge 5 commits into
InferMatrixLab:mainfrom
Dong1017:codex/issue91-infera-source

Conversation

@Dong1017

@Dong1017 Dong1017 commented Nov 3, 2026 •

Copy link
Copy Markdown
Collaborator

Refs #91. Refs #177.

Problem and scope

An Infera result labeled source="inference" can represent dry, analytical or anchor-assisted paths. Its best-summary output, retained history and scalar SLO checks also describe different evidence. This source-only amendment adds one implementation-bound reference to the existing calibrate-serving-simulation owner and a short route from optimization-search-policy.

The reference distinguishes measured anchors from target projections, a deterministic seed sweep from an LLM continuation, retained evaluated rows from future duplicate-evaluation skips, and the scalar parser from the separate DES percentile report. It preserves missing/unknown SLO-field limits and the code/documentation disagreement about split P/D queues. Trace-bound ranking calibration is an explicitly proposed independent study, with no supplied runner, calibration result or service guarantee.

Eight canonical paths contain two owner-local references, the two existing owner route/metadata pairs and the two matrix mappings. Existing Vidur knowledge and generic search rules remain intact. No registered skill, engine, planner, runtime, schema or experiment implementation is added.

Fixed source and provenance

  • AMD-AGI/Infera, commit ff1136e4a51998eba2933ed63cfb9c10120f86ea, tree 7ca812406c61b52452270c4c8c53d1582d510376.
  • The ordinary source record distinguishes 16 selected paths with full, bounded or definition-search inspection. Forty retained source/current-main files were checked against pinned Git blob and byte identities. The complete 2,861-entry tree is a path inventory, not a whole-repository audit.
  • Selected original code/documentation follows the pinned root MIT license. Dependencies, models, traces and third-party assets have separate rights. The public files contain original attributed prose, immutable links and source/readset identities; no upstream implementation, raw docs, tests, traces or model artifacts are copied.
  • The source history retains M1 d4a1922a452ed5b10f4cbd303d4f1d90e871f4b9 and corrected M2 fe3891c8db8c0fe38c8d5fd97b287ba19de82cf9 over main 663f3b327998526a13aa31e72ad729025c18983c. Actual canonical M3 f8a7e832feab05f8262ebe4057f34e2c8a48fd95 adds the existing calibration owner ID to the reference-matrix row so the original coverage parser attributes Infera correctly. Native G/H 0a215de89a7cd9023d022fd5e9f4d943ef5ebf99 was generated only after real M3. All eight canonical files remain unchanged in G/H; 81 native projection files retain existing owners, source records, matrices and registry.
  • Pending Xe-Forge, DeepSeek and NInfer source increments are not imported. Later integration must preserve each actual canonical increment and regenerate projections from the resulting combined source revision.

Validation and limits

The fixed source/readset and rights were grounded before construction. Independent private gpt-6.1-sol / ultra source review passed corrected M2, including retained duplicate history rows versus future evaluation skips, and separately passed the minimal M3 owner-mapping correction against the original parser contract. The reviewer is review-only.

Both original native write modes passed at actual M3. At final H, the original index check reported 79 current metadata records and the original coverage check matched its sources; both returned zero. The coverage row now attributes both Vidur and Infera to the existing calibration owner.

Real current-H native owner/catalog and resource readers passed for both affected owners. Checkout bundles contained 5 calibration resources and 26 search resources; each source-package bundle contained 757 resources. Complete bundle bytes, hashes, required resources and exact revisions were verified. Fourteen revision-bound resource API reads covered the two new references, owner/package entry points and cross-owner routes. Whole-resource Collect returned both requested owners for both adapters with complete manifests, matching entrypoint material and no omissions. Source-package reads use the checkout and are separate from wheel evidence.

Ready 41626479226 passed all six jobs. Python 3.10 and 3.11 full checks each reported 3,544 passed / 13 skipped / 1 warning / 284 subtests, plus Ruff. Both fresh isolated noneditable wheels loaded 127 source-grounded records from site-packages outside the checkout and verified the declared source resources, including both new references. The actual tested merge 8422a362cf019819c65d43073eda003f8d36e6e9, with main 663f3b32 and this H as parents, has exactly this H tree.

Independent private gpt-6.1-sol / ultra review covered the complete final H, fixed source interpretation, the M3 correction, all native projections, actual readers and current CI/wheel evidence: LGTM, with no findings. The reviewer is review-only. Current-H Codex review completed without findings or unresolved flags. The previous owner-mapping thread remains unmodified and outdated; its source issue is corrected and independently verified. Current PR checks report the final head-bound declaration result.

Earlier M1 outputs, pre-H checks, H 16a29658 software results and the interrupted expanded historical-resource reader attempt remain separate historical evidence. They are not substituted for the final-H checks above. No SkillEval comparison or model call was executed; unsupported paths supply no efficacy result.

Knowledge remains candidate/not_run and efficacy remains not_evaluated. Source test definitions were inspected, not run. No upstream import/build/test/CLI, model/device/service execution, ranking calibration, agent comparison or paid trial was performed. Software and source consistency do not establish measured optimization benefit.

Knowledge authorship declaration

{
  "schema_version": 1,
  "head_sha": "0a215de89a7cd9023d022fd5e9f4d943ef5ebf99",
  "human_only": false,
  "material_ai_authors": [
    {
      "tool": "Codex",
      "model_id": "gpt-6.1-sol",
      "effort": "max",
      "role": "author"
    }
  ]
}

Add an implementation-bound reference for result provenance, deterministic seed comparison, complete evaluated-trial history and future trace-bound ranking calibration in the existing knowledge owners.

Signed-off-by: Dong1017 <55723162+Dong1017@users.noreply.github.com>
Agent-assisted-by: Codex / gpt-6.1-sol [effort=max] (author)
Retain valid duplicate history rows in the Infera source explanation and separate signature-based future evaluation skips from loading the ledger.

Signed-off-by: Dong1017 <55723162+Dong1017@users.noreply.github.com>
Agent-assisted-by: Codex / gpt-6.1-sol [effort=max] (author)
Build the native catalog and coverage from the corrected canonical source revision while preserving all existing owners and source records.

Signed-off-by: Dong1017 <55723162+Dong1017@users.noreply.github.com>
Agent-assisted-by: Codex / gpt-6.1-sol [effort=max] (author)
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Nov 3, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-11-03T11:23:54.488617Z 0a215de New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown

Skill evaluation

PLANNED: not executed; there are no task outcomes yet.
No approval, model efficacy or current-head test result is implied.

  • Next: run the pinned source/index --check below at head 0a215de89a7cd9023d022fd5e9f4d943ef5ebf99.
  • Task selection: confirm the prepared task tests the changed claim.
  • Selected comparisons: 1 · Estimated task calls: 2. Uncovered/unsupported changes: 87; Canonical library paths: 4; Generated projection paths: 80; Other paths: 3. These are paths, not independent claims.
  • Return: command, input/source pin, exit status, outputs/failures and untested claims for independent verified/refuted/unverified disposition.
Author verification steps (nonpaid; not yet run)
  1. Bind the checkout. Run git rev-parse HEAD; it must equal 0a215de89a7cd9023d022fd5e9f4d943ef5ebf99. If it differs, obtain a current plan; do not reuse old results.
  2. Check source/index consistency. At that PR checkout, using the reviewed repository tool and its documented development dependencies, run:
python tools/build_skill_index.py --source-revision f8a7e832feab05f8262ebe4057f34e2c8a48fd95 --check

The declared source pin matches this head's canonical library bytes. The command has not run: retain its exit code and full drift/success output. It checks the generated projection, not claim truth or skill efficacy.

  • optimization-search-policy
    Selected by the trusted path mapping: src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md; src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json.
    Task case-05: Diagnose this blocked request at the recorded decision boundary; propose the next read-only check.
    Scope: Synthetic finite-state observations; not a production trace or engine benchmark.
    Required answer fields: diagnosis, evidence, next_check, reuse_authorized.
    Independent check: frozen kv-admission-diagnostic-v1 grader/schema bound in details. Confirm it tests the changed claim, not merely the touched path.
    From the downloaded skill-eval-plan artifact directory, inspect the first prepared task and its required answer schema (read-only; not grading):
python -m json.tool optimization-search-policy/plan/tasks.json
python -m json.tool optimization-search-policy/plan/schema.json

Uncovered scope by location: Canonical library paths: 4; Generated projection paths: 80; Other paths: 3. Path counts are not claim counts; no metadata-only conclusion is inferred.
3. Return evidence for independent review: head, check/task/source pin, command, environment, exit status, outputs/failures and untested claims. Label scripted controls. Request each claim's disposition: verified, refuted or unverified; this plan proves neither model provenance nor benefit.
Check recipes and evidence limits

Evidence and logs · Retention: 30 days.
Retained artifacts are verifiable only before Unix time 1796301719 while the linked artifact is available. Expired evidence is unverified.

Plan bindings, budget, frozen exam and advisory details

Advisory: obtain missing evidence

Retained evidence availability: planned / unexecuted. No approval or merge authorization is issued.
Applicable only while these revisions and inputs match the current PR.
Paid execution requires trusted label authorization and cumulative PR reservation. Unknown accounting blocks new paid calls; planning is not execution.
Pipeline evidence only; offline fixed outputs do not establish skill efficacy.
Unchanged-correct is valid neutral evidence, not incremental benefit.
Content/source review and authorship admission remain separate.
Trusted regrading checks retained answers, not model/hardware provenance or a hostile executor; this is not an efficacy certification.

  • Retained evidence is planned / unexecuted.
  • Uncovered/unsupported scope needs a case or explicit reviewer disposition.
    Plan SHA-256: ea9e9f4e590f43daa3d10a9655a2a30f57e4d6ee439b87c53474a7f5abdcc30e
    Base: 663f3b327998526a13aa31e72ad729025c18983c · Head: 0a215de89a7cd9023d022fd5e9f4d943ef5ebf99
    Trusted implementation: 663f3b327998526a13aa31e72ad729025c18983c

Model/settings: {"effort":"not_applicable","name":"claude-opus-5-5"}
Budget: {"comparisons":1,"estimated_calls":2,"limits_per_comparison":{"campaign_seconds":600,"max_task_calls":2,"repeats":1,"timeout_seconds":180,"token_stop_new_trials":200000},"provider_config_sha256":"b28d80f8194fbe0f5a9f01515efb24b218979fd45f702776560da276f4b30d04","reservation":{"amount":"20.34","currency":"USD","group":"default","limit":"200","per_request":"10.17","pricing_sha256":"2a82453ec18b75b92e12f9a9c18e6b57811a3ef593c31e4639b839df218cac39","requests":2}}

Skill Comparison Cases Estimated calls
optimization-search-policy update case-05 (holdout) 2

Frozen exam hashes: {"cases":"a0dd4e1615402a3a629f925c15435470095c27eeac54c4a2080c2d874abeb031","grader":"e25cfee943052aaefbddf3f545fe6d56d95ab1edb9723cd9353feeabc954ea9a","schema":"46ed2e63dadd5f9fa60107ff58b020554b42f47472ca80b4de9add79d92f8449"}

Selection/task metadata (not a relevance verdict):

{"adapter":"kv-admission-diagnostic-v1","basis":"trusted_path_mapping","matched_paths":["src/inferrsi/data/skill_library/methods/optimization-search-policy/SKILL.md","src/inferrsi/data/skill_library/methods/optimization-search-policy/metadata.json"],"required_answer_fields":["diagnosis","evidence","next_check","reuse_authorized"],"tasks":[{"id":"case-05","provenance":"Synthetic finite-state observations; not a production trace or engine benchmark.","request":"Diagnose this blocked request at the recorded decision boundary; propose the next read-only check.","split":"holdout"}]}

Automatic execution / cumulative PR budget:

{"reason":"Trusted configuration or pricing missing, invalid or expired","remaining_usd":"unknown","reserved_or_unresolved_usd":"unknown","spent_or_legacy_usd":"unknown","state":"blocked"}

Projection check selection (not an executed result):

{"declared_in":"src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md","source_revision":"f8a7e832feab05f8262ebe4057f34e2c8a48fd95","status":"ready"}

Provider/settings: {"client":{"api_version":"2023-06-01","endpoint":"https://yibuapi.com/v1/messages","kind":"anthropic-messages-full-context-v1","max_output_tokens":4096,"max_read_bytes":32768,"max_request_bytes":262144,"max_requests":1,"max_tool_calls":12,"provider":"yibuapi"},"limits":{"token_stop_new_trials":200000},"model":{"effort":"not_applicable","name":"claude-opus-5-5"},"pricing":{"currency":"USD","expires_at":1793271228,"group":"default","max_input_tokens":1000000,"model":"claude-opus-5-5","rate_evidence":"https://github.com/InferMatrixLab/InferRSI/issues/215#issuecomment-6467531341","rates":{"cache_read":"0.4","cache_write":"10","input":"8","output":"40"},"request_fee":"0","unit":"per_million_tokens"},"spend_limit":{"amount":"200","currency":"USD"}}

Uncovered / unsupported paths (87)
  • uncovered: "docs/reference-matrix.md"
  • uncovered: "docs/searchspace-matrix.md"
  • uncovered: "docs/skill-coverage.md"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-aclgraph-capture-replay.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-device-health.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-distributed-parallel.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-graph-mode.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-model-adaptation.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-profiling.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-operator-tuning.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-optimization-casebook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-performance-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascend-video-diffusion-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/ascendc-tiling-design.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/cann-attribution-overlap.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torch-npu.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-device-memory-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/ascend/skills/torchnpu-pinned-host-memory-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-serving-preemption.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/assess-split-backward-schedule.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-fixed-workload-claim.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-metal-fasth3-semantics.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-h3-runtime-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-llama-runtime-state.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-recurrent-kv-finalization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sd-cpp-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-sglang-diffusion-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/audit-vllm-kv-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/bound-windowed-attention-replay.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/budget-speculative-verification.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/calibrate-serving-simulation.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cgroup-resource-controls.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/checkpoint-recovery-consistency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/choose-parallel-training-plan.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/cite-check-downstream-pr.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/claim-contract.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/comfy-ui.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/competitor-scan.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dcp-async-save-performance.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dense-performance-evidence.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diagnose-vllm-admission-pressure.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/diffusers-invocation-state.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/draft-acceptance-issue.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/dwarfstar.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/evaluate-elastic-serving-placement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/generation-cache-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-memory-management.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/host-overhead-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/husky.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-benchmark-design.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/inference-optimization-casebook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kernel-writing-guide.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/kv-tier-management.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lazy-evaluation-stream-lifetimes.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lily.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/lithos-metal.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/local-dream.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mistral-rs.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlc-llm.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/mlx-swift-lm.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/npu-skill-factory.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/optimization-search-policy.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/os-process-placement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/performance-ceiling-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/plan-activation-residency.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/project-maya.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/pytorch.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/repository-evolution-analysis.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/rsi-evidence.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/skill-evolution-playbook.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/splash.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/storage-io-measurement.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-input-pipeline.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/training-resource-budget.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/video-diffusion-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/vllm-metal.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/common/skills/weight-loading-optimization.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-afd-p2p-exchanges.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/audit-flare-session-lifecycle.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/diagnose-attention-bottlenecks.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/host-overhead-profiling.json"
  • uncovered: "src/inferrsi/data/repo_packs/inferrsi/knowledge/cuda/skills/reason-hopper-kernels.json"
  • uncovered: "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md"
  • uncovered: "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/metadata.json"
  • uncovered: "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/references/infera-serving-search/README.md"
  • uncovered: "src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/references/infera-serving-search/source-record.json"

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 16a296585e

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread docs/reference-matrix.md Outdated
| Original source / version | Inspected scope and local evidence | Mechanism / consumer | Evidence limits |
|---|---|---|---|
| Vidur — [2405.05465v2](https://arxiv.org/abs/2405.05465v2) | [A readset](../src/inferrsi/data/skill_library/methods/performance-ceiling-analysis/references/papers-20261015/READSET.md); §§3–7, A.1–A.2 | mined — operator/queue model calibration and joint-SLO shortlist → [calibrate-serving-simulation](../src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md), ceiling analysis | Empirical prediction, not physical bound; near-capacity CPU overhead and 12.65% maximum error in the specified appendix case; no current runtime calibration |
| [AMD Infera @ ff1136e4](https://github.com/AMD-AGI/Infera/tree/ff1136e4a51998eba2933ed63cfb9c10120f86ea) | Direct bounded source inspection, 2026-11-03: serving CLI/evaluator/history, seed/objective parser, launcher/DES countercheck and named unexecuted test definitions; [16-path readset and rights](../src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/references/infera-serving-search/source-record.json) | mined — one [calibration-owned provenance reference](../src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/references/infera-serving-search/README.md); search-policy links its seed comparator and evaluated-trial ledger | Source-derived candidate; empirical not_run. Scalar tuner scoring and DES percentiles are separate; missing SLO fields and stale no-P/D-queues text are qualified. Selected original paths MIT; no runtime, ranking accuracy, quality, service or agent-benefit result. |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Associate the Infera row with its registered calibration owner

When generating the coverage view, tools/build_skill_coverage.py::references() recognizes owners only through backticked registered IDs or links to /SKILL.md. This row has neither: its local links target resource files, so the builder associates Infera with no skill. Consequently, the regenerated docs/skill-coverage.md still lists Vidur as the calibration skill's only mapped source, omitting the new Infera provenance. Include a backticked calibrate-serving-simulation mention or a link to its skill entry and regenerate the coverage view.

AGENTS.md reference: AGENTS.md:L100-L100

Useful? React with 👍 / 👎.

Name the existing registered calibration owner in the reference matrix
so native coverage retains the Infera source mapping.

Signed-off-by: Dong1017 <55723162+Dong1017@users.noreply.github.com>
Agent-assisted-by: Codex / gpt-6.1-sol [effort=max] (author)
@Dong1017 Dong1017 added the area:knowledge Knowledge line: packs, skill library, knowledge admission label Nov 3, 2026 — with ChatGPT Codex Connector
Generate native projections from actual corrected canonical source
f8a7e83.

Signed-off-by: Dong1017 <55723162+Dong1017@users.noreply.github.com>
Agent-assisted-by: Codex / gpt-6.1-sol [effort=max] (author)
@agent-ci-infra-bot

Copy link
Copy Markdown

This docs-only PR adds an owner-local Infera serving-search provenance reference under calibrate-serving-simulation, routes it from optimization-search-policy, and regenerates the matrix/coverage projections; the body edit adds validation claims and a knowledge-authorship declaration. No defects found in the changed files, and the change stays within its linked tracking scope without claiming efficacy. Earlier finding (reference-matrix owner attribution): fixed — the row now names calibrate-serving-simulation, and build_skill_coverage.py --check attributes Infera to that owner. Locally, the coverage check, the 79-record skill-index check (run with a workaround for the container's git 2.39), ruff, and the knowledge/catalog test subset pass; hosted ready CI is green at 0a215de (the full local pytest needs git >= 2.45 and executable /tmp, which this container lacks). Upstream Infera bytes were not re-fetched, so this review verifies local consistency and hosted checks rather than the upstream claims.

Reviewed commit: 0a215de
Coverage: Checkout: 2647 files at 0a215de in a git worktree with the repository's history

Copy link
Copy Markdown
Collaborator

Review at head 0a215de8: no defect found in the Infera provenance reference in isolation (tools/build_skill_coverage.py --check passes locally, and the earlier Codex P2 on the reference-matrix owner token appears addressed), but I am not approving yet because of a cross-PR integration problem:

  1. Conflicts with the other open knowledge PRs: merging this head onto main together with any of Extend VLA observation-to-action benchmark guidance #342, Add source-bound TTS playout benchmark guidance #339, knowledge: validate NInfer state and completion contracts #325, knowledge: audit DeepSeek C expert-cache byte validity #324 or knowledge: distinguish Xe-Forge trial origin and timing #322 produces ~81 conflicting files in my local trial merges (generated repo_packs/.../knowledge/**, docs/skill-coverage.md, docs/reference-matrix.md, docs/searchspace-matrix.md).
  2. Expected: please agree a merge order with the other authors; after each predecessor lands, rebase, regenerate the projections from the new source revision, re-run the index/coverage checks and request re-review on the new head.

Not verified by me: the upstream source pins in references/infera-serving-search/source-record.json.

Dong1017 commented Nov 4, 2026

Copy link
Copy Markdown
Collaborator Author

@amy-why-3459 @zengchuang-hw, could you please independently review this PR at 0a215de89a7cd9023d022fd5e9f4d943ef5ebf99?

To address the cross-PR integration concern, I propose merging this PR first, followed by #322, #324, #325, #339 and #342, subject to each PR's current reviews and checks. After each predecessor lands, we will preserve the combined canonical sources, regenerate the shared index and coverage from the actual source revision, and revalidate the next head before requesting its review.

Please also let us know if you suggest a different order. Source and software checks do not establish model, device, or effectiveness results.

Copy link
Copy Markdown
Contributor

Thanks for the review request and proposed order. I did a Codex-assisted, non-voting integration check of 0a215de8 against current main (9dded7ad).

The current head is awaiting formal independent approvals.

@Dong1017
Dong1017 requested a review from david6666666 November 4, 2026 15:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:knowledge Knowledge line: packs, skill library, knowledge admission bot-reviewed kind:docs Documentation and template delivery

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants