Skip to content

test(corpus): lock audited external napplet evidence - #23

Draft
jodobear wants to merge 48 commits into
masterfrom
test/external-napplet-corpus
Draft

test(corpus): lock audited external napplet evidence#23
jodobear wants to merge 48 commits into
masterfrom
test/external-napplet-corpus

Conversation

@jodobear

@jodobear jodobear commented Jul 31, 2026

Copy link
Copy Markdown
Owner

Purpose

Partial, data-only slice of #21. This locks a small audited external napplet corpus before live fetch/launch automation exists. It does not close #21.

What changed

  • Locks four signed events from hzrd149/napplelets@aa4dc7a0799d95e3066b50055b29685d6e376045:
    • Good Morning
    • Rubik Cube
    • Nap Feed
    • WiFi Map
  • Records immutable event coordinates, source provenance, expected trust classification, and bounded automation labels.
  • Adds an offline verifier and tests for valid, invalid-signature, malformed, wrong-tool-version, and broken-tool cases.
  • Requires exactly the four audited names and rejects missing/unknown automation entries.
  • Requires the flake-pinned nak 0.20.1; host nak versions are rejected.
  • Resolves lock paths consistently, including relative and basename-only paths.
  • Captures and classifies failed jq entry enumeration instead of allowing an empty false-success loop.
  • Records the corpus lane and current dependency boundaries in the validated pack.

Deliberate limits

This PR adds no napplet artifact blobs, runtime registration, UI integration, dependency pins, or live-availability claims. It does not claim reproducible builds of the external projects. Live naddr fetch/launch/screenshots remain blocked on #13 and #17. Runtime dependency repinning remains #11.

Failure contract

  • exit 0: corpus valid
  • exit 2: trust failure, including an invalid signature
  • exit 3: verifier infrastructure failure, including missing/broken/wrong-version nak or malformed decoder output

safeAutomation uses a closed mapping; unknown values fail validation.

How tested

  • pnpm check
  • pnpm lint
  • pnpm test
  • pnpm test:ui — 22/22
  • Fallow — 0 issues
  • documentation audit — 47 docs, 76 links, 9 Mermaid diagrams, 0 errors/warnings
  • formatting check
  • ShellCheck
  • corpus verifier Node assertions — 7/7; 9/9 with shared contract checks
  • shell failure-classification matrix
  • exact flake verifier — 4/4
  • graphify path "External napplet interoperability corpus" "Runtime" — no runtime path

Independent defect review found four verifier-contract issues and one basename-path issue; all were fixed before PR creation. Exact-head Codex review then found an unknown-name allowlist bypass and an unpropagated jq enumeration failure. Both now have regressions and are fixed at f24f5fcba5e0079b16e754e4bc8eecc0cbfdd461.

Refs #21

@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e88a46de05

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.mjs
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f24f5fcba5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.sh Outdated
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 61350a326a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.mjs
Comment thread scripts/verify-external-napplet-corpus.mjs
Comment thread scripts/verify-external-napplet-corpus.mjs Outdated
Comment thread scripts/verify-external-napplet-corpus.mjs Outdated
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d138b7aefe

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.mjs
Comment thread scripts/verify-external-napplet-corpus.mjs
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
Comment thread graphify-out/manifest.json Outdated
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

Codex: please re-review exact head 8b1552d0d8a625cb42db1bd3a993bdb38334a620. All prior threads are addressed and resolved. Exact-head gates pass: Node verifier tests, pinned shell classification, full pinned four-entry verification, ShellCheck, docs audit (47 documents, zero errors/warnings), and diff check. Please report any remaining actionable finding against this exact head.

@jodobear

Copy link
Copy Markdown
Owner Author

@codex review exact head 8b1552d0d8a625cb42db1bd3a993bdb38334a620. Please report any remaining actionable finding against this head.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8b1552d0d8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.sh
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review exact head 96798a6e110097821bcd352881d792a18ea0ceff. Final lock-authentication thread is fixed/resolved. Exact gates pass: canonical-lock mutation/tool suite, full shell classification, pinned four-entry verifier, Node tests, ShellCheck, docs audit, and diff check.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 96798a6e11

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.sh
Comment thread uzel-poc-validated-pack/STATUS.md Outdated
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

jodobear commented Jul 31, 2026

Copy link
Copy Markdown
Owner Author

@codex review

Please review exact head 079b050cb4a1a6c03309d0f417010bb3664b647e. All three exact-head findings are fixed, answered, and resolved. Event text is bound to each audited event ID before structural success; cleanup is bounded, observable, and success-blocking; STATUS records the complete known commit chain. Exact gates pass: full shell classification, canonical-lock suite, pinned four-entry verifier, Node tests, ShellCheck, docs audit (47/0/0), diff check. Graphify refresh is a separate final commit.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 079b050cb4

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread uzel-poc-validated-pack/STATUS.md Outdated
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
Comment thread scripts/verify-external-napplet-corpus.mjs
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

Please review exact head e6b4840787b793e3d06ef4a41bfc23e8c6c12b26.

All prior threads are fixed and resolved. Exact-head gates passed: Node verifier tests; Nix shell classification; canonical-lock regression; full pinned verifier (STRUCTURE_OK, CORPUS_OK, 4 entries, source aa4dc7a0799d95e3066b50055b29685d6e376045); ShellCheck warning gate; docs audit 47/0/0; git diff --check. Graphify refresh is isolated in the final commit.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e6b4840787

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

Please review exact head c5f24a4e719b25d48b4cc892f9555bdd42fb54a3. The prior trust-result jq finding is fixed with streaming finite output bounds and a continuous-output regression. Please review the entire PR at this exact head.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: c5f24a4e71

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread scripts/verify-external-napplet-corpus.sh Outdated
Comment thread scripts/verify-external-napplet-corpus.sh
Comment thread scripts/verify-external-napplet-corpus.sh Outdated
@jodobear

Copy link
Copy Markdown
Owner Author

@codex review

Please review exact head fe61eccc1a830200fa63b2c20f2a9b9f8da6ba45. All prior findings are addressed with bounded hostile-output, long typed-diagnostic, exclusive temp ownership, sentinel-preservation, and no-downstream-execution regressions. Please review the entire PR at this exact head.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: fe61eccc1a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

# jq expands these variables, not Bash.
# shellcheck disable=SC2016
set +e
"$timeout_bin" --kill-after=1 "$jq_timeout_seconds" "$jq_bin" -e \

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Bound coordinate-comparison stderr

When UZEL_JQ_BIN malfunctions during the final coordinate comparison, this invocation discards stdout but leaves stderr inherited and checks only the exit status. A fast producer can therefore flood CI log or capture storage for the full timeout, and a jq wrapper that emits diagnostics before exiting 0 still lets the verifier report success. Route this comparison through the bounded subprocess helper and reject nonempty stderr like the preceding jq stages.

AGENTS.md reference: uzel-poc-validated-pack/AGENTS.md:L20-L20

Useful? React with 👍 / 👎.

@jodobear
jodobear marked this pull request as draft July 31, 2026 10:44
@jodobear

Copy link
Copy Markdown
Owner Author

Deferred by product priority. This corpus is for later real native-runtime interoperability acceptance after profile/follows and core runtime bugs are fixed—not a current TypeScript conformance target. Preserve the branch/evidence, but do not merge or continue review churn now. Resume under issue #21 only after the dependency order in #9 is satisfied.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adopt hzrd149 napplelets as a signed interoperability and design-practice corpus

1 participant